Dump Truck Cargo Box State Detection Method, Device and Dump Truck

Abstract

The present invention provides a method and device for detecting the state of a dump truck box and a dump truck. The method includes: obtaining the current image information of the box through an image acquisition device; determining the current state of the box according to the current image information; if the current state indicates that the box has descended and stopped stably, then sending a vehicle safety operation prompt message. Since the current image information is collected through the image acquisition device, there is no need to additionally increase image acquisition equipment, which is beneficial to cost reduction. And only when it is detected that the box is in the state of descending and stopping stably, the vehicle safety operation prompt is sent, solving the potential problem caused by the lifting mechanism jamming during the driving of the dump truck and the box not descending completely in place, effectively ensuring the safety of the dump truck and the driver.

Description

Technical Field

[0001] The present invention relates to the technical field of cargo box state detection, and particularly to a method and device for detecting the state of a dump truck cargo box and a dump truck. Background Art

[0002] A dump truck refers to a vehicle that can unload goods by hydraulic or mechanical lifting. Therefore, monitoring the state of the cargo box is an important guarantee for ensuring the transportation and driving safety of the dump truck. Currently, for monitoring the cargo box of a dump truck, first, a camera device is installed on the top of the cargo box of the dump truck, then a video image of the cargo box is obtained through the camera device, and then it is identified whether the scenery around the cargo box in the video image has reversed or moved, or whether the muck in the cargo box image slides towards the tail of the cargo box uniformly, so as to determine whether the cargo box is in the lifting and unloading state.

[0003] However, identifying whether the cargo box is in the lifting and unloading state cannot well guarantee the driving safety of the driver for the dump truck, resulting in certain potential safety hazards for the driver during driving. Summary of the Invention

[0004] The present invention provides a method and device for detecting the state of a dump truck cargo box and a dump truck, aiming to solve the defect of potential safety hazards in the driving of a dump truck in the prior art, and to ensure the driving safety of the driver by sending a safety operation prompt when the cargo box of the dump truck is in the state of descending and stopping stably.

[0005] The present invention provides a method for detecting the state of a dump truck cargo box, including:

[0006] Obtaining the current image information of the cargo box through an image acquisition device;

[0007] Determining the current state of the cargo box according to the current image information;

[0008] If the current state indicates that the cargo box is in the state of descending and stopping stably, a vehicle safety operation prompt message is sent.

[0009] According to the method for detecting the state of a dump truck cargo box provided by the present invention, the determining the current state of the cargo box according to the current image information includes:

[0010] Inputting the current image information into a cargo box state detection model, and outputting the current state of the cargo box, where the current state includes the state of the cargo box descending and stopping stably and the state of the cargo box not descending and stopping stably. Among them, the cargo box state detection model is trained based on current image information samples and cargo box descending and stopping stably samples under different working conditions.

[0011] According to the method for detecting the state of a dump truck cargo box provided by the present invention, before training based on current image information samples and cargo box descending and stopping stably samples under different working conditions, it further includes:

[0012] Calibrate the image acquisition device;

[0013] Collect the image information of the cargo box under different working conditions according to the calibrated image acquisition device, as the current image information sample and the cargo box descending and stabilizing sample.

[0014] According to a method for detecting the state of a dump truck cargo box provided by the present invention, the calibrated image acquisition device includes:

[0015] Adjust the image acquisition angle of the image acquisition device;

[0016] When the image acquisition angle indicates that the image acquisition device is operating normally and a cargo box of a preset size is acquired, it is regarded as successful calibration.

[0017] According to a method for detecting the state of a dump truck cargo box provided by the present invention, the image acquisition device includes a first image acquisition component, a second image acquisition component, and a third image acquisition component; the first image acquisition component is arranged on the left rearview mirror side of the dump truck, the second image acquisition component is arranged on the right rearview mirror side of the dump truck, and the third image acquisition component is arranged at the tail of the vehicle frame;

[0018] Correspondingly, the current image information includes current first image information, current second image information, and current third image information.

[0019] According to a method for detecting the state of a dump truck cargo box provided by the present invention, determining the current state of the cargo box according to the current image information includes:

[0020] When it is determined that the cargo box is in the descending and stabilizing state according to at least one of the current first image information, current second image information, and current third image information, it is determined that the cargo box is in the descending and stabilizing state.

[0021] According to a method for detecting the state of a dump truck cargo box provided by the present invention, it further includes:

[0022] If the current state indicates that the cargo box is in a state of not descending and stabilizing, an alarm prompt is issued and the vehicle speed of the dump truck is restricted to be less than a preset vehicle speed.

[0023] According to a method for detecting the state of a dump truck cargo box provided by the present invention, the image acquisition device includes at least one of a 360 panoramic camera, an electronic rearview mirror, and a right blind spot compensation camera.

[0024] The present invention also provides a device for detecting the state of a dump truck cargo box, including:

[0025] An acquisition module for acquiring the current image information of the cargo box through an image acquisition device;

[0026] A determination module, configured to determine the current state of the cargo box according to the current image information;

[0027] A prompt module, configured to send a vehicle safety operation prompt message if the current state indicates that the cargo box has descended and stopped stably.

[0028] The present invention further provides a dump truck, which is configured to execute the dump truck cargo box state detection method as described in any one of the above, or includes the dump truck cargo box state detection device as described above.

[0029] The present invention further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the dump truck cargo box state detection method as described in any one of the above is implemented.

[0030] The present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the dump truck cargo box state detection method as described in any one of the above is implemented.

[0031] The present invention further provides a computer program product, including a computer program. When the computer program is executed by a processor, the dump truck cargo box state detection method as described in any one of the above is implemented.

[0032] A dump truck cargo box state detection method, device, and dump truck provided by the present invention. The method includes: obtaining the current image information of the cargo box through an image acquisition device; determining the current state of the cargo box according to the current image information; and sending a vehicle safety operation prompt message if the current state indicates that the cargo box has descended and stopped stably. Since the current image information acquired through the image acquisition device does not require additional image acquisition equipment, it is beneficial to reduce costs. And only when it is detected that the cargo box is in the state of descending and stopping stably, a vehicle safety operation prompt is sent, solving the hidden danger problem caused by the lifting mechanism getting stuck during the driving process of the dump truck and the cargo box not descending completely in place, effectively ensuring the safety of the dump truck and the driver. Description of the Drawings

[0033] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0034] Figure 1 It is a flowchart of the dump truck cargo box state detection method provided by the present invention;

[0035] Figure 2 It is a schematic structural diagram of the installation position of the image acquisition device provided by the present invention;

[0036] Figure 3 It is a schematic structural diagram of the dump truck cargo box status detection device provided by the present invention;

[0037] Figure 4 It is a schematic structural diagram of the electronic device provided by the present invention. Detailed implementation manners

[0038] To make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present invention without making creative efforts shall fall within the protection scope of the present invention.

[0039] After the dump truck completes the unloading by lifting the cargo box, it is necessary to lower the cargo box to the original position to ensure the normal driving of the vehicle. Currently, most devices detect the lifting state of the cargo box to ensure the completion of unloading. However, if the cargo box does not descend to the lowest position after the dump truck finishes unloading and then runs, a series of potential safety hazards will be caused, resulting in the center of gravity of the dump truck shifting and being prone to tipping over during high-speed driving. Moreover, if the cargo box does not descend to the lowest position, the dump truck will not be able to pass the height limit normally and cannot pass through bridges, tunnels, etc. normally. Therefore, to ensure the driving safety of the dump truck, the following is combined with Figures 1-4 Describe a method, device and dump truck for detecting the status of the cargo box of a dump truck according to the present invention.

[0040] Figure 1 It is a schematic flow diagram of the method for detecting the status of the cargo box of a dump truck provided by the present invention, Figure 2 It is a schematic structural diagram of the installation position of the image acquisition device provided by the present invention.

[0041] As Figure 1 and Figure 2 shown, a method for detecting the status of the cargo box of a dump truck provided in this embodiment, the execution subject can be an on-vehicle control system, or a remote monitoring terminal, a cloud platform, etc. The method mainly includes the following steps:

[0042] 101. Obtain the current image information of the cargo box through an image acquisition device.

[0043] In a specific implementation process, obtain the current image information of the cargo box through an image acquisition device, where the image acquisition device refers to the image acquisition equipment equipped on the dump truck itself. As Figure 2As shown in the figure, the image acquisition device can be a vehicle-mounted image acquisition device, and its installation position can be outside the rearview mirror of the dump truck, or at the tail of the frame of the dump truck, etc., ensuring that the image acquisition device on the vehicle can effectively acquire the image of the cargo box. However, the current image information of the cargo box obtained by the image acquisition device does not necessarily mean that the complete image information of the cargo box is obtained. It can be a part of the current image information, that is, the current image information only needs to include the cargo box, which can be a complete picture of the cargo box or a partial picture of the cargo box.

[0044] The image acquisition device can also collect video information, and then the image processing unit performs processing such as distortion reduction, perspective conversion, and image stitching on the video information to obtain the current image information of the cargo box in the video information.

[0045] 102. Determine the current state of the cargo box according to the current image information.

[0046] After obtaining the current image information of the cargo box through the image acquisition device, analyze and process the current image information to determine the current state of the cargo box in the image information.

[0047] Among them, after the vehicle leaves the factory, the installation position of the image acquisition device is fixed. Moreover, when the dump truck is in the state of descending and stopping stably, the image acquisition device can pre-collect the standard image information, and the standard image information contains relevant content of the cargo box. Therefore, the current image information can be compared with the pre-determined standard image information to determine whether the position of the cargo box has shifted. If the offset exceeds the preset offset, it indicates that the cargo box is not in the state of descending and stopping stably at this time. If the offset between the cargo box in the current image information and the standard image information is within the preset offset, it indicates that the current image information represents that the cargo box is in the state of descending and stopping stably.

[0048] When determining the current state of the cargo box according to the current image information, in addition to determining the state of descending and stopping stably and the state of not descending and stopping stably, it is also possible that the image information recognition fails. If the current image information recognition fails, re-acquire the current image information until the current state of the cargo box is successfully recognized.

[0049] 103. If the current state indicates that the cargo box is in the state of descending and stopping stably, send a vehicle safety operation prompt message.

[0050] If it is determined that the current state indicates that the cargo box is in the state of descending and stopping stably, it means that the dump truck can operate safely at this time, and a vehicle safety operation prompt message can be sent to prompt the driver that the current cargo box has descended and stopped stably and can drive normally. Among them, the state of descending and stopping stably refers to the state where the cargo box has descended to the position and remains stable.

[0051] Further, based on the above embodiments, determining the current state of the cargo box according to the current image information in this embodiment includes: inputting the current image information into the cargo box state detection model to output the current state of the cargo box, where the current state includes the state where the cargo box stops stably after descending. The cargo box state detection model is trained based on the current image information samples and the cargo box descending and stopping stably samples under different working conditions.

[0052] Specifically, to determine the current state of the cargo box according to the current image information, in order to ensure the recognition accuracy of the current image information, the method of a machine learning model can be used for recognition. For a dump truck, its working environment is mostly construction sites, mines, etc. Therefore, for different working conditions, the image acquisition device will collect a variety of current image information corresponding to different working conditions. The cargo box state detection model can be constructed by training with the current image information samples and the cargo box descending and stopping stably samples. This can ensure that the current image information can be accurately recognized under different working conditions and different light conditions, guarantee the accuracy of image information recognition, and further better ensure the driving safety of the dump truck. The cargo box state detection model can also output three states: the lifting state, the descending state, and the stopping stably state. Only the samples for model training need to be adjusted. However, in this embodiment, it is mainly used to judge whether the current state of the cargo box is in the state of stopping stably after descending. Therefore, it is preferably to train with the current image information samples and the cargo box descending and stopping stably samples to construct the cargo box state detection model.

[0053] For example, for a construction site, during the collection of the current image information samples and the cargo box descending and stopping stably samples, it is necessary to collect them respectively based on different dimensions such as different times, different visibilities, and different light sources to ensure that the collected samples are more comprehensive, thereby ensuring that the trained cargo box state detection model is more accurate. Different working conditions refer to the conditional parameters that affect the image information collected by the image acquisition device. In addition to time, visibility, and light source, it can also include humidity, temperature, etc. When the conditional parameters in the working conditions change, the collected images will change. Therefore, during the sample collection process, the corresponding samples are collected and trained for different working conditions, and the finally obtained cargo box state detection model will be more accurate.

[0054] Before training based on the current image information samples and the cargo box descending and stopping stably samples under different working conditions, it further includes: calibrating the image acquisition device; collecting the image information of the cargo box under different working conditions according to the calibrated image acquisition device as the current image information samples and the cargo box descending and stopping stably samples.

[0055] When the dump truck leaves the factory, first calibrate the image acquisition device. Calibration means ensuring that in addition to effectively performing its own functions, the image acquisition device can also effectively detect the cargo box. After calibration, the image information of the cargo box can be collected under different working conditions as the current image information acquisition sample and the sample of the cargo box coming to a stable stop after descending. That is to say, under various different working conditions, the corresponding current image information is collected through the image acquisition device in the calibrated state as the current image information sample and the sample of the cargo box coming to a stable stop after descending. Ensure that the constructed cargo box state detection model can accurately and efficiently detect the current state of the current dump truck cargo box when working under different working conditions.

[0056] Calibrating the image acquisition device may include: adjusting the image acquisition angle of the image acquisition device; when the image acquisition angle indicates that the image acquisition device is operating normally and a cargo box of a preset size is acquired, it is regarded as successful calibration.

[0057] Specifically, by adjusting the angle of the image acquisition device, ensure that while not affecting the functions of the image acquisition device itself, a cargo box appears in the captured image of the image acquisition device, so that the current state of the cargo box can be determined according to parameters such as the position and size of the cargo box in the current image information. The specific size of the cargo box appearing in the current image information can be determined according to the actual situation. As long as it is ensured that the cargo box image appearing in the current image information can effectively identify the current state of the cargo box, it indicates that the image acquisition device is successfully calibrated at this time.

[0058] Furthermore, on the basis of the above embodiments, the image acquisition device in this embodiment includes at least two image acquisition components, for example, a first image acquisition component, a second image acquisition component, and a third image acquisition component; the first image acquisition component is arranged on the left rearview mirror side of the dump truck, the second image acquisition component is arranged on the right rearview mirror side of the dump truck, and the third image acquisition component is arranged at the tail of the vehicle frame; correspondingly, the current image information includes current first image information, current second image information, and current third image information.

[0059] Correspondingly, determining the current state of the cargo box according to the current image information includes: when it is determined that the cargo box is in the state of coming to a stable stop after descending according to at least one of the current first image information, current second image information, and current third image information, it is determined that the cargo box is in the state of coming to a stable stop after descending.

[0060] Specifically, due to the different installation positions of the first image acquisition component, the second image acquisition component, and the third image acquisition component, the image information they acquire is also different. Similarly, the speed and result of judging whether the cargo box is in the state of descending and stopping stably according to the recognition situation may also vary. However, in this embodiment, when any one or more of them detect that the cargo box is in the state of descending and stopping stably, it indicates that the cargo box is in the state of descending and stopping stably at this time. Otherwise, only when all three detect that the current cargo box is in the state of not descending and stopping stably can it be indicated that the cargo box is in the state of not descending and stopping stably at this time. Through the combined action of the three groups of image acquisition components, the efficiency of cargo box state recognition can be improved, the timeliness of recognizing the state of the cargo box descending and stopping stably can be enhanced, and at the same time, it can be ensured that when an image acquisition perspective is blocked, the image information collected by the image acquisition components from other perspectives can also be used to determine that the cargo box is in the state of descending and stopping stably.

[0061] Further, on the basis of the above embodiment, this embodiment further includes that if the image acquisition angle of the image acquisition device changes, the cargo box state detection model is switched to the new cargo box state detection model after the image acquisition angle changes to ensure the accuracy of image recognition. For the left and right rearview mirrors, that is, when the angle of the rearview mirror changes, the cargo box state detection model is switched to the new cargo box state detection model after the angle change, so as to ensure the accuracy of detecting the descending state of the cargo box. The corresponding model training process is that for different image acquisition angles of the image acquisition device, different cargo box state detection models are trained. Since each angle corresponds to a different model, compared with a single cargo box state detection model, it can better ensure the accuracy of cargo box state detection.

[0062] Further, on the basis of the above embodiment, this embodiment may further include: if the current state indicates that the cargo box is in the state of not descending and stopping stably, an alarm prompt is issued and the speed of the dump truck is restricted to be less than the preset speed.

[0063] Specifically, only when it is detected that the cargo box is in the state of descending and stopping stably can the safe operation of the dump truck be ensured at this time. If it is detected that the current state indicates that the cargo box is in the state of not descending and stopping stably, in order to ensure driving safety, an alarm prompt needs to be issued at this time to remind the driver that the cargo box has not descended and stopped stably and there are potential safety hazards. At the same time, the speed of the dump truck can also be controlled to be less than the preset speed. For example, the preset speed can be 10 kilometers per hour to ensure the driving safety of the dump truck.

[0064] Further, on the basis of the above embodiment, the image acquisition device in this embodiment includes at least one of a 360-degree panoramic camera, an electronic rearview mirror, and a right blind spot camera.

[0065] Specifically, for the vehicle models equipped with 360-degree surround-view cameras, install the left and right 360-degree surround-view cameras outside the rearview mirrors, and then adjust the angles of the left and right cameras. Without affecting the 360-degree surround-view function, ensure that the cargo box is exposed in the captured images, and the current state of the cargo box can be judged through the exposed cargo box images. Install the rear camera at the rear of the vehicle frame, and also expose part of the cargo box in the image. After adjusting the angles and selecting the best positions, real-time detection can be carried out. Since the relative position of the cargo box in the video image is a fixed value when the cargo box is in the lowered and stationary state, the current state of the cargo box can be determined through parameters such as the position and size of the cargo box in the image information. By using the cargo box state detection model constructed by machine learning for recognition, the accuracy of cargo box state recognition can be ensured under different working conditions, and driving safety can be better guaranteed. Conducting image recognition and redundancy calculation on the left, right, and rear three-way videos can also ensure the accuracy of cargo box state judgment.

[0066] Similarly, for the vehicle models equipped with electronic rearview mirrors, adjust the angles of the left and right electronic rearview mirrors to ensure that while the electronic rearview mirrors complete their own functions, they can detect the cargo box images. For the vehicle models equipped with right blind spot cameras, adjust the angles of the right blind spot cameras to expose the cargo box in the images without affecting the right blind spot imaging function.

[0067] The captured image information can also be displayed in real time on the display interface of the dump truck, such as the central control screen, so that the driver can also make subjective judgments. At the same time, the recognition results of the cargo box state can be uploaded to the remote end, and it is also possible to remotely monitor whether the current operation of the dump truck complies with the operation specifications. The state can be directly displayed, or the cargo box state can be displayed by means of identification. For example, when the cargo box is lowered and stationary, it is displayed by "0", and when it is not lowered and stationary, it is displayed by other means, including when the cargo box is in the lifting state, it is displayed by "1", and when the image recognition fails, it is displayed by "2". The display method can be continuous display or flashing display, etc., as long as the driver can understand the current state of the cargo box.

[0068] Furthermore, on the basis of the above embodiments, this embodiment also provides a dump truck cargo box state detection device. The dump truck cargo box state detection device provided by the present invention will be described below. The dump truck cargo box state detection device described below can be mutually referred to with the dump truck cargo box state detection method described above.

[0069] Figure 3 It is a schematic structural diagram of the dump truck cargo box state detection device provided by the present invention.

[0070] As Figure 3 shown, a dump truck cargo box state detection device provided by the present invention includes:

[0071] An acquisition module 301, configured to acquire current image information of the cargo box through an image acquisition device;

[0072] A determination module 302, configured to determine the current state of the cargo box according to the current image information;

[0073] A prompt module 303, configured to send a vehicle safe operation prompt message if the current state indicates that the cargo box has descended and stopped stably.

[0074] A cargo box state detection device for a dump truck provided in this embodiment includes: acquiring current image information of the cargo box through an image acquisition device; determining the current state of the cargo box according to the current image information; if the current state indicates that the cargo box has descended and stopped stably, sending a vehicle safe operation prompt message. Since the current image information acquired through the image acquisition device does not require additional image acquisition equipment, it is beneficial to reduce costs, and the vehicle safe operation prompt is sent only when it is detected that the cargo box is in the state of descending and stopping stably, solving the hidden danger problem caused by the cargo box not descending completely in place during the driving process of the dump truck, and effectively ensuring the safety of the dump truck and the driver.

[0075] Further, the determination module 302 in this embodiment is specifically configured to:

[0076] Input the current image information into a cargo box state detection model, and output the current state of the cargo box, where the current state includes the state that the cargo box has descended and stopped stably. Among them, the cargo box state detection model is trained based on current image information samples and cargo box descending and stopping stably samples under different working conditions.

[0077] Further, the determination module 302 in this embodiment is specifically further configured to:

[0078] Calibrate the image acquisition device;

[0079] Acquire image information of the cargo box under different working conditions according to the calibrated image acquisition device as the current image information samples and the cargo box descending and stopping stably samples.

[0080] Further, the determination module 302 in this embodiment is specifically further configured to:

[0081] Adjust the image acquisition angle of the image acquisition device;

[0082] When the image acquisition angle indicates that the image acquisition device is operating normally and a cargo box of a preset size is acquired, it is regarded as successful calibration.

[0083] Further, the image acquisition device in this embodiment includes a first image acquisition component, a second image acquisition component, and a third image acquisition component; the first image acquisition component is disposed on the left rearview mirror side of the dump truck, the second image acquisition component is disposed on the right rearview mirror side of the dump truck, and the third image acquisition component is disposed at the tail of the vehicle frame;

[0084] Correspondingly, the current image information includes current first image information, current second image information, and current third image information.

[0085] Further, the determination module 302 in this embodiment is specifically further configured to:

[0086] When it is determined that the cargo box is in the lowered and stable state according to at least one of the current first image information, the current second image information, and the current third image information, it is determined that the cargo box is in the lowered and stable state.

[0087] Further, the prompt module 303 in this embodiment is specifically further configured to:

[0088] If the current state indicates that the cargo box is not in the lowered and stable state, an alarm prompt is issued and the vehicle speed of the dump truck is restricted to be less than a preset vehicle speed.

[0089] Further, the image acquisition device in this embodiment includes at least one of a 360-degree panoramic camera, an electronic rearview mirror, and a right blind spot camera.

[0090] Based on the same general inventive concept, the present invention also protects a dump truck, which is used to execute the dump truck cargo box state detection method in any of the above embodiments, or includes the dump truck cargo box state detection device in any of the above embodiments.

[0091] Figure 4 It is a schematic structural diagram of an electronic device provided by the present invention.

[0092] As Figure 4 shown, the electronic device may include: a processor 410, a communication interface 420, a memory 430, and a communication bus 440. Among them, the processor 410, the communication interface 420, and the memory 430 communicate with each other through the communication bus 440. The processor 410 can call the logical instructions in the memory 430 to execute the dump truck cargo box state detection method, which includes: obtaining the current image information of the cargo box through an image acquisition device; determining the current state of the cargo box according to the current image information; if the current state indicates that the cargo box is in the lowered and stable state, a vehicle safety operation prompt message is issued.

[0093] In addition, when the logical instructions in the above-mentioned memory 430 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0094] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the dump truck cargo box state detection method provided by the above-mentioned various methods. The method includes: obtaining the current image information of the cargo box through an image acquisition device; determining the current state of the cargo box according to the current image information; and if the current state indicates that the cargo box is in a lowered and stable state, sending a vehicle safety operation prompt message.

[0095] In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is implemented to execute the dump truck cargo box state detection method provided by the above-mentioned various methods. The method includes: obtaining the current image information of the cargo box through an image acquisition device; determining the current state of the cargo box according to the current image information; and if the current state indicates that the cargo box is in a lowered and stable state, sending a vehicle safety operation prompt message.

[0096] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative labor.

[0097] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0098] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for detecting the state of a dump truck cargo box, characterized in that, Including: Obtaining the current image information of the cargo box through an image acquisition device; The image acquisition device includes a first image acquisition component, a second image acquisition component, and a third image acquisition component; the first image acquisition component is arranged on the left rearview mirror side of the dump truck, the second image acquisition component is arranged on the right rearview mirror side of the dump truck, and the third image acquisition component is arranged at the rear of the vehicle frame; correspondingly, the current image information includes current first image information, current second image information, and current third image information; Determining the current state of the cargo box according to the current image information; If the current state indicates that the cargo box is in the state of descending and stopping stably, then sending a vehicle safety operation prompt message; the determining the current state of the cargo box according to the current image information includes: Inputting the current image information into a cargo box state detection model to output the current state of the cargo box, where the current state includes the state of the cargo box descending and stopping stably. Among them, the cargo box state detection model is trained based on current image information samples and cargo box descending and stopping stably samples under different working conditions; The determining the current state of the cargo box according to the current image information further includes: When it is determined that the cargo box is in the state of descending and stopping stably according to at least one of the current first image information, current second image information, and current third image information, then it is determined that the cargo box is in the state of descending and stopping stably; For different image acquisition angles of the image acquisition device, different cargo box state detection models are trained. If the image acquisition angle of the image acquisition device changes, then switch the cargo box state detection model to the new cargo box state detection model after the image acquisition angle changes.

2. The method for detecting the state of the dump truck cargo box according to claim 1, wherein Before training based on current image information samples and cargo box descending and stopping stably samples under different working conditions, it further includes: Calibrating the image acquisition device; Collecting the image information of the cargo box under different working conditions according to the calibrated image acquisition device as the current image information samples and the cargo box descending and stopping stably samples.

3. The dump truck cargo box state detection method according to claim 2, characterized in that, The calibrating the image acquisition device includes: Adjusting the image acquisition angle of the image acquisition device; When the image acquisition angle indicates that the image acquisition device is operating normally and a cargo box of a preset size is collected, it is regarded as calibration success.

4. The dump truck cargo box state detection method according to any one of claims 1-3, characterized in that, It further includes: If the current state indicates that the cargo box is in the state of not descending and stopping stably, then sending an alarm prompt and restricting the vehicle speed of the dump truck to be less than a preset vehicle speed.

5. The dump truck cargo box state detection method according to any one of claims 1-3, characterized in that, The image acquisition device includes at least one of a 360 panoramic camera, an electronic rearview mirror, and a right blind spot compensation camera.

6. A dump truck cargo box status detection device, characterized in that, Including: An acquisition module for obtaining the current image information of the cargo box through an image acquisition device; The image acquisition device includes a first image acquisition component, a second image acquisition component, and a third image acquisition component; the first image acquisition component is arranged on the left rearview mirror side of the dump truck, the second image acquisition component is arranged on the right rearview mirror side of the dump truck, and the third image acquisition component is arranged at the rear of the vehicle frame; correspondingly, the current image information includes current first image information, current second image information, and current third image information; A determination module for determining the current state of the cargo box according to the current image information; A prompt module, configured to issue a vehicle safety operation prompt message if the current state indicates that the cargo box has stopped descending; Determining the current state of the cargo box according to the current image information includes: When it is determined that the cargo box is in the state of stopping descending according to at least one of the current first image information, the current second image information, and the current third image information, it is determined that the cargo box is in the state of stopping descending; Determining the current state of the cargo box according to the current image information further includes: Inputting the current image information into a cargo box state detection model, and outputting the current state of the cargo box, where the current state includes the state of the cargo box stopping descending, and the cargo box state detection model is trained based on current image information samples and cargo box stopping descending samples under different working conditions; For different image acquisition angles of the image acquisition device, different cargo box state detection models are trained. If the image acquisition angle of the image acquisition device changes, the cargo box state detection model is switched to the new cargo box state detection model after the change of the image acquisition angle.

7. A dump truck, characterized in that, The dump truck is configured to execute the dump truck cargo box state detection method according to any one of claims 1-5, or includes the dump truck cargo box state detection device according to claim 6.

Images