Feeding method, device, mixer and storage medium for mixer

Abstract

The present application relates to the field of data monitoring, and discloses a feeding method, device, mixer and storage medium for a mixer. The mixer includes an imaging module and a feeding hopper. The feeding method for the mixer includes: responding to the received feeding request signal, and using the imaging module to obtain an image of the material area; when it is determined according to the image of the material area that there is material to be fed in the material area, sending an unlocking signal to the feeding hopper; comparing the image of the material area with a preset image of the material area without piled-up materials, and generating a first coincidence degree between the image of the material area and the image of the material area without piled-up materials; when the first coincidence degree is greater than a first threshold, using the imaging module to obtain an image of the feed inlet; comparing the image of the feed inlet with a preset image of the empty feed inlet, and generating a second coincidence degree between the image of the feed inlet and the image of the empty feed inlet; when the second coincidence degree is less than a second threshold, generating a feeding completion information according to the received feeding completion signal, realizing the abnormal detection of the whole feeding process.

Description

Technical Field

[0001] The present invention relates to the field of data monitoring, and more particularly to a feeding method, device, mixer and storage medium for a mixer. Background Art

[0002] Mortar is a material mixed and stirred from various materials such as aggregates, auxiliary materials and additives, and is widely used in various construction projects. Due to the differences in the properties and quantities of the materials fed into the mixer, different properties of mortar will be produced. In the existing mortar production line, the feeding personnel need to weigh and confirm each material, and then feed the materials into the mixer to ensure the quality of the produced mortar. After all the materials of the current batch are fed into the mixer, the feeding personnel press a button to generate an electrical signal indicating the completion of feeding. The operator in the control area controls the mixer to stir the materials according to the received electrical signal and plans the feeding time of the next batch of materials.

[0003] However, due to the heavy production tasks and numerous production batches of the mortar production line, it is easy to occur that the feeding personnel accidentally trigger the button when not all the materials are fed into the mixer, and the feeding personnel accidentally trigger the button when no materials are fed. Since it is impossible to quickly determine whether there is an abnormal feeding in the mixer during the feeding process, in the case where the feeding personnel wrongly trigger the button, it will lead to abnormal feeding of the mixer, and then lead to unqualified mortar production. The above solutions of the prior art cannot quickly determine whether there is an abnormal feeding in the mixer. Summary of the Invention

[0004] An object of an embodiment of the present invention is to provide a device for solving the problem of being unable to quickly determine whether there is an abnormal feeding in a mixer.

[0005] To achieve the above object, in a first aspect, the present application provides a feeding method for a mixer, where the mixer includes an imaging module and a feeding hopper, and the method includes:

[0006] Responding to a received feeding request signal, and acquiring an image of the material area by using the imaging module;

[0007] When it is determined that there are materials to be fed in the material area according to the image of the material area, sending an unlocking signal to the feeding hopper, where the unlocking signal is used to adjust the feeding hopper to a state where the hopper lid is unlocked;

[0008] Comparing the image of the material area with a preset image of the non-piled material area in the material area, and generating a first coincidence degree between the image of the material area and the image of the non-piled material area in the material area;

[0009] When the first coincidence degree is greater than a first threshold, acquiring an image of the feed inlet by using the imaging module;

[0010] Compare the inlet port image with a preset empty inlet port image to generate a second degree of coincidence between the inlet port image and the empty inlet port image;

[0011] When the second degree of coincidence is less than a second threshold, generate a feeding completion message according to the received feeding completion signal.

[0012] Combined with the first aspect, in a first possible implementation manner, the generating a feeding completion message according to the received feeding completion signal when the second degree of coincidence is less than a second threshold includes:

[0013] When the second degree of coincidence is less than a second threshold, detect whether a locking confirmation signal is received, where the locking confirmation signal is used to determine that the feeding hopper has been adjusted to the hopper lid locked state;

[0014] When the locking confirmation signal is received, obtain the duration from sending the unlocking signal to receiving the locking confirmation signal;

[0015] When the feeding completion signal is received and the duration is less than a preset duration threshold, generate a feeding completion message.

[0016] Combined with the first possible implementation manner of the first aspect, in a second possible implementation manner, after detecting whether a locking confirmation signal is received when the second degree of coincidence is less than a second threshold, further includes:

[0017] When the locking confirmation signal sent by the mixer is not received and the feeding completion signal is received, generate a prompt message for prompting that the feeding completion request is invalid.

[0018] Combined with the first possible implementation manner of the first aspect, in a third possible implementation manner, after obtaining the duration from sending the unlocking signal to receiving the locking confirmation signal when the locking confirmation signal is received, further includes:

[0019] When the feeding completion signal is received, determine a first time when the feeding completion signal is received and a second time when the locking confirmation signal is received;

[0020] When the first time is before the second time, generate a prompt message for prompting that the feeding completion request is invalid.

[0021] Combined with the first aspect, in a fourth possible implementation manner, the method further includes:

[0022] Based on a preset time interval, obtain all mixer inlet port images and mixer material area images within a preset time range;

[0023] In the case where the difference between any one of the mixer feed port images and another mixer feed port image is less than a third threshold, a feed port background image is generated based on the mixer feed port images. In the case where the difference between any one of the mixer material area images and another mixer material area image is less than a third threshold, a material area background image is generated based on the mixer material area images;

[0024] A preset material area non-piled image is generated based on the material area background image, and a preset feed port empty material image is generated based on the feed port background image.

[0025] Combined with the fourth possible implementation manner of the first aspect, in the fifth possible implementation manner, the generating a preset material area non-piled image based on the material area background image and generating a preset feed port empty material image based on the feed port background image includes:

[0026] The material area background image and the feed port background image are respectively input into a preset target recognition model to generate a non-piled material area in the material area background image and an empty feed port area in the feed port background image;

[0027] The non-piled material area in the material area background image is cropped to generate a preset material area non-piled image;

[0028] The empty feed port area in the feed port background image is cropped to generate a preset feed port empty material image.

[0029] Combined with the first aspect, in the sixth possible implementation manner, the mixer further includes an illumination module. The obtaining a feed port image by using the imaging module in the case where the first coincidence degree is greater than a first threshold includes:

[0030] In the case where the first coincidence degree is greater than a first threshold, the feed port is illuminated by using the illumination module, and a feed port image is obtained by using the imaging module.

[0031] In a second aspect, the present application provides a feeding device for a mixer. The mixer includes an imaging module and a feeding hopper. The device includes:

[0032] A material area image acquisition module, configured to acquire a material area image by using the imaging module in response to a received feeding request signal;

[0033] An unlocking signal sending module, configured to send an unlocking signal to the feeding hopper in the case where it is determined according to the material area image that there is material to be fed in the material area, where the unlocking signal is used to adjust the feeding hopper to a hopper lid unlocking state;

[0034] The first coincidence degree generation module is configured to compare the material area image with a preset non-stacked material area image, and generate a first coincidence degree between the material area image and the non-stacked material area image;

[0035] The feed inlet image acquisition module is configured to, when the first coincidence degree is greater than a first threshold, acquire a feed inlet image by using the imaging module;

[0036] The second coincidence degree generation module is configured to compare the feed inlet image with a preset empty feed inlet image, and generate a second coincidence degree between the feed inlet image and the empty feed inlet image;

[0037] The completion information generation module is configured to, when the second coincidence degree is less than a second threshold, generate feeding completion information according to a received feeding completion signal.

[0038] In a third aspect, the present application provides a mixer, which includes an imaging module, a feeding hopper, a memory, and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the feeding method for a mixer as described in the first aspect is implemented.

[0039] In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the feeding method for a mixer as described in the first aspect is implemented.

[0040] The present application provides a feeding method for a mixer. The mixer includes an imaging module and a feeding hopper. The method includes: in response to a received feeding request signal, acquiring a material area image by using the imaging module; when it is determined according to the material area image that there is material to be fed in the material area, sending an unlocking signal to the feeding hopper; comparing the material area image with a preset non-stacked material area image, and generating a first coincidence degree between the material area image and the non-stacked material area image; when the first coincidence degree is greater than a first threshold, acquiring a feed inlet image by using the imaging module; comparing the feed inlet image with a preset empty feed inlet image, and generating a second coincidence degree between the feed inlet image and the empty feed inlet image; when the second coincidence degree is less than a second threshold, generating feeding completion information according to a received feeding completion signal. The present application determines whether the material in the material area has been emptied by using the material area image, and determines whether the material has entered the mixer by using the feed inlet image, and can quickly detect feeding abnormalities in the whole feeding process, ensuring the quality of the produced mortar.

[0041] Other features and advantages of the present invention will be described in detail in the subsequent specific implementation part. Brief Description of the Drawings

[0042] The accompanying drawings are used to provide a further understanding of the embodiments of the present invention, and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the embodiments of the present invention, but do not constitute a limitation to the embodiments of the present invention. In the accompanying drawings:

[0043] Figure 1 The first flow chart of the feeding method for a mixer provided by an embodiment of the present application is shown;

[0044] Figure 2 The second flow chart of the feeding method for a mixer provided by an embodiment of the present application is shown;

[0045] Figure 3 The third flow chart of the feeding method for a mixer provided by an embodiment of the present application is shown;

[0046] Figure 4 The structural schematic diagram of the feeding device for a mixer provided by an embodiment of the present application is shown. Specific Embodiments

[0047] The following will specifically describe the specific embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. It should be understood that the specific embodiments described herein are only used to illustrate and explain the embodiments of the present invention, and do not limit the embodiments of the present invention.

[0048] Generally, the components of the embodiments of the present invention described and illustrated in the accompanying drawings herein can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0049] In the following, the terms "comprising", "having" and their cognates that can be used in various embodiments of the present invention are only intended to indicate specific features, numbers, steps, operations, elements, components or combinations of the foregoing items, and should not be construed as precluding the existence or adding the possibility of one or more other features, numbers, steps, operations, elements, components or combinations of the foregoing items first.

[0050] In addition, the terms "first", "second", "third", etc. are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance.

[0051] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the present invention pertain. The terms (such as those defined in a commonly used dictionary) will be interpreted as having the same meaning as the contextual meaning in the relevant technical field and will not be interpreted as having an idealized meaning or an overly formal meaning, unless clearly defined in various embodiments of the present invention.

[0052] Embodiment 1

[0053] Please refer to Figure 1 , Figure 1 which shows the first flowchart of the feeding method for a mixer provided by an embodiment of the present application. The mixer includes an imaging module and a feeding hopper. Figure 1 The feeding method for the mixer in

[0054] S110, in response to the received feeding request signal, use the imaging module to obtain an image of the material area.

[0055] The mixer controls the operating state of the imaging module according to the received feeding request signal and the feeding completion signal. In the actual production process, the mortar production line includes a confirmation button. The feeding operator presses the confirmation button according to the demand to send a feeding request signal or a feeding completion signal to the mixer. The mixer responds to the received feeding request signal and uses the imaging module to obtain an image of the material area. For ease of understanding, in the embodiments of the present application, the feeding request signal is a door closing signal. When the feeding operator needs to feed materials into the mixer, the door closing signal is input into the mixer. When the mixer needs to be cleaned or a fault is detected, the door opening signal is input into the mixer.

[0056] It should be understood that the mixer can also be provided with a feeding prompt light according to actual needs. When the mixer receives the feeding request signal, the feeding prompt light emits light to prompt the feeding operator that feeding operation can be performed. The type of the imaging module is set according to actual needs and can be a camera, etc., which is not limited herein. At the same time, the position of the imaging module for obtaining the image of the material area is also set according to actual needs, which is not limited herein. To obtain a full - range image of the material area, the imaging module can be set above the material area, which will not be elaborated herein.

[0057] S120, when it is determined from the image of the material area that there is material to be fed in the material area, send an unlocking signal to the feeding hopper.

[0058] After obtaining the material area image of the material area, determine whether there is material to be fed in the material area according to the material area image. In the case where there is no material to be fed in the material area, an unlocking signal is not sent to the feeding hopper, where the unlocking signal is used to adjust the feeding hopper to the state where the hopper lid is unlocked. In the case where there is material to be fed in the material area, an unlocking signal is sent to the feeding hopper.

[0059] According to the material area image, determine the stacking state of the material area. When it is confirmed that all the materials to be fed into the mixer have been stacked in the material area, an unlocking signal is sent to the feeding hopper to allow the feeding personnel to open the hopper lid of the feeding hopper and ensure the quality of the produced mortar.

[0060] S130. Compare the material area image with a preset material area non-stacked image to generate a first overlap degree between the material area image and the material area non-stacked image.

[0061] The mixer stores a material area non-stacked image. Compare the generated material area image with the material area non-stacked image to generate a first overlap degree between the material area image and the material area non-stacked image. According to the first overlap degree, determine the difference between the current material area and the non-stacked material area.

[0062] S140. In the case where the first overlap degree is greater than a first threshold, use the imaging module to obtain an inlet image.

[0063] The first overlap degree changes according to the pixel difference between the material area image and the material area non-stacked image. When there is no material stacked in the material area, the pixels of the generated material area non-stacked image will be within a certain horizontal range. After determining that there is material to be fed in the material area according to the material area image, if the feeding personnel feed the material in the material area into the mixer, there will be no material to be fed in the material area, and there will be no significant difference between the material area image and the material area non-stacked image, and the value of the first overlap degree will be relatively high. In the case where the first overlap degree is greater than the first threshold, it is determined that the material in the material area has been emptied. According to the first overlap degree between the material area image and the material area non-stacked image, determine that the material in the material area has been emptied to prevent the feeding personnel from missing the material that needs to be fed into the mixer. At the same time, use the imaging module to obtain an inlet image to determine whether the material in the material area has entered the mixer according to the inlet image.

[0064] It should be understood that the position of the imaging module for obtaining the inlet image is also set according to actual needs and is not limited here. To obtain a full-range image of the inlet, the imaging module can be set above the inlet, which will not be elaborated here.

[0065] As an example, the mixer further includes a lighting module. The step of using the imaging module to obtain an inlet image in the case where the first overlap degree is greater than a first threshold includes:

[0066] When the first coincidence degree is greater than the first threshold, the feeding port is illuminated by the illumination module, and an image of the feeding port is acquired by the imaging module.

[0067] Due to the low visibility of the feeding port of the mixer, when the first coincidence degree is greater than the first threshold, the feeding port is illuminated by the illumination module. The light environment of the feeding port of the mixer is improved to ensure that a clear image of the feeding port is acquired by the imaging module.

[0068] S150. Compare the image of the feeding port with a preset empty-feeding-port image of the feeding port to generate a second coincidence degree between the image of the feeding port and the empty-feeding-port image of the feeding port.

[0069] A preset empty-feeding-port image of the feeding port is stored in the mixer. The generated image of the feeding port is compared with the empty-feeding-port image of the feeding port to generate a second coincidence degree between the image of the feeding port and the empty-feeding-port image of the feeding port. According to the second coincidence degree, the difference between the current feeding port and the feeding port in the empty-material state is determined, where the feeding port in the empty-material state means that no material enters the mixer through the feeding port.

[0070] S160. When the second coincidence degree is less than the second threshold, generate a feeding-completion message according to the received feeding-completion signal.

[0071] The second coincidence degree varies according to the pixel difference between the image of the feeding port and the empty-feeding-port image of the feeding port. When no material enters the mixer through the feeding port, the pixels of the generated empty-feeding-port image will be within a certain horizontal range, and there is no significant difference between the image of the feeding port and the empty-feeding-port image. When material enters the mixer through the feeding port, regardless of the amount of material at the feeding port, there is a significant difference between the image of the feeding port and the empty-feeding-port image, resulting in a low second coincidence degree between the image of the feeding port and the empty-feeding-port image.

[0072] When the second coincidence degree is greater than or equal to the second threshold, it is determined that there is no feeding operation by the feeding personnel at the feeding port, and an alarm message is generated to prompt the feeding personnel to perform a feeding action. When the second coincidence degree is less than the second threshold, it is determined that all the materials stacked in the material area have been emptied and the materials have entered the mixer through the feeding port. At this time, it can be determined that the feeding personnel have performed the feeding action normally and there is no feeding abnormality in the current batch of feeding, which is a qualified feeding batch. A feeding-completion message is generated according to the received feeding-completion signal, and the feeding-completion message is used to prompt the feeding personnel that the current batch of feeding has been completed. This application uses the image of the material area to determine whether the materials in the material area have been emptied, and uses the image of the feeding port to determine whether the materials have entered the mixer, and can detect feeding abnormalities in the whole feeding process, ensuring the quality of the produced mortar.

[0073] Please refer to Figure 2 ,Figure 2 The second flowchart of the feeding method for a mixer provided by an embodiment of the present application is shown.

[0074] As an example, in the case where the second coincidence degree is less than the second threshold, according to the received feeding completion signal, generating feeding completion information includes:

[0075] S161, in the case where the second coincidence degree is less than the second threshold, detecting whether a lock confirmation signal is received.

[0076] In the case where the second coincidence degree is less than the second threshold, it is determined that the feeder has performed a feeding action, and the feeder is waited to complete the feeding. Detect whether a lock confirmation signal is received, where the lock confirmation signal is used to determine that the feeding hopper has been adjusted to the hopper cover locked state. Based on the received lock confirmation signal, it is determined that the feeder actively requests to complete the feeding, and the mixer is requested to stir the material.

[0077] S162, when the lock confirmation signal is received, obtaining the duration from sending the unlocking signal to receiving the lock confirmation signal.

[0078] When the lock confirmation signal is received, it is determined that the feeder actively requests to complete the feeding, and the duration from sending the unlocking signal to receiving the lock confirmation signal is obtained. Specifically, according to the time when the mixer sends the unlocking signal and the time when the lock confirmation signal is received, the duration from sending the unlocking signal to receiving the lock confirmation signal is determined.

[0079] S163, in the case where the feeding completion signal is received and the duration is less than a preset duration threshold, generating feeding completion information.

[0080] It should be understood that the preset time threshold is set according to actual needs and is not limited herein. In the actual production process, the time for the feeder to perform the feeding action on the same material is within a stable time range. For example, it is assumed that when producing a certain mortar, the time taken by the feeder to perform the feeding action is usually 5 to 10 minutes, then the preset time threshold can be set to 10 minutes. When the lock confirmation signal is received, it is determined whether the duration from obtaining the sending of the unlocking signal to receiving the lock confirmation signal is within 10 minutes. When the mixer fails or the feeding action of the feeder is interrupted, the duration will be greater than or equal to the preset time threshold, and then it is prompted to manually detect whether there is an abnormal feeding.

[0081] If the feeding personnel complete the feeding within the preset time threshold and adjust the feeding hopper to the state where the hopper lid is locked, the mixer receives the locking confirmation signal and obtains the duration from sending the unlocking signal to receiving the locking confirmation signal. When receiving the feeding completion signal and the duration is less than the preset duration threshold, it is determined that there is no abnormal feeding in the current batch, and a feeding completion message is generated.

[0082] In an optional example, after detecting whether the locking confirmation signal is received when the second coincidence degree is less than the second threshold, it further includes:

[0083] When the locking confirmation signal sent by the mixer is not received and the feeding completion signal is received, a prompt message for prompting that the feeding completion request is invalid is generated.

[0084] Due to the heavy production tasks and numerous production batches in the mortar production line, it is easy to occur that the feeding personnel accidentally trigger the confirmation button when not all the materials are put into the mixer, and the feeding personnel accidentally trigger the confirmation button when no materials are fed, resulting in the mixer receiving the feeding completion signal and terminating the feeding. When the locking confirmation signal sent by the mixer is not received and the feeding completion signal is received, since the feeding personnel do not adjust the hopper lid of the feeding hopper to the locked state, there is a situation where the feeding personnel accidentally trigger the confirmation button, and a prompt message for prompting that the feeding completion request is invalid is generated. The prompt message is used to prompt the feeding personnel that the current feeding completion request is an invalid request, and then prompt the feeding personnel to manually determine whether the confirmation button is accidentally triggered.

[0085] In an optional example, after obtaining the duration from sending the unlocking signal to receiving the locking confirmation signal when receiving the locking confirmation signal, it further includes:

[0086] When receiving the feeding completion signal, determine the first time of receiving the feeding completion signal and the second time of receiving the locking confirmation signal;

[0087] When the first time is before the second time, a prompt message for prompting that the feeding completion request is invalid is generated.

[0088] To prevent the feeding personnel from accidentally triggering the confirmation button within the preset time threshold, which may cause the mixer to receive the signal indicating the completion of feeding and terminate the feeding process. Before triggering the confirmation button to request complete feeding, the feeding personnel need to adjust the hopper lid of the feeding hopper to the locked state. Specifically, when the signal indicating the completion of feeding is received, determine the first time when the signal indicating the completion of feeding is received and the second time when the signal indicating the locking confirmation is received. Based on the first time and the second time, determine the sequence of the feeding personnel adjusting the hopper lid of the feeding hopper to the locked state and requesting the completion of feeding. When the first time is after the second time, generate the feeding completion information. When the first time is before the second time, there is a situation where the feeding personnel accidentally trigger the confirmation button within the preset time threshold, and a prompt message for indicating that the feeding completion request is invalid is generated, thereby prompting the feeding personnel to manually determine whether the confirmation button has been accidentally triggered.

[0089] Please refer to Figure 3 , Figure 3 which shows the third flowchart of the feeding method for a mixer provided by an embodiment of the present application.

[0090] As an example, the feeding method for a mixer further includes:

[0091] S101, based on a preset time interval, obtain all mixer inlet images and mixer material area images within a preset time range.

[0092] Before comparing the inlet image with the preset empty inlet image or comparing the material area image with the preset non-piled material area image, it is necessary to obtain the preset non-piled material area image and the empty inlet image. Specifically, based on a preset time interval, obtain all mixer inlet images and mixer material area images within a preset time range. For the convenience of understanding, in the embodiments of the present application, the time interval is 0.5 seconds and the preset time range is 5 seconds, that is, 10 mixer inlet images and mixer material area images are obtained within 5 seconds. It should be understood that since the material area and the inlet are usually in different positions, it is necessary to separately obtain the mixer material area image including the material area and the mixer inlet image including the inlet.

[0093] S102, when the difference between any one of the mixer inlet images and another mixer inlet image is less than a third threshold, generate an inlet background image according to the mixer inlet image, and when the difference between any one of the mixer material area images and another mixer material area image is less than a third threshold, generate a material area background image according to the mixer material area image.

[0094] When the feeding port of the mixer is in the empty material state, the pixels of all the mixer feeding port images generated will be within a horizontal range. Compare the mixer feeding port images pairwise. If the difference between any one of the mixer feeding port images and another mixer feeding port image is less than the third threshold, it is determined that the feeding port of the mixer is in the empty material state, and a feeding port background image is generated according to the mixer feeding port image. In this embodiment, any one of the 10 mixer feeding port images is used as the feeding port background image.

[0095] When the material area of the mixer is in the non-piled state, the pixels of all the mixer material area images generated will be within a horizontal range. Compare the mixer material area images pairwise. If the difference between any one of the mixer material area images and another mixer material area image is less than the third threshold, it is determined that the material area of the mixer is in the non-piled state, and a material area background image is generated according to the mixer material area image. In this embodiment, any one of the 10 mixer material area images is used as the material area background image.

[0096] S103, generate a preset non-piled material area image according to the material area background image, and generate a preset empty feeding port image according to the feeding port background image.

[0097] Since the mixer feeding port images and the mixer material area images also include background environment images of people or other sundries. It is necessary to remove the background environment images in the material area background image to generate a background image only including the non-piled material area of the material area, and remove the background environment images in the feeding port background image to generate a background image only including the empty feeding port area of the feeding port.

[0098] In an optional example, the generating a preset non-piled material area image according to the material area background image and generating a preset empty feeding port image according to the feeding port background image includes:

[0099] Input the material area background image and the feeding port background image into a preset target recognition model respectively to generate the non-piled material area in the material area background image and the empty feeding port area in the feeding port background image;

[0100] Crop the non-piled material area in the material area background image to generate a preset non-piled material area image;

[0101] Crop the empty feeding port area in the feeding port background image to generate a preset empty feeding port image.

[0102] Input the background image of the material area into a preset target recognition model, and use the target recognition model to generate the non-stacked area of the material area in the background image of the material area. Here, the type of the target recognition model is set according to actual needs and is not limited herein. Crop the non-stacked area of the material area in the background image of the material area, and remove the image in the background image of the material area except for the non-stacked area of the material area to generate a preset non-stacked image of the material area.

[0103] Input the background image of the feed inlet into a preset target recognition model, and use the target recognition model to generate the empty material area of the feed inlet in the background image of the feed inlet. Crop the empty material area of the feed inlet in the background image of the feed inlet, and remove the image in the background image of the feed inlet except for the empty material area of the feed inlet to generate a preset empty material image of the feed inlet.

[0104] In an optional example, after receiving the feeding request signal and using the imaging module to obtain the material area image, it further includes:

[0105] Input the material area image into the target recognition model to generate the material area in the material area image;

[0106] Crop the material area in the material area image to update the material area image.

[0107] After obtaining the material area image, crop the material area in the material area image, and remove the image in the material area image except for the material area to generate a material area image only including the material area, so as to avoid the influence of the background environment image of people or other sundries on the recognition of the material area.

[0108] In an optional example, after the first coincidence degree is greater than the first threshold and using the imaging module to obtain the feed inlet image, it further includes:

[0109] Input the feed inlet image into the target recognition model to generate the feed inlet area in the feed inlet image;

[0110] Crop the feed inlet area in the feed inlet image to update the feed inlet image.

[0111] After obtaining the feed inlet image, crop the feed inlet area in the feed inlet image, and remove the image in the feed inlet image except for the feed inlet area to generate a feed inlet image only including the feed inlet area, so as to avoid the influence of the background environment image of people or other sundries on the recognition of the feed inlet area.

[0112] The present application provides a feeding method for a mixer. The mixer includes an imaging module and a feeding hopper. The method includes: in response to a received feeding request signal, using the imaging module to obtain an image of the material area; in the case where it is determined from the image of the material area that there is material to be fed in the material area, sending an unlocking signal to the feeding hopper; comparing the image of the material area with a preset image of the non-piled material area in the material area to generate a first coincidence degree between the image of the material area and the image of the non-piled material area in the material area; in the case where the first coincidence degree is greater than a first threshold, using the imaging module to obtain an image of the feed inlet; comparing the image of the feed inlet with a preset empty-feed-inlet image to generate a second coincidence degree between the image of the feed inlet and the empty-feed-inlet image; in the case where the second coincidence degree is less than a second threshold, generating a feeding completion message according to the received feeding completion signal. The present application uses the image of the material area to determine whether the material in the material area has been emptied, and uses the image of the feed inlet to determine whether the material has entered the mixer, and can perform feeding anomaly detection on the entire feeding process, ensuring the quality of the produced mortar.

[0113] Embodiment 2

[0114] Please refer to Figure 4 , Figure 4 which shows a schematic structural diagram of a feeding device for a mixer provided by an embodiment of the present application. The mixer includes an imaging module and a feeding hopper. Figure 4 The feeding device 200 for a mixer in

[0115] The material area image acquisition module 210 is configured to, in response to a received feeding request signal, use the imaging module to obtain an image of the material area;

[0116] The unlocking signal sending module 220 is configured to, in the case where it is determined from the image of the material area that there is material to be fed in the material area, send an unlocking signal to the feeding hopper, where the unlocking signal is used to adjust the feeding hopper to a state where the hopper lid is unlocked;

[0117] The first coincidence degree generation module 230 is configured to compare the image of the material area with a preset image of the non-piled material area in the material area to generate a first coincidence degree between the image of the material area and the image of the non-piled material area in the material area;

[0118] The feed inlet image acquisition module 240 is configured to, in the case where the first coincidence degree is greater than a first threshold, use the imaging module to obtain an image of the feed inlet;

[0119] The second coincidence degree generation module 250 is configured to compare the image of the feed inlet with a preset empty-feed-inlet image to generate a second coincidence degree between the image of the feed inlet and the empty-feed-inlet image;

[0120] The completion information generation module 260 is configured to generate the feeding completion information according to the received feeding completion signal when the second coincidence degree is less than the second threshold value.

[0121] As an example, the completion information generation module 260 includes:

[0122] The locking confirmation signal detection sub-module is configured to detect whether the locking confirmation signal is received when the second coincidence degree is less than the second threshold value, where the locking confirmation signal is used to determine that the feeding hopper has been adjusted to the hopper cover locked state;

[0123] The duration acquisition sub-module is configured to acquire the duration from sending the unlocking signal to receiving the locking confirmation signal when the locking confirmation signal is received;

[0124] The feeding completion sub-module is configured to generate the feeding completion information when the feeding completion signal is received and the duration is less than the preset duration threshold value.

[0125] In an optional example, the completion information generation module 260 further includes:

[0126] The first invalid prompt sub-module is configured to generate a prompt information for prompting that the feeding completion request is invalid when the locking confirmation signal sent by the mixer is not received and the feeding completion signal is received.

[0127] In an optional example, the completion information generation module 260 further includes:

[0128] The time determination sub-module is configured to determine the first time when the feeding completion signal is received and the second time when the locking confirmation signal is received when the feeding completion signal is received;

[0129] The first invalid prompt sub-module is configured to generate a prompt information for prompting that the feeding completion request is invalid when the first time is before the second time.

[0130] As an example, the feeding device 200 for the mixer further includes:

[0131] The interval acquisition image module is configured to acquire all the mixer feed inlet images and mixer material area images within a preset time range based on a preset time interval;

[0132] A background image module, configured to generate a background image of the feeding port according to the feeding port image of the mixer when the difference between any one of the feeding port images of the mixer and another feeding port image of the mixer is less than a third threshold, and generate a background image of the material area according to the material area image of the mixer when the difference between any one of the material area images of the mixer and another material area image of the mixer is less than the third threshold;

[0133] An image generation module, configured to generate a preset image of the material area without material stacking according to the background image of the material area, and generate a preset image of the empty feeding port according to the background image of the feeding port.

[0134] In an optional example, the image generation module includes:

[0135] A model input sub-module, configured to input the background image of the material area and the background image of the feeding port into a preset target recognition model respectively, to generate an area without material stacking in the background image of the material area and an empty feeding port area in the background image of the feeding port;

[0136] An image without material stacking sub-module, configured to crop the area without material stacking in the background image of the material area to generate a preset image of the material area without material stacking;

[0137] An empty feeding port image sub-module, configured to crop the empty feeding port area in the background image of the feeding port to generate a preset image of the empty feeding port.

[0138] As an example, the feeding port image acquisition module 240 is further configured to, when the first coincidence degree is greater than a first threshold, use the lighting module to illuminate the feeding port and use the imaging module to acquire a feeding port image.

[0139] The feeding device 200 for the mixer is configured to execute the corresponding steps in the feeding method for the mixer described above. The specific implementation of each function will not be described one by one here. In addition, the optional examples in Embodiment 1 are also applicable to the feeding device 200 for the mixer in Embodiment 2.

[0140] An embodiment of the present application further provides a mixer, where the mixer includes an imaging module, a feeding hopper, a memory, and a processor. The memory stores a computer program, and when the computer program is executed by the processor, it implements the feeding method for the mixer as described in Embodiment 1.

[0141] In this embodiment, the material area image acquisition module 210, the unlocking signal sending module 220, the first coincidence degree generation module 230, the feeding port image acquisition module 240, the second coincidence degree generation module 250, the completion information generation module 260, etc. are all stored in the memory as program units, and the above program units stored in the memory are executed by the processor to implement corresponding functions.

[0142] The processor contains a kernel, and the kernel retrieves the corresponding program units from the memory. One or more kernels can be set, and by adjusting the kernel parameters, the problem of being unable to quickly determine whether there is abnormal feeding in the mixer can be solved.

[0143] The memory may include non-permanent memory in a computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one storage chip.

[0144] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the feeding method of the mixer as described in Embodiment 1 is implemented.

[0145] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0146] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, as well as the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0147] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufacture including an instruction device that implements the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 specified in one block or multiple blocks.

[0148] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operational steps are performed on the computer or other programmable device to produce a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one process Figure 1 one process or multiple processes and / or blocks Figure 1 specified in one block or multiple blocks.

[0149] In a typical configuration, a computing device includes one or more processors (CPUs), an input / output interface, a network interface, and memory.

[0150] The memory may include non-permanent memory in the form of computer-readable media, random access memory (RAM) and / or non-volatile memory such as read-only memory (ROM) or flash memory (flash RAM). The memory is an example of computer-readable media.

[0151] Computer-readable storage media includes permanent and non-permanent, removable and non-removable media that can store information by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media such as modulated data signals and carrier waves.

[0152] It should also be noted that the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, commodity or device comprising a series of elements not only includes those elements but also other elements not expressly listed, or further includes elements inherent to such process, method, commodity or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the existence of additional identical elements in the process, method, commodity or device comprising the element.

[0153] The above are only embodiments of the present application and are not used to limit the present application. For those skilled in the art, various changes and modifications can be made to the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims

1. A feeding method for a mixer, the mixer comprising an imaging module and a feeding hopper, characterized in that, The method includes: In response to the received feeding request signal, obtaining an image of the material area by using the imaging module; When it is determined that there is material to be fed in the material area according to the image of the material area, sending an unlocking signal to the feeding hopper, where the unlocking signal is used to adjust the feeding hopper to the state where the hopper cover is unlocked; Comparing the image of the material area with a preset image of the non-piled material area in the material area, and generating a first coincidence degree between the image of the material area and the preset image of the non-piled material area in the material area; When the first coincidence degree is greater than a first threshold, obtaining an image of the feed inlet by using the imaging module; Comparing the image of the feed inlet with a preset image of the empty feed inlet, and generating a second coincidence degree between the image of the feed inlet and the preset image of the empty feed inlet; When the second coincidence degree is less than a second threshold, generating a feeding completion message according to the received feeding completion signal.

2. The feeding method for a mixer according to claim 1, characterized in that, The step of generating a feeding completion message according to the received feeding completion signal when the second coincidence degree is less than the second threshold includes: When the second coincidence degree is less than the second threshold, detecting whether a locking confirmation signal is received, where the locking confirmation signal is used to determine that the feeding hopper has been adjusted to the state where the hopper cover is locked; When the locking confirmation signal is received, obtaining the duration from sending the unlocking signal to receiving the locking confirmation signal; When the feeding completion signal is received and the duration is less than a preset duration threshold, generating a feeding completion message.

3. The feeding method for a mixer according to claim 2, wherein After detecting whether the locking confirmation signal is received when the second coincidence degree is less than the second threshold, it further includes: When the locking confirmation signal sent by the mixer is not received and the feeding completion signal is received, generating a prompt message for prompting that the feeding completion request is invalid.

4. The feeding method for a mixer according to claim 2, characterized in that, After obtaining the duration from sending the unlocking signal to receiving the locking confirmation signal when the locking confirmation signal is received, it further includes: When the feeding completion signal is received, determining a first time when the feeding completion signal is received and a second time when the locking confirmation signal is received; When the first time is before the second time, generating a prompt message for prompting that the feeding completion request is invalid.

5. The feeding method for a mixer according to claim 1, characterized in that The method further includes: Based on a preset time interval, obtaining all the images of the mixer feed inlet and the mixer material area within a preset time range; When the difference between any one of the images of the mixer feed inlet and another image of the mixer feed inlet is less than a third threshold, generating a background image of the feed inlet according to the image of the mixer feed inlet, and when the difference between any one of the images of the mixer material area and another image of the mixer material area is less than the third threshold, generating a background image of the material area according to the image of the mixer material area; Generating a preset image of the non-piled material area in the material area according to the background image of the material area, and generating a preset image of the empty feed inlet according to the background image of the feed inlet.

6. The feeding method for a mixer according to claim 5, characterized in that, The step of generating a preset image of the non-piled material area in the material area according to the background image of the material area and generating a preset image of the empty feed inlet according to the background image of the feed inlet includes: Input the material area background image and the feed inlet background image into a preset target recognition model respectively to generate the non-stacked material area in the material area background image and the empty material area in the feed inlet background image; Crop the non-stacked material area in the material area background image to generate a preset non-stacked material area image of the material area; Crop the empty material area in the feed inlet background image to generate a preset empty material area image of the feed inlet.

7. The feeding method for a mixer according to claim 1, characterized in that, The mixer further includes an illumination module. When the first coincidence degree is greater than a first threshold, acquiring a feed inlet image by using the imaging module includes: When the first coincidence degree is greater than the first threshold, illuminate the feed inlet by using the illumination module and acquire a feed inlet image by using the imaging module.

8. A feeding device for a mixer, the mixer including an imaging module and a feed hopper, characterized in that, The feeding device includes: A material area image acquisition module, configured to acquire a material area image by using the imaging module in response to a received feeding request signal; An unlocking signal sending module, configured to send an unlocking signal to the feeding hopper when it is determined according to the material area image that there is material to be fed in the material area, where the unlocking signal is used to adjust the feeding hopper to a state where the hopper lid is unlocked; A first coincidence degree generation module, configured to compare the material area image with a preset non-stacked material area image of the material area and generate a first coincidence degree between the material area image and the non-stacked material area image of the material area; A feed inlet image acquisition module, configured to acquire a feed inlet image by using the imaging module when the first coincidence degree is greater than a first threshold; A second coincidence degree generation module, configured to compare the feed inlet image with a preset empty material area image of the feed inlet and generate a second coincidence degree between the feed inlet image and the empty material area image of the feed inlet; A completion information generation module, configured to generate feeding completion information according to a received feeding completion signal when the second coincidence degree is less than a second threshold.

9. A mixer, characterized in that, The mixer includes an imaging module, a feeding hopper, a memory and a processor. The memory stores a computer program. When the computer program is executed by the processor, it implements the feeding method for a mixer according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, it implements the feeding method for a mixer according to any one of claims 1 to 7.

Images