Information processing method, system and device

Abstract

The embodiment of the invention discloses an information processing method, system and device, and the method comprises the steps: obtaining a first image collected by an image collection assembly at a first moment; the first image is obtained by performing image acquisition on a target position in the production line by the image acquisition assembly in response to a first trigger signal, and the first trigger signal is sent when the detection assembly detects that the product reaches the target position; according to the first image, determining whether two connected products exist at the target position at the first moment; under the condition that two connected products exist at the target position at the first moment, the image acquisition assembly is triggered at the second moment to perform image acquisition on the target position, and the second moment is delayed by the target duration compared with the first moment.

Description

Technical Field

[0001] The present application relates to but is not limited to the field of intelligent production, and in particular to an information processing method, system and device. Background Art

[0002] Visual inspection is a commonly used inspection technology in industrial production. In the process of visual inspection, the image acquisition component can be controlled to capture images of products on the production line to obtain product image information, and then the product image information is analyzed to complete specific product inspection projects. However, in the related art, the product image may be missed during the process of capturing images of products on the production line. Summary of the invention

[0003] In view of this, embodiments of the present application at least provide an information processing method, system, and device.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] The present application provides an information processing method, including:

[0006] Acquire a first image acquired by the image acquisition component at a first moment; the first image is acquired by the image acquisition component in response to a first trigger signal when acquiring an image of a target position in the production line, and the first trigger signal is sent when the detection component detects that the product has reached the target position;

[0007] Determine, based on the first image, whether there are two connected products at the target position at a first moment;

[0008] When there are two connected products at the target position at a first moment, the image acquisition component is triggered to acquire an image of the target position at a second moment, and the second moment is delayed by a target time length compared to the first moment.

[0009] In some embodiments, triggering the image acquisition component to acquire an image of the target position at a second moment includes: sending a second trigger signal to the image acquisition component at the second moment, the second trigger signal being used to trigger the image acquisition component to acquire an image of the target position.

[0010] In some embodiments, the above method further includes: counting the number of times the second trigger signal is sent; and determining the number of first products missed by the detection component according to the number of times the second trigger signal is sent.

[0011] In some embodiments, triggering the image acquisition component to capture an image of the target position at the second moment includes: controlling the simulation component to simulate the state of the product reaching the target position at the second moment, so as to trigger the detection component to send the next first trigger signal to the image acquisition component, so that the image acquisition component captures the image of the target position in response to the next first trigger signal.

[0012] In some embodiments, the above method further includes: counting the number of times the first trigger signal is sent; and determining the number of second products detected in the production line according to the number of times the first trigger signal is sent.

[0013] In some embodiments, the size of the product matches the field of view size of the image acquisition component; the above method also includes: determining the target duration based on the conveying speed of the product in the production line and the size of the product.

[0014] In some embodiments, the above method also includes at least one of the following: identifying the product label in the first image to obtain the label information of the product corresponding to the first moment; identifying the product label in the second image to obtain the label information of the product corresponding to the second moment, and the second image is obtained by the image acquisition component capturing the target position at the second moment.

[0015] In some embodiments, the above method also includes: acquiring a second image, the second image is obtained by the image acquisition component capturing the target position at the second moment; determining whether there are two connected products at the target position at the second moment based on the second image; if there are two connected products at the target position at the second moment, triggering the image acquisition component to capture an image of the target position at a third moment, and the third moment is delayed by a target time length compared to the second moment.

[0016] The present application provides an information processing system, including:

[0017] An image acquisition component, used for acquiring an image of a target position in the production line in response to a first trigger signal;

[0018] A detection component, used to detect whether the product on the production line has reached the target position, and send a first trigger signal to the image acquisition component when the product reaches the target position;

[0019] An information processing component is used to: obtain a first image captured by an image acquisition component at a first moment, the first image being captured by the image acquisition component in response to a first trigger signal; determine, based on the first image, whether there are two connected products at a target position at the first moment; and, if there are two connected products at the target position at the first moment, trigger the image acquisition component to capture an image of the target position at a second moment, the second moment being delayed by a target length compared to the first moment.

[0020] The present application provides an information processing device, including:

[0021] An acquisition module, used to acquire a first image acquired by the image acquisition component at a first moment; the first image is acquired by the image acquisition component in response to a first trigger signal when acquiring an image of a target position in the production line, and the first trigger signal is sent when the detection component detects that the product has reached the target position;

[0022] A first determination module, configured to determine, based on the first image, whether there are two connected products at the target position at a first moment;

[0023] The trigger module is used to trigger the image acquisition component to acquire an image of the target position at a second moment when there are two connected products at the target position at a first moment, and the second moment is delayed by a target time length compared to the first moment.

[0024] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0026] Figure 1 A schematic diagram of an implementation flow of an information processing method provided in an embodiment of the present application;

[0027] Figure 2 A schematic diagram of a scenario for detecting a box product label provided in an embodiment of the present application;

[0028] Figure 3 A schematic diagram of boxes connected on a production line provided in an embodiment of the present application;

[0029] Figure 4 A schematic diagram of a photographed image of a single product not connected to other products provided in an embodiment of the present application;

[0030] Figure 5 A schematic diagram of a photographed image of two products connected together provided in an embodiment of the present application;

[0031] Figure 6 A schematic diagram of an implementation flow of an information processing method provided in an embodiment of the present application;

[0032] Figure 7 A schematic diagram of the structure of an information processing system provided in an embodiment of the present application;

[0033] Figure 8A schematic diagram of the structure of an information processing device provided in an embodiment of the present application;

[0034] Fig. 9 A schematic diagram of a hardware entity of a computer device in an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions of the present application are further elaborated in detail below in conjunction with the drawings and embodiments. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0036] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0037] The terms "first / second / third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It is understandable that "first / second / third" can be interchanged with a specific order or sequence where permitted so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0038] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing this application and are not intended to limit this application. In addition, the technical features involved in the different embodiments and different implementations of this application described below can be combined with each other as long as they do not conflict with each other.

[0039] In order to better understand the solution of the embodiment of the present application, the image acquisition process of the products on the production line in the related art is first described below.

[0040] In the related art, an image acquisition component can be set on one or both sides of the production line, and a detection component can be used to detect whether the product on the production line has reached the acquisition position of the image acquisition component. When the detection component detects that the product has reached the acquisition position, the detection component will trigger the image acquisition component to capture the image of the acquisition position, thereby obtaining the image information of the product.

[0041] However, in the actual production process, products on the production line may be connected together. For multiple connected products on the production line, the detection component can usually only detect the arrival of the first product at the detection position and trigger the image acquisition component to capture the image of the first product at the acquisition position. The second product connected to the first product and other products connected thereafter are connected to the previous box, so the detection component cannot recognize their arrival status and cannot detect whether they have arrived at the acquisition position, which will lead to the omission of product image acquisition.

[0042] On this basis, the embodiment of the present application provides an information processing method, which can be executed by a processor of a computer device. When implemented, the computer device can be any suitable device with data processing capabilities. It is understandable that in industrial production, the computer device can refer to a host computer, such as a server, a laptop, a tablet computer, a desktop computer, a smart phone, etc., and the computer device can also refer to a lower computer, such as an industrial computer, a programmable logic controller (PLC), etc. The processor may include but is not limited to at least one of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA).

[0043] Figure 1 A schematic diagram of an implementation flow of an information processing method provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the method includes the following steps S101 to S103:

[0044] Step S101, obtaining a first image captured by an image acquisition component at a first moment; the first image is obtained by the image acquisition component capturing an image of a target position in a production line in response to a first trigger signal, and the first trigger signal is sent when a detection component detects that a product has reached the target position.

[0045] Here, the image acquisition component can be set at any suitable position beside the production line to capture images of target positions in the production line. For example, the image acquisition component can be set on one side or both sides of the production line, or can be set above or obliquely above the production line.

[0046] The image acquisition component may include but is not limited to at least one of a two-dimensional camera, a three-dimensional camera, a depth camera, a line scan camera, a surface scan camera, etc., and the present application embodiment does not limit this. For example, the image acquisition component may include a two-dimensional line scan charge coupled device (CCD) camera.

[0047] The target position may be a position on a production line where product image acquisition is to be performed. In some embodiments, the target position may be a preset acquisition position, which is located within the acquisition field of view of the image acquisition component.

[0048] The detection component is used to detect whether the product on the production line has reached the target position, and sends a first trigger signal to the image acquisition component when it is detected that the product has reached the target position. The image acquisition component can respond to the first trigger signal to capture an image of the target position in the production line to obtain a first image containing the current product. The capture time of the first image is the first moment.

[0049] The detection component may include but is not limited to at least one of a photoelectric detection device, a pressure sensor, etc. It is understandable that for a single product, before and after the product is transported to the target position on the production line, the transmission condition of the light at the target position and / or the pressure of the transport track at the target position will change, so that the detection component can detect whether the product has reached the target position through the change of the light signal at the target position and / or the change of the pressure signal.

[0050] During implementation, those skilled in the art may adopt any suitable detection component according to actual conditions, and the embodiments of the present application are not limited to this.

[0051] In some embodiments, the detection assembly may include a photoelectric tube assembly. The photoelectric tube assembly may be disposed at a suitable position beside the production line to facilitate detection of changes in light signals at a target position in the production line, thereby detecting whether a product has reached the target position.

[0052] For example, the photoelectric tube assembly may include a reflective photoelectric tube disposed on one side of the production line, and the reflective photoelectric tube may determine whether a product has reached the target position by detecting the reflected light at the target position. The reflective photoelectric tube includes a light emitter and a light receiver. The light emitter emits light to the target position, and the light receiver receives the reflected light. When a product reaches the target position, the change in the reflected light triggers the change in the output voltage of the phototransistor in the light receiver, thereby outputting a first trigger signal.

[0053] For example, the photoelectric tube assembly may include opposing photoelectric tubes arranged on both sides of the production line. The opposing photoelectric tubes are composed of two photoelectric tubes placed opposite to each other. The light beam between the two phototubes passes through the target position. When a product reaches the target position, the product will block the light beam between the two phototubes, thereby triggering the photoelectric sensor in the opposing phototube to output a first trigger signal.

[0054] It should be noted that the embodiments of the present application do not limit the products produced in the production line. For example, the products may include but are not limited to at least one of electronic products, food, daily necessities, etc.

[0055] Step S102: determining, based on the first image, whether there are two connected products at the target position at the first moment.

[0056] Here, the image content of the first image may be analyzed in any appropriate manner to determine whether there are at least two connected products at the target position at the first moment.

[0057] In some embodiments, it is possible to determine whether there are two connected products at the target location at the first moment by identifying the number of products in the first image. For example, if the image acquisition component can only acquire image information of one product when acquiring images of the target location under normal circumstances, then if only one product is identified in the first image, it can be determined that there are no two connected products at the target location at the first moment; if more than one product is identified in the first image, it can be determined that there are two connected products at the target location at the first moment.

[0058] In some embodiments, it can be determined whether there are two connected products at the target position at the first moment by identifying the overall outline of the product in the first image. For example, if the overall outline of the product identified in the first image is larger than the target size, it can be determined that there are two connected products at the target position at the first moment; if the overall outline of the product identified in the first image is smaller than or equal to the target size, it can be determined that there are no two connected products at the target position at the first moment. The target size may be the size corresponding to the product outline of a single product.

[0059] In some embodiments, an image recognition model can be used to identify the edge features of the product in the first image to obtain a recognition result; the recognition result represents whether there are two connected products at the target position at the first moment. The image recognition model can be pre-trained using any suitable model training method. It is understandable that when a product is not connected to other products, the edge of the product will have different image features compared to when the product is connected to other products. Therefore, by identifying the edge features of the product in the first image, it can be determined whether the first image contains at least two adjacent products, thereby determining whether there are at least two connected products at the target position at the first moment.

[0060] In some embodiments, the product includes a square box; the image recognition model can be used to identify the connection line features between two square boxes in the first image to obtain a recognition result. When the product is a square box, there will be a connection line with specific features between the two connected square boxes. When a square box is not connected to other square boxes, the edge of the square box will not have the specific feature. By identifying the image feature corresponding to the connection line in the first image (i.e., the connection line feature), it can be determined whether the first image contains at least two adjacent square boxes, thereby determining whether there are at least two connected square boxes at the target position at the first moment.

[0061] Step S103, when there are two connected products at the target position at the first moment, triggering the image acquisition component to acquire an image of the target position at a second moment, the second moment being delayed by a target time length compared to the first moment.

[0062] Here, any suitable method may be used to trigger the image acquisition component to acquire an image of the target location, and the embodiments of the present application are not limited to this.

[0063] In some implementations, the image acquisition component may be triggered to acquire an image of the target location by directly sending a trigger signal to the image acquisition component.

[0064] In some implementations, the state in which a product reaches a target location may be simulated to trigger the detection component to send a first trigger signal to the image acquisition component, thereby triggering the image acquisition component to acquire an image of the target location.

[0065] The target duration can be pre-set by those skilled in the art according to the actual production scenario, and the embodiments of the present application are not limited to this.

[0066] In the embodiment of the present application, a first image captured by the image acquisition component at a first moment is obtained; the first image is obtained by the image acquisition component in response to a first trigger signal to capture an image of a target position in the production line, and the first trigger signal is sent by the detection component when the product reaches the target position; according to the first image, it is determined whether there are two connected products at the target position at the first moment; when there are two connected products at the target position at the first moment, the image acquisition component is triggered at the second moment to capture an image of the target position. In this way, by supplementing the triggering of the image acquisition component to capture an image of the target position at the second moment when it is determined that there are two connected products at the target position at the first moment, the situation of missing product image capture can be reduced. In addition, since the second moment is delayed by the target time length than the first moment, the image acquisition component can capture the image of the current product at the target position after the first moment captures the first image containing the previous product, and then delays the target time length, which can reduce the image information of the previous product in the picture of the current product image capture, thereby improving the accuracy of the current product image capture.

[0067] In some embodiments, the triggering of the image acquisition component to acquire an image of the target position at the second moment in the above step S103 may include the following step S111:

[0068] Step S111: sending a second trigger signal to the image acquisition component at a second moment, wherein the second trigger signal is used to trigger the image acquisition component to acquire an image of the target position.

[0069] Here, the image acquisition component can, in response to receiving the second trigger signal, acquire an image of the target position again to obtain a second image. It is understandable that the image content of the first image can include the first product of the two connected products, and the image content of the second image can include the next product connected after the first product.

[0070] In the above embodiment, a second trigger signal is sent to the image acquisition component at the second moment to trigger the image acquisition component to acquire an image of the target position. In this way, the image acquisition component can be triggered to acquire an image of the target position simply and quickly, thereby reducing the situation where product images are missed.

[0071] In some embodiments, the above information processing method may further include the following steps S121 to S122:

[0072] Step S121, counting the number of times the second trigger signal is sent.

[0073] Step S122: determining the number of first products missed by the detection component according to the number of times the second trigger signal is sent.

[0074] In the above embodiment, a second trigger signal is sent to the image acquisition component to supplement the triggering of the image acquisition component to perform image acquisition on the products missed by the detection component. Therefore, the number of times the second trigger signal is sent can reflect the number of products missed by the detection component. Thus, by counting the number of times the second trigger signal is sent, the number of first products missed by the detection component can be quickly and accurately determined.

[0075] It is understandable that, for multiple products connected on the production line, since the detection component can only detect the first product, the subsequent connected products cannot be detected. The second trigger signal is sent when it is determined based on the first image that there are two connected products at the target position at the first moment. And it is understandable that, for the case where there are more than three connected products on the production line, after using the second trigger signal to trigger the image acquisition component to capture the image of the target position and obtain the second image, it is also possible to continue to determine whether there are two connected products at the target position at the second moment based on the second image, and when it is determined that there are two connected products at the target position at the second moment, continue to send the next second trigger signal until it is determined that there are no two connected products at the target position at a certain moment. In this way, the number of times the second trigger signal is sent is the number of first products that the detection component missed.

[0076] In some embodiments, the triggering of the image acquisition component to acquire an image of the target position at the second moment in the above step S103 may include the following step S131:

[0077] Step S131, at the second moment, controls the simulation component to simulate the state of the product reaching the target position, so as to trigger the detection component to send the next first trigger signal to the image acquisition component, so that the image acquisition component acquires an image of the target position in response to the next first trigger signal.

[0078] Here, according to the logic of the detection component detecting whether the product has reached the target position, a suitable simulation component can be designed to simulate the state of the product reaching the target position, thereby triggering the detection component to send the next first trigger signal to the image acquisition component. The embodiment of the present application does not limit the implementation method of the simulation component.

[0079] In some embodiments, when the detection component is a pressure sensor, the simulation component can be a pressure simulation device, which can trigger the detection component to send the next first trigger signal to the image acquisition component by simulating the pressure change state of the conveying track at the target position when the product reaches the target position.

[0080] In some embodiments, when the detection component is a photoelectric tube component, the simulation component can simulate the change state of the light signal at the target position when the product reaches the target position, thereby triggering the detection component to send the next first trigger signal to the image acquisition component.

[0081] For example, in the case where the photoelectric tube assembly is a reflective photoelectric tube, the simulation assembly may include a reflective unit; first, the reflective unit may be controlled to reflect the light emitted by the light emitter in the reflective photoelectric tube to an angle that the light receiver cannot receive, so as to simulate the situation where there is no product at the target position, so that the reflective photoelectric tube cannot detect the product at the current target position; then, the reflective unit is controlled to reflect the light emitted by the light emitter to an angle that the light receiver can receive, or the reflective unit is controlled not to receive the light emitted by the light emitter, so that the reflective photoelectric tube detects the product at the current target position; in this way, the changing state of the light signal at the target position during the process of the product reaching the target position can be simulated.

[0082] For another example, in the case where the photoelectric tube assembly is a through-beam phototube, the simulation assembly may include an auxiliary light source; first, the auxiliary light source may be controlled to send a light beam to the photoelectric sensor in the through-beam phototube to simulate a situation where there is no product at the target position, so that the through-beam phototube cannot detect the product at the current target position; then, the auxiliary light source is controlled to stop sending a light beam to the photoelectric sensor in the through-beam phototube, so that the through-beam phototube detects the product at the current target position; in this way, the changing state of the light signal at the target position during the process of the product reaching the target position can be simulated.

[0083] In the above embodiment, at the second moment, the simulation component is controlled to simulate the state of the product reaching the target position, so as to trigger the detection component to send the next first trigger signal to the image acquisition component, so that the image acquisition component responds to the next first trigger signal to acquire an image of the target position. In this way, the image acquisition component can be accurately triggered to acquire images of the target position, and the situation of missed product image acquisition can be reduced. Moreover, whether it is the image acquisition of the product detected by the detection component or the image acquisition of the product missed by the detection component, it is triggered by the first trigger signal sent by the detection component, which can simplify the logic of subsequent statistics and analysis of the image acquisition related data, and facilitate production control.

[0084] In some embodiments, the above information processing method may further include the following steps S141 to S142:

[0085] Step S141, counting the number of times the first trigger signal is sent.

[0086] Step S142: determining the number of second products detected in the production line according to the number of times the first trigger signal is sent.

[0087] In the above embodiment, since both the image acquisition of the product detected by the detection component and the image acquisition of the product missed by the detection component are triggered by the first trigger signal sent by the detection component, the number of second products detected in the production line can be simply and accurately determined by counting the number of times the first trigger signal is sent.

[0088] It is understandable that, in the case where there are more than three connected products on the production line, the state of the products reaching the target position is simulated by controlling the simulation component to trigger the detection component to send the first trigger signal to the image acquisition component. After obtaining the second image, it is also possible to continue to determine whether there are two connected products at the target position at the second moment based on the second image, and when it is determined that there are two connected products at the target position at the second moment, continue to control the simulation component to simulate the state of the products reaching the target position to trigger the detection component to send the next first trigger signal to the image acquisition component until it is determined that there are no two connected products at the target position at a certain moment. In this way, the number of times the first trigger signal is sent is the number of second products detected in the production line.

[0089] In some embodiments, the size of the product matches the field of view size of the image acquisition component. The above information processing method may also include the following step S151:

[0090] Step S151, determining the target duration based on the conveying speed of the products in the production line and the size of the products.

[0091] Here, the size of the product may include but is not limited to the length and / or width of the side of the product facing the image acquisition component, and the field of view size of the image acquisition component may include but is not limited to the length and / or width of the field of view range.

[0092] In some embodiments, the width of the side surface of the product facing the image acquisition component is equal to the width of the field of view of the image acquisition component.

[0093] It is understandable that the size of the product matches the field of view size of the image acquisition component, so that only one complete product will appear in the field of view of the image acquisition component. The first image is acquired at the first moment after the detection component detects that the product has arrived at the target position. If there are two connected products at the target position at the first moment, the first image may include a complete image of the first product. As the production line conveys the product at the conveying speed, the first product will gradually leave the field of view of the image acquisition component at the conveying speed. Since the size of the product matches the field of view size of the image acquisition component, a more appropriate second moment can be determined based on the conveying speed of the product in the generation line and the size of the product, so that the second image captured at the second moment is more accurate.

[0094] In some embodiments, the ratio between the size of the product and the conveying speed of the product in the production line can be determined as the target duration. In this way, the second image captured at the second moment can contain as little image information of the first product as possible, thereby further making the second image captured at the second moment more accurate.

[0095] In some embodiments, the above information processing method may further include at least one of the following steps S161 and S162:

[0096] Step S161: Identify the product label in the first image to obtain label information of the product corresponding to the first moment.

[0097] Here, the surface of the product is usually affixed with a product label of the product, and the product label has label information of the product. By identifying the product label in the image of each product, the label information of the product can be obtained.

[0098] In some embodiments, any suitable target detection and information extraction method may be used to identify the product label in the first image, and extract information on the identified product label to obtain the label information of the product corresponding to the first moment.

[0099] In some embodiments, when it is determined that there are no two connected products at the target position at the first moment, the product label in the first image may be identified; when it is determined that there are two connected products at the target position at the first moment, the product label in the first image may not be identified. In this way, since the first image may contain product labels of multiple products at the same time when there are two connected products at the target position, which may lead to misidentification of label information, when it is determined that there are two connected products at the target position at the first moment, the product label in the first image may not be identified, which can reduce the misidentification of label information.

[0100] Step S162, identifying the product label in the second image to obtain label information of the product corresponding to the second moment, wherein the second image is obtained by the image acquisition component capturing the target position at the second moment.

[0101] Here, the method of identifying the product label in the second image may be similar to the method of identifying the product label in the first image in step S161 , and the implementation method may refer to the aforementioned implementation method of step S161 .

[0102] In this way, if the detection component does not detect that the subsequent product after the first product among the multiple connected products has arrived at the target detection position, it can also capture the image of the target position by supplementing the triggering image acquisition component to obtain a second image, and identify the product label in the second image to obtain the label information of the product corresponding to the second moment, thereby reducing the situation of missed identification of label information.

[0103] In some embodiments, the above information processing method may further include the following steps S171 to S173:

[0104] Step S171, acquiring a second image, where the second image is obtained by the image acquisition component capturing the target position at the second moment.

[0105] Step S172: determining, based on the second image, whether there are two connected products at the target position at the second moment.

[0106] Step S173, when there are two connected products at the target position at the second moment, trigger the image acquisition component to acquire an image of the target position at a third moment, and the third moment is delayed by the target time length compared to the second moment.

[0107] Here, step S172 to step S173 may correspond to step S102 to step S103 in the aforementioned embodiment, and during implementation, reference may be made to the implementation of the aforementioned step S102 to step S103.

[0108] In the above embodiment, the image acquisition component acquires the second image obtained by acquiring the target position at the second moment; based on the second image, it is determined whether there are two connected products at the target position at the second moment; when there are two connected products at the target position at the second moment, the image acquisition component is triggered to acquire the image of the target position at the third moment, and the third moment is delayed by the target time length compared to the second moment. In this way, when there are more than three connected products on the production line, the image acquisition component is triggered to acquire the image of the target position at the second moment, and after the second image is acquired, it is possible to continue to determine whether there are still two connected products at the target position at the second moment based on the second image, and when it is determined that there are still two connected products at the target position at the second moment, the next second trigger signal is delayed by the target time length to continue to send, so as to acquire the image information of the next product at the third moment. In this way, the situation where product images are missed can be further reduced.

[0109] The following describes the application of the information processing method provided in the embodiment of the present application in a practical scenario. Take the scenario of a cigarette factory producing cigarette products as an example.

[0110] In the production process of cigarette products, it is necessary to identify the product labels on the boxes (corresponding to the products in the above embodiments) in the production line. The boxes may be packaging boxes for cigarette products, and the product labels on the boxes may include label information such as the gross weight, net weight, and origin of the cigarette products in the boxes. Figure 2 As shown, the position of the product label 211 on the box 21 is random, and may be on the left side or on the right side of the box 21. There is a camera 23 on each side of the production line 22, which is respectively connected to the photoelectric tube 24 for receiving the trigger signal of the photoelectric tube 24. When the track at the bottom of the production line 22 moves forward, the box 21 is transferred to the detection position of the photoelectric tube 24 (corresponding to the target position in the above embodiment), and the photoelectric tube 24 triggers the camera 23 to take a picture of the box 21 at the target position by sending a first trigger signal to the camera 23, and then the algorithm recognizes the label information of the current box.

[0111] Under normal production conditions, the spacing between boxes on the production line is uniform or large, and the above method can detect the label information of each box. Figure 3 As shown, the boxes 21 on the production line may be connected together for various reasons. After the previous box triggers the photoelectric tube to send the first trigger signal, the next box will not trigger the photoelectric tube to send the first trigger signal when the second box arrives because it is connected to the previous box, resulting in the label of the second box being missed. Similarly, there may be three, four, five or even more boxes connected together, resulting in missed detection. When missed detection occurs, the number of missed boxes needs to be counted.

[0112] On this basis, the embodiment of the present application provides an information processing method, which can reduce the problem of missed detection of box labels due to multiple boxes being connected, and can count the number of missed boxes.

[0113] Consider that when a product is not connected to other products, the edge of the product will have different image features compared to when the product is connected to other products. Figure 4 A schematic diagram of a photographed image of a single product not connected to other products provided in an embodiment of the present application, such as Figure 4 As shown, taking the track moving direction from right to left as an example, under normal circumstances, the right side of the box body 21 is empty. Figure 5 A schematic diagram of a photographed image of two products connected to each other provided in an embodiment of the present application, such as Figure 5 As shown, taking the track advancing direction from right to left as an example, when the box 21a and the box 21b are connected together, the edge portion of the next box 21b can be seen on the right side of the box 21a.

[0114] In an embodiment of the present application, a machine vision algorithm is used to determine whether there are two connected boxes in the current camera image.

[0115] Figure 6 The following is a schematic diagram of an implementation flow of an information processing method provided in an embodiment of the present application. Figure 6 As shown, the method includes the following steps S301 to S304:

[0116] Step S301 , collect a large number of sample images of two boxes connected together, and mark the connection portion of the two boxes in each sample image, and use the marked sample images to train the image recognition model.

[0117] For example, a large number of photos of two boxes connected together are collected as sample images, and the parts of the boxes connected in each sample image are manually marked using annotation tools. Then the marked boxes are cut out and fed to the image recognition model for training to obtain the model file of the trained image recognition model. During recognition, the model file of the trained image recognition model is loaded, and the image to be recognized is input into the image recognition model, so that it can quickly calculate and determine whether there are boxes connected in the current input image.

[0118] The image to be recognized may include the first image and / or the second image in the above embodiment.

[0119] Step S302: the box reaches the photoelectric tube position and the camera is hard-triggered to capture a frame of image.

[0120] Here, hard triggering refers to triggering the camera to capture a frame of image (recorded as the current image) by sending a first trigger signal through a triggering photoelectric tube.

[0121] In some implementations, a frame of image acquired by hard triggering may correspond to the first image in the aforementioned embodiment.

[0122] Step S303: Use the trained image recognition model to identify whether there are two boxes connected in the current image.

[0123] In some embodiments, after the hard-triggered camera captures an image, it first detects whether there are two boxes connected in the current image; if there are boxes connected, the label information of the current box will not be recognized; after a period of time t (corresponding to the target time in the aforementioned embodiment), the camera is notified to switch to soft triggering (i.e., a second trigger signal is sent to the camera), and the next frame of image captured by the camera is obtained to identify whether the boxes in the next frame of image are connected; until there is only one box in a frame of image acquired by soft triggering, indicating that there are no subsequent connected boxes, the process ends.

[0124] The time t is the time it takes for a box to pass through the camera screen, which can be preset or dynamically determined.

[0125] In some embodiments, the width of the box box_width and the conveying speed v of the conveyor belt in the production line are known, and the time t = box_width / v for a box to pass through the camera screen can be calculated. After the current moment (corresponding to the first moment in the above embodiment) plus the time t, another frame of soft-triggered image is input into the image recognition model to identify whether the boxes in the image are connected, and the counter accumulates and increases by 1. Similarly, the number of soft triggers is accumulated and then added by 1, and the number of boxes currently connected can be calculated, so that the total number of boxes with missed label information can be determined.

[0126] Step S304, counting the number of soft triggers to determine the number of cabinets missed detection this time.

[0127] By adopting the information processing method provided in the embodiment of the present application, the number of boxes that have been missed in inspection can be counted using a machine vision algorithm, without the need to install additional sensors on both sides of the production line, thereby saving costs.

[0128] The present application embodiment provides an information processing system, such as Figure 7 As shown, the information processing system 70 includes an image acquisition component 71, a detection component 72 and an information processing component 73, wherein:

[0129] An image acquisition component 71, for acquiring an image of a target position in the production line in response to a first trigger signal;

[0130] A detection component 72, used for detecting whether the product on the production line has reached the target position, and sending the first trigger signal to the image acquisition component when the product has reached the target position;

[0131] The information processing component 73 is used to: obtain a first image captured by the image acquisition component at a first moment, the first image being captured by the image acquisition component in response to the first trigger signal; determine whether there are two connected products at the target position at the first moment based on the first image; if there are two connected products at the target position at the first moment, trigger the image acquisition component to capture an image of the target position at a second moment, the second moment being delayed by a target time length compared to the first moment.

[0132] In the embodiment of the present application, a first image captured by the image acquisition component at a first moment is obtained; the first image is obtained by the image acquisition component in response to a first trigger signal to capture an image of a target position in the production line, and the first trigger signal is sent by the detection component when the product reaches the target position; according to the first image, it is determined whether there are two connected products at the target position at the first moment; when there are two connected products at the target position at the first moment, the image acquisition component is triggered at the second moment to capture an image of the target position. In this way, by supplementing the triggering of the image acquisition component to capture an image of the target position at the second moment when it is determined that there are two connected products at the target position at the first moment, the situation of missing product image capture can be reduced. In addition, since the second moment is delayed by the target time length than the first moment, the image acquisition component can capture the image of the current product at the target position after the first moment captures the first image containing the previous product, and then delays the target time length, which can reduce the image information of the previous product in the picture of the current product image capture, thereby improving the accuracy of the current product image capture.

[0133] In some embodiments, the information processing component is further used to: send a second trigger signal to the image acquisition component at a second moment, and the second trigger signal is used to trigger the image acquisition component to acquire an image of the target position.

[0134] In some embodiments, the information processing component is further used to: count the number of times the second trigger signal is sent; and determine the number of first products missed by the detection component based on the number of times the second trigger signal is sent.

[0135] In some embodiments, the information processing system also includes a simulation component; the information processing component is also used to: control the simulation component to simulate the state of the product arriving at the target position at a second moment, so as to trigger the detection component to send a next first trigger signal to the image acquisition component; the image acquisition component is also used to: acquire an image of the target position in response to the next first trigger signal.

[0136] In some embodiments, the information processing component is further used to: count the number of times the first trigger signal is sent; and determine the number of second products detected in the production line based on the number of times the first trigger signal is sent.

[0137] In some embodiments, the size of the product matches the field of view size of the image acquisition component; the information processing component is also used to determine the target duration based on the conveying speed of the product in the production line and the size of the product.

[0138] In some embodiments, the information processing component is also used for at least one of the following: identifying the product label in the first image to obtain the label information of the product corresponding to the first moment; identifying the product label in the second image to obtain the label information of the product corresponding to the second moment, and the second image is obtained by the image acquisition component capturing the target position at the second moment.

[0139] In some embodiments, the information processing component is also used to: acquire a second image, where the second image is obtained by the image acquisition component when acquiring the target position at the second moment; determine whether there are two connected products at the target position at the second moment based on the second image; if there are two connected products at the target position at the second moment, trigger the image acquisition component to acquire an image of the target position at a third moment, and the third moment is delayed by the target time length compared to the second moment.

[0140] The present application embodiment provides an information processing device, such as Figure 8 As shown, the information processing device 80 includes an acquisition module 81, a first determination module 82 and a trigger module 83, wherein:

[0141] An acquisition module 81 is used to acquire a first image acquired by an image acquisition component at a first moment; the first image is acquired by the image acquisition component in response to a first trigger signal when acquiring an image of a target position in a production line, and the first trigger signal is sent when a detection component detects that a product has reached the target position;

[0142] A first determination module 82, configured to determine, based on the first image, whether there are two connected products at the target position at the first moment;

[0143] The trigger module 83 is used to trigger the image acquisition component to acquire an image of the target position at a second moment when there are two connected products at the target position at the first moment, and the second moment is delayed by a target time length than the first moment.

[0144] In some embodiments, the information processing device may be applied to the information processing component in the aforementioned embodiments.

[0145] In some embodiments, the trigger module is further used to: send a second trigger signal to the image acquisition component at a second moment, and the second trigger signal is used to trigger the image acquisition component to acquire an image of the target position.

[0146] In some embodiments, the device further includes: a first statistical module, configured to: count the number of times the second trigger signal is sent; and determine the number of first products missed by the detection component based on the number of times the second trigger signal is sent.

[0147] In some embodiments, the trigger module is also used to: control the simulation component to simulate the state of the product reaching the target position at a second moment, so as to trigger the detection component to send a next first trigger signal to the image acquisition component, so that the image acquisition component acquires an image of the target position in response to the next first trigger signal.

[0148] In some embodiments, the device further includes: a second statistical module, configured to: count the number of times the first trigger signal is sent; and determine the number of second products detected in the production line according to the number of times the first trigger signal is sent.

[0149] In some embodiments, the size of the product matches the field of view size of the image acquisition component; the device also includes: a second determination module, used to determine the target duration based on the conveying speed of the product in the production line and the size of the product.

[0150] In some embodiments, the device also includes: an identification module, used for at least one of: identifying the product label in the first image to obtain the label information of the product corresponding to the first moment; identifying the product label in the second image to obtain the label information of the product corresponding to the second moment, and the second image is obtained by the image acquisition component capturing the target position at the second moment.

[0151] In some embodiments, the acquisition module is also used to acquire a second image, which is obtained by the image acquisition component capturing the target position at the second moment; the first determination module is also used to determine whether there are two connected products at the target position at the second moment based on the second image; the trigger module is also used to trigger the image acquisition component to capture an image of the target position at a third moment when there are two connected products at the target position at the second moment, and the third moment is delayed by the target time length compared to the second moment.

[0152] The description of the above system embodiment and device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the system and device provided in the embodiment of the present application can be used to execute the method described in the above method embodiment. For technical details not disclosed in the processor embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0153] It should be noted that in the embodiment of the present application, if the above-mentioned information processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software, and firmware.

[0154] An embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and the processor implements the steps in the above-mentioned information processing method when executing the program.

[0155] The embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium can be transient or non-transient.

[0156] An embodiment of the present application provides a computer program, including a computer-readable code. When the computer-readable code is run in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0157] The embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, some or all of the steps in the above method are implemented. The computer program product can be implemented specifically by hardware, software or a combination thereof. In some embodiments, the computer program product is specifically embodied as a computer storage medium, and in other embodiments, the computer program product is specifically embodied as a software product, such as a software development kit (SDK) and the like.

[0158] An embodiment of the present application provides a computer program product, including a computer program or instructions, which, when executed by a processor, implements some or all of the steps in the above method.

[0159] It should be noted here that the description of the various embodiments above tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. The description of the above device, storage medium, computer program and computer program product embodiments is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the embodiments of the device, storage medium, computer program and computer program product of this application, please refer to the description of the method embodiment of this application for understanding.

[0160] It should be noted that Fig. 9 A schematic diagram of a hardware entity of a computer device in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the hardware entity of the computer device 900 includes: a processor 901, a communication interface 902 and a memory 903, wherein: the processor 901 generally controls the overall operation of the computer device 900. The communication interface 902 enables the computer device to communicate with other terminals or servers through a network.

[0161] The memory 903 is configured to store instructions and applications executable by the processor 901, and can also cache data to be processed or processed by the processor 901 and each module in the computer device 900 (for example, image data, audio data, voice communication data, and video communication data), which can be implemented by flash memory (FLASH) or random access memory (Random Access Memory, RAM). Data transmission between the processor 901, the communication interface 902 and the memory 903 can be carried out through the bus 904.

[0162] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the serial numbers of the above-mentioned steps / processes does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0163] It should be noted that, in this article, the term "include", "comprise" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes one..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0164] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, the functional units in the embodiments of the present application may be all integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0165] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0166] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0167] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. An information processing method, the method comprising: Acquire a first image acquired by the image acquisition component at a first moment; The first image is obtained by the image acquisition component acquiring an image of a target position in the production line in response to a first trigger signal, and the first trigger signal is sent when the detection component detects that the product has reached the target position; determining, according to the first image, whether there are two connected products at the target location at the first moment; In the case where there are two connected products at the target position at the first moment, the image acquisition component is triggered to acquire an image of the target position at the second moment, and the second moment is delayed by a target time length compared to the first moment.

2. The method according to claim 1, wherein triggering the image acquisition component to acquire an image of the target position at the second moment comprises: A second trigger signal is sent to the image acquisition component at a second moment, where the second trigger signal is used to trigger the image acquisition component to acquire an image of the target position.

3. The method according to claim 2, further comprising: Counting the number of times the second trigger signal is sent; The number of first products missed by the detection component is determined according to the number of times the second trigger signal is sent.

4. The method according to claim 1, wherein triggering the image acquisition component to acquire an image of the target position at the second moment comprises: At the second moment, the simulation component is controlled to simulate the state of the product reaching the target position, so as to trigger the detection component to send the next first trigger signal to the image acquisition component, so that the image acquisition component acquires an image of the target position in response to the next first trigger signal.

5. The method according to claim 4, further comprising: Counting the number of times the first trigger signal is sent; The number of second products detected in the production line is determined according to the number of times the first trigger signal is sent.

6. The method according to any one of claims 1 to 5, wherein the size of the product matches the field of view size of the image acquisition component; the method further comprising: The target duration is determined based on a conveying speed of the products in the production line and a size of the products.

7. The method according to any one of claims 1 to 5, further comprising at least one of the following: Identify the product label in the first image to obtain label information of the product corresponding to the first moment; The product label in the second image is identified to obtain label information of the product corresponding to the second moment, and the second image is obtained by the image acquisition component capturing the target position at the second moment.

8. The method according to any one of claims 1 to 5, further comprising: Acquire a second image, where the second image is obtained by the image acquisition component capturing the target position at the second moment; determining, according to the second image, whether there are two connected products at the target location at the second moment; In the case where there are two connected products at the target position at the second moment, the image acquisition component is triggered to acquire an image of the target position at a third moment, and the third moment is delayed by the target time length compared to the second moment.

9. An information processing system comprising: An image acquisition component, used for acquiring an image of a target position in the production line in response to a first trigger signal; a detection component, used for detecting whether the product on the production line has reached the target position, and sending the first trigger signal to the image acquisition component when the product has reached the target position; An information processing component, used to: acquire a first image acquired by the image acquisition component at a first moment, wherein the first image is acquired by the image acquisition component in response to the first trigger signal; Based on the first image, determine whether there are two connected products at the target position at the first moment; if there are two connected products at the target position at the first moment, trigger the image acquisition component to capture an image of the target position at a second moment, and the second moment is delayed by a target time length than the first moment.

10. An information processing device, comprising: An acquisition module, used to acquire a first image acquired by the image acquisition component at a first moment; The first image is obtained by the image acquisition component acquiring an image of a target position in the production line in response to a first trigger signal, and the first trigger signal is sent when the detection component detects that the product has reached the target position; A first determining module, configured to determine, based on the first image, whether there are two connected products at the target position at the first moment; A trigger module is used to trigger the image acquisition component to acquire an image of the target position at a second moment when there are two connected products at the target position at the first moment, and the second moment is delayed by a target time length compared to the first moment.

Images