Image acquisition control system and method, acquisition card, equipment, medium and product
By using transmission components, detection components, encoders and synchronization acquisition components in the image acquisition control system, and using pulse signals to control the shooting time and sequence of multiple cameras, the problem of difficult multi-camera synchronization in the prior art is solved, and high-precision and reliable image acquisition are achieved.
Patent Information
- Application Number
- CN202510102957.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-22
- Publication Date
- 2025-05-06
AI Technical Summary
The prior art is difficult to ensure that multiple cameras work simultaneously in complex industrial scenarios, resulting in difficult control of image acquisition accuracy and high error rate.
An image acquisition control system is proposed, including a transmission component, a detection component, an encoder and a synchronous acquisition component. Through the coordinated work of the first pulse signal and the second pulse signal, the shooting time and sequence of multiple cameras are accurately controlled to ensure that the material captured by the camera is the same material.
It realizes high-precision image acquisition and synchronous control in complex industrial scenarios, improves fault tolerance and control accuracy, and ensures the accuracy and reliability of material images.
Smart Images

Figure CN119946420A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer vision technology, and in particular to an image acquisition control system, method, acquisition card, device, medium and product. Background Art
[0002] With the development of science and technology, the application scenarios of industrial cameras in the field of modern industrial inspection and automation are becoming more and more extensive and complex. Many scenarios require the control of multiple cameras for simultaneous or phased inspection. For example, in material inspection, different cameras need to be triggered at different times to shoot materials. How to ensure that the materials shot are the same is the key to synchronization.
[0003] The traditional multi-camera synchronization method mainly triggers multiple cameras to expose at the same time by giving the camera a pulse signal. However, this synchronization method is difficult to control the accuracy when facing complex scenes and is prone to errors. Summary of the invention
[0004] The main purpose of this application is to propose an image acquisition control system, method, acquisition card, device, medium and product, aiming to solve the technical problem of being unable to ensure the synchronous operation of multiple cameras.
[0005] To achieve the above purpose, the present application proposes an image acquisition control system, comprising:
[0006] A conveying component for conveying materials;
[0007] A detection component is arranged corresponding to the position of the transmission component, and the detection component is used to output a first pulse signal when detecting a material;
[0008] An encoder, arranged corresponding to the position of the conveying component, for detecting the position of the material conveyed by the conveying component and outputting a corresponding second pulse signal;
[0009] A synchronous acquisition component is electrically connected to the detection component, the encoder and multiple cameras respectively, and is used to send a control signal to a corresponding camera among the multiple cameras according to the first pulse signal and the second pulse signal to control the operation of the corresponding camera.
[0010] In one embodiment, the synchronous acquisition component uses a trigger protocol to output a control signal; wherein the trigger protocol includes at least one of camera configuration information, a trigger signal, a frame number, and verification information.
[0011] In one embodiment, the trigger protocol specifically includes camera manufacturer information of a first preset byte, a camera number of a second preset byte, a trigger signal of a third preset byte, a frame number of a fourth preset byte, and verification information of a fifth preset byte.
[0012] In one embodiment, the synchronous acquisition component is used to determine the material sequence transmitted by the conveying component according to the first pulse signal, and determine the material position corresponding to the material sequence transmitted by the conveying component according to the second pulse signal, so as to send the control signal to the corresponding camera among the multiple cameras to control the corresponding camera to capture the material image corresponding to the material sequence.
[0013] In one embodiment, the synchronous acquisition component includes a synchronization module, and the synchronization module is used to determine the material sequence according to the number of received first pulse signals.
[0014] In one embodiment, the synchronization module includes a plurality of counters, each of which is used to count a received second pulse signal;
[0015] The synchronization module is also used to determine the number of materials that can be processed simultaneously by the synchronization acquisition component according to the number of the counters used.
[0016] In one embodiment, the material image is in frames, and the synchronous acquisition component also includes an image processing module, a cache module, and a storage module. The image processing module is used to perform image preprocessing on the material image, and the cache module is used to perform frame cache on the preprocessed material image, and store the frame cached material image in the storage module.
[0017] In one embodiment, the image acquisition control system further comprises a host computer, and the synchronous acquisition component is connected to the host computer;
[0018] The host computer is used to output a reminder signal when it is determined that the plurality of cameras are not working synchronously for the same material sequence;
[0019] The host computer is used to output a first signal to control the corresponding material to proceed to the next process when it is determined that the multiple cameras are working synchronously on the same material sequence and the materials in the corresponding material sequence are good products based on the material images transmitted by the multiple cameras.
[0020] In one embodiment, the image acquisition control system further includes a blowing component, which is arranged at a position corresponding to the conveying component and is used to blow the material on the conveying component;
[0021] The host computer is used to output a second signal when it is determined that the plurality of cameras are working synchronously for the same material sequence and when it is determined that the materials in the corresponding material sequence are non-conforming products according to the material images transmitted by the plurality of cameras;
[0022] The synchronous acquisition component is connected to the blowing component and is used to control the operation of the blowing component according to the second signal.
[0023] In addition, to achieve the above purpose, the present application also proposes an image acquisition control method, which is applied to the image acquisition control system as described above, and the image acquisition control method comprises the following steps:
[0024] Acquire a first pulse signal to determine a material sequence according to the first pulse signal;
[0025] Acquire a second pulse signal to determine a material position corresponding to the material sequence according to the second pulse signal;
[0026] The operation of corresponding cameras among the multiple cameras is controlled according to the material sequence and material position.
[0027] In one embodiment, before executing the step of controlling the operation of corresponding cameras among the plurality of cameras according to the material sequence and material position, the image acquisition control method further includes the following steps:
[0028] Determine camera configuration information of multiple connected cameras;
[0029] triggering the plurality of cameras according to a preset triggering protocol;
[0030] The trigger protocol includes at least one of camera configuration information, a trigger signal, a frame number, and verification information, and the frame number corresponds to the material sequence.
[0031] In one embodiment, after executing the step of controlling the operation of corresponding cameras among the plurality of cameras according to the material sequence and material position, the image acquisition control method further includes the following steps:
[0032] Acquire material images transmitted by multiple cameras;
[0033] The material image is pre-processed and then stored.
[0034] In one embodiment, after executing the step of pre-processing and storing the material image, the image acquisition control method further includes the following steps:
[0035] In response to the image reading instruction, the processed material images are output in the material sequence.
[0036] In addition, to achieve the above-mentioned purpose, the present application also proposes an acquisition card, including the synchronous acquisition component as described above, and the acquisition card is used to implement the image acquisition control method as described above.
[0037] In one embodiment, the acquisition card further includes:
[0038] Communication module, used to connect with the host computer;
[0039] A control interface, used to connect to multiple cameras and also used to receive camera configuration information;
[0040] The connection interface is used to electrically connect to at least one of the detection component, the encoder, and the blowing component.
[0041] In addition, to achieve the above-mentioned purpose, the present application also proposes an image acquisition control device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the image acquisition control method as described above.
[0042] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the image acquisition control method as described above are implemented.
[0043] In addition, to achieve the above-mentioned purpose, the present application also proposes a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the image acquisition control method described above are implemented.
[0044] Compared with the prior art, this application has the following beneficial effects:
[0045] Through the coordinated work of the transmission component, detection component, encoder and synchronous acquisition component, high-precision image acquisition and synchronous control are achieved in complex industrial scenarios. The first pulse signal of the detection component and the second pulse signal of the encoder provide accurate position feedback. The synchronous acquisition component controls multiple cameras according to these pulse signals to ensure that the corresponding cameras can be controlled to work when the material reaches the predetermined position, to ensure that the materials photographed by multiple cameras are the same material, and to ensure the accuracy and reliability of the obtained material images, thereby improving fault tolerance and control accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.
[0047] Figure 1 A module schematic diagram of an embodiment of the image acquisition control system provided by the present application;
[0048] Figure 2A schematic diagram of an embodiment of the trigger protocol provided by the present application;
[0049] Figure 3 A schematic diagram of an embodiment of the image acquisition control system provided by the present application;
[0050] Figure 4 A flowchart of an embodiment of the image acquisition control method provided by the present application;
[0051] Figure 5 One of the other partial flow charts of an embodiment of the image acquisition control method provided by the present application;
[0052] Figure 6 This is the second flowchart of the other part of an embodiment of the image acquisition control method provided by the present application.
[0053] Description of Figure Numbers:
[0054] 100. Detection components;
[0055] 200, encoder;
[0056] 300, synchronous acquisition component; 310, synchronization module; 320, image processing module; 330, cache module; 340, storage module; 341, DMA module; 342, DDR module;
[0057] 410, communication module; 420, control interface; 430, connection interface;
[0058] 500, host computer;
[0059] 600, Camera;
[0060] 700. Peripheral devices.
[0061] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0062] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0063] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components in a certain specific posture. If the specific posture changes, the directional indication will also change accordingly.
[0064] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features limited to "first" and "second" may explicitly or implicitly include at least one of the features. In addition, if "and / or" or "and / or" appears in the full text, its meaning includes three parallel schemes. Taking "A and / or B" as an example, it includes scheme A, or scheme B, or a scheme that satisfies both A and B. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in the field to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.
[0065] With the development of science and technology, in the field of modern industrial inspection and automation, the application scenarios of industrial cameras are becoming more and more extensive and complex. Many scenarios require image acquisition cards to control multiple cameras for simultaneous or phased inspection. Therefore, multi-camera synchronization technology is the key to ensuring high-precision, multi-angle image capture. For example, in material inspection, it is necessary to trigger different cameras for shooting different cross-sections of materials at different times, and to detect the material images taken by different cameras. How to ensure that the materials photographed by different cameras are the same material is the key to synchronization. In related technologies, a pulse signal is mainly given to the camera through external or software to trigger multiple cameras to expose at the same time. However, this synchronization method is difficult to control in terms of accuracy in the face of complex scenes, and when the camera loses frames, there is no fault tolerance mechanism, which will lead to an increase in the error rate of subsequent processing.
[0066] In order to solve the technical problem that the related technology cannot ensure the synchronous operation of multiple cameras, refer to Figures 1 to 6 This application proposes an image acquisition control system, method, acquisition card, device, medium and product, wherein the method is mainly an image acquisition control method, the device is mainly an image acquisition control device, the medium is mainly a computer-readable storage medium, and the product is mainly a computer program product.
[0067] In the present application, the image acquisition control system includes a transmission component, a detection component 100 , an encoder 200 and a synchronous acquisition component 300 .
[0068] The transmission component is used to transmit materials. The detection component 100 is set corresponding to the position of the transmission component, and the detection component 100 is used to output a first pulse signal when detecting materials; the encoder 200 is set corresponding to the position of the transmission component, and is used to detect the position of the material transmitted by the transmission component and output a corresponding second pulse signal.
[0069] The synchronous acquisition component 300 is electrically connected to the detection component 100, the encoder 200 and multiple cameras 600 respectively. The synchronous acquisition component 300 is used to send a control signal to the corresponding camera 600 among the multiple cameras 600 according to the first pulse signal and the second pulse signal to control the corresponding camera 600 to work.
[0070] Multiple cameras 600 can be connected to the synchronous acquisition component through the high-speed control interface 420. In the image acquisition control system, the synchronous acquisition component 300 configures the camera and realizes the software and hardware triggering of the camera through the control interface 420. The received material image is then processed by the image processing module for some ISP (Image Signal Processing) or image storage. The synchronous acquisition component 300 is responsible for receiving pulse signals from the detection component 100 and the encoder 200, and sending control signals to multiple cameras 600 based on these signals. These control signals are used to trigger the camera 600 to acquire images, ensuring that all cameras 600 shoot the same material at the right time, thereby achieving synchronous operation of multiple cameras 600. The synchronous acquisition component 300 provides precise time control and synchronization mechanisms, which are essential for high-precision, multi-angle image acquisition and subsequent image processing.
[0071] Multiple cameras 600 can be set at different positions of the conveyor assembly according to actual needs, such as different sides or top surfaces, to shoot different directions of the material. The number of cameras 600 can be set to two, three, four or more as needed to obtain multi-angle images of the material to help determine whether the material is good.
[0072] The transmission component is used to transmit materials from one location to another, ensuring that the detection component 100, the encoder 200 and the camera 600 can detect, encode and capture images when the material passes. The transmission component can be a conveyor belt, a roller, a chain, etc., and the specific selection depends on the material characteristics and the application scenario. The detection component 100 is usually composed of one or more sensors, such as a photoelectric sensor, an infrared sensor or a laser sensor, for detecting materials. These sensors include a transmitter, a receiver, and a detection circuit. When the material passes, it blocks or reflects the light beam. The detection circuit generates a first pulse signal, which is used to trigger subsequent acquisition actions to ensure that the synchronous acquisition component 300 triggers the camera 600 to shoot at the right time. The encoder 200 is used to output a corresponding second pulse signal to determine the specific position of the material on the transmission component. The encoder 200 is relatively fixed to the detection component 100. The synchronous acquisition component 300 controls its internal counter to start timing according to the first pulse signal, and obtains the material position information according to the second pulse signal sent by the encoder 200. The encoder 200 provides the system with accurate information about the material position, so that the synchronous acquisition component 300 can trigger the camera 600 to shoot according to the material position, thereby realizing synchronization of multiple cameras 600. The positions between the multiple cameras 600 are relatively fixed, and the multiple cameras 600 arranged along the transmission component can be controlled to work in sequence according to the received first pulse signal and the subsequently received second pulse signal (or the multiple cameras 600 arranged on the transmission component corresponding to different shooting directions can be controlled to work synchronously).
[0073] In some specific embodiments, when the multiple cameras 600 include four cameras, namely, camera 1, camera 2, camera 3, and camera 4, if the multiple cameras 600 are arranged in sequence along the conveying component from the feed end to the discharge end of the conveying component, the position of the corresponding material can be determined based on the first pulse signal received and the second pulse signal received subsequently, and the cameras 1, camera 2, camera 3, and camera 4 can be controlled to work in sequence; if the multiple cameras 600 are adjacently arranged corresponding to different shooting directions, the position of the corresponding material can be determined based on the first pulse signal received and the second pulse signal received subsequently, and the cameras 1, camera 2, camera 3, and camera 4 can be controlled to work at the same time; the specific details can be determined according to the actual settings and are not limited here.
[0074] Through the coordinated work of the transmission component, the detection component 100, the encoder 200 and the synchronous acquisition component 300, high-precision image acquisition and synchronous control are achieved in complex industrial scenarios. The first pulse signal of the detection component 100 and the second pulse signal of the encoder 200 provide accurate position feedback. The synchronous acquisition component 300 controls multiple cameras 600 according to these pulse signals to ensure that the corresponding camera 600 can be controlled to work when the material reaches the predetermined position, to ensure that the material photographed by the multiple cameras 600 is the same material, and to ensure the accuracy and reliability of the obtained material image, thereby improving fault tolerance and control accuracy.
[0075] In the related art, the method applied to the synchronization acquisition component 300 such as the acquisition card has many challenges when facing complex scenes: the hardware trigger is difficult to ensure that multiple cameras corresponding to the same material work synchronously when triggering different cameras in stages, and the flexibility is poor; the software trigger is limited by the operating system and communication delays, resulting in low control accuracy; the pulse or timestamp synchronization method cannot guarantee the subsequent synchronization of multiple cameras when the camera has a frame loss error.
[0076] In order to avoid the risk of errors caused by camera frame loss and improve fault tolerance and control accuracy, refer to Figure 2 In one embodiment, the synchronous acquisition component 300 uses a trigger protocol to output a control signal.
[0077] Furthermore, the trigger protocol includes at least one of camera configuration information, a trigger signal, a frame number, and verification information.
[0078] By triggering multiple cameras in stages in complex scenes and synchronizing them through encoders, higher camera control accuracy can be ensured. The trigger is not a single pulse, but a protocol trigger. Even if there is an occasional loss of trigger signal or frame loss, it will not affect the subsequent multi-camera synchronization, and the fault tolerance performance is greatly improved.
[0079] The trigger protocol serves as a bridge for communication between the synchronous acquisition component 300 and the camera 600, and includes camera configuration information (such as camera manufacturer information, camera number, etc.), trigger signal, frame number and verification information. The configuration information can be used to determine the connected camera 600 and control its operation. The trigger signal indicates the moment when the camera 600 starts shooting to start image acquisition. The frame number is used to identify the order of material images, which helps the system distinguish different image frames for subsequent management. The verification information ensures the integrity and accuracy of the control signal. By calculating and comparing the verification information, the system can detect and correct errors in the transmission process and realize the connection between the system and the camera.
[0080] As some optional embodiments of the present application, when the trigger protocol includes camera configuration information (including camera manufacturer information, camera number), trigger signal, frame number and verification information, the trigger protocol specifically includes the camera manufacturer information of the first preset byte, the camera number of the second preset byte, the trigger signal of the third preset byte, the frame number of the fourth preset byte and the verification information of the fifth preset byte. For example, the trigger protocol specifically includes 1 byte of camera manufacturer information, 2 bytes of camera number, 1 byte of trigger signal, 4 bytes of frame number and 1 byte of verification information, etc. It is used to control the startup of multiple cameras 600 through the trigger protocol when it is necessary to control the startup of multiple cameras 600, and in each subsequent control, output a control signal in a manner such as changing the frame number in the corresponding material order to control the operation of the corresponding camera 600 in the multiple cameras 600; the specific settings can be based on the actual settings and are not limited here. The trigger protocol is sent through the serial port, and finally the calibration information such as the check bit CRC (Cyclic Redundancy Check) is used for verification. After receiving the trigger information, the camera will first verify the CRC information. If the verification is wrong, the image will not be captured. If it is correct, the trigger information will be superimposed on the first few bytes of the first line of the material image and sent to the host computer. After the host computer captures all the material images, it will compare the frame numbers. If the frame numbers are the same, an algorithm will be used to determine whether the corresponding material is a good product. If the frame numbers are different, it means that the camera has lost frames. The corresponding materials that are determined to have lost frames will be collected (or recorded) for subsequent secondary inspection.
[0081] Different from the related art, the synchronous acquisition component 300 of the present application adopts a trigger protocol to output a control signal, and controls multiple cameras 600 to achieve synchronous operation corresponding to the same material according to the first pulse signal, the second pulse signal and the trigger protocol. This method avoids the risk of frame loss of the camera 600 that may be caused by pulse or time control, and improves fault tolerance and control accuracy. At the same time, it ensures that the material photographed by different cameras 600 is the same, and achieves synchronous control while ensuring the accuracy and reliability of data such as material images. The addition of verification information further ensures the accuracy and reliability of the control signal. In this way, the problem of being unable to achieve synchronous control of multiple cameras 600 in the face of complex scenes is effectively solved, and strong support is provided for obtaining high-quality, multi-angle material images and other image data.
[0082] In one embodiment, the synchronous acquisition component 300 is specifically used to determine the material sequence transmitted by the transmission component according to the first pulse signal, and then determine the material position corresponding to the material sequence transmitted by the transmission component according to the second pulse signal, so as to send a control signal to the corresponding camera 600 among the multiple cameras 600, and control the corresponding camera 600 to capture the material image corresponding to the material sequence.
[0083] By using the first pulse signal and the second pulse signal, the synchronous acquisition component 300 can accurately track the position and order of the materials transmitted on the transmission component. When the material passes through the transmission component, the detection component 100 (such as a photoelectric sensor) detects the presence of the material and outputs a first pulse signal. After receiving this signal, the synchronous acquisition component 300 determines the order of the materials on the transmission component, that is, the order of the materials. At the same time, the encoder 200 is installed on the transmission component and outputs a second pulse signal as the transmission component moves. Optionally, the synchronous acquisition component 300 can trigger the encoder 200 to start working according to the first (or each) first pulse signal received. The encoder 200 detects the position of the material on the transmission component and outputs a second pulse signal. The synchronous acquisition component 300 determines the specific position of the material on the transmission component based on the count, thereby ensuring that the camera 600 can take pictures when the material reaches the predetermined position.
[0084] The synchronous acquisition component 300 sends a control signal including camera configuration information, a trigger signal, a frame number and verification information to multiple cameras 600 through a trigger protocol according to the order and position information of the materials. After receiving these control signals, the camera 600 starts shooting under the instruction of the trigger signal. After the shooting is completed, the camera 600 associates the image data such as the material image with the position and order information of the material through the image processing module 320, the storage module 340, etc., and transmits the material image with the frame number to the host computer 500 or other terminal devices. The host computer 500 or other terminal devices sort and verify the material images according to the frame number and verification information to ensure the accuracy and reliability of the image data.
[0085] In this way, the system can control the multiple cameras 600 set along the conveying component to work in sequence according to the corresponding material (or control the multiple cameras 600 set on the conveying component corresponding to different shooting directions to work synchronously), ensuring that the multiple cameras 600 maintain a high degree of synchronization when shooting the same material, thereby avoiding image inconsistency problems caused by image misalignment or time delay. Since the synchronous acquisition component 300 can dynamically adjust the shooting time and sequence of the camera 600 according to the pulse signal, the system can easily adapt to different numbers of cameras 600 and different material conveying speeds.
[0086] Reference Figure 1 In one embodiment, the synchronous acquisition component 300 includes a synchronization module 310, and the synchronization module 310 is used to determine the material sequence according to the number of received first pulse signals.
[0087] The synchronization module 310 may include at least one of a field programmable gate array (FPGA), a programmable logic controller (PLC), a microcontroller (such as STM32), or a combination of these technologies and other technologies. The main function of the synchronization module 310 is to receive the first pulse signal and record the order of the materials according to the order of these signals. Specifically, the first received first pulse signal corresponds to the first material, the second corresponds to the second material, and so on.
[0088] The synchronization module 310 not only determines the order of the materials according to the number of the first pulse signals received, but also combines the second pulse signals to accurately track the position of the materials on the conveying component. By calculating the cumulative number of pulse signals, time intervals, etc., it is possible to ensure that the camera 600 triggers the shooting operation when the materials arrive at the predetermined position (or at a specific time when the materials are conveyed).
[0089] The synchronization module 310 sends control signals to multiple cameras 600 through a trigger protocol based on the order and location information of the materials, ensuring that the cameras 600 take pictures when the materials arrive at a predetermined location or are delivered at a specific time. In this way, not only is a high degree of synchronization ensured when multiple cameras 600 take pictures of the same material, but also image inconsistency problems caused by image misalignment or time delay are avoided. The synchronization module 310 has the ability to dynamically adjust the shooting time and order of the cameras 600, allowing the system to easily adapt to different numbers of cameras 600 and different material delivery speeds. This flexibility significantly improves the versatility and adaptability of the system.
[0090] It should be noted that, without limiting the present application, the synchronous acquisition component 300 may be specifically configured to include a communication module 410, a control interface 420, and a connection interface 430, wherein: the communication module 410 is used to connect to the host computer 500; the control interface 420 is used to connect to multiple cameras 600, to trigger the camera to take pictures, configure camera information, and also to receive images taken by the camera; in addition, when input devices such as keyboards, control buttons, touch screens, and mice, or host computers and other terminal devices are connected to the camera through the synchronous acquisition component, the camera configuration information can also be directly input and changed through these input devices and terminal devices. The connection interface 430 is used to be electrically connected to at least one of the detection component 100, the encoder 200, and the peripheral device 700 (such as a blowing component such as an air valve or other peripheral devices). The synchronization module 310 plays a control and interaction role, and is used to connect to the camera 600 through the control interface 420, to the host computer 500 through the communication module 410, and to the detection component 100, the encoder 200, the peripheral device 700, etc. through the connection interface 430; the specific settings can be based on actual conditions and are not limited here.
[0091] In one embodiment, the synchronization module 310 includes a plurality of counters, each counter being used to count a received second pulse signal. The synchronization module 310 is also used to determine the number of materials that can be processed simultaneously by the synchronization acquisition component according to the number of counters used.
[0092] When the detection component 100 detects the material and outputs the first pulse signal, the synchronization module 310 activates a counter according to the sequence of the first pulse signal. At the same time, the encoder 200 outputs the second pulse signal as the transmission component moves, and these pulse signals are used to represent the displacement or time interval of the material.
[0093] Each counter independently accumulates and counts the received second pulse signal, and by calculating the number of pulses or the time interval, the synchronization module 310 can determine the precise position of each material. Specifically, each counter records the number of pulses generated when the material passes through the encoder 200, thereby reflecting the position and movement state of the material. Since each material triggers a certain number of pulses, each counter actually represents the position and movement state of a material.
[0094] The synchronization module 310 also determines the number of materials that can be processed simultaneously by the synchronization acquisition component according to the number of counters used. For example, if the synchronization module 310 includes 512 counters, 512 material positions can be tracked simultaneously. By monitoring the data of the counters in real time, the synchronization module 310 can dynamically adjust the working time, working order and other parameters of the multiple cameras 600 to ensure that the corresponding cameras 600 take pictures when the materials arrive at the predetermined positions.
[0095] It should be noted that when the counter completes a cycle, it can be reset to prepare for the next cycle. The specific cycle can be determined according to the number of materials that the synchronous acquisition component can process simultaneously. After completing the tracking of all materials on the conveyor component, the next unused counter can be directly used as the start of the next cycle. This process can be flexibly set according to actual needs and is not limited.
[0096] Reference Figure 3 , the synchronization module 310 and the workflow for each material include the following steps:
[0097] The material passes through the photoelectric sensor or other detection component 100, and the photoelectric sensor or other detection component 100 sends a first pulse signal; the synchronization module 310 obtains the first pulse signal transmitted by the photoelectric sensor, and the counter of the synchronization module 310 starts to record the number of pulses of the encoder 200. The counter sends a trigger protocol to each camera according to the number of second pulse signals fed back by the encoder 200 and the camera position information.
[0098] The material images taken by different cameras at various angles are transmitted to the host computer. The host computer determines whether the current material is qualified according to the algorithm (used to determine whether the material is OK and further determine whether the material is good):
[0099] If the material is determined to be unqualified (or the material is NG, or the material is not a good product), the counter controls the peripheral device to take action (such as air valve blowing, etc.) at the appropriate position according to the information given by the host computer and the number of pulses to remove the unqualified material.
[0100] If the material is determined to be qualified (or the material is OK, the material is a good product), the corresponding material is controlled to enter the next process, and the counter is cleared after it passes the last peripheral position (or after the synchronous acquisition component completes the processing of all materials that can be processed simultaneously) for the next cycle.
[0101] Reference Figure 1 In one embodiment, the material image is in frames, and the synchronous acquisition component 300 also includes an image processing module 320, a cache module 330, and a storage module 340. The image processing module 320 is used to perform image preprocessing on the material image, and the cache module 330 is used to perform frame cache on the preprocessed material image, and store the frame cached material image in the storage module 340.
[0102] The image processing module 320 is used to pre-process the original material image taken by the camera 600. The pre-processing may include operations such as image enhancement, noise removal, image cropping, format conversion, or other related processing. The pre-processed material image is output in frames, aiming to improve image quality, reduce the complexity of subsequent processing, and prepare for subsequent caching and storage. The cache module 330 is mainly a Framebuffer module, which caches the pre-processed material image in the order of shooting to form a temporary image queue. This process ensures that each image can be processed and stored correctly, and at the same time provides a time buffer for subsequent image analysis, making up for the difference between image processing speed and storage speed, thereby improving the overall efficiency of the system. In order to achieve long-term preservation of image data for subsequent data management and analysis, the image data in the cache module 330 is written to the storage module 340 (such as a DDR module, etc.). When the host computer 500 or other terminal devices are connected to the synchronous acquisition component 300 through the communication module 410, etc., the material image and related data after frame buffering stored in the storage module 340 can be directly obtained.
[0103] Optionally, the storage module 340 includes a DMA module 341 and a DDR module 342. The DMA module 341 is used to efficiently transfer image data from the cache module 330 to the DDR module 342 to improve data transmission efficiency; the DDR module 342 is used to store processed image data to ensure fast reading and writing of image data. The cache module 330 will control the material image after frame caching to be written into the DDR module 342 through the DMA module 341 after completing the frame caching, effectively alleviating the problem of image reading tearing or jamming.
[0104] Through the coordinated work of the image processing module 320, the cache module 330 and the storage module 340, the system not only improves the quality and processing efficiency of image data, but also enhances the reliability and adaptability of the system. This enables the system to better cope with the high-precision image acquisition requirements in complex industrial scenes and ensure the accuracy and integrity of image data.
[0105] Reference Figure 1 In one embodiment, the image acquisition control system further includes a host computer 500, and the synchronous acquisition component 300 is connected to the host computer 500:
[0106] The host computer 500 is used to output a reminder signal when it is determined that the multiple cameras 600 are not working synchronously for the same material sequence; when it is determined that the multiple cameras 600 are working synchronously for the same material sequence, and the materials in the corresponding material sequence are determined to be good products based on the material images transmitted by the multiple cameras 600, the host computer 500 is used to output a first signal to control the corresponding materials to proceed to the next process. The host computer 500 is also used to output a second signal when it is determined that the multiple cameras 600 are working synchronously for the same material sequence, and the materials in the corresponding material sequence are determined to be non-good products based on the material images transmitted by the multiple cameras 600.
[0107] The synchronous acquisition component is connected to the terminal device such as the host computer through the communication interface such as the PCIE (Peripheral Component Interconnect Express) interface, and the host computer 500 performs read and write operations on the DDR module through XDMA (eXtended Direct Memory Access). The host computer 500 can optionally determine whether multiple cameras 600 have synchronized the same material sequence through information such as frame numbers: when the material image frame numbers of multiple cameras 600 are the same, the host computer 500 determines that the camera 600 has synchronized the same material sequence; conversely, when the frame numbers are different, it is determined that the camera 600 is not synchronized, and the camera 600 has a frame loss error. When it is determined that the camera 600 is not synchronized, the host computer 500 marks these materials as pending materials and outputs a reminder signal to notify the operator to perform a secondary inspection or trigger other alarm mechanisms.
[0108] When it is determined that the cameras 600 have been working synchronously on the same material, the host computer 500 further analyzes the material images to detect the material quality and determine whether the material is good. To this end, the host computer 500 presets an image processing algorithm and a machine learning model to identify material features and defects in the image and determine whether the material is good according to the preset quality standards.
[0109] The system can automatically detect the material quality and control the material flow direction by automatically judging whether the material needs secondary inspection and whether it is a good product through the host computer 500. This not only reduces manual intervention and speeds up production, but also reduces misjudgments caused by the camera 600 not being able to detect synchronously, and improves the reliability and stability of the inspection. In addition, this method can also reduce subsequent production interruptions and product quality problems caused by material failures or quality problems to a certain extent.
[0110] Reference Figure 1 In one embodiment, the image acquisition control system further includes an external device 700. These external devices 700 are used for subsequent processing of materials. The specific configuration of these external devices 700 can be flexibly set according to actual needs. For example, a blowing component such as an air valve can be configured to perform blowing processing; or a mechanical arm can be configured to sort and process according to the detection results; or, multiple (such as two, three or other numbers) discharge stations are set at the discharge end of the conveying component to classify the materials according to the detection results. When multiple cameras 600 do not work synchronously for the same material sequence, the material will be regarded as pending material and sent to a specific discharge station (such as when there are three discharge stations, one is used to discharge pending materials, another is used to discharge good products, and another is used to discharge non-good products). In addition, a marking component for realizing spray marking can also be configured to mark pending materials or non-good products for subsequent processing. The specific configuration and use of the external device 700 can be flexibly adjusted according to actual conditions and are not limited here.
[0111] This application is mainly explained by taking the example of the peripheral device 700 including the blowing components such as the air valve: the blowing component is set at the position corresponding to the conveying component, and is used to blow the material on the conveying component; the host computer 500 is used to output a second signal when it is determined that multiple cameras 600 are working synchronously for the same material sequence, and the materials in the corresponding material sequence are determined to be non-conforming products based on the material images transmitted by the multiple cameras 600. The synchronous acquisition component 300 is connected to the blowing component, and is used to control the operation of the blowing component according to the second signal. Blowing components such as air valves generate sufficient airflow to blow away materials detected as non-conforming products to prevent them from entering the subsequent process, thereby reducing production interruptions and rework. This automated processing method does not require manual intervention, which not only improves production efficiency, but also reduces quality problems caused by improper manual processing.
[0112] The specific implementation of the image acquisition control system of this application is as follows:
[0113] Photoelectric sensors and other detection components are used to detect materials. The synchronization module 310 counts the number of materials internally and serves as the starting point for the encoder 200 to count. The encoder 200 is used to generate an accurate second pulse signal, which is transmitted to the synchronization module 310 through a connection interface such as an I / O interface. The synchronization module 310 integrates 512 or more pulse counters internally, and multiple counters are used to cyclically and independently record the position information of each material. At the same time, the synchronization module 310 also sends a trigger protocol to the corresponding camera and controls the camera exposure work when it is determined that the material has reached a fixed position corresponding to the count value based on the count value. The count value can be set in advance by the host computer.
[0114] The acquisition card of the present application can be connected to n cameras (n is a positive integer not less than 2). The synchronous acquisition component 300 configures the camera through the control interface and realizes the software and hardware triggering of the camera. The received material image is subjected to some ISP processing or image storage processing in the image processing module 320. The cache module 330 is specifically a Framebuffer (frame buffer) module. The cache module 330 will control the material image after frame buffering and write the frame buffered material image into the DDR module through the DMA module, effectively alleviating the problem of image tearing or jamming when reading out the image. The communication interface for communicating with the host computer or other terminal devices can optionally use a PCIE interface, and the host computer reads and writes DDR through XDMA.
[0115] When all cameras have finished taking pictures, they are transmitted to the host computer or other terminal devices. The host computer or other terminal devices perform algorithm calculations on the material images obtained from all cameras to determine whether the material is good or not, and give an OK signal or other signals to determine that the material is good when the corresponding material is good, and give an NG signal or other signals to determine that the material is not good when the corresponding material is not good. When the corresponding material is not good, a second signal is output to the synchronization module 310 to tell the synchronization module 310 that the material corresponding to the current counter needs to operate the peripheral device (such as air valve blowing, etc.). After a cycle, the counter is reset to prepare for the next cycle.
[0116] Reference Figures 1 to 6 The present application also proposes an image acquisition control method, which is applied to the above image acquisition control system. The image acquisition control method includes the following steps:
[0117] Step S100: Acquire a first pulse signal to determine a material sequence according to the first pulse signal.
[0118] The first pulse signal is generated by the detection component 100 (such as a photoelectric sensor, an infrared sensor or a laser sensor). When the material enters the detection area of the conveyor component, the detection component 100 detects the presence of the material and outputs a pulse signal. The first pulse signal provides the system with the time sequence of the material entering the detection area, ensuring that the system can track the order of each material.
[0119] Step S200: Acquire a second pulse signal to determine a material position corresponding to the material sequence according to the second pulse signal.
[0120] The second pulse signal is generated by the encoder 200, and the second pulse signal is output as the conveying component moves, providing the system with accurate position information of the material, ensuring that the camera 600 can take pictures when the material reaches the predetermined position.
[0121] Step S300: controlling the operation of corresponding cameras among the plurality of cameras according to the material sequence and material position.
[0122] The synchronous acquisition component 300 is used to obtain the first pulse signal transmitted by the detection component 100 and the second pulse signal transmitted by the encoder 200. By combining the first pulse signal and the second pulse signal, the synchronous acquisition component 300 can accurately determine the position and order of the materials on the conveying component, and control the corresponding camera 600 in the multiple cameras 600 to work according to the material sequence and position information. In this way, it can be ensured that the camera 600 can take pictures when the corresponding material reaches the predetermined position, thereby realizing high-precision, multi-angle synchronous image acquisition.
[0123] The image acquisition control method of the present application is applied to the above-mentioned image acquisition control system. The specific implementation method of the image acquisition control system refers to the above-mentioned embodiment. Since the image acquisition control method adopts all the technical solutions of all the above-mentioned embodiments, it has at least all the beneficial effects brought by the technical solutions of the above-mentioned embodiments, which will not be described one by one here.
[0124] Reference Figure 5 In one embodiment, before executing the step of controlling the operation of corresponding cameras in the plurality of cameras according to the material sequence and material position in step S300, the image acquisition control method further includes the following steps:
[0125] Step S410: determining camera configuration information of multiple connected cameras;
[0126] Step S420, triggering multiple cameras according to a preset triggering protocol;
[0127] The trigger protocol includes at least one of camera configuration information, trigger signal, frame number, and verification information, and the frame number corresponds to the material sequence.
[0128] The control interface 420 of the synchronous acquisition component is used to connect to multiple cameras 600, and is used to trigger the camera to take pictures, configure camera information, and receive images taken by the camera through the control interface 420; in addition, when input devices such as keyboards, control buttons, touch screens, mice, or host computers and other terminal devices are connected to the cameras through the synchronous acquisition component, the camera configuration information can also be directly input and changed through these input devices and terminal devices; the camera configuration information for different application scenarios may be different, and the specific configuration may be based on the actual configuration and is not limited here.
[0129] The trigger protocol is used to output the control signal, and multiple cameras 600 are controlled to work synchronously with the same material according to the first pulse signal, the second pulse signal and the trigger protocol. This method avoids the risk of frame loss of the camera 600 that may be caused by traditional pulse or time control, and improves fault tolerance and control accuracy. At the same time, it ensures that different cameras 600 shoot the same material, realizes synchronous control and ensures the accuracy and reliability of image data.
[0130] After receiving the control signal, the camera 600 starts shooting under the instruction of the trigger signal. After shooting, the camera 600 associates the image data such as the material image with the position and sequence information of the material through the image processing module 320 and the storage module 340 (such as the DMA module 341 and the DDR module 342), and transmits the material image with the frame number to the host computer 500 or other terminal devices. The host computer 500 or other terminal devices sorts and verifies the material image according to the frame number and verification information to ensure the accuracy and reliability of the image data.
[0131] Reference Figure 6 In one embodiment, after executing step S300, the step of controlling the operation of corresponding cameras in the plurality of cameras according to the material sequence and the material position, the image acquisition control method further includes the following steps:
[0132] Step S510, acquiring material images transmitted by multiple cameras;
[0133] Step S520: pre-process the material image and then store it.
[0134] The synchronous acquisition component 300 includes a synchronization module 310, an image processing module 320, a cache module 330 and a storage module 340 (including DMA and DDR). In the image acquisition control system, multiple cameras 600 take material images according to the control signal of the synchronization module 310 and transmit them to the image processing module 320 for preprocessing. The preprocessing is to improve the image quality and simplify the subsequent processing. The preprocessed material image is frame cached by the cache module 330 and then output to the storage module 340 (DMA module 341 and DDR module 342).
[0135] In one embodiment, after executing step S520, the step of pre-processing and storing the material image, the image acquisition control method further includes the following steps:
[0136] In response to the image reading instruction, the processed material images are output in the material sequence.
[0137] After receiving the instruction, the system will retrieve the corresponding material image and other related information in the storage module 340 according to the information in the instruction. Since the material images have been sorted according to the material order when stored (such as determining the material order when controlling the synchronous shooting according to the first pulse signal and the second pulse signal), the system can easily find and extract the required material images and other related information according to the material order.
[0138] In this way, the host computer 500 or other terminal device can use information such as frame numbers to determine whether multiple cameras 600 have synchronized the same material sequence. When it is determined that the cameras 600 have synchronized the same material, the system further analyzes the material images to detect the material quality and determine whether the material is good.
[0139] The present application also proposes an acquisition card, including the above synchronous acquisition component 300, and the acquisition card is used to implement the above image acquisition control method. The acquisition card can be a hardware device for converting external signals (such as images, videos, audio, etc.) into digital signals and transmitting them to a host computer or other processing devices. The specific structure of the synchronous acquisition component 300 and the specific steps of the image acquisition control method refer to the above embodiments. Since the acquisition card adopts all the technical solutions of all the above embodiments, it has at least all the beneficial effects brought by the technical solutions of the above embodiments, which will not be repeated here.
[0140] In one embodiment, the acquisition card further includes a communication module 410, a control interface 420 and a connection interface 430, wherein:
[0141] The communication module 410 is used to connect to the host computer 500; the communication module 410 may include an XDMA module, a PCIE interface, a USB interface or other communication devices suitable for connecting to the host computer (such as a computer).
[0142] The control interface 420 is used to connect to multiple cameras 600 and also to receive camera configuration information. Specifically, the control interface 420 is used to connect to multiple cameras 600, to trigger the camera to take pictures, configure camera information, and to receive images taken by the camera; in addition, when input devices such as keyboards, control buttons, touch screens, and mice, or host computers and other terminal devices are connected to the cameras through synchronous acquisition components, the camera configuration information can also be directly input and changed through these input devices and terminal devices. The control interface can be an I2C (Inter-Integrated Circuit) interface, an SPI (Serial Peripheral Interface) interface, a GPIO (General Purpose Input / Output) general input and output interface, etc.
[0143] The connection interface 430 is used to electrically connect to at least one of the detection component 100, the encoder 200, the blowing component or other peripheral devices 700. The connection interface can be an I / O interface, an analog input interface or a digital input / output interface.
[0144] Through the coordinated work of these interfaces, the acquisition card ensures efficient operation of the system and accurate transmission of data.
[0145] This application can accurately synchronize multiple cameras to capture images simultaneously or sequentially, and through an independently designed trigger protocol, it greatly improves the fault tolerance performance of the acquisition card system, and has high application value in complex industrial detection and automation scenarios.
[0146] The image acquisition control device includes at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the image acquisition control method in the above-mentioned embodiment. The image acquisition control device in the embodiment of the present application may include but is not limited to a field programmable gate array such as an FPGA (Field-Programmable Gate Array), a digital signal processor such as a DSP (Digital Signal Processor), and an application-specific integrated circuit such as an ASIC (Application-Specific Integrated Circuit). The computer device such as the image acquisition control device shown in the present application is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0147] Computer devices such as image acquisition control devices may include control components such as processing devices (such as central processing units, graphics processing units, etc.), which can perform various appropriate actions and processes according to programs stored in read-only memory (ROM) or programs loaded from storage devices into random access memory (RAM). In RAM, various programs and data required for the operation of the computer device are also stored. The processing device, ROM, and RAM are connected to each other through a bus. The input / output (I / O) interface is also connected to the bus. Generally, the following systems can be connected to the I / O interface: input devices such as touch screens, touch pads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices such as liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices such as magnetic tapes, hard disks, etc.; and communication devices. The communication device can allow the computer device to communicate with other devices wirelessly or by wire to exchange data.
[0148] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.
[0149] The image acquisition control device provided by the present application adopts the image acquisition control method in the above embodiment to solve the technical problem that multiple cameras cannot work synchronously. Compared with the prior art, the beneficial effects of the computer device provided by the present application are the same as the beneficial effects of the image acquisition control method provided by the above embodiment, and the other technical features in the computer device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.
[0150] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.
[0151] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
[0152] The present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the image acquisition control method in the above embodiment are implemented.
[0153] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.
[0154] The computer-readable storage medium may be included in the computer device; or it may exist independently without being installed in the computer device. The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the computer device, the computer device: obtains a first pulse signal to determine the material sequence according to the first pulse signal; obtains a second pulse signal to determine the material position corresponding to the material sequence according to the second pulse signal; and controls the operation of corresponding cameras among the multiple cameras according to the material sequence and the material position.
[0155] The computer program code for performing the operation of the present application can be written in one or more programming languages or a combination thereof, and the above-mentioned programming languages include such as Verilog, VHDL, and System Verilog. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on the remote computer, or completely on the remote computer or server. The host computer design language can use Java, C++, etc. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).
[0156] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0157] The modules involved in the embodiments of the present application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.
[0158] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned image acquisition control method, and is used to solve the technical problem that it is impossible to ensure that multiple cameras work synchronously. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the image acquisition control method provided by the above-mentioned embodiment, and will not be repeated here.
[0159] The embodiment of the present application also provides a computer program product, including a computer program, which implements the steps of the image acquisition control method of the above embodiment when the computer program is executed by a processor.
[0160] The computer program product provided in this application is used to solve the technical problem that it is impossible to ensure that multiple cameras work synchronously. Compared with the prior art, the beneficial effects of the computer program product provided in the embodiment of this application are the same as the beneficial effects of the image acquisition control method provided in the above embodiment, which will not be repeated here.
[0161] The above description is only an exemplary embodiment of the present application and does not limit the patent scope of the present application. All equivalent structural changes made by using the contents of the present application specification and drawings under the technical concept of the present application, or directly / indirectly applied in other related technical fields are included in the patent protection scope of the present application.
Claims
1. An image acquisition control system, characterized in that: include: A conveying component for conveying materials; A detection component is arranged corresponding to the position of the transmission component, and the detection component is used to output a first pulse signal when detecting a material; An encoder, arranged corresponding to the position of the conveying component, for detecting the position of the material conveyed by the conveying component and outputting a corresponding second pulse signal; A synchronous acquisition component is electrically connected to the detection component, the encoder and multiple cameras respectively, and is used to send a control signal to a corresponding camera among the multiple cameras according to the first pulse signal and the second pulse signal to control the operation of the corresponding camera.
2. The image acquisition control system according to claim 1, characterized in that: The synchronous acquisition component uses a trigger protocol to output a control signal; wherein the trigger protocol includes at least one of camera configuration information, a trigger signal, a frame number, and verification information.
3. The image acquisition control system according to claim 2, characterized in that: The trigger protocol specifically includes camera manufacturer information of a first preset byte, a camera number of a second preset byte, a trigger signal of a third preset byte, a frame number of a fourth preset byte, and verification information of a fifth preset byte.
4. The image acquisition control system according to claim 1, characterized in that: The synchronous acquisition component is specifically used to determine the material sequence transmitted by the transmission component according to the first pulse signal, and then determine the material position corresponding to the material sequence transmitted by the transmission component according to the second pulse signal, so as to send the control signal to the corresponding camera among the multiple cameras and control the corresponding camera to capture the material image corresponding to the material sequence.
5. The image acquisition control system according to claim 4, characterized in that: The synchronous acquisition component includes a synchronization module, and the synchronization module is used to determine the material sequence according to the number of received first pulse signals.
6. The image acquisition control system according to claim 5, characterized in that: The synchronization module includes a plurality of counters, each of which is used to count a received second pulse signal; The synchronization module is also used to determine the number of materials that can be processed simultaneously by the synchronization acquisition component according to the number of the counters used.
7. The image acquisition control system according to claim 5, characterized in that: The material image is in frames, and the synchronous acquisition component also includes an image processing module, a cache module, and a storage module. The image processing module is used to perform image preprocessing on the material image, and the cache module is used to perform frame cache on the preprocessed material image, and store the frame cached material image in the storage module.
8. The image acquisition control system according to any one of claims 1 to 7, characterized in that: The image acquisition control system further comprises a host computer, and the synchronous acquisition component is connected to the host computer; The host computer is used to output a reminder signal when it is determined that the plurality of cameras are not working synchronously for the same material sequence; The host computer is used to output a first signal to control the corresponding material to proceed to the next process when it is determined that the multiple cameras are working synchronously on the same material sequence and the materials in the corresponding material sequence are good products based on the material images transmitted by the multiple cameras.
9. The image acquisition control system according to claim 8, characterized in that: The image acquisition control system further includes a blowing component, which is arranged at a position corresponding to the conveying component and is used to blow the material on the conveying component; The host computer is used to output a second signal when it is determined that the plurality of cameras are working synchronously for the same material sequence and when it is determined that the materials in the corresponding material sequence are non-conforming products according to the material images transmitted by the plurality of cameras; The synchronous acquisition component is connected to the blowing component and is used to control the operation of the blowing component according to the second signal.
10. An image acquisition control method, characterized in that: Applied to the image acquisition control system according to any one of claims 1 to 9, the image acquisition control method comprises the following steps: Acquire a first pulse signal to determine a material sequence according to the first pulse signal; Acquire a second pulse signal to determine a material position corresponding to the material sequence according to the second pulse signal; The operation of corresponding cameras among the multiple cameras is controlled according to the material sequence and material position.
11. The image acquisition control method according to claim 10, characterized in that: Before executing the step of controlling the operation of corresponding cameras among the plurality of cameras according to the material sequence and material position, the image acquisition control method further includes the following steps: Determine camera configuration information of multiple connected cameras; triggering the plurality of cameras according to a preset triggering protocol; The trigger protocol includes at least one of camera configuration information, a trigger signal, a frame number, and verification information, and the frame number corresponds to the material sequence.
12. The image acquisition control method according to claim 10 or 11, characterized in that: After executing the step of controlling the operation of corresponding cameras among the plurality of cameras according to the material sequence and material position, the image acquisition control method further comprises the following steps: Acquire material images transmitted by multiple cameras; The material image is pre-processed and then stored.
13. The image acquisition control method according to claim 12, characterized in that: After executing the step of preprocessing and storing the material image, the image acquisition control method further includes the following steps: In response to the image reading instruction, the processed material images are output in the material sequence.
14. A capture card, characterized in that: It comprises the synchronous acquisition component as described in any one of claims 1 to 9, and the acquisition card is used to implement the image acquisition control method as described in any one of claims 10 to 13.
15. The acquisition card as claimed in claim 14, characterized in that: The acquisition card also includes: Communication module, used to connect with the host computer; A control interface, used to connect to multiple cameras and also used to receive camera configuration information; The connection interface is used to electrically connect to at least one of the detection component, the encoder, and the blowing component.
16. An image acquisition control device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the image acquisition control method according to any one of claims 1 to 9.
17. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the image acquisition control method according to any one of claims 1 to 9 are implemented.
18. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the image acquisition control method according to any one of claims 1 to 9 are implemented.
Citation Information
Patent Citations
Equipment and system for triggering camera to synchronously collect moving object images
CN108956633A
Product detection method, device and system
CN115937189A
Multi-channel synchronous control method and system
CN117193120A
Synchronous control system based on hybrid imaging detection
CN203350663U
Printed product detecting device
CN203587525U
Cited By
Multi-camera high-speed synchronous imaging system and method based on FPGA
CN122053767A