Man-machine interaction method and device of SMT detection equipment, equipment and medium

Abstract

The invention discloses a human-computer interaction method and device of SMT detection equipment, equipment and a medium, and relates to the technical field of surface mounting, and the method comprises the steps that a voice control panel establishes physical connection with a host based on a communication interface; triggering a conversion chip in the voice control panel to convert a USB communication mode into a UART communication mode based on the physical connection; based on the UART communication mode, a received voice instruction is compiled through a UART serial port communication protocol, a data frame used for representing the voice instruction is obtained and sent to SMT detection equipment, and the data frame is used for controlling the SMT detection equipment to execute corresponding operation. The method can be applied to the SMT PCBA manufacturing industry of electronic manufacturing.

Description

Technical Field

[0001] The present application relates to the field of surface mount technology, and in particular to a human-computer interaction method, device, equipment and medium for SMT testing equipment. Background Art

[0002] With the advancement of science and technology and the development of industrial automation, the demand for automation and intelligence in the electronics manufacturing industry is growing. Automated Optical Inspection (AOI) equipment based on surface mount technology (SMT) has become a key link in ensuring product quality in modern manufacturing. SMT is a technology that directly solders electronic components to the surface of a circuit board. As a key component, AOI equipment is an important device for detecting the soldering quality of electronic components.

[0003] For the printed circuit board (PCBA: Printed Circuit Board Assembly) manufacturing industry, SMT inspection equipment (AOI equipment) plays a vital role in the electronics manufacturing industry. However, in the actual control of existing industrial production lines, the operation mode of traditional AOI equipment relies on professional technicians to perform related operations through manual buttons, which increases labor costs. The overall operation process has certain professional requirements for technicians. The cumbersome operation may lead to technical problems such as inaccurate detection results, high missed detection rate, and slow detection speed. Summary of the invention

[0004] In view of this, the present application provides a human-computer interaction method, device, equipment and medium for SMT inspection equipment, the main purpose of which is to solve the technical problems that traditional AOI equipment has manual inspection resulting in low inspection accuracy, a certain risk of misoperation, and low manual inspection efficiency.

[0005] According to one aspect of the present application, a human-computer interaction method for SMT inspection equipment is provided, the method comprising:

[0006] The voice control board establishes a physical connection with the host based on the communication interface;

[0007] Based on the physical connection, triggering a conversion chip in the voice control board to convert a USB communication mode into a UART communication mode;

[0008] Based on the UART communication mode, the received voice command is compiled and processed using the UART serial communication protocol to obtain a data frame for representing the voice command and send it to the SMT detection device. The data frame is used to control the SMT detection device to perform corresponding operations.

[0009] According to another aspect of the present application, a human-computer interaction device for SMT inspection equipment is provided, the system comprising:

[0010] A connection module, used for the voice control board to establish a physical connection with the host based on the communication interface;

[0011] A trigger module, used for triggering a conversion chip in the voice control board to convert a USB communication mode into a UART communication mode based on the physical connection;

[0012] The compiling module is used to compile and process the received voice instructions based on the UART communication mode and using the UART serial communication protocol to obtain a data frame for representing the voice instructions and send it to the SMT detection device, and the data frame is used to control the SMT detection device to perform corresponding operations.

[0013] According to another aspect of the present application, a computer storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the human-computer interaction method of the above-mentioned SMT inspection device is implemented.

[0014] According to another aspect of the present application, a computer device is provided, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the human-computer interaction method of the above-mentioned SMT inspection device when executing the program.

[0015] By means of the above technical scheme, the human-computer interaction method, device, equipment and medium of the SMT detection equipment provided by the present application, compared with the technical scheme in which the traditional AOI equipment has manual detection resulting in low detection accuracy, a certain risk of misoperation, and low manual detection efficiency, the voice control board of the present application can establish a physical connection with the host based on the communication interface, and based on the physical connection, trigger the conversion chip in the voice control board to convert the USB communication mode to the UART communication mode, and then based on the UART communication mode, use the UART serial port communication protocol to compile and process the received voice instructions, obtain a data frame for characterizing the voice instructions and send it to the SMT detection equipment, and the data frame is used to control the SMT detection equipment to perform corresponding operations. It can be seen that through the innovative voice control board, based on the conversion chip that converts the USB communication mode to the UART communication mode, based on the defined UART serial port communication protocol, the voice instructions are compiled into data frames and sent to the SMT detection equipment, so that the SMT detection equipment can realize voice control of the SMT detection equipment by parsing the data frame.

[0016] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0018] Figure 1 A schematic diagram of a process flow of a human-computer interaction method for an SMT inspection device provided in an embodiment of the present application is shown;

[0019] Figure 2 A schematic diagram of a process flow of another human-computer interaction method for SMT inspection equipment provided by an embodiment of the present application is shown;

[0020] Figure 3 A schematic diagram of the structure of a human-computer interaction device for SMT inspection equipment provided in an embodiment of the present application is shown;

[0021] Figure 4 A structural schematic diagram of a human-computer interaction device of another SMT inspection device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0022] The present application will be described in detail below with reference to the accompanying drawings and in combination with embodiments. It should be noted that the embodiments and features in the embodiments of the present application can be combined with each other without conflict.

[0023] The traditional AOI equipment has the technical problems of low detection accuracy due to manual detection, certain risks of misoperation, and low manual detection efficiency. This embodiment provides a human-computer interaction method for SMT detection equipment, which can realize voice control of SMT detection equipment by innovating a voice control board and, without changing the SMT detection equipment, compiling voice commands into data frames based on the defined UART serial communication protocol and sending them to the SMT detection equipment. Figure 1 As shown, the above method comprises the following steps:

[0024] Step 101: The voice control board establishes a physical connection with the host based on the communication interface.

[0025] Step 102: Based on the physical connection, trigger the conversion chip in the voice control board to convert the USB communication mode into the UART communication mode.

[0026] In this embodiment, the voice control board is a voice control PCBA hardware board, which is designed to establish a physical connection with the SMT detection equipment host through the USB Type-C interface, ensuring good versatility and compatibility. Among them, the conversion chip used to convert the USB communication mode to the UART communication mode plays a bridging role, that is, using the defined UART serial communication protocol to convert the USB signal into a UART serial signal to achieve communication with the host. In addition, the widespread use of the USB Type-C interface makes the connection more convenient and can provide stable data transmission.

[0027] Step 103: Based on the UART communication mode, the received voice command is compiled and processed using the UART serial communication protocol to obtain a data frame for representing the voice command and send it to the SMT detection device, where the data frame is used to control the SMT detection device to perform corresponding operations.

[0028] In this embodiment, the frame format of the defined UART serial communication protocol includes a frame header, a frame length, a frame content, and a CRC check, which is used to ensure the accuracy and integrity of data transmission. Among them, the frame header is used to identify the beginning of a frame of data, so that the host (receiver) can accurately identify the received data frame; the frame length is used to inform the host of the length of the frame data, so as to implement the parsing and processing of the data frame based on the frame length; the frame content is used to carry specific control instructions or data information, for example, it can include relevant parameters and commands of voice control; the CRC check (cyclic redundancy check) generates a check code by calculating the frame content, so as to check on the host side (receiver) to check whether the data frame has errors during the transmission process. It can be seen that by redefining the frame format of the UART serial communication protocol, it can effectively ensure that the voice command is accurately and reliably transmitted between the voice control board and the host, providing a solid foundation for realizing efficient voice control functions.

[0029] For this embodiment, according to the above scheme, the voice control board can establish a physical connection with the host based on the communication interface, and based on the physical connection, trigger the conversion chip in the voice control board to convert the USB communication mode to the UART communication mode, and then based on the UART communication mode, use the UART serial communication protocol to compile and process the received voice instructions, obtain a data frame for characterizing the voice instructions and send it to the SMT detection equipment, and the data frame is used to control the SMT detection equipment to perform corresponding operations. Compared with the technical solution that the traditional AOI equipment has manual detection resulting in low detection accuracy, a certain risk of misoperation, and low manual detection efficiency, this embodiment uses an innovative voice control board, based on the conversion chip that converts the USB communication mode to the UART communication mode, and based on the defined UART serial communication protocol, compiles the voice instructions into data frames and sends them to the SMT detection equipment, so that the SMT detection equipment can realize voice control of the SMT detection equipment by parsing the data frame, improve detection efficiency, thereby replacing manual operation, reducing dependence on human resources, and effectively reducing enterprise production costs.

[0030] Furthermore, as a refinement and expansion of the specific implementation of the above embodiment, in order to fully illustrate the specific implementation process of this embodiment, another human-computer interaction method for SMT inspection equipment is provided. This embodiment can be applied to the electronic manufacturing surface mount technology SMT PCBA manufacturing industry. This embodiment can realize the automatic control of AOI equipment through the innovation and upgrade of the voice control board, while improving the inspection efficiency of AOI equipment. Figure 2 As shown, the method includes:

[0031] Step 201: predefine a UART serial port communication protocol, wherein the UART communication protocol includes a frame header, a frame length, a frame content and a CRC check.

[0032] During implementation, step 201 is consistent with step 101. In order to illustrate the specific implementation method of step 201, as a preferred embodiment, the data frame length defined based on the UART serial communication protocol is 6 bytes, including a 1-byte frame header, a 1-byte frame length, a 2-byte frame content and a 2-byte CRC check.

[0033] Step 202: The voice control board establishes a physical connection with the host based on the communication interface.

[0034] Step 203: Based on the physical connection, trigger the conversion chip in the voice control board to convert the USB communication mode into the UART communication mode.

[0035] In the implementation, the voice command is converted into a data frame suitable for UART serial communication based on the conversion chip in the voice control board. Specifically, after the USB communication mode is converted into the UART communication mode, the received voice command is compiled and processed based on the UART serial communication protocol defined in the UART communication mode, so as to convert the voice command into command information that can be recognized by the host, so as to realize the automatic control of the AOI equipment. According to the needs of the actual application scenario, triggering the conversion chip in the voice control board to convert the USB communication mode into the UART communication mode can be to convert the data frame based on the USB communication mode into the data frame of the UART communication mode, and no specific setting is made here.

[0036] Step 204: Utilize the UART serial communication protocol to define the format of the received voice command to obtain a data frame.

[0037] To illustrate the specific implementation of step 204, as a preferred embodiment, the data frame includes a 1-byte frame header, a 1-byte frame length, a 2-byte frame content and a 2-byte CRC check, and the frame content is used to characterize the voice command; wherein the 2-byte CRC check is to compile and calculate the frame content, and define the generated 2-byte calculation result as the CRC check.

[0038] During implementation, the process of formatting the voice command specifically includes: determining the length of the data frame according to the UART serial communication protocol, compiling the voice command into frame content, and further compiling the frame content (or frame header + frame length + frame content) into CRC check, and by defining the frame header (taking 0xA5 as an example), obtaining a data frame for characterizing the voice command, so as to realize the compilation process of the voice control board and realize the control of the AOI equipment on the host side, thereby achieving the purpose of improving the automation level and detection efficiency of the AOI equipment.

[0039] According to the needs of actual application scenarios, the process of compiling voice commands specifically includes: waking up the voice control board through the voice "ant ant", triggering the USB to generate test commands through the voice "start test", and then using the conversion chip to convert the test commands based on the USB communication mode into test commands based on the UART communication mode according to the command comparison table, and sending them to the host side; similarly, after triggering the USB to generate a reset command through the voice "machine reset", the conversion chip is used to convert the reset command based on the USB communication mode into a reset command based on the UART communication mode according to the command comparison table, and sending it to the host side; and, triggering the USB to generate a stop command through the voice "stop test". After the instruction is given, the stop instruction based on the USB communication mode is converted into the stop instruction of the UART communication mode by using the conversion chip according to the instruction comparison table, and sent to the host side; and, after the USB is triggered to generate the call instruction through the voice "open the program list", the call instruction based on the USB communication mode is converted into the call instruction of the UART communication mode by using the conversion chip according to the instruction comparison table, and sent to the host side; and, after the USB is triggered to generate the report sending instruction through the voice "output report No. *", the report sending instruction based on the USB communication mode is converted into the report sending instruction of the UART communication mode by using the conversion chip according to the instruction comparison table, and sent to the host side.

[0040] Among them, the instruction comparison table may include: start test corresponding control command 0x0001, stop test corresponding control command 0x0002, machine reset corresponding control command 0x0003, open program list corresponding control command 0x0004, close software corresponding control command 0x0005, export x report corresponding control command 0x0006-0x00031, etc.

[0041] Step 205: The SMT detection device calls a parsing algorithm corresponding to the UART serial port communication protocol according to the received data frame.

[0042] Step 206: parse the data frame using the parsing algorithm to obtain a control command, where the control command is used to control a corresponding component in the SMT testing device to execute the control command.

[0043] To illustrate the specific implementation of step 206, as a preferred embodiment, the control command includes: controlling the SMT inspection device to perform corresponding operations by simulating the triggering of a mechanical button; or controlling the SMT inspection device to perform corresponding operations by calling a command program.

[0044] In the implementation, after obtaining the control command by parsing the data frame of the AOI device serial port, the AOI device software calls the AOI device interface to send the control command to control the AOI device. Specifically, taking the start test as an example, execute(command) in http: / / 127.0.0.1:8081 / rpc / api simulates triggering BTN.G (green button) for 100ms to enable the machine to enter the board, and at the same time, the run() command software in http: / / 127.0.0.1:8081 / rpc / api starts the test; taking machine reset as an example, execute(command) in http: / / 127.0.0.1:8081 / rpc / api simulates triggering BTN.Y (yellow button) for 100ms to enable machine reset; taking the stop test as an example,

[0045] The stop() command software in http: / / 127.0.0.1:8081 / rpc / api stops the test; taking the opening of report No. ** as an example, open the matching report link.

[0046] To illustrate the specific implementation of step 206, as a preferred embodiment, step 206 includes: using the UART serial port communication protocol to parse the received data frame to determine the frame header position, frame length position, frame content position and CRC check position; according to the byte information at the frame length position, determine whether the frame length of the data frame matches the byte information; if they match, then according to the frame header position, check the byte information at the CRC check position to determine whether the data frame is correct; if the check of the byte information at the CRC check position fails, the data frame is wrong, and the data frame is requested to be resent; if the check of the byte information at the CRC check position is successful, the data frame is correct, and according to the frame header position, the byte information at the frame content position is obtained and parsed to obtain a control command; if they do not match, then the data frame is requested to be resent.

[0047] In implementation, the CRC check process specifically includes: if the CRC check fails, the host side generates a corresponding request to enable the voice control board to resend the data frame, thereby improving the reliability of communication; if the CRC check passes, the byte information at the frame content position is parsed to obtain the control command. It should be noted that compared with other common data verification methods (such as parity check, sum check, etc.), CRC check can detect more types of errors, including single bit errors, multiple bit errors, and burst errors, etc., and CRC check has stronger error detection capabilities; at the same time, it can generate a check value of variable length, that is, it can select different CRC algorithms according to needs and generate check values ​​of different lengths, thereby achieving a balance between error detection capability and transmission efficiency.

[0048] To illustrate the specific implementation of step 206, as a preferred embodiment, the step of obtaining and parsing the byte information of the frame content position according to the frame header position to obtain the control command comprises: obtaining and parsing the byte information of the frame content position according to the frame header position; obtaining the control command corresponding to the byte information according to the instruction comparison table of byte information and control commands; specifically comprising: if the byte information of the frame content position is the first byte information, determining by parsing that the control command is the first control instruction, and the first control instruction is to start the test; if the byte information of the frame content position is the second byte information, determining by parsing that the control command is the second control instruction, and the second control instruction is to start the test; The instruction is to stop the test; if the byte information at the frame content position is the third byte information, then the control command is determined to be the third control instruction through analysis, and the third control instruction is to reset the machine; if the byte information at the frame content position is the fourth byte information, then the control command is determined to be the fourth control instruction through analysis, and the fourth control instruction is to open the program list; if the byte information at the frame content position is the fifth byte information, then the control command is determined to be the fifth control instruction through analysis, and the fifth control instruction is to shut down the software; if the byte information at the frame content position is within the preset byte range, then the control command is determined to be the sixth control instruction through analysis, and the sixth control instruction is to export a specified report.

[0049] In order to illustrate the specific implementation method of step 206, as a preferred embodiment, the step of controlling the corresponding component in the SMT detection equipment to execute the control command includes: parsing the control command to determine the component identifier corresponding to the control command; according to the component identifier, sending the control command to the corresponding target component via the RPC interface of the SMT detection equipment; the target component performs a corresponding operation according to the received control command.

[0050] According to the requirements of the actual application scenario, after the host side receives the data frame representing "start test" from the voice control board, the C# parsing software is used to parse the data frame, and the AOI device is controlled to enter the running state, and the corresponding test action is realized through the mechanical button; similarly, after the host side receives the data frame representing "machine reset" from the voice control board, the C# parsing software is used to parse the data frame, and the AOI device is controlled to start resetting; and, after the host side receives the data frame representing "stop test" from the voice control board, the C# parsing software is used to parse the data frame, and the AOI device is controlled to exit the running state; and, after the host side receives the data frame representing "open program list" from the voice control board, the C# parsing software is used to parse the data frame, and the AOI device is controlled to open the program list, and the AOI device is controlled to change the specified program by calling the corresponding program; and, after the host side receives the data frame representing "output report No. *" from the voice control board, the C# parsing software is used to parse the data frame, and the AOI device is controlled to open and present the corresponding report. It can be seen that after parsing the data frame through the C# parsing software, the AOI device can be controlled through the AOI software interface to achieve various operating states.

[0051] By applying the technical solution of this embodiment, the voice control board can establish a physical connection with the host based on the communication interface, and based on the physical connection, trigger the conversion chip in the voice control board to convert the USB communication mode to the UART communication mode, and then based on the UART communication mode, use the UART serial communication protocol to compile and process the received voice instructions, obtain a data frame for characterizing the voice instructions and send it to the SMT detection device, and the data frame is used to control the SMT detection device to perform the corresponding operation. Compared with the technical solution of the traditional AOI equipment, which has low detection accuracy due to manual detection, a certain risk of misoperation, and low manual detection efficiency, this embodiment integrates a voice control board (voice recognition chip) and forms a data frame based on the UART serial communication protocol after recognizing the voice instruction to achieve communication with the AOI device, thereby controlling the operation of the AOI device through voice instructions, effectively reducing the difficulty of manual operation and simplifying the operation process, improving the automation of the AOI device, and facilitating overall installation, thereby improving the ease of use of the AOI device.

[0052] According to the needs of actual application scenarios, this embodiment can be applied to the electronics manufacturing industry, such as quality inspection during the production process of electronic products such as smart phones, computers, and home appliances; the automobile manufacturing industry, such as quality inspection of automotive electronics, sensors and other components; the aerospace field, such as quality inspection of spacecraft electronic systems, etc.

[0053] This embodiment combines voice recognition technology with AOI equipment to improve the automation and operational convenience of AOI equipment. In terms of specific implementation, it may include: 1. Voice-controlled SMT placement machine: The operator issues voice commands to control the operation of the SMT placement machine, such as start, stop, speed adjustment, etc., thereby reducing the operator's labor intensity and improving production efficiency; 2. Voice-guided AOI detection system: In some AOI detection systems, the operator navigates the detection process through voice commands, such as selecting detection items, adjusting detection parameters, etc., thereby improving detection efficiency and reducing the operator's error rate; 3. Voice-interactive AOI equipment maintenance system: In some AOI equipment, maintenance personnel obtain the equipment's operating status, fault information, etc. through voice interaction, and realize remote monitoring and maintenance of AOI equipment, thereby effectively reducing maintenance costs and improving equipment availability.

[0054] Specifically, in this embodiment, the operator can issue voice commands through natural language interaction, which reduces the difficulty of operation and improves the usability of the AOI equipment. However, in order to further improve the problems of insufficient voice recognition accuracy and poor human-computer interaction experience, a dual-microphone interface with noise reduction function is used to receive voice commands to ensure the receiving distance of voice commands, and the applicable application scenarios are wide. In addition, in order to ensure high-precision voice recognition, a voice recognition algorithm based on deep learning can also be used to improve the recognition accuracy and speed of voice commands, so as to achieve precise control of AOI equipment; and, based on adaptive learning, the voice control panel is continuously optimized according to the operator's voice habits and operating behaviors to improve the recognition accuracy and response speed of AOI equipment; and, based on multimodal fusion, voice recognition technology is combined with other sensor technologies (such as vision, touch, etc.), and a multimodal fusion control method is realized by setting priorities to improve the intelligence and detection accuracy of AOI equipment, so as to promote the development of the electronic manufacturing industry and the field of intelligent manufacturing.

[0055] Furthermore, it can also include a fault diagnosis and alarm system. By integrating the fault diagnosis and alarm system, it can monitor the operating status of the AOI equipment in real time, detect and handle AOI equipment faults in a timely manner, and improve the reliability and stability of the AOI equipment. Specifically, by combining the intelligent detection algorithm with machine learning, the AOI equipment can automatically identify and locate defects, improving the detection efficiency and accuracy of the AOI equipment. In addition, by collecting and analyzing the detection data in real time, it provides users with intuitive detection reports, which facilitates timely detection of problems and taking measures to achieve data analysis and visualization. It can be seen that by combining intelligent detection algorithms with data analysis technology, the detection accuracy of AOI equipment can be effectively improved, and it can be applied to enterprises of all sizes and can be easily operated without professionals.

[0056] Further, as Figure 1The specific implementation of the method, the embodiment of the present application provides a human-machine interaction device for SMT inspection equipment, which is applied in the SMT mounting industry. The SMT process includes the use of a board loading machine, laser marking, PCB board cleaning, fully automatic printing machine, online solder paste detection, mounting machine, pre-furnace AOI detection, reflow soldering, post-furnace AOI, online board splitter, and fully automatic board collection machine. The device can be used in the above equipment process. Figure 3 As shown, the device includes: a connection module 31, a trigger module 32, and a compilation module 33.

[0057] A connection module 31 is used for the voice control board to establish a physical connection with the host based on the communication interface;

[0058] A trigger module 32 is used to trigger the conversion chip in the voice control board to convert the USB communication mode into the UART communication mode based on the physical connection;

[0059] The compiling module 33 is used to compile and process the received voice instructions based on the UART communication mode and using the UART serial communication protocol to obtain a data frame for representing the voice instructions and send it to the SMT detection device, and the data frame is used to control the SMT detection device to perform corresponding operations.

[0060] In specific application scenarios, such as Figure 4 As shown, the device predefines a UART serial port communication protocol, and the UART communication protocol includes a frame header, a frame length, a frame content and a CRC check.

[0061] In a specific application scenario, the data frame length defined based on the UART serial communication protocol is 6 bytes, including a 1-byte frame header, a 1-byte frame length, a 2-byte frame content and a 2-byte CRC check.

[0062] In a specific application scenario, the compiling module 33 includes: a defining unit 331 .

[0063] The definition unit 331 is used to define the format of the received voice command using the UART serial communication protocol to obtain a data frame, wherein the data frame includes a 1-byte frame header, a 1-byte frame length, a 2-byte frame content and a 2-byte CRC check, and the frame content is used to characterize the voice command; wherein the 2-byte CRC check is to compile and calculate the frame content, and define the generated 2-byte calculation result as the CRC check.

[0064] In a specific application scenario, the device further includes: a receiving module 34 .

[0065] The receiving module 34 is used for the SMT detection device to call the parsing algorithm corresponding to the UART serial communication protocol according to the received data frame; and to parse the data frame using the parsing algorithm to obtain a control command, which is used to control the corresponding components in the SMT detection device to execute the control command.

[0066] In a specific application scenario, the control command includes: controlling the SMT inspection equipment to perform corresponding operations by simulating the triggering of a mechanical button; or controlling the SMT inspection equipment to perform corresponding operations by calling a command program.

[0067] In a specific application scenario, the receiving module 34 also includes: using the UART serial port communication protocol to parse the received data frame to determine the frame header position, frame length position, frame content position and CRC check position; and, according to the byte information at the frame length position, determining that the frame length of the data frame matches the byte information; and, according to the frame header position, verifying the byte information at the CRC check position to determine whether the data frame is correct; and, if the byte information at the CRC check position fails to be verified, the data frame is erroneous and requests to resend the data frame; and, if the byte information at the CRC check position is verified successfully, the data frame is correct, and according to the frame header position, the byte information at the frame content position is obtained and parsed to obtain a control command.

[0068] In a specific application scenario, the step of obtaining a control command by obtaining and parsing the byte information of the frame content position according to the frame header position includes: obtaining and parsing the byte information of the frame content position according to the frame header position; obtaining a control command corresponding to the byte information according to an instruction comparison table of byte information and control commands; specifically including: if the byte information of the frame content position is the first byte information, determining through parsing that the control command is the first control instruction, and the first control instruction is to start the test; if the byte information of the frame content position is the second byte information, determining through parsing that the control command is the second control instruction, and the second control instruction is to stop the test ; If the byte information at the frame content position is the third byte information, then the control command is determined to be the third control instruction through analysis, and the third control instruction is to reset the machine; if the byte information at the frame content position is the fourth byte information, then the control command is determined to be the fourth control instruction through analysis, and the fourth control instruction is to open the program list; if the byte information at the frame content position is the fifth byte information, then the control command is determined to be the fifth control instruction through analysis, and the fifth control instruction is to shut down the software; if the byte information at the frame content position is within the preset byte range, then the control command is determined to be the sixth control instruction through analysis, and the sixth control instruction is to export a specified report.

[0069] In a specific application scenario, the step of controlling the corresponding component in the SMT inspection device to execute the control command includes: parsing the control command to determine the component identifier corresponding to the control command; and, based on the component identifier, sending the control command to the corresponding target component via the RPC interface of the SMT inspection device; and, the target component performs corresponding operations based on the received control command.

[0070] It should be noted that for other corresponding descriptions of the functional units involved in the human-machine interaction device of an SMT inspection device provided in the embodiment of the present application, reference can be made to Figure 1 and Figure 2 The corresponding description in will not be repeated here.

[0071] Based on the above Figure 1 and Figure 2 The method shown in the embodiment of the present application accordingly provides a computer storage medium on which a computer program is stored, and when the program is executed by a processor, the above-mentioned Figure 1 and Figure 2 The human-computer interaction method of the SMT inspection equipment is shown.

[0072] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.), and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each implementation scenario of the present application.

[0073] Based on the above Figure 1 , Figure 2 The method shown, and Figure 3 , Figure 4 In order to achieve the above-mentioned purpose, the embodiment of the present application further provides a computer device, which can be a personal computer, a server, a network device, etc. The physical device includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to achieve the above-mentioned Figure 1 and Figure 2 The human-computer interaction method of the SMT inspection equipment is shown.

[0074] Optionally, the computer device may further include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, etc. The user interface may include a display, an input unit such as a keyboard, etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (such as a Bluetooth interface, a WI-FI interface), etc.

[0075] Those skilled in the art will appreciate that the computer device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different component arrangements.

[0076] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages computer devices and software resources, and supports the operation of information processing programs and other software and / or programs. The network communication module is used to achieve communication between components within the storage medium, as well as communication with other hardware and software in the physical device.

[0077] Through the description of the above implementation methods, the technical personnel in this field can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform, or by hardware. By applying the technical solution of the present application, compared with the technical solution of the traditional AOI equipment, which has manual detection resulting in low detection accuracy, a certain risk of misoperation, and low manual detection efficiency, the present application integrates a voice control board (voice recognition chip) as an efficient and convenient intelligent solution, based on an innovative voice control board with a high recognition rate and response speed, and forms a data frame based on the UART serial communication protocol after recognizing the voice command to realize communication with the AOI device, thereby controlling the operation of the AOI device through voice commands, simplifying the manual operation process, and improving the automation level, detection efficiency and accuracy of the AOI device. At the same time, the overall installation is convenient, which improves the ease of use of the AOI device.

[0078] Those skilled in the art will appreciate that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, and the modules or processes in the accompanying drawings are not necessarily necessary for implementing the present application. Those skilled in the art will appreciate that the modules in the system in the implementation scenario can be distributed in the system of the implementation scenario according to the implementation scenario description, or can be changed accordingly and located in one or more systems different from the present implementation scenario. The modules of the above-mentioned implementation scenario can be combined into one module, or can be further split into multiple submodules.

[0079] The above serial numbers of this application are only for description and do not represent the advantages and disadvantages of the implementation scenarios. The above disclosure is only a few specific implementation scenarios of this application, but this application is not limited to them, and any changes that can be thought of by technicians in this field should fall within the scope of protection of this application.

Claims

1. A human-computer interaction method for SMT inspection equipment, It is characterized in that The method includes: The voice control board establishes a physical connection with the host based on the communication interface; Based on the physical connection, triggering a conversion chip in the voice control board to convert a USB communication mode into a UART communication mode; Based on the UART communication mode, the received voice command is compiled and processed using the UART serial communication protocol to obtain a data frame for representing the voice command and send it to the SMT detection device. The data frame is used to control the SMT detection device to perform corresponding operations.

2. The method according to claim 1, It is characterized in that The step of compiling and processing the received voice command by using the UART serial communication protocol to obtain a data frame for representing the voice command includes: The received voice command is formatted using the UART serial communication protocol to obtain a data frame, wherein the data frame includes a 1-byte frame header, a 1-byte frame length, a 2-byte frame content, and a 2-byte CRC checksum, and the frame content is used to characterize the voice command; The 2-byte CRC check is to compile and calculate the frame content, and define the generated 2-byte calculation result as the CRC check.

3. The method according to claim 1, It is characterized in that Also includes: The SMT detection device calls the parsing algorithm corresponding to the UART serial port communication protocol according to the received data frame; The data frame is parsed using the parsing algorithm to obtain a control command, and the control command is used to control a corresponding component in the SMT testing device to execute the control command.

4. The method according to claim 3, It is characterized in that The step of parsing the data frame using the parsing algorithm to obtain a control command includes: Use the UART serial communication protocol to parse the received data frame to determine the frame header position, frame length position, frame content position and CRC check position; Determining, according to the byte information at the frame length position, that the frame length of the data frame matches the byte information; According to the frame header position, the byte information of the CRC check position is checked to determine whether the data frame is correct; If the byte information check at the CRC check position fails, the data frame is wrong and a request is made to resend the data frame; If the byte information at the CRC check position is successfully checked, the data frame is correct, and the byte information at the frame content position is acquired and parsed according to the frame header position to obtain a control command.

5. The method according to claim 4, It is characterized in that The step of acquiring and parsing the byte information of the frame content position according to the frame header position to obtain the control command includes: According to the frame header position, acquiring and parsing the byte information of the frame content position; According to the instruction comparison table of byte information and control command, the control command corresponding to the byte information is obtained; specifically including: If the byte information at the frame content position is the first byte information, determining through analysis that the control command is the first control instruction, the first control instruction is to start a test; If the byte information at the frame content position is the second byte information, determining through analysis that the control command is the second control instruction, the second control instruction is to stop the test; If the byte information at the frame content position is the third byte information, determining through analysis that the control command is the third control instruction, and the third control instruction is a machine reset; If the byte information at the frame content position is the fourth byte information, determining through analysis that the control command is the fourth control instruction, the fourth control instruction is to open a program list; If the byte information at the frame content position is the fifth byte information, determining through analysis that the control command is the fifth control instruction, the fifth control instruction is to shut down the software; If the byte information of the frame content position is within a preset byte range, it is determined through analysis that the control command is a sixth control instruction, and the sixth control instruction is to export a specified report.

6. The method according to claim 3, It is characterized in that The step of controlling the corresponding components in the SMT inspection equipment to execute the control command comprises: Parsing the control command to determine the component identifier corresponding to the control command; According to the component identification, the control command is sent to the corresponding target component via the RPC interface of the SMT inspection device; The target component performs corresponding operations according to the received control command.

7. The method according to claim 1 or 3, It is characterized in that The control commands include: By simulating the triggering of mechanical buttons, the SMT inspection equipment is controlled to perform corresponding operations; Alternatively, the SMT inspection equipment can be controlled to perform corresponding operations by calling a command program.

8. A human-machine interaction device for SMT inspection equipment, It is characterized in that The device comprises: A connection module, used for the voice control board to establish a physical connection with the host based on the communication interface; A trigger module, used for triggering a conversion chip in the voice control board to convert a USB communication mode into a UART communication mode based on the physical connection; The compiling module is used to compile and process the received voice instructions based on the UART communication mode and using the UART serial communication protocol to obtain a data frame for representing the voice instructions and send it to the SMT detection device, and the data frame is used to control the SMT detection device to perform corresponding operations.

9. A computer storage medium having a computer program stored thereon, It is characterized in that When the program is executed by a processor, the human-computer interaction method of the SMT inspection device according to any one of claims 1 to 7 is implemented.

10. A computer device comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, It is characterized in that When the processor executes the program, the human-computer interaction method of the SMT detection equipment according to any one of claims 1 to 7 is implemented.

Images