Product debugging test system, method and device, electronic equipment and storage medium

Abstract

The invention discloses a product debugging and testing system, method and device, electronic equipment and a storage medium, the system comprises an on-site debugging and testing system, an image system and a user interaction system, the on-site debugging and testing system is in communication connection with the image system and the user interaction system, and the user interaction system is used for responding to a debugging and testing request of a front-end user for a tested product. Sending a commissioning instruction to the field commissioning system; the field debugging and testing system is used for providing a remote debugging and testing environment of a tested product, receiving a debugging and testing instruction sent by the user interaction system, and calling debugging and testing environment resources of the remote debugging and testing environment according to the debugging and testing instruction to execute corresponding debugging and / or testing operation on the tested product; the image system is used for acquiring an image picture of a commissioning and testing site and transmitting the image picture to the user interaction system for remote online display. According to the application, the perception degree and interactivity of research and development work of research and development personnel are improved, the research and development period of circuit board products can be obviously reduced, and the production quality is improved.

Description

Technical Field

[0001] The present application relates to the field of communication information technology, and in particular to a product debugging and testing system, method, device, electronic equipment and storage medium. Background Art

[0002] With the rapid development of the economy, the rapid debugging and testing of the functions and performance of circuit board products (hereinafter referred to as debugging) has become a key factor affecting the product development cycle and production quality.

[0003] Circuit board product commissioning includes hardware commissioning and software commissioning. Hardware commissioning mainly includes pre-power-on inspection and post-power-on testing. Pre-power-on inspection includes checking whether the PCB connection is correct, whether the components are installed correctly, and open circuit and short circuit tests. Post-power-on testing includes: applying a specific signal input to the input end of the circuit board, following the flow of the input signal, sequentially detecting the signal change status of each detection point on the circuit board, and observing whether the expected change occurs when the signal passes through the components on the circuit board. To complete these hardware commissioning tasks, you need to use some test instruments, such as: multimeter, oscilloscope, spectrum analyzer, temperature gun, etc.

[0004] The circuit board software debugging work mainly focuses on the CPU processor chip software loading and working state machine verification, verifying whether its chip pins can output valid level signals, and whether the peripheral controller can send and receive control instructions; programmable logic chip software loading and working state machine verification; also includes the function and performance verification of components such as sensors and clocks.

[0005] At present, most company R&D personnel usually have to debug and test the hardware and software functions of circuit boards in laboratories or on-site debugging environments. This will not only increase the operational safety risks of R&D personnel, but also affect the product production quality and delivery progress if the relevant R&D personnel do not have the conditions for on-site debugging. Especially for companies with offices distributed in multiple regions, the existing remote debugging technology has poor perception and interactivity for cross-regional remote debugging experience. In order to quickly debug and test the functions of circuit board products, personnel have to be arranged to travel to the environment site to complete the work, which not only significantly increases product R&D costs, drags down product R&D efficiency and production quality, but also affects the mood of R&D personnel. Summary of the invention

[0006] In view of this, the main purpose of the embodiments of the present application is to propose a product debugging and testing system, method, device, electronic device and storage medium, aiming to improve the visual and interactivity of R&D personnel in remote debugging and testing of circuit board functions and performance, reduce the R&D cycle of circuit board products and improve production quality.

[0007] To achieve the above-mentioned purpose, the embodiment of the present application proposes a product debugging and testing system, the system comprising: an on-site debugging system, an imaging system, and a user interaction system, the on-site debugging system is communicatively connected with the imaging system and the user interaction system, wherein:

[0008] The user interaction system is used to respond to the front-end user's commissioning request for the tested product and send a commissioning instruction to the on-site commissioning system;

[0009] The on-site debugging system is used to provide a remote debugging environment for the product under test, receive a debugging instruction sent by the user interaction system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0010] The image system is used to obtain the image of the commissioning site and transmit it to the user interaction system;

[0011] The user interaction system is also used to remotely display the image screen of the commissioning site online.

[0012] The present application embodiment provides a method applied to the product debugging and testing system as described above, the method comprising:

[0013] In response to a front-end user's request for commissioning of the product under test, a commissioning instruction is sent to the on-site commissioning system through the user interaction system;

[0014] Receiving the debugging instruction sent by the user interaction system through the on-site debugging system, and calling the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0015] Acquire the image of the commissioning site through the image system and transmit it to the user interaction system;

[0016] The image screen of the commissioning site is remotely displayed online through the user interaction system.

[0017] The present application embodiment provides a product debugging and testing device, including:

[0018] The command trigger module is used to respond to the front-end user's commissioning request for the tested product and send the commissioning command to the on-site commissioning system through the user interaction system;

[0019] A debugging and testing module, configured to receive a debugging instruction sent by the user interaction system through the on-site debugging system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0020] A transmission module, used to obtain the image of the commissioning site through the image system and transmit it to the user interaction system;

[0021] The display module is used to remotely display the image screen of the commissioning site online through the user interaction system.

[0022] An embodiment of the present application further provides an electronic device, which includes a memory, a processor, and a product debugging test program stored in the memory and executable on the processor, wherein the product debugging test program implements the method described above when executed by the processor.

[0023] An embodiment of the present application further provides a computer-readable storage medium, on which a product debugging test program is stored. When the product debugging test program is executed by a processor, the method described above is implemented.

[0024] The embodiments of the present application propose a product debugging and testing system, method, device, electronic device and storage medium, the system comprising: an on-site debugging system, an imaging system, and a user interaction system, the on-site debugging system is communicatively connected with the imaging system and the user interaction system, wherein: the user interaction system is used to respond to a front-end user's debugging request for a product under test and send a debugging instruction to the on-site debugging system; the on-site debugging system is used to provide a remote debugging environment for the product under test, receive the debugging instruction sent by the user interaction system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test; the imaging system is used to obtain an image screen of the debugging site and transmit it to the user interaction system; the user interaction system is also used to remotely display the image screen of the debugging site online. The embodiment of the present application constructs a virtual product debugging and testing system based on digital twin technology, obtains the image of the debugging site through the imaging system, and transmits it to the front-end user interaction system for display, so that R&D personnel can watch the entire debugging process of the product site through the image on the front end, thereby eliminating the limitations of on-site debugging and on-site testing by R&D personnel, and enabling R&D personnel to experience immersive debugging and testing of the functions and performance of the tested products (such as circuit board products), which not only improves the visual and interactive nature of the R&D work of R&D personnel, but also significantly reduces the R&D cycle of circuit board products and improves production quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0026] Figure 1 This is a schematic diagram of the architecture of an embodiment of a product debugging and testing system of the present application;

[0027] Figure 2 This is a schematic diagram of the structure of a workbench of a product debugging and testing system according to an embodiment of the present application;

[0028] Figure 3 A schematic diagram of the structure of a user interaction system of a product debugging and testing system according to an embodiment of the present application;

[0029] Figure 4 A schematic diagram of the hardware test flow of the product debugging test system in the embodiment of the present application before the circuit board under test is powered on;

[0030] Figure 5 This is a schematic diagram of a power-on observation hardware test process after the circuit board under test is powered on in an embodiment of the present application;

[0031] Figure 6 Schematic diagram of static hardware test flow after the circuit board under test is powered on in the embodiment of the present application;

[0032] Figure 7 A schematic diagram of a dynamic hardware test process after the circuit board under test is powered on in an embodiment of the present application;

[0033] Figure 8 Schematic diagram of the hardware driver loading test process of the circuit board under test in the embodiment of the present application;

[0034] Fig. 9 This is a flow chart of an embodiment of a method for debugging and testing a product of the present application;

[0035] Fig.10 A schematic diagram of the functional modules of an embodiment of a debugging and testing device for a product of the present application;

[0036] Fig.11 This is a schematic diagram of functional modules of an embodiment of an electronic device of the present application.

[0037] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0038] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0039] Optionally, in this document, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element. Optionally, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context in the specific embodiment.

[0040] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0041] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0042] In the embodiments of the present application, the communication device may be a server, a terminal device, or a base station device, etc., and the present application needs to be determined according to the specific context.

[0043] The following description will be made by taking a server as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to other fixed types of terminals.

[0044] Technical terms involved in the embodiments of this application:

[0045] Metaverse technology: With the rapid development of the Internet, metaverse technology has emerged. With the help of digital technology, people reproduce real-world products in the virtual world and establish a digital living space for a new social system. The supporting technologies of the metaverse include: interactive technology, digital twin technology, communication network technology, artificial intelligence technology, Internet of Things technology, network and computing power technology, blockchain technology, etc.

[0046] Digital twin: Digital twin is the digitization of a physical object in the real world in the form of software modeling, which includes static attributes and dynamic data. It imitates the device or system to create a digital clone. Digital twin technology has taken root in industrial manufacturing, scientific research, medical care and education. Through interactive immersive technology, users can achieve an immersive experience in the digital living space, have a virtual avatar in the digital world, and create content in the digital world. To obtain a more immersive experience, it is inseparable from the support of high-speed communication networks. In addition, the use of Internet of Things technology to transmit data on the network improves the convenience of interaction between people or between people and devices.

[0047] Circuit board product debugging: Usually, circuit board product debugging includes hardware debugging and software debugging. Among them:

[0048] Hardware commissioning work includes: pre-power-on inspection and post-power-on inspection. The pre-power-on inspection includes: checking whether the PCB connection is correct according to the circuit board schematic, such as: whether the line is connected incorrectly, whether there are insufficient connections or excessive connections, etc. Check whether the components are installed correctly, such as whether the components have poor contact, whether the polarity of the components with polarity is connected incorrectly, and open circuit test and short circuit test, etc. To complete these hardware commissioning tasks, some test instruments are needed, such as: multimeter, oscilloscope, spectrum analyzer, temperature gun, etc. Hardware commissioning personnel currently mainly use the above test instruments to perform hardware commissioning in the laboratory, and lack the technical means to remotely immerse the hardware devices. Post-power-on inspection work includes: applying a specific signal input at the input end of the circuit board, following the flow direction of the input signal, sequentially detecting the signal change status of each detection point on the circuit board, and observing whether the expected change occurs when the signal passes through the component status on the circuit board.

[0049] Circuit board software debugging includes: software loading and working state machine verification of the CPU processor chip, verifying whether its chip pins can output valid level signals, and whether the peripheral controller can send and receive control instructions; software loading and working state machine verification of programmable logic chips; and also includes function and performance verification of components such as sensors and clocks. Currently, software debugging personnel mainly rely on the hardware emulator of the CPU processor and its supporting software and hardware signal test instruments and signal generators to directly or indirectly debug and test the software functions and performance of circuit board components such as CPU processors, programmable logic chips, sensors, and clocks. This working method cannot observe the hardware parameter status of circuit board components in real time, and the overall debugging and testing work has poor perception and interactivity.

[0050] The embodiments of the present application take into account that, at present, for the debugging and testing of circuit board products, R&D personnel are usually required to debug and test the hardware and software functions of the circuit board in a laboratory or on-site debugging environment. This will not only increase the operational safety risks of R&D personnel, but also once the relevant R&D personnel do not have the conditions for on-site debugging, it will affect the production quality and delivery progress of the product. Especially for companies with offices distributed in multiple regions, the existing remote debugging technology has poor perception and interactivity for cross-regional remote debugging experience. In order to quickly debug and test the functions of circuit board products, personnel have to be arranged to travel to the environment site to complete the work, which not only significantly increases the cost of product development, drags down the product development efficiency and production quality, but also affects the mood of R&D personnel.

[0051] Therefore, the embodiment of the present application proposes a solution to build a digital twin debugging and testing system for a circuit board. By leveraging digital twin technology, interactive technology, Internet of Things technology, and communication network technology, a virtual debugging and testing system for circuit board products is created on an information technology platform, enabling R&D personnel to experience immersive debugging and testing of circuit board product functions and performance, eliminating the limitations of on-site debugging and on-site testing by R&D personnel, which not only improves the visual and interactivity of R&D personnel's R&D work, but also significantly reduces the product R&D cycle and improves product production quality.

[0052] Specifically, refer to Figure 1 , Figure 1 This is a system architecture diagram of an embodiment of a product debugging and testing system of the present application.

[0053] like Figure 1 As shown, an embodiment of the present application proposes a product debugging and testing system, which is a virtual product debugging and testing system built based on digital twin technology.

[0054] The system includes: an on-site commissioning system and an image system set up at the commissioning site, and a user interaction system remotely set up at the front end, wherein the on-site commissioning system is in communication with the image system and the user interaction system, wherein:

[0055] The user interaction system is used to respond to the front-end user's commissioning request for the tested product and send a commissioning instruction to the on-site commissioning system;

[0056] The on-site debugging system is used to provide a remote debugging environment for the product under test, receive a debugging instruction sent by the user interaction system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0057] Among them, the product under test can be a circuit board, etc. This embodiment takes the test of the circuit board as an example, wherein the debugging and / or testing operations on the circuit board include: one or more of: hardware testing before the circuit board is powered on, hardware testing after the circuit board is powered on, and software testing of the circuit board.

[0058] The image system is used to obtain the image of the commissioning site and transmit it to the user interaction system;

[0059] The user interaction system is also used to remotely display the image screen of the commissioning site online.

[0060] Specifically, as an implementation manner, the imaging system may include: a camera disposed at the commissioning site, the camera being connected to the communication network via the communication network interface.

[0061] The images acquired by the imaging system should preferably cover the interfaces and indicator lights of the product under test, as well as the front of the components.

[0062] As an implementation mode, the camera of the imaging system is preferably a holographic camera.

[0063] The embodiment of the present application adopts the above-mentioned scheme, specifically through the remote online display function of the imaging system of the debugging site and the user interaction system, to build a virtual product debugging and testing system based on digital twin technology. The imaging system obtains the image of the debugging site and transmits it to the front-end user interaction system for display, so that R&D personnel can watch the entire debugging process of the product site through the image at the front end, thereby eliminating the limitations of on-site debugging and on-site testing by R&D personnel, and enabling R&D personnel to experience immersive debugging and testing of the functions and performance of the tested products (such as circuit board products), which not only improves the visual and interactivity of the R&D work of R&D personnel, but also significantly reduces the R&D cycle of circuit board products and improves production quality.

[0064] Specifically, as an implementation method, the on-site commissioning system may include: a workbench, a signal testing system, and a robotic arm, wherein:

[0065] like Figure 2 As shown, the workbench is used to place the product under test, and the workbench is configured with a communication network interface, a power module, and a power control module; further, the workbench is also configured with a grounding module.

[0066] Among them, the communication network interface is used to connect the tested product and the corresponding equipment or system to the communication network; the communication network interface supports Ethernet communication and also supports serial communication. The communication network interface can be a wired network communication interface or a wireless network communication interface. The wired network communication interface can be an Ethernet communication interface, a USB communication interface, an RS232 serial port, an RS485 serial port, or a CAN interface, etc. The wireless network communication interface can be a mobile network communication interface, a WIFI interface, a Bluetooth interface or a ZigBee interface. The mobile network communication interface can be a 4G mobile network communication interface, a 5G network mobile communication interface or a satellite network communication interface, etc.

[0067] Taking a circuit board as an example, during testing, the communication interface of the circuit board under test is connected to the network communication interface of the workbench through a cable, and the number of the communication interfaces of the circuit board under test connected can be one or more.

[0068] The power module is used to supply power to the product under test during the debugging and testing process, can output low-voltage DC and AC power, and supports network-based control of power on and off of the power module. Taking a circuit board as an example, when debugging and testing the circuit board, the circuit board is connected to the power module, and the grounding point of the circuit board is connected to the grounding module. The power module is initially in a power-off state.

[0069] The power control module is used to control the power on and off of the power module during the debugging and testing process. The power control module can access the communication network through a communication network interface or through a wireless interface.

[0070] The robotic arm is used to control the imaging system to obtain the image of the test site according to the test instruction, and / or control the signal test system to perform corresponding debugging and / or testing operations on the tested product. The robotic arm supports network communication control and can be connected to the communication network to facilitate remote control by users. Figure 2 As shown, the robotic arm changes direction through the steering rod to control the corresponding system to perform corresponding operations.

[0071] The signal testing system is used to perform corresponding operations according to the control instructions of the robot arm to perform corresponding debugging and / or testing operations on the product under test.

[0072] Specifically, taking a circuit board as an example, the information signal test system is used to measure the circuit continuity, voltage value, resistance value, audio level, capacitance, inductance, transistor amplification factor, current value, signal spectrum, semiconductor parameters and power-on timing of the tested circuit board. In order to enhance the user's perception and interactivity, the signal test system can control the test instrument through a mechanical arm to measure the signal parameters of components on the circuit board and their connection links.

[0073] The test meter may include hardware signal test instruments such as a multimeter, an oscilloscope, a thermometer, a signal analyzer, and a network tester.

[0074] Furthermore, the on-site commissioning system further includes:

[0075] An information transmission system is used to transmit the image pictures acquired by the imaging system to the user interaction system.

[0076] Furthermore, the on-site commissioning system further includes: a file transfer service system; wherein:

[0077] The file transfer service system is used to support the tested product to download the debugging software.

[0078] Specifically, taking the circuit board as an example, as an implementation method, the file transfer service system is used to support the downloading and debugging software of the circuit board under test. The user interaction system also includes real-time acquisition of the software loading process data of the circuit board under test, and visually displaying these software loading process data.

[0079] Furthermore, the on-site debugging system further comprises: a signal generating system. The signal generating system is used to provide a test signal required for debugging and / or testing.

[0080] Specifically, as an implementation method, the user interaction system includes: a user interaction platform and a display system; wherein:

[0081] The user interaction platform is used to provide a user interaction interface, receive a commissioning request for the tested product from a front-end user on the user interaction interface, send a commissioning instruction to the on-site commissioning system, and receive an image of the commissioning site acquired by the imaging system;

[0082] The display system is used to display the image of the commissioning site.

[0083] Specifically, as an implementation mode, the display system and the user interaction platform can be integrated on one display device.

[0084] Alternatively, as another implementation, the display system is independently configured as a holographic projection device.

[0085] Specifically, as another implementation mode, Figure 3 As shown, the user interaction system includes: a user operation subsystem, a data information receiving and sending subsystem and a display device. Among them:

[0086] The user operation subsystem is used to provide a user operation interface, receive a commissioning request for the product under test from a front-end user on the user interaction interface, and generate a commissioning instruction according to the commissioning request;

[0087] The data information transceiver subsystem is used to receive the image pictures of the commissioning site acquired by the image system from the communication network, and send the commissioning instructions generated by the user operation subsystem to the communication network;

[0088] The display device is used to display the image images received by the data information receiving and sending subsystem, and to display the operations input by the user operation subsystem.

[0089] Taking the circuit board as an example, the user operation subsystem is used to provide a user operation interface, on which the user can remotely call various resources on the workbench to debug and / or test the circuit board, and can select the circuit board to be tested through the user operation interface, thereby generating corresponding debugging instructions.

[0090] The data information receiving and sending subsystem is used, on the one hand, to receive real-time image data from the workbench side of the circuit board debugging and testing from the communication network, and convert the received image data into image data that can be used for display. When projecting the image, a holographic projection device, such as a holographic projector, is preferred; on the other hand, the user control instructions (i.e., debugging instructions) generated by the user operation subsystem are sent to the communication network.

[0091] Among them, the best effect is achieved by using a holographic projection device to project the image data obtained by the received image system.

[0092] The display device, on the one hand, visualizes the image data received by the data information receiving and sending subsystem; and on the other hand, displays the operations input by the user operation subsystem.

[0093] Furthermore, as an implementation mode, the workbench is also configured with a fan system for cooling the tested product.

[0094] The following uses a circuit board as an example of a product under test to explain in detail the working principle of the product debugging and testing system of the present application for debugging and testing the circuit board under test.

[0095] As mentioned above, the debugging of circuit board products usually includes hardware debugging and software debugging. Among them, hardware debugging includes pre-power-on inspection and post-power-on inspection.

[0096] Specific examples are described below:

[0097] Example 1: Hardware testing before powering on the board.

[0098] like Figure 4As shown, the specific implementation process is as follows:

[0099] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0100] Step 2: Through the user interaction system, control the robot arm to move the camera to observe the tested circuit board, observe whether the components soldered on the tested circuit board meet the requirements of its design drawings, and whether the connections between all components are consistent with the requirements of the circuit board design drawings.

[0101] Step 3: Control the signal test system through the user interaction system to measure whether the pin arrangement of components with polarity on the tested circuit board is correct.

[0102] Example 2: Power-on observation of hardware test after the circuit board is powered on.

[0103] like Figure 5 As shown, the specific implementation process is as follows:

[0104] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0105] Step 2: Control the power module on the debugging and testing workbench to be in a power-on state through the user interaction system.

[0106] Step 3: Through the user interaction system, the robot arm is controlled to move a camera that can observe the circuit board under test to observe whether the circuit under test is smoking or other component damage. Once the component is found to be smoking abnormally on the user interaction system display interface, the power module on the debugging and testing workbench is promptly controlled to be in a power-off state.

[0107] Step 4: Through the user interaction system, use the robot arm to control the temperature probe in the signal measurement system to measure the temperature measurement points of the specified components, and view the temperature measurement data on the user interaction system display interface. Once the measurement data is found to be abnormal, the power module on the debugging and testing workbench is promptly controlled to be in a power-off state.

[0108] Step 5: After the test is completed, the power module on the debugging and testing workbench is controlled to be in a power-off state.

[0109] Example 3: Static test of hardware test after the circuit board is powered on.

[0110] like Figure 6 As shown, the specific implementation process is as follows:

[0111] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0112] Step 2: Control the power module on the debugging and testing workbench to be in a power-on state through the user interaction system.

[0113] Step 3: Do not input the test stimulus signal to the input interface of the circuit board under test. Use the robot arm to control the probe of the multimeter or oscilloscope in the signal measurement system through the user interaction system to measure the measurement points of the circuit board under test. The test parameters include voltage value, current value, clock signal frequency and amplitude, and power-on timing of the chip power supply. Check whether the values ​​of the above measurement items meet expectations on the user-side interactive system display interface.

[0114] Step 4: After the test is completed, the power module on the debugging and testing workbench is controlled to be in a power-off state.

[0115] Example 4: Dynamic test of hardware test after the circuit board is powered on.

[0116] like Figure 7 As shown, the specific implementation process is as follows:

[0117] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing, and connect the signal generation system to the input terminal of the circuit board under test.

[0118] Step 2: Control the power module on the debugging and testing workbench to be in a powered-on state through the user-side interactive system.

[0119] Step 3: Through the user interaction system, use the robot arm to control the network tester in the signal test system to apply a test excitation signal to the input end of the circuit board under test.

[0120] Step 4: Through the user interaction system, follow the input signal flow of the circuit board under test, use the robot arm to control the network tester in the signal measurement system, and check in turn whether each measurement point on the circuit board receives the expected data, and observe whether the signal amplitude of the signal passing through the component pins on the circuit board changes as expected.

[0121] Step 5: After the test is completed, the power module on the debugging and testing workbench is controlled to be in a power-off state.

[0122] Example 5: Hardware driver loading test after the circuit board is powered on.

[0123] like Figure 8 As shown, the specific implementation process is as follows:

[0124] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0125] Step 2: Upload the hardware driver software version file to the file transfer service system.

[0126] Step 3: Control the power module on the debugging and testing workbench to be powered on through the user interaction system.

[0127] Step 4: Connect the signal generation system test instrument to the test point on the circuit board under test.

[0128] Step 5: Check the startup information of the driver software of the circuit board under test through the user interaction system, and determine whether there is a problem with the hardware power-on loading based on the output information.

[0129] Step 6: After the test is completed, the power module on the debugging and testing workbench is controlled to be in a power-off state.

[0130] Through the above scheme, this embodiment builds a virtual product debugging and testing system with the help of digital twin technology, interactive technology, Internet of Things technology, and communication network technology. The user interaction system receives the debugging request of the front-end user for the tested product, and sends the debugging instruction to the on-site debugging system, so as to realize the pre-power-on inspection, post-power-on detection and software debugging of the circuit board, and can obtain the image of the debugging site through the imaging system, and transmit it to the front-end user interaction system for display, so that the R&D personnel can watch the entire debugging process of the product site through the image at the front end, thereby eliminating the limitations of on-site debugging and on-site testing of the R&D personnel, and can realize the immersive debugging and testing of the functions and performance of the tested products (such as circuit board products), which not only improves the perception and interactivity of the R&D work of the R&D personnel, but also significantly reduces the R&D cycle of the circuit board product and improves the production quality.

[0131] Reference Fig. 9 , Fig. 9 This is a flow chart of an embodiment of the product debugging and testing method of the present application. This embodiment pre-builds a virtual product debugging and testing system as described above based on digital twin technology.

[0132] like Fig. 9 As shown, an embodiment of the present application proposes a method for applying a product debugging test system of each of the above embodiments, the method comprising:

[0133] Step S101, in response to a front-end user's commissioning request for a product under test, a commissioning instruction is sent to an on-site commissioning system through a user interaction system;

[0134] As mentioned above, the product debugging and testing system includes: an on-site debugging system, an imaging system, and a user interaction system, wherein the on-site debugging system is in communication with the imaging system and the user interaction system. The on-site debugging system provides a remote debugging environment for the product under test.

[0135] Among them, the remote debugging environment is configured with corresponding debugging environment resources, which include: workbench, signal testing system, robotic arm, information transmission system, file transmission service system, signal generation system, etc. The workbench is configured with communication network interface, power module, power control module, etc.

[0136] The product under test may be a circuit board, etc., and this embodiment takes testing of a circuit board as an example.

[0137] Taking a circuit board as an example, when the circuit board needs to be tested, the operator can trigger a commissioning request for the tested circuit board through the operation interface of the user interaction platform of the front-end user interaction system. After receiving the commissioning request, the user interaction system sends a commissioning instruction to the on-site commissioning system. The commissioning instruction includes one or more of a debugging instruction and a test instruction.

[0138] Step S102, receiving the debugging instruction sent by the user interaction system through the on-site debugging system, and calling the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0139] After receiving the debugging instruction sent by the user interaction system, the on-site debugging system calls the debugging environment resources of the remote debugging environment according to the debugging instruction, such as a workbench, a signal test system, a robotic arm, an information transmission system, a file transmission service system, a signal generation system, etc., to perform corresponding debugging and / or testing operations on the product under test.

[0140] Taking a circuit board as an example, the debugging and / or testing operations on the circuit board include: one or more of hardware testing before the circuit board is powered on, hardware testing after the circuit board is powered on, and software testing of the circuit board.

[0141] Step S103, obtaining an image of the test site through an image system, and transmitting the image to the user interaction system;

[0142] At the commissioning and testing site, the image system is used to obtain images of the commissioning and testing site of the product under test. The images obtained by the image system should preferably cover the interfaces and indicator lights of the product under test, as well as the front of the components, etc., which also include images of the debugging or test operations of the product under test, such as images of the corresponding operations performed by the corresponding system controlled by a robotic arm.

[0143] The imaging system transmits the acquired image pictures of the test site to the user interaction system.

[0144] Step S104: remotely displaying the video image of the commissioning site online through the user interaction system.

[0145] The user interaction system includes: a user interaction platform and a display system. After the user interaction system receives the image picture of the commissioning site transmitted by the image system, the image picture of the commissioning site is displayed online through the display system.

[0146] Through the above scheme, this embodiment constructs a virtual product debugging and testing system based on digital twin technology, obtains the image of the debugging site through the imaging system, and transmits it to the front-end user interaction system for display, so that R&D personnel can watch the entire debugging process of the product site through the image screen at the front end, thereby eliminating the limitations of on-site debugging and on-site testing by R&D personnel, and enabling R&D personnel to experience immersive debugging and testing of the functions and performance of the tested products (such as circuit board products), which not only improves the visual and interactive nature of the R&D work of R&D personnel, but also significantly reduces the R&D cycle of circuit board products and improves production quality.

[0147] Specifically, as an implementation mode, taking the product under test as a circuit board as an example, the circuit board under test can be subjected to remote pre-power-on hardware testing, post-power-on hardware testing, and / or software testing.

[0148] As an implementation mode, the corresponding debugging environment resources are called according to the debugging instruction to perform the following remote pre-power-on hardware test on the tested circuit board:

[0149] Controlling the robotic arm to place the circuit board under test on the workbench;

[0150] Controlling the robot arm to move a camera that observes the circuit board under test, and determining whether the components soldered on the circuit board under test meet the requirements of the circuit board design drawing, and / or whether the connections between all components are consistent with the requirements of the circuit board design drawing according to the observation results;

[0151] The signal testing system is controlled to measure whether the arrangement of the pins of the components with polarity on the tested circuit board is correct.

[0152] As an implementation mode, the corresponding debugging environment resources are called by the debugging instruction to perform the following hardware test on the tested circuit board after remote power-on:

[0153] Controlling the robotic arm to place the circuit board under test on the workbench;

[0154] Controlling the power module on the workbench to be in a power-on state;

[0155] Controlling the robotic arm to move a camera that observes the circuit board under test;

[0156] Displaying the observation results on the display interface of the user interaction system;

[0157] If the display interface shows that the components are damaged, the power module on the workbench is controlled to be in a power-off state.

[0158] As an implementation mode, a test instrument in the signal measurement system is controlled by a mechanical arm through a test instruction to measure the hardware parameter status of components on the circuit board under test;

[0159] Displaying hardware parameter status data on the display interface of the user interaction system, or displaying hardware parameter status data on the display interface of the user interaction system according to a query instruction;

[0160] In the case that the hardware parameter status data is abnormal, the power module on the workbench is controlled to be in a power-off state; or, in the case that the test is completed, the power module on the workbench is controlled to be in a power-off state.

[0161] Furthermore, before the step of controlling the power module on the workbench to be in a power-on state, the step further includes:

[0162] Controlling the robotic arm to connect the signal generating system to the input end of the circuit board under test;

[0163] After the step of controlling the power module on the workbench to be in a power-on state, the following step is further included:

[0164] Controlling the mechanical arm to control the network tester in the signal testing system to apply a test excitation signal to the input end of the circuit board under test;

[0165] Along the flow direction of the input signal of the tested circuit board, the network tester is controlled by a mechanical arm to detect each measuring point of the tested circuit board in turn, and obtain the change of the signal amplitude of the component pins on the tested circuit board through which the signal passes.

[0166] Furthermore, before the step of controlling the power module on the workbench to be in a power-on state, the step further includes:

[0167] Upload the hardware driver software version file to the file transfer service system;

[0168] After the step of controlling the power module on the workbench to be in a power-on state, the following step is further included:

[0169] A test instrument of the signal generating system is connected to a detection point on the circuit board under test, so as to perform a hardware drive loading test on the circuit board under test after power is turned on.

[0170] As an implementation mode, the robot arm is controlled to connect the communication interface of the circuit board under test to the communication network interface of the workbench through the commissioning instruction;

[0171] Downloading the debugging software through the file transfer service system;

[0172] The debugging software is run, and the software loading process data of the circuit board under test is obtained through the user interaction system, and the software loading process data is visually displayed on the display interface to perform remote software debugging and / or testing on the circuit board under test.

[0173] Furthermore, as an implementation mode, the user interaction system is used to control the robot arm to call the fan system to perform a cooling operation on the circuit board under test.

[0174] The detailed process of this embodiment to implement remote pre-power-on hardware testing, post-power-on hardware testing and / or software testing of the circuit board under test may refer to the above-mentioned system embodiment.

[0175] This embodiment uses the above scheme to build a virtual product debugging and testing system based on digital twin technology, which realizes remote pre-power-on hardware testing, post-power-on hardware testing, software testing, etc. of the tested circuit board. The image screen of the debugging site is obtained through the image system and transmitted to the front-end user interaction system for display, so that R&D personnel can watch the entire debugging process of the product site through the image screen at the front end, thereby eliminating the restrictions on on-site debugging and on-site testing of R&D personnel, and enabling R&D personnel to experience immersive debugging and testing of the functions and performance of the tested products (such as circuit board products), which not only improves the perception and interactivity of the R&D work of R&D personnel, but also significantly reduces the R&D cycle of circuit board products and improves production quality.

[0176] In addition, if Fig.10 As shown, an embodiment of the present application provides a product debugging and testing device, including:

[0177] The command trigger module is used to respond to the front-end user's commissioning request for the tested product and send the commissioning command to the on-site commissioning system through the user interaction system;

[0178] A debugging and testing module, configured to receive a debugging instruction sent by the user interaction system through the on-site debugging system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0179] A transmission module, used to obtain the image of the commissioning site through the image system and transmit it to the user interaction system;

[0180] The display module is used to remotely display the image screen of the commissioning site online through the user interaction system.

[0181] For the principle and implementation process of implementing product debugging and testing in this embodiment, please refer to the above embodiments and will not be repeated here.

[0182] like Fig.11 As shown, an embodiment of the present application further proposes an electronic device, which includes a memory, a processor, and a product debugging and testing program stored in the memory and executable on the processor, wherein the product debugging and testing program, when executed by the processor, implements the product debugging and testing method as described in the above embodiments.

[0183] The electronic device may be a terminal device or a server, such as Fig.11 As shown, the electronic device may include an output module 110 , a processor 120 , a memory 130 and a communication module 140 .

[0184] The product debugging and testing program is stored in the memory 130. The communication module 140 may include a WIFI module, a mobile communication module, a Bluetooth module, etc., and communicates with an external device or a server through the communication module 140.

[0185] The product debugging and testing program in the memory 130 can implement the product debugging and testing methods described in the above embodiments when executed by the processor.

[0186] Since all the technical solutions of all the aforementioned embodiments are adopted when the debugging test program of this product is executed by the processor, it has at least all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0187] In addition, an embodiment of the present application further proposes a computer-readable storage medium, on which a product debugging and testing program is stored. When the product debugging and testing program is executed by a processor, the product debugging and testing method described in the above embodiments is implemented.

[0188] Since all the technical solutions of all the aforementioned embodiments are adopted when the debugging test program of this product is executed by the processor, it has at least all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0189] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0190] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a communication device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0191] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A product debugging and testing system, characterized in that: The system includes: an on-site debugging system, an imaging system, and a user interaction system. The on-site debugging system is communicatively connected with the imaging system and the user interaction system, wherein: The user interaction system is used to respond to the front-end user's commissioning request for the tested product and send a commissioning instruction to the on-site commissioning system; The on-site debugging system is used to provide a remote debugging environment for the product under test, receive a debugging instruction sent by the user interaction system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test; The image system is used to obtain the image of the commissioning site and transmit it to the user interaction system; The user interaction system is also used to remotely display the image screen of the commissioning site online.

2. The product debugging and testing system according to claim 1, characterized in that: The on-site debugging system includes: a workbench, a signal testing system and a mechanical arm, wherein: The workbench is used to place the product under test and is equipped with a communication network interface, a power module, and a power control module: The communication network interface is used to connect the tested product and the corresponding device or system to the communication network; The power supply module is used to supply power to the product under test during the commissioning and testing process; The power control module is used to control the power on and off of the power module during the debugging and testing process; The robotic arm is used to control the imaging system to acquire the image of the testing site according to the testing instruction, and / or control the signal testing system to perform corresponding debugging and / or testing operations on the tested product.

3. The product debugging and testing system according to claim 2, characterized in that: The on-site commissioning system further includes: An information transmission system is used to transmit the image frame acquired by the imaging system to the user interaction system.

4. The product debugging and testing system according to claim 2, characterized in that: The on-site debugging system also includes: a file transmission service system and / or a signal generation system; wherein: The file transfer service system is used to support the tested product to download the debugging software; The signal generating system is used to provide the test signal required for debugging and / or testing.

5. The product debugging and testing system according to any one of claims 1 to 4, characterized in that: The user interaction system comprises: a user interaction platform and a display system; wherein: The user interaction platform is used to provide a user interaction interface, receive a front-end user's commissioning request for the tested product on the user interaction interface, send a commissioning instruction to the on-site commissioning system, and receive an image of the commissioning site acquired by the imaging system; The display system is used to display the image of the commissioning site.

6. The product debugging and testing system according to claim 5, characterized in that: The display system and the user interaction platform are integrated on one display device, or the display system is independently configured as a holographic projection device.

7. The product debugging and testing system according to any one of claims 2 to 4, characterized in that: The user interaction system includes: a user operation subsystem, a data information receiving and sending subsystem and a display device; wherein: The user operation subsystem is used to provide a user operation interface, receive a commissioning request for the product under test from a front-end user on the user interaction interface, and generate a commissioning instruction according to the commissioning request; The data information transceiver subsystem is used to receive the image pictures of the commissioning site acquired by the image system from the communication network, and send the commissioning instructions generated by the user operation subsystem to the communication network; The display device is used to display the image images received by the data information receiving and sending subsystem, and to display the operations input by the user operation subsystem.

8. The product debugging and testing system according to any one of claims 2 to 4, characterized in that: The workbench is further configured with a fan system for cooling the tested product; and / or the workbench is further configured with a grounding module.

9. The product debugging and testing system according to any one of claims 2 to 4, characterized in that: The imaging system comprises: a camera arranged at the commissioning site, and the camera is connected to the communication network through the communication network interface.

10. The product debugging and testing system according to any one of claims 1 to 4, characterized in that: The product under test is a circuit board, and the debugging and / or testing operations include: one or more of: hardware testing before the circuit board is powered on, hardware testing after the circuit board is powered on, and software testing of the circuit board.

11. A method for a product debugging and testing system according to any one of claims 1 to 10, characterized in that: The method comprises: In response to a front-end user's request for commissioning of the product under test, a commissioning instruction is sent to the on-site commissioning system through the user interaction system; Receiving the debugging instruction sent by the user interaction system through the on-site debugging system, and calling the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test; Acquire the image of the commissioning site through the image system and transmit it to the user interaction system; The image screen of the commissioning site is remotely displayed online through the user interaction system.

12. A product debugging and testing device, characterized in that: include: The command trigger module is used to respond to the front-end user's commissioning request for the tested product and send the commissioning command to the on-site commissioning system through the user interaction system; A debugging and testing module, configured to receive a debugging instruction sent by the user interaction system through the on-site debugging system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test; A transmission module, used to obtain the image of the commissioning site through the image system and transmit it to the user interaction system; The display module is used to remotely display the image screen of the commissioning site online through the user interaction system.

13. An electronic device comprising a memory, a processor, and a product debugging test program stored in the memory and executable on the processor, wherein the product debugging test program implements the method according to claim 11 when executed by the processor.

14. A computer-readable storage medium having a product debugging test program stored thereon, wherein the product debugging test program implements the method according to claim 11 when executed by a processor.

Images