Product debugging and testing system, method and apparatus, and electronic device and storage medium

Abstract

Disclosed in the present application are a product debugging and testing system, method and apparatus, and an electronic device and a storage medium. The system comprises: an on-site debugging and testing system, an image system and a user interaction system, wherein the on-site debugging and testing system is in communication connection with the image system and the user interaction system; the user interaction system is used for sending a debugging and testing instruction to the on-site debugging and testing system in response to a debugging and testing request of a front-end user for a tested product; the on-site debugging and testing system is used for providing a remote debugging and testing environment of the tested product, receiving the debugging and testing instruction sent by the user interaction system, and calling a debugging and testing environment resource of the remote debugging and testing environment according to the debugging and testing instruction so as to execute a corresponding debugging and / or testing operation on the tested product; and the image system is used for acquiring an image picture of a debugging and testing site and transmitting the image picture to the user interaction system for remote online display.

Description

Product debugging and testing system, method, device, electronic equipment and storage medium

[0001] Related applications

[0002] This application claims priority to Chinese patent application No. 202310792362.8 filed on June 29, 2023, the entire contents of which are incorporated by reference into this application. Technical Field

[0003] The present application relates to the field of communication information technology, and in particular to a product debugging and testing system, method, device, electronic equipment and storage medium. Background Art

[0004] With the rapid development of the economy, the rapid debugging and testing of the functions and performance of circuit board products (hereinafter referred to as debugging) has become a key factor affecting the product development cycle and production quality.

[0005] Circuit board product testing includes both hardware and software testing. Hardware testing primarily involves pre-power-on inspection and post-power-on testing. Pre-power-on inspections include verifying correct PCB wiring and component installation, as well as open and short circuit testing. Post-power-on testing involves applying a specific signal to the board's input terminals, sequentially monitoring the signal's state at each test point along the input signal's flow path, and observing whether the expected state changes occur in components on the board as the signal passes through it. These hardware testing tasks require the use of test instruments such as multimeters, oscilloscopes, spectrum analyzers, and temperature guns.

[0006] The circuit board software debugging work mainly focuses on the CPU processor chip software loading and working state machine verification, verifying whether its chip pins can output valid level signals, and whether the peripheral controller can send and receive control instructions; programmable logic chip software loading and working state machine verification; also includes the function and performance verification of components such as sensors and clocks.

[0007] Currently, most companies' R&D personnel typically debug and test circuit board hardware and software functions in labs or on-site testing environments. This not only increases operational safety risks for R&D personnel, but also impacts product production quality and delivery schedules if they lack on-site testing capabilities. This is especially true for companies with offices spread across multiple locations. Existing remote testing technologies offer poor user experience and interactivity for cross-regional remote testing. To quickly debug and test circuit board product functions, personnel must travel to on-site environments to complete the work. This significantly increases product R&D costs, hinders R&D efficiency and production quality, and can also negatively impact R&D personnel's morale.

[0008] Summary of the Invention

[0009] In view of this, the main purpose of the embodiments of the present application is to propose a product debugging and testing system, method, device, electronic device and storage medium, aiming to improve the visual experience and interactivity of R&D personnel in remote debugging and testing of circuit board functions and performance, shorten the R&D cycle of circuit board products and improve production quality.

[0010] To achieve the above objectives, the present application provides a product debugging and testing system, which includes: an on-site debugging system, an imaging system, and a user interaction system. The on-site debugging system is communicatively connected to the imaging system and the user interaction system, wherein:

[0011] The user interaction system is configured to send a commissioning instruction to the on-site commissioning system in response to a front-end user's commissioning request for the product under test;

[0012] The on-site commissioning system is configured to provide a remote commissioning environment for the product under test, receive a commissioning instruction sent by the user interaction system, and invoke commissioning environment resources of the remote commissioning environment according to the commissioning instruction to perform corresponding debugging and / or testing operations on the product under test;

[0013] The imaging system is configured to obtain an image of the test site and transmit it to the user interaction system;

[0014] The user interaction system is further configured to remotely display the image of the test site online.

[0015] The present application provides a method for the product debugging and testing system as described above, the method comprising:

[0016] In response to the front-end user's request for commissioning of the product under test, a commissioning instruction is sent to the on-site commissioning system through the user interaction system;

[0017] Receiving, through the on-site commissioning system, a commissioning instruction sent by the user interaction system, and calling commissioning environment resources of the remote commissioning environment according to the commissioning instruction to perform corresponding debugging and / or testing operations on the product under test;

[0018] Acquire the image of the test site through the imaging system and transmit it to the user interaction system;

[0019] The image screen of the commissioning site is remotely displayed online through the user interaction system.

[0020] The present application provides a product debugging and testing device, including:

[0021] The command trigger module is configured to respond to a front-end user's request for commissioning of the product under test and send a commissioning command to the on-site commissioning system through the user interaction system;

[0022] a debugging and testing module configured to receive a debugging instruction sent by the user interaction system through the on-site debugging system, and to call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0023] A transmission module, configured to obtain an image of the test site through an imaging system and transmit the image to the user interaction system;

[0024] The display module is configured to remotely display the image of the test site online through the user interaction system.

[0025] An embodiment of the present application further provides an electronic device, comprising a memory, a processor, and a product debugging and testing program stored in the memory and executable on the processor, wherein the product debugging and testing program implements the method described above when executed by the processor.

[0026] An embodiment of the present application further provides a computer-readable storage medium, on which a product debugging test program is stored. When the product debugging test program is executed by a processor, the method described above is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for describing the embodiments. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without inventive work.

[0028] FIG1 is a schematic diagram of the architecture of an embodiment of a product debugging and testing system of the present application;

[0029] FIG2 is a schematic diagram of the structure of a workbench of a product debugging and testing system according to an embodiment of the present application;

[0030] FIG3 is a schematic diagram of the structure of a user interaction system of a product debugging and testing system according to an embodiment of the present application;

[0031] FIG4 is a schematic diagram of a hardware test flow before power is applied to a circuit board under test in a product debugging and testing system according to an embodiment of the present application;

[0032] FIG5 is a schematic diagram of a power-on observation hardware test process after the circuit board under test is powered on in an embodiment of the present application;

[0033] FIG6 is a schematic diagram of a static hardware test process after the circuit board under test is powered on according to an embodiment of the present application;

[0034] FIG7 is a schematic diagram of a dynamic hardware test process after the circuit board under test is powered on according to an embodiment of the present application;

[0035] FIG8 is a schematic diagram of a hardware driver loading test process for a circuit board under test according to an embodiment of the present application;

[0036] FIG9 is a flow chart of an embodiment of a product debugging and testing method of the present application;

[0037] FIG10 is a schematic diagram of the functional modules of an embodiment of a product debugging and testing device of the present application;

[0038] FIG11 is a schematic diagram of functional modules of an electronic device according to an embodiment of the present application.

[0039] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0040] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0041] As used herein, the terms "comprises," "includes," or any other variants thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element. Optionally, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings shall be determined by their interpretation in the specific embodiment or further in conjunction with the context of the specific embodiment.

[0042] The specific embodiments described herein are merely used to explain the present application and are not intended to limit the present application.

[0043] In the subsequent description, the use of suffixes such as "module", "component" or "unit" to represent elements is only for the purpose of facilitating the description of the present application and has no specific meaning. Therefore, "module", "component" or "unit" can be used interchangeably.

[0044] In the embodiments of the present application, the communication device may be a server, a terminal device, or a base station device, etc., and the present application needs to be determined according to the specific context.

[0045] The subsequent description will be made using a server as an example. It will be understood by those skilled in the art that, in addition to components specifically used for mobile purposes, the structure according to the embodiments of the present application can also be applied to other fixed types of terminals.

[0046] Technical terms involved in the embodiments of this application:

[0047] Metaverse technology: With the rapid development of the internet, metaverse technology has emerged. Using digital technology, people are recreating real-world products in the virtual world, establishing a digital living space for a new social system. The metaverse's supporting technologies include interactive technology, digital twin technology, communication network technology, artificial intelligence technology, Internet of Things technology, network and computing power technology, and blockchain technology.

[0048] Digital twin: A digital twin is a software model of a physical object in the real world, digitized and composed of both static attributes and dynamic data. It mimics a device or system, creating a digital clone. Digital twin technology has taken root in fields such as industrial manufacturing, scientific research, healthcare, and education. Through interactive immersive technology, users can experience an immersive digital living space, possessing a virtual avatar in the digital world and creating content within it. A more immersive experience requires the support of high-speed communication networks. Furthermore, the use of IoT technology to transmit data over the network enhances the convenience of interaction between people and devices.

[0049] Circuit board product debugging: Usually, circuit board product debugging includes hardware debugging and software debugging. Among them:

[0050] Hardware commissioning involves pre-power-on inspection and post-power-on testing. Pre-power-on inspection involves checking the PCB wiring for correctness according to the circuit board schematic, such as checking for incorrect connections, missing connections, or excessive connections. Components are also checked for proper installation, including loose connections and incorrect polarity for polarized components. Open and short circuit testing is also performed. These hardware commissioning tasks require the use of test instruments such as multimeters, oscilloscopes, spectrum analyzers, and temperature guns. Currently, hardware commissioning personnel primarily use these instruments in the laboratory, lacking the technical means to remotely and immersively commission hardware components. Post-power-on testing involves applying a specific signal to the input terminals of the circuit board, monitoring the signal state at each test point along the input signal path, and observing whether the expected state changes occur in the components on the board as the signal passes through them.

[0051] Circuit board software debugging involves: software loading and state machine verification of the CPU processor chip, verifying whether its pins can output valid level signals and whether peripheral controllers can send and receive control commands; software loading and state machine verification of the programmable logic chip; and functional and performance verification of components such as sensors and clocks. Currently, software debugging personnel primarily rely on CPU hardware emulators and their accompanying software, along with hardware signal testers and signal generators, to directly or indirectly debug and test the software functions and performance of circuit board components such as the CPU processor, programmable logic chip, sensors, and clocks. This approach prevents real-time observation of the hardware parameter status of circuit board components, resulting in poor visual and interactive debugging and testing.

[0052] The embodiments of the present application take into account that, at present, for the debugging and testing of circuit board products, R&D personnel are usually required to debug and test the hardware and software functions of the circuit board in a laboratory or on-site debugging environment. This will not only increase the operational safety risks of R&D personnel, but also once the relevant R&D personnel do not have the conditions for on-site debugging, it will affect the production quality and delivery progress of the product. Especially for companies with offices distributed in multiple regions, the existing remote debugging technology has poor user experience and interactivity for cross-regional remote debugging. In order to quickly debug and test the functions of circuit board products, personnel have to be arranged to travel to the environment site to complete the work, which not only significantly increases the cost of product development, drags down the product development efficiency and production quality, but also affects the mood of R&D personnel.

[0053] Therefore, the embodiment of the present application proposes a solution to build a digital twin debugging and testing system for circuit boards. By leveraging digital twin technology, interactive technology, Internet of Things technology, and communication network technology, a virtual debugging and testing system for circuit board products is created on an information technology platform, enabling R&D personnel to experience immersive debugging and testing of circuit board product functions and performance, eliminating the limitations of on-site debugging and on-site testing by R&D personnel, and not only improving the visual and interactive nature of R&D personnel's R&D work, but also significantly reducing the product R&D cycle and improving product production quality.

[0054] In one implementation, referring to FIG. 1 , FIG. 1 is a system architecture diagram of an embodiment of a product debugging and testing system of the present application.

[0055] As shown in FIG1 , an embodiment of the present application proposes a product debugging and testing system, which is a virtual product debugging and testing system built based on digital twin technology.

[0056] The system includes: an on-site commissioning system and an imaging system set up at the commissioning site, and a user interaction system remotely set up at the front end, wherein the on-site commissioning system is in communication with the imaging system and the user interaction system, wherein:

[0057] The user interaction system is configured to send a commissioning instruction to the on-site commissioning system in response to a front-end user's commissioning request for the product under test;

[0058] The on-site commissioning system is configured to provide a remote commissioning environment for the product under test, receive commissioning instructions sent by the user interaction system, and invoke commissioning environment resources of the remote commissioning environment according to the commissioning instructions to perform corresponding debugging and / or testing operations on the product under test;

[0059] Among them, the product under test can be a circuit board, etc. This embodiment takes the testing of the circuit board as an example, wherein the debugging and / or testing operations on the circuit board include: hardware testing before the circuit board is powered on, hardware testing after the circuit board is powered on, and one or more of the circuit board software testing.

[0060] The imaging system is used to obtain images of the test site and transmit them to the user interaction system;

[0061] The user interaction system is also used to remotely display the image of the test site online.

[0062] As an implementation manner, the imaging system may include: a camera provided at the test site, the camera being connected to the communication network via the communication network interface.

[0063] The images acquired by the imaging system should preferably cover the interfaces and indicator lights of the product under test, as well as the front of the components.

[0064] As an embodiment, the camera of the imaging system is preferably a holographic camera.

[0065] The embodiment of the present application uses the above-mentioned scheme, specifically through the remote online display function of the imaging system of the debugging site and the user interaction system, to build a virtual product debugging and testing system based on digital twin technology. The imaging system obtains the image of the debugging site and transmits it to the front-end user interaction system for display, so that R&D personnel can watch the entire debugging process of the product site through the image screen at the front end, thereby eliminating the limitations of on-site debugging and on-site testing by R&D personnel, and enabling R&D personnel to experience immersive debugging and testing of the functions and performance of the tested products (such as circuit board products), which not only improves the visual and interactive nature of the R&D work of R&D personnel, but also significantly reduces the R&D cycle of circuit board products and improves production quality.

[0066] As an embodiment, the on-site commissioning system may include: a workbench, a signal testing system, and a robotic arm, wherein:

[0067] As shown in FIG2 , the workbench is used to place the product under test, and is equipped with a communication network interface, a power module, and a power control module. In one embodiment, the workbench is also equipped with a grounding module.

[0068] The communication network interface is used to connect the tested product and the corresponding device or system to the communication network; the communication network interface supports Ethernet communication and serial communication. The communication network interface can be a wired network communication interface or a wireless network communication interface. The wired network communication interface can be an Ethernet communication interface, a USB communication interface, an RS232 serial port, an RS485 serial port, or a CAN interface, etc. The wireless network communication interface can be a mobile network communication interface, a WIFI interface, a Bluetooth interface, or a ZigBee interface. The mobile network communication interface can be a 4G mobile network communication interface, a 5G mobile network communication interface, or a satellite network communication interface, etc.

[0069] Taking a circuit board as an example, during testing, the communication interface of the circuit board under test is connected to the network communication interface of the workbench via a cable, and the number of communication interfaces of the circuit board under test connected can be one or more.

[0070] The power module is used to power the product under test during commissioning and testing. It can output low-voltage DC and AC power and supports network-based power-on and power-off control of the power module. For example, during commissioning and testing of a circuit board, the board is connected to the power module, and the board ground point is connected to the ground module. The power module is initially powered off.

[0071] The power control module is used to control the power on and off of the power module during the debugging and testing process. The power control module can access the communication network through a communication network interface or a wireless interface.

[0072] The robotic arm is used to control the imaging system to capture images of the test site according to the test instructions, and / or to control the signal testing system to perform corresponding debugging and / or testing operations on the product under test. The robotic arm supports network communication control and can access a communication network to facilitate remote user control. As shown in Figure 2, the robotic arm changes direction via a steering rod to control the corresponding system to perform the corresponding operation.

[0073] The signal testing system is used to perform corresponding operations according to the control instructions of the robotic arm to perform corresponding debugging and / or testing operations on the product under test.

[0074] Taking a circuit board as an example, this information signal testing system measures circuit continuity, voltage, resistance, audio level, capacitance, inductance, transistor gain, current, signal spectrum, semiconductor parameters, and power-on timing. To enhance user experience and interactivity, the signal testing system can control test instruments using a robotic arm to measure signal parameters of components on the circuit board and their interconnects.

[0075] The test meter may include hardware signal test instruments such as a multimeter, an oscilloscope, a thermometer, a signal analyzer, and a network tester.

[0076] In one embodiment, the on-site commissioning system further includes:

[0077] An information transmission system is used to transmit the image images captured by the imaging system to the user interaction system.

[0078] In one embodiment, the on-site commissioning system further includes: a file transfer service system; wherein:

[0079] The file transfer service system is used to support the tested product in downloading the debugging software.

[0080] Taking the circuit board as an example, as an implementation method, the file transfer service system is used to support the downloading and debugging software of the circuit board under test. The user interaction system also includes real-time acquisition of the software loading process data of the circuit board under test and visualization of these software loading process data.

[0081] In one embodiment, the on-site debugging system further includes a signal generating system, which is configured to provide test signals required for debugging and / or testing.

[0082] As an embodiment, the user interaction system includes: a user interaction platform and a display system; wherein:

[0083] The user interaction platform is configured to provide a user interaction interface, receive a front-end user's request for commissioning the product under test on the user interaction interface, send a commissioning instruction to the on-site commissioning system, and receive an image of the commissioning site acquired by the imaging system;

[0084] The display system is used to display the image of the test site.

[0085] As an implementation method, the display system and the user interaction platform can be integrated into one display device.

[0086] Alternatively, as another embodiment, the display system is independently configured as a holographic projection device.

[0087] As another embodiment, as shown in FIG3 , the user interaction system includes: a user operation subsystem, a data information receiving and sending subsystem, and a display device.

[0088] The user operation subsystem is configured to provide a user operation interface, receive a front-end user's commissioning request for the product under test on the user interaction interface, and generate a commissioning instruction according to the commissioning request;

[0089] The data information transceiver subsystem is used to receive the image of the test site acquired by the imaging system from the communication network, and send the test instruction generated by the user operation subsystem to the communication network;

[0090] The display device is used to display the image images received by the data information receiving and sending subsystem, and to display the operations input by the user operation subsystem.

[0091] Taking the circuit board as an example, the user operation subsystem is used to provide a user operation interface, on which the user can remotely call various resources on the workbench to debug and / or test the circuit board, and can select the circuit board to be tested through the user operation interface to generate corresponding debugging instructions.

[0092] The data information transceiver subsystem is used, on the one hand, to receive real-time image data from the workbench side of the circuit board debugging and testing from the communication network, and convert the received image data into image data that can be used for display. When projecting images, a holographic projection device, such as a holographic projector, is preferably used; on the other hand, the user control instructions (i.e., debugging instructions) generated by the user operation subsystem are sent to the communication network.

[0093] Among them, the best effect is achieved when the image data obtained by the received image system is projected using a holographic projection device.

[0094] The display device, on the one hand, visually displays the image data received by the data information transceiver subsystem; and on the other hand, displays the operations input by the user operation subsystem.

[0095] As an embodiment, the workbench is further configured with a fan system for cooling the product under test.

[0096] The following takes the product under test as a circuit board as an example to explain in detail the working principle of the product debugging and testing system of the present application for debugging and testing the circuit board under test.

[0097] As mentioned above, circuit board product commissioning usually includes hardware commissioning and software commissioning. Hardware commissioning includes pre-power-on inspection and post-power-on testing.

[0098] Specific examples are described below:

[0099] Example 1: Hardware testing before powering on the board.

[0100] As shown in FIG4 , the specific implementation process is as follows:

[0101] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0102] Step 2: Through the user interaction system, control the robotic arm to move the camera to observe the tested circuit board to see whether the components soldered on the tested circuit board meet the requirements of its design drawings and whether the connections between all components are consistent with the requirements of the circuit board design drawings.

[0103] Step 3: Control the signal testing system through the user interaction system to measure whether the pin arrangement of components with polarity on the tested circuit board is correct.

[0104] Example 2: Power-on observation of hardware test after the circuit board is powered on.

[0105] As shown in FIG5 , the specific implementation process is as follows:

[0106] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0107] Step 2: Control the power module on the debugging and testing workbench to be in a power-on state through the user interaction system.

[0108] Step 3: Through the user interaction system, the robotic arm moves a camera that can observe the circuit board under test to observe whether the circuit under test is smoking or other component damage. If smoke is detected on the user interaction system display interface, the power module on the debugging and testing workbench is immediately powered off.

[0109] Step 4: Through the user interaction system, use the robotic arm to control the temperature probe in the signal measurement system to measure the temperature of the specified component. The temperature measurement data is displayed on the user interaction system display interface. If any abnormal measurement data is found, the power module on the debugging and testing workbench is immediately powered off.

[0110] Step 5: After the test is completed, the power supply module on the debugging and testing workbench is controlled to be in a power-off state.

[0111] Example 3: Static test of hardware test after the circuit board is powered on.

[0112] As shown in FIG6 , the specific implementation process is as follows:

[0113] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0114] Step 2: Control the power module on the debugging and testing workbench to be in a power-on state through the user interaction system.

[0115] Step 3: Without inputting a test stimulus signal to the input interface of the PCB under test, use the user-interactive system to control the multimeter or oscilloscope probe in the signal measurement system using the robotic arm to measure the measurement points on the PCB under test. Test parameters include voltage, current, clock signal frequency and amplitude, and chip power supply power-up timing. Check the user-interactive system display to see if the values ​​of these measurements meet expectations.

[0116] Step 4: After the test is completed, the power supply module on the debugging and testing workbench is controlled to be in a power-off state.

[0117] Example 4: Dynamic test of hardware test after the circuit board is powered on.

[0118] As shown in FIG7 , the specific implementation process is as follows:

[0119] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing, and connect the signal generation system to the input terminal of the circuit board under test.

[0120] Step 2: Control the power module on the debugging and testing workbench to be in a powered-on state through the user-side interactive system.

[0121] Step 3: Through the user interaction system, use the robotic arm to control the network tester in the signal test system to apply a test excitation signal to the input end of the circuit board under test.

[0122] Step 4: Through the user interaction system, follow the input signal flow of the circuit board under test, use the robotic arm to control the network tester in the signal measurement system, and sequentially detect whether each measurement point on the circuit board receives the expected data, and observe whether the signal amplitude of the component pins on the circuit board changes as expected.

[0123] Step 5: After the test is completed, the power supply module on the debugging and testing workbench is controlled to be in a power-off state.

[0124] Example 5: Hardware driver loading test after the circuit board is powered on.

[0125] As shown in FIG8 , the specific implementation process is as follows:

[0126] Step 1: Place the circuit board under test on the workbench for circuit board debugging and testing.

[0127] Step 2: Upload the hardware driver software version file to the file transfer service system.

[0128] Step 3: Control the power module on the debugging and testing workbench to be in a power-on state through the user interaction system.

[0129] Step 4: Connect the signal generation system test instrument to the test point on the circuit board under test.

[0130] Step 5: Use the user interaction system to check the startup information of the driver software of the tested circuit board, and determine whether there is a problem with the hardware power-on loading based on the output information.

[0131] Step 6: After the test is completed, the power supply module on the debugging and testing workbench is controlled to be in a power-off state.

[0132] Through the above-mentioned scheme, this embodiment uses digital twin technology, interactive technology, Internet of Things technology, and communication network technology to build a virtual product debugging and testing system. The user interaction system receives the front-end user's debugging request for the tested product and sends the debugging instruction to the on-site debugging system. It can realize pre-power-on inspection, post-power-on detection, and software debugging of the circuit board. The image screen of the debugging site can be obtained through the imaging system and transmitted to the front-end user interaction system for display, so that R&D personnel can watch the entire debugging process of the product site through the image screen at the front end, thereby eliminating the limitations of R&D personnel's on-site debugging and on-site testing. It can enable R&D personnel to experience immersive debugging and testing of the functions and performance of the tested product (such as circuit board products), which not only improves the perception and interactivity of R&D personnel's R&D work, but also significantly reduces the R&D cycle of circuit board products and improves production quality.

[0133] 9, which is a flow chart of an embodiment of a product debugging and testing method of the present application, in which a virtual product debugging and testing system as described above is constructed in advance based on digital twin technology.

[0134] As shown in FIG9 , an embodiment of the present application provides a method for applying the product debugging and testing system of each of the above embodiments, the method comprising:

[0135] Step S101, in response to a front-end user's request for commissioning of a product under test, a commissioning instruction is sent to an on-site commissioning system via a user interaction system;

[0136] As mentioned above, the product debugging and testing system includes: an on-site debugging system, an imaging system, and a user interaction system. The on-site debugging system is in communication with the imaging system and the user interaction system. The on-site debugging system provides a remote debugging environment for the product under test.

[0137] Among them, the remote debugging environment is configured with corresponding debugging environment resources, which include: workbench, signal testing system, robotic arm, information transmission system, file transfer service system, signal generation system, etc. The workbench is configured with communication network interface, power module, power control module, etc.

[0138] The product under test may be a circuit board, etc. This embodiment takes the test of a circuit board as an example.

[0139] For example, when a circuit board needs to be tested, an operator can trigger a commissioning request for the circuit board in the user interface of the front-end user interaction system's user interaction platform. After receiving the commissioning request, the user interaction system sends a commissioning instruction to the on-site commissioning system. The commissioning instruction can include one or more of a debugging instruction and a test instruction.

[0140] Step S102: receiving a debugging instruction sent by the user interaction system through the on-site debugging system, and calling debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0141] After receiving the debugging instruction sent by the user interaction system, the on-site debugging system calls the debugging environment resources of the remote debugging environment according to the debugging instruction, such as the workbench, signal test system, robotic arm, information transmission system, file transfer service system, signal generation system, etc., to perform corresponding debugging and / or testing operations on the product under test.

[0142] Taking a circuit board as an example, the debugging and / or testing operations on the circuit board include: one or more of: hardware testing before the circuit board is powered on, hardware testing after the circuit board is powered on, and software testing of the circuit board.

[0143] Step S103: acquiring an image of the test site through the imaging system and transmitting the image to the user interaction system;

[0144] At the commissioning site, the imaging system is used to obtain images of the commissioning site of the product under test. The images obtained by the imaging system should preferably cover the interfaces and indicator lights of the product under test, as well as the front of the components, etc., which also include images of the debugging or testing operations of the product under test, such as images of the corresponding operations performed by the corresponding system controlled by a robotic arm.

[0145] The imaging system transmits the acquired image of the test site to the user interaction system.

[0146] Step S104: remotely displaying the image of the test site online through the user interaction system.

[0147] The user interaction system includes: a user interaction platform and a display system. After the user interaction system receives the image of the test site transmitted by the imaging system, the display system displays the image of the test site online.

[0148] This embodiment uses the above scheme to build a virtual product debugging and testing system based on digital twin technology. The image screen of the debugging site is obtained through the imaging system and transmitted to the front-end user interaction system for display, so that R&D personnel can watch the entire debugging process of the product site through the image screen at the front end, thereby eliminating the limitations of on-site debugging and on-site testing by R&D personnel, and enabling R&D personnel to experience immersive debugging and testing of the functions and performance of the tested products (such as circuit board products). It not only improves the visual and interactive nature of the R&D work of R&D personnel, but also significantly reduces the R&D cycle of circuit board products and improves production quality.

[0149] As an implementation manner, taking the product under test as a circuit board as an example, the circuit board under test may be subjected to remote pre-power-on hardware testing, post-power-on hardware testing, and / or software testing.

[0150] As an implementation method, the corresponding debugging environment resources are called according to the debugging instruction to perform the following remote pre-power-on hardware test on the circuit board under test:

[0151] Controlling the robotic arm to place the circuit board under test on the workbench;

[0152] Controlling the robotic arm to move a camera that observes the circuit board under test, and determining, based on the observation results, whether the components soldered on the circuit board under test meet the requirements of the circuit board design drawing, and / or whether the connections between all components are consistent with the requirements of the circuit board design drawing;

[0153] The signal testing system is controlled to measure whether the pin arrangement of components with polarity on the tested circuit board is correct.

[0154] As an implementation method, the corresponding debugging environment resources are called by the debugging instruction to perform the following hardware test on the circuit board under test after remote power-on:

[0155] Controlling the robotic arm to place the circuit board under test on the workbench;

[0156] Controlling the power module on the workbench to be in a power-on state;

[0157] Controlling the robotic arm to move a camera to observe the circuit board under test;

[0158] Displaying the observation results on the display interface of the user interaction system;

[0159] If the display interface shows that the component is damaged, the power module on the workbench is controlled to be in a power-off state.

[0160] As an implementation mode, a test instrument in the signal measurement system is controlled by a robotic arm through a test instruction to measure the hardware parameter status of components on the circuit board under test;

[0161] Displaying hardware parameter status data on the display interface of the user interaction system, or displaying hardware parameter status data on the display interface of the user interaction system according to a query instruction;

[0162] In the case that the hardware parameter status data is abnormal, the power supply module on the workbench is controlled to be in a power-off state; or, in the case that the test is completed, the power supply module on the workbench is controlled to be in a power-off state.

[0163] Before the step of controlling the power module on the workbench to be in a power-on state, the step further includes:

[0164] Controlling the robotic arm to connect the signal generating system to the input end of the circuit board under test;

[0165] After the step of controlling the power module on the workbench to be in a powered-on state, the following steps are further included:

[0166] Controlling the robotic arm to control the network tester in the signal testing system to apply a test excitation signal to the input end of the circuit board under test;

[0167] The network tester is controlled by a robotic arm along the flow direction of the input signal of the circuit board under test, and each measurement point of the circuit board under test is detected in turn, and the change in the signal amplitude of the component pins on the circuit board under test through which the signal passes is obtained.

[0168] Before the step of controlling the power module on the workbench to be in a power-on state, the step further includes:

[0169] Uploading the hardware driver software version file to the file transfer service system;

[0170] After the step of controlling the power module on the workbench to be in a powered-on state, the following steps are further included:

[0171] A test instrument of a signal generating system is connected to a detection point on the circuit board under test, so as to perform a hardware drive loading test on the circuit board under test after power is turned on.

[0172] As an implementation mode, the robot arm is controlled to connect the communication interface of the circuit board under test to the communication network interface of the workbench through a test instruction;

[0173] Downloading the debugging software through the file transfer service system;

[0174] Run the debugging software, obtain the software loading process data of the circuit board under test through the user interaction system, and visualize the software loading process data on the display interface to perform remote software debugging and / or testing on the circuit board under test.

[0175] As an implementation manner, the user interaction system is used to control the robotic arm to call the fan system to perform a cooling operation on the circuit board under test.

[0176] The detailed process of remotely performing pre-power-on hardware testing, post-power-on hardware testing, and / or software testing on the circuit board under test in this embodiment may refer to the above-mentioned system embodiment.

[0177] This embodiment uses the above-mentioned solution to build a virtual product debugging and testing system based on digital twin technology, which enables remote pre-power-on hardware testing, post-power-on hardware testing, and software testing of the circuit board under test. The video system captures the video footage of the debugging site and transmits it to the front-end user interaction system for display, allowing R&D personnel to watch the entire on-site debugging process of the product through the video footage at the front end, thereby eliminating the limitations of on-site debugging and testing by R&D personnel. This allows R&D personnel to experience immersive debugging and testing of the functions and performance of the tested product (such as circuit board products), which not only improves the visual and interactive nature of R&D work, but also significantly reduces the R&D cycle of circuit board products and improves production quality.

[0178] In addition, as shown in FIG10 , an embodiment of the present application provides a product debugging and testing device, including:

[0179] The command trigger module is used to respond to the front-end user's request for commissioning of the product under test and send a commissioning command to the on-site commissioning system through the user interaction system;

[0180] a debugging and testing module, configured to receive a debugging instruction sent by the user interaction system through the on-site debugging system, and invoke debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test;

[0181] A transmission module, configured to obtain an image of the test site through an imaging system and transmit the image to the user interaction system;

[0182] The display module is used to remotely display the image of the test site online through the user interaction system.

[0183] For the principle and implementation process of implementing product debugging and testing in this embodiment, please refer to the above embodiments and will not be repeated here.

[0184] As shown in Figure 11, an embodiment of the present application also proposes an electronic device, which includes a memory, a processor, and a product debugging and testing program stored in the memory and runnable on the processor. When the product debugging and testing program is executed by the processor, it implements the product debugging and testing method described in the above embodiments.

[0185] The electronic device may be a terminal device or a server. As shown in FIG11 , the electronic device may include an output module 110 , a processor 120 , a memory 130 and a communication module 140 .

[0186] The product debugging and testing program is stored in the memory 130. The communication module 140 may include a WIFI module, a mobile communication module, a Bluetooth module, etc., and communicates with an external device or server through the communication module 140.

[0187] The product debugging and testing program in the memory 130 can implement the product debugging and testing methods described in the above embodiments when executed by the processor.

[0188] Since the debugging test program of this product adopts all the technical solutions of all the aforementioned embodiments when it is executed by the processor, it has at least all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0189] In addition, an embodiment of the present application further provides a computer-readable storage medium, on which a product debugging and testing program is stored. When the product debugging and testing program is executed by a processor, the product debugging and testing method described in the above embodiments is implemented.

[0190] Since the debugging test program of this product adopts all the technical solutions of all the aforementioned embodiments when it is executed by the processor, it has at least all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0191] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0192] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as mentioned above, and includes a number of instructions for enabling a communication device (which can be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the method of each embodiment of the present application.

[0193] The above are merely optional embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A product debugging and testing system, wherein: The system includes: an on-site debugging system, an imaging system, and a user interaction system. The on-site debugging system is communicatively connected with the imaging system and the user interaction system, wherein: The user interaction system is configured to send a commissioning instruction to the on-site commissioning system in response to a commissioning request of a front-end user for a product under test; The on-site debugging system is configured to provide a remote debugging environment for the product under test, receive a debugging instruction sent by the user interaction system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test; The imaging system is configured to obtain an image of the test site and transmit it to the user interaction system; The user interaction system is also configured to remotely display the image of the commissioning site online.

2. The product debugging and testing system according to claim 1, wherein: The on-site debugging system includes: a workbench, a signal testing system and a mechanical arm, wherein: The workbench is configured to place the product under test and is equipped with a communication network interface, a power module, and a power control module: The communication network interface is configured to connect the tested product and the corresponding device or system to a communication network; The power supply module is configured to supply power to the product under test during the commissioning and testing process; The power control module is configured to control power on and power off of the power module during the test process; The robotic arm is configured to control the imaging system to acquire the image of the testing site according to the testing instruction, and / or control the signal testing system to perform corresponding debugging and / or testing operations on the tested product.

3. The product debugging and testing system according to claim 2, wherein: The on-site commissioning system further includes: An information transmission system is configured to transmit the image frame acquired by the imaging system to the user interaction system.

4. The product debugging and testing system according to claim 2, wherein: The on-site debugging system also includes: a file transmission service system and / or a signal generation system; wherein: The file transfer service system is configured to support the tested product in downloading the debugging software; The signal generating system is configured to provide test signals required for debugging and / or testing.

5. The product debugging and testing system according to any one of claims 1 to 4, wherein: The user interaction system comprises: a user interaction platform and a display system; wherein: The user interaction platform is configured to provide a user interaction interface, receive a front-end user's commissioning request for the tested product on the user interaction interface, send a commissioning instruction to the on-site commissioning system, and receive an image of the commissioning site acquired by the imaging system; The display system is configured to display the image of the commissioning site.

6. The product debugging and testing system according to claim 5, wherein: The display system and the user interaction platform are integrated on one display device, or the display system is independently configured as a holographic projection device.

7. The product debugging and testing system according to any one of claims 2 to 4, wherein: The user interaction system includes: a user operation subsystem, a data information receiving and sending subsystem and a display device; wherein: The user operation subsystem is configured to provide a user operation interface, receive a front-end user's commissioning request for the product under test on the user interaction interface, and generate a commissioning instruction according to the commissioning request; The data information transceiver subsystem is configured to receive images of the test site acquired by the imaging system from the communication network. image screen, and sending the debugging instruction generated by the user operation subsystem to the communication network; The display device is configured to display the image images received by the data information receiving and sending subsystem, and to display the operations input by the user operation subsystem.

8. The product debugging and testing system according to any one of claims 2 to 4, wherein: The workbench is further configured with a fan system, which is configured to cool the tested product; and / or, the workbench is further configured with a grounding module.

9. The product debugging and testing system according to any one of claims 2 to 4, wherein: The imaging system comprises: a camera arranged at the commissioning site, and the camera is connected to the communication network through the communication network interface.

10. The product debugging and testing system according to any one of claims 1 to 4, wherein: The product under test is a circuit board, and the debugging and / or testing operations include: one or more of: hardware testing before the circuit board is powered on, hardware testing after the circuit board is powered on, and software testing of the circuit board.

11. A method for applying to a product debugging and testing system according to any one of claims 1 to 10, wherein: The method comprises: In response to a front-end user's request for commissioning of the product under test, a commissioning instruction is sent to the on-site commissioning system through the user interaction system; Receiving the debugging instruction sent by the user interaction system through the on-site debugging system, and calling the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test; Acquire the image of the commissioning site through the image system and transmit it to the user interaction system; The image screen of the commissioning site is remotely displayed online through the user interaction system.

12. A product debugging and testing device, wherein: The device comprises: The command trigger module is configured to respond to the front-end user's commissioning request for the tested product and send a commissioning command to the on-site commissioning system through the user interaction system; A debugging and testing module, configured to receive a debugging instruction sent by the user interaction system through the on-site debugging system, and call the debugging environment resources of the remote debugging environment according to the debugging instruction to perform corresponding debugging and / or testing operations on the product under test; A transmission module, configured to obtain an image of the test site through an image system and transmit the image to the user interaction system; The display module is configured to remotely display the image screen of the commissioning site online through the user interaction system.

13. An electronic device comprising a memory, a processor, and a product debugging test program stored in the memory and executable on the processor, wherein the product debugging test program implements the method according to claim 11 when executed by the processor.

14. A computer-readable storage medium having a product debugging test program stored thereon, wherein the product debugging test program implements the method according to claim 11 when executed by a processor.

Images