Remote visual terminal equipment debugging method and system, medium and equipment

Abstract

The invention discloses a remote visual terminal equipment debugging method and system, a medium and equipment, and the method comprises the following steps: a remote communication step: enabling remote terminal equipment to be in communication connection with an integrated operation platform, and uploading the information of the remote terminal equipment; a 3D virtual equipment model rendering step: dynamically generating 3D virtual equipment according to the equipment model library and the received remote terminal equipment information; a real-time interface transmission step: transmitting the interface of the remote terminal equipment information to the integrated operation platform in real time; a control and feedback step: sending an operation instruction to the remote terminal device through the integrated operation platform, obtaining data of the remote terminal device, and displaying the obtained data on the integrated operation platform; a state monitoring and alarming step: analyzing and detecting the received data of the remote terminal device, and sending a high alarm for an abnormal state, the method enables the debugging process to be more intuitive and efficient through the transmission of the real-time interface data and the display of the high-precision 3D virtual device.

Description

Technical Field

[0001] The present invention relates to the technical field of remote debugging, and in particular to a remote visualization terminal device debugging method, system, medium and device. Background Art

[0002] With the rapid development of IoT technology, remote debugging of terminal devices has become an important technical requirement. Traditional debugging methods often rely on text logs or simple graphical interfaces, which lack intuitiveness and real-time performance, resulting in complex and inefficient debugging. Traditional debugging methods make it difficult to view the physical status and operation interface of the reaction equipment in real time, which increases the difficulty and uncertainty of debugging. Summary of the invention

[0003] The technical problem solved by the invention is to provide a remote visualization terminal equipment debugging method which is convenient for debugging.

[0004] The technical solution adopted by the present invention to solve the technical problem is: a remote visual terminal device debugging method, comprising the following steps:

[0005] Remote communication steps: Use instant messaging protocol to establish communication connection between remote terminal equipment and integrated operation platform, and upload information of remote terminal equipment;

[0006] 3D virtual device model rendering step: the integrated operation platform dynamically generates 3D virtual devices based on the pre-defined device model library and the received remote terminal device information;

[0007] Real-time interface transmission steps: Real-time transmission of the interface of remote terminal equipment information to the integrated operation platform;

[0008] Control and feedback steps: sending operation instructions to the remote terminal device through the integrated operation platform, obtaining data from the remote terminal device, and displaying the obtained data on the integrated operation platform;

[0009] Status monitoring and alarm steps: Analyze and detect the data received from the remote terminal equipment and issue an alarm for abnormal status.

[0010] Furthermore, in the remote communication step, MQTT is used as an instant communication protocol, so that a long connection is established between the remote terminal device and the integrated operation platform, and the remote terminal device uploads the information of the remote terminal device through heartbeat information;

[0011] The information of the remote terminal device includes device model, CPU model, memory status, storage status, operating system, and information of various hardware parts.

[0012] Furthermore, the remote communication step also includes an automatic reconnection and disconnection resumption module, which can quickly restore the connection and continue to transmit data in the event of network instability or short-term interruption.

[0013] Furthermore, the transmission step of the real-time interface also includes an error detection and recovery step, and automatically requests retransmission when data loss or damage is detected during the transmission process.

[0014] Furthermore, the control and feedback step also includes instruction preview and simulated execution steps, and the instruction preview and simulated execution steps are specifically: previewing the effect of the instruction and simulating the execution process before formally issuing the instruction.

[0015] Furthermore, in the status monitoring and alarming steps, new monitoring items and alarming rules can be customized.

[0016] Furthermore, in the status monitoring and alarm step, when an abnormal state is detected or a threshold is exceeded, an alarm mechanism is triggered and an alarm is issued through sound, pop-up window, text message, or phone call.

[0017] The present invention also discloses a remote visualization terminal device debugging system, which includes a remote communication step module, a 3D virtual device model rendering module, a real-time interface transmission module, a control and feedback module, and a status monitoring and alarm module;

[0018] The remote communication module is used to establish a communication connection between the remote terminal device and the integrated operation platform using an instant messaging protocol, and to upload information about the remote terminal device;

[0019] The 3D virtual device model rendering module is used to enable the integrated operation platform to dynamically generate a 3D virtual device according to a predefined device model library and received remote terminal device information;

[0020] The real-time interface transmission module is used to transmit the interface of the remote terminal equipment information to the integrated operation platform in real time;

[0021] The control and feedback module is used to send operation instructions to the remote terminal device through the integrated operation platform, obtain data from the remote terminal device, and display the obtained data on the integrated operation platform;

[0022] The status monitoring and alarm module is used to analyze and detect the data received from the remote terminal equipment and issue an alarm for abnormal status.

[0023] The present invention also discloses a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned remote visualization terminal device debugging method are implemented.

[0024] The present invention also discloses a computer device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; wherein:

[0025] The memory is used to store computer programs;

[0026] The processor is used to execute the steps of the above-mentioned remote visualization terminal device debugging method by running the program stored in the memory.

[0027] The beneficial effects of the present invention are as follows: the method makes the debugging process more intuitive and efficient through the transmission of real-time interface data and the display of high-precision 3D virtual devices. At the same time, through the 3D virtual devices, the debuggers can understand the physical structure and operation interface of the equipment in more detail, reducing the uncertainty in the debugging process. The method provides remote control and real-time feedback functions, making the debugging process more convenient and comfortable; and improves the stability and reliability of the system through intelligent interception scripts and exception handling mechanisms. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a flow chart of a remote visualization terminal device debugging method according to an embodiment of the present application.

[0029] Figure 2 This is a module diagram of a remote visual terminal device debugging system according to an embodiment of the present application. DETAILED DESCRIPTION

[0030] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0031] like Figure 1 As shown, the present application discloses a first embodiment, specifically: a remote visual terminal device debugging method, comprising the following steps:

[0032] Remote communication steps: Use instant messaging protocol to establish communication connection between remote terminal equipment and integrated operation platform, and upload information of remote terminal equipment;

[0033] 3D virtual device model rendering step: The integrated operation platform dynamically generates 3D virtual devices based on the pre-defined device model library and the received remote terminal device information, so that operators can understand the physical structure and layout of the equipment more clearly;

[0034] That is, the integrated operation platform generates a 3D virtual device for the terminal device based on the pre-implanted device model and the information uploaded by the terminal device. The 3D virtual device can generate different states of different components according to the information of the current terminal device, such as red alarm, yellow maintenance waiting, and green normal operation, so as to reflect the appearance, layout, current operation status, etc. of the terminal device;

[0035] Real-time interface transmission steps: The interface of the remote terminal device information is transmitted to the integrated operation platform in real time. That is, the operator can choose the terminal device to display the real-time interface through screenshots or uninterrupted video streaming according to the requirements of this operation. This operation allows the operator to view the real-time operation interface style and changes. At the same time, the system supports historical record query and playback functions to facilitate problem tracing and learning sharing.

[0036] Control and feedback steps: sending operation instructions to the remote terminal device through the integrated operation platform, obtaining data from the remote terminal device, and displaying the obtained data on the integrated operation platform;

[0037] Status monitoring and alarm steps: Analyze and detect the data received from the remote terminal equipment and issue an alarm for abnormal status.

[0038] Specifically, the operator sends refined operation instructions to the terminal through a graphical interface or command interface, including but not limited to fault diagnosis. After the instructions are executed, the system captures the corresponding data of the terminal device through an interception script and feeds it back to the integrated operation platform. The integrated operation platform supports data display in multiple formats (such as icons, logs, etc.) to facilitate rapid analysis of debugging results.

[0039] Specifically, when debugging a remote device, the operator can, according to the requirements of the current operation, send the terminal device's operation interface and component information in the interface (such as component width, height, location information, etc.) to the operation platform in real time through uninterrupted screenshots or video streams. The operation platform can view the operation interface style of the terminal device in real time, and the operation platform generates a click area based on the component reported by the remote terminal; the operation platform can send operation instructions to the terminal device, including but not limited to interface movement, clicking, text input, file transfer, etc.; after the instruction is sent, the operation result of the terminal device is reported to the operation platform, and the real-time result information after the operation can be viewed; this method can improve the intuitiveness and real-time nature of terminal device debugging and improve the debugging efficiency of operators.

[0040] This method makes the debugging process more intuitive and efficient through the transmission of real-time interface data and the display of high-precision 3D virtual devices. At the same time, through the 3D virtual devices, the debuggers can understand the physical structure and operation interface of the equipment in more detail, reducing the uncertainty in the debugging process. This method also provides remote control and real-time feedback functions, making the debugging process more convenient and comfortable. It improves the stability and reliability of the system through intelligent interception scripts and exception handling mechanisms.

[0041] In this embodiment, in the remote communication step, MQTT is used as an instant communication protocol, so that the remote terminal device and the integrated operation platform establish a long connection, and the remote terminal device uploads the information of the remote terminal device through the heartbeat information;

[0042] The information of the remote terminal device includes device model, CPU model, memory status, storage status, operating system, hardware and other parts information, providing the platform with detailed information of each device as much as possible.

[0043] This method uses MQTT as the basic communication and ensures the security of data transmission through transmission encryption, so as to achieve long-term and stable communication with remote terminal devices. At the same time, the heartbeat detection mechanism is used to determine the stability and real-time performance of the connection, and it supports debugging of multiple devices online at the same time.

[0044] In this embodiment, the remote communication step also includes an automatic reconnection and disconnection resumption module, which can quickly restore the connection and continue to transmit data when the network is unstable or temporarily interrupted.

[0045] It should be explained that the programs in the automatic reconnection and disconnection resumption modules are existing programs, and no improvements have been made to the specific programs here. The settings of the above functions can achieve rapid network recovery and ensure system stability.

[0046] In this embodiment, the real-time interface transmission step also includes an error detection and recovery step, and automatically requests retransmission when data loss or damage is detected during the transmission process.

[0047] Specifically, the above-mentioned error detection may include automatic detection and manual detection. For example, network detection, packet loss, or other reasons may cause the transmission of pictures or video streams to fail. At this time, the system automatically requires data retransmission. For example, when manually uploading data, when using the system, if the picture is not displayed or the real-time video interface is not displayed, you can issue a task command to request the terminal to upload data again.

[0048] The setting of the above method can ensure that when data errors occur, they can be restored in time, ensuring the integrity and accuracy of the transmission, thereby ensuring the accuracy of subsequent debugging of the remote terminal equipment.

[0049] In this embodiment, the control and feedback steps further include instruction preview and simulated execution steps, and the instruction preview and simulated execution steps are specifically: previewing the effect of the instruction and simulating the execution process before formally issuing the instruction.

[0050] Specifically, in the above method, operators can preview the effect and simulate the execution process before issuing the instruction formally, so as to reduce the risk of misoperation.

[0051] In this embodiment, in the status monitoring and alarm steps, new monitoring items and alarm rules can be customized, so that the system can support use in various scenarios.

[0052] In this embodiment, in the status monitoring and alarm step, when an abnormal state is detected or a threshold is exceeded, an alarm mechanism is triggered and an alarm is issued through sound, pop-up window, text message, or phone call.

[0053] Specifically, the system integrates a variety of sensor data and intelligent analysis algorithms to perform all-round and multi-dimensional detection of the operation of terminal devices. The intelligent analysis algorithm based on sensor data described above can select different intelligent analysis algorithms according to different application environments. The intelligent analysis algorithm can be an existing analysis algorithm or can be developed according to different needs.

[0054] The above method can be set up to promptly warn the remote terminal equipment of any problems, so that the remote terminal equipment can be repaired in time.

[0055] The present application also discloses a second embodiment, which is a remote visualization terminal device debugging system, including a remote communication step module, a 3D virtual device model rendering module, a real-time interface transmission module, a control and feedback module, and a status monitoring and alarm module;

[0056] The remote communication module is used to establish a communication connection between the remote terminal device and the integrated operation platform using an instant messaging protocol, and to upload information about the remote terminal device;

[0057] The 3D virtual device model rendering module is used to enable the integrated operation platform to dynamically generate a 3D virtual device according to a predefined device model library and received remote terminal device information;

[0058] The real-time interface transmission module is used to transmit the interface of the remote terminal equipment information to the integrated operation platform in real time;

[0059] The control and feedback module is used to send operation instructions to the remote terminal device through the integrated operation platform, obtain data from the remote terminal device, and display the obtained data on the integrated operation platform;

[0060] The status monitoring and alarm module is used to analyze and detect the data received from the remote terminal equipment and issue an alarm for abnormal status.

[0061] The present invention also discloses a third embodiment, which is a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the remote visualization terminal device debugging method described above are implemented.

[0062] In addition, the computer-readable storage medium of this embodiment may adopt any combination of one or more computer-readable storage media, wherein the computer-readable storage medium includes electrical, optical, electromagnetic, infrared or semiconductor systems, devices or components, or any combination thereof.

[0063] The present invention also discloses a fourth embodiment, which is a computer device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; wherein:

[0064] The memory is used to store computer programs;

[0065] The processor is used to execute the steps of the above-mentioned remote visualization terminal device debugging method by running the program stored in the memory.

[0066] As an embodiment of the present invention, the communication bus mentioned in the above terminal can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc.

[0067] As an implementation mode of the present invention, the communication interface is used for communication between the above-mentioned terminal and other devices.

[0068] As an embodiment of the present invention, the memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0069] As an embodiment of the present invention, the above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

[0070] Different from the existing technology, this method makes the debugging process more intuitive and efficient through the transmission of real-time interface data and the display of high-precision 3D virtual devices. At the same time, through 3D virtual devices, debuggers can understand the physical structure and operation interface of the equipment in more detail, reducing the uncertainty in the debugging process. This method also provides remote control and real-time feedback functions, making the debugging process more convenient and comfortable; through intelligent interception scripts and exception handling mechanisms, the stability and reliability of the system are improved.

[0071] The specific embodiments described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A remote visual terminal device debugging method, characterized in that: The steps include: Remote communication steps: Use instant messaging protocol to establish communication connection between remote terminal equipment and integrated operation platform, and upload information of remote terminal equipment; 3D virtual device model rendering step: the integrated operation platform dynamically generates 3D virtual devices based on the pre-defined device model library and the received remote terminal device information; Real-time interface transmission steps: Real-time transmission of the interface of remote terminal equipment information to the integrated operation platform; Control and feedback steps: sending operation instructions to the remote terminal device through the integrated operation platform, obtaining data from the remote terminal device, and displaying the obtained data on the integrated operation platform; Status monitoring and alarm steps: Analyze and detect the data received from the remote terminal equipment and issue an alarm for abnormal status.

2. The remote visualization terminal device debugging method according to claim 1, characterized in that: In the remote communication step, MQTT is used as an instant communication protocol, so that the remote terminal device and the integrated operation platform establish a long connection, and the remote terminal device uploads the information of the remote terminal device through heartbeat information; The information of the remote terminal device includes device model, CPU model, memory status, storage status, operating system, and information of various hardware parts.

3. The remote visualization terminal device debugging method according to claim 2, characterized in that: The remote communication step also includes an automatic reconnection and disconnection resumption module, which can quickly restore the connection and continue to transmit data when the network is unstable or temporarily interrupted.

4. The remote visualization terminal device debugging method according to claim 1, characterized in that: The transmission step of the real-time interface also includes an error detection and recovery step, which automatically requests retransmission when data loss or damage is detected during the transmission process.

5. The remote visualization terminal device debugging method according to claim 1, characterized in that: The control and feedback steps also include instruction preview and simulated execution steps, which specifically include: previewing the effect of the instruction and simulating the execution process before formally issuing the instruction.

6. The remote visualization terminal device debugging method according to claim 1, characterized in that: In the status monitoring and alarm steps, new monitoring items and alarm rules can be customized.

7. The remote visualization terminal device debugging method according to claim 6, characterized in that: In the status monitoring and alarm step, when an abnormal state is detected or the threshold is exceeded, the alarm mechanism is triggered and an alarm is issued through sound, pop-up window, text message, or phone call.

8. Remote visual terminal equipment debugging system, characterized in that: It includes remote communication step module, 3D virtual equipment model rendering module, real-time interface transmission module, control and feedback module and status monitoring and alarm module; The remote communication module is used to establish a communication connection between the remote terminal device and the integrated operation platform using an instant messaging protocol, and to upload information about the remote terminal device; The 3D virtual device model rendering module is used to enable the integrated operation platform to dynamically generate a 3D virtual device according to a predefined device model library and received remote terminal device information; The real-time interface transmission module is used to transmit the interface of the remote terminal equipment information to the integrated operation platform in real time; The control and feedback module is used to send operation instructions to the remote terminal device through the integrated operation platform, obtain data from the remote terminal device, and display the obtained data on the integrated operation platform; The status monitoring and alarm module is used to analyze and detect the data received from the remote terminal equipment and issue an alarm for abnormal status.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the remote visualization terminal device debugging method according to any one of claims 1 to 7 are implemented.

10. A computer device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; wherein: The memory is used to store computer programs; The processor is used to execute the steps of the remote visualization terminal device debugging method according to any one of claims 1 to 7 by running the program stored in the memory.

Images