Remote debugging method, device, terminal device and storage medium

Abstract

The present application discloses a remote debugging method, device, terminal device and storage medium. The remote debugging method includes: receiving on-site picture data sent by the device to be debugged; displaying a first on-site picture based on the on-site picture data; in response to a debugging operation of a user, sending a debugging control instruction to the device to be debugged, so that the device to be debugged debugs a second on-site picture displayed by the device to be debugged based on the debugging control instruction. Based on the solution of the present application, the debugging end and the device to be debugged can be located in two different places respectively. The user at the debugging end can clearly and intuitively view the picture content of the device to be debugged, and can also debug the second on-site picture displayed by the device to be debugged, solving the problem of low efficiency of the on-site debugging method for digital display projects.

Description

Technical Field

[0001] This application relates to the field of digital display technology, and particularly to a remote debugging method, device, terminal device, and storage medium. Background Art

[0002] Nowadays, digital display technology is widely used in scenarios such as product launches, stage performances, or digital exhibition halls, and the display content includes videos, music, PPTs, or other content forms. Different digital display projects may involve display carriers with different models and specifications, that is, different hardware environments. Technical personnel need to perform software debugging according to the hardware environment to smoothly promote the digital display project.

[0003] For the software debugging requirements of digital display projects, it is usually necessary for the supplier to assign technical personnel to go to the site for communication and debugging. On the one hand, limited by the progress of on-site implementation, the debugging work progresses slowly; on the other hand, technical personnel who are good at debugging may not be able to go to the site, and cannot timely solve the professional problems that occur during the debugging process.

[0004] In summary, the on-site debugging method for digital display projects is inefficient. Summary of the Invention

[0005] The main purpose of this application is to provide a remote debugging method, device, terminal device, and storage medium, aiming to solve the problem of low efficiency of the on-site debugging method for digital display projects.

[0006] To achieve the above purpose, this application provides a remote debugging method. The remote debugging method is applied to a debugging end. The debugging end establishes a communication connection with a device to be debugged. The number of screens of the debugging end is the same as that of the device to be debugged and the arrangement relationship is consistent. The remote debugging method includes:

[0007] Receiving the on-site picture data sent by the device to be debugged;

[0008] Displaying a first on-site picture based on the on-site picture data;

[0009] Responding to a user's debugging operation, sending a debugging control instruction to the device to be debugged for the device to be debugged to debug a second on-site picture displayed by the device to be debugged based on the debugging control instruction.

[0010] Optionally, before the step of receiving the on-site picture data sent by the device to be debugged, the method further includes:

[0011] Establishing a communication connection between the debugging end and the device to be debugged based on a preset streaming program and an intranet penetration service.

[0012] Optionally, before the step of establishing a communication connection between the debugging end and the device under debugging based on a preset streaming program and an intranet penetration service, the method further includes:

[0013] Based on the hardware topology information of the debugging end and the device under debugging, determine the servers of the debugging end and the device under debugging, where the hardware topology information includes the quantitative relationship and connection relationship between the server and the screen;

[0014] The step of establishing a communication connection between the debugging end and the device under debugging based on a preset streaming program and an intranet penetration service includes:

[0015] Based on the preset streaming program and the intranet penetration service, establish a communication connection between the servers of the debugging end and the device under debugging.

[0016] Optionally, the number of screens of the debugging end is more than two, and the step of displaying the first live scene based on the live scene data includes:

[0017] Perform a picture fusion process on the live scene data based on a preset picture fusion program to obtain a fused first live scene;

[0018] Display the fused first live scene on different screens of the debugging end.

[0019] Optionally, before the step of performing a picture fusion process on the live scene data based on a preset picture fusion program to obtain a fused first live scene, the method further includes:

[0020] Obtain the display environment parameters of the device under debugging, where the display environment parameters include one or more of the number of screens, screen resolution, and viewing point position;

[0021] Process the display environment parameters of the device under debugging based on a preset configuration parameter generator to obtain the display configuration parameters of the debugging end;

[0022] The step of performing a picture fusion process on the live scene data based on a preset picture fusion program to obtain a fused first live scene includes:

[0023] Perform a picture fusion process on the live scene data based on the display configuration parameters of the debugging end and the preset picture fusion program to obtain the fused first live scene.

[0024] To achieve the above object, the present application further provides a remote debugging method, which is applied to the device to be debugged. The device to be debugged establishes a communication connection with the debugging end. The number of screens of the device to be debugged is the same as that of the debugging end and the arrangement relationship is consistent. The remote debugging method includes:

[0025] Sending on-site picture data to the debugging end for the debugging end to receive the on-site picture data and display a first on-site picture based on the on-site picture data;

[0026] Receiving a debugging control instruction sent by the debugging end in response to a user's debugging operation;

[0027] Debugging a second on-site picture displayed by the device to be debugged based on the debugging control instruction.

[0028] The embodiment of the present application further provides a remote debugging device, which is applied to the debugging end. The debugging end establishes a communication connection with the device to be debugged. The number of screens of the debugging end is the same as that of the device to be debugged and the arrangement relationship is consistent. The remote debugging device includes:

[0029] A receiving module, configured to receive on-site picture data sent by the device to be debugged;

[0030] A display module, configured to display a first on-site picture based on the on-site picture data;

[0031] A debugging module, configured to send a debugging control instruction to the device to be debugged in response to a user's debugging operation for the device to be debugged to debug a second on-site picture displayed by the device to be debugged based on the debugging control instruction.

[0032] The embodiment of the present application further provides a remote debugging device, which is applied to the device to be debugged. The device to be debugged establishes a communication connection with the debugging end. The number of screens of the device to be debugged is the same as that of the debugging end and the arrangement relationship is consistent. The remote debugging device includes:

[0033] A sending module, configured to send on-site picture data to the debugging end for the debugging end to receive the on-site picture data and display a first on-site picture based on the on-site picture data;

[0034] A receiving module, configured to receive a debugging control instruction sent by the debugging end in response to a user's debugging operation;

[0035] A debugging module, configured to debug a second on-site picture displayed by the device to be debugged based on the debugging control instruction.

[0036] An embodiment of the present application also provides a terminal device, which includes a memory, a processor, and a remote debugging program stored on the memory and executable on the processor. When the remote debugging program is executed by the processor, the steps of the remote debugging method described above are implemented.

[0037] An embodiment of the present application also provides a computer-readable storage medium, on which a remote debugging program is stored. When the remote debugging program is executed by a processor, the steps of the remote debugging method described above are implemented.

[0038] The remote debugging method, device, terminal device, and storage medium provided by the embodiments of the present application receive the on-site screen data sent by the device to be debugged; display the first on-site screen based on the on-site screen data; and in response to the user's debugging operation, send a debugging control instruction to the device to be debugged for the device to be debugged to debug the second on-site screen displayed based on the debugging control instruction. Based on the solution of the present application, the debugging end and the device to be debugged can be located in two different places. The debugging end receives the on-site screen data of the device to be debugged and displays the first on-site screen, which can synchronize the screens of the debugging end and the device to be debugged. And since the number of screens of the debugging end and the device to be debugged is the same and the arrangement relationship is consistent, the display effects of the debugging end and the device to be debugged can be made basically similar, and the user of the debugging end can clearly and intuitively see the screen content of the device to be debugged. In addition, the user of the debugging end can also perform debugging operations, and the debugging end sends a debugging control instruction to the device to be debugged to further debug the second on-site screen displayed by the device to be debugged, solving the problem of low efficiency of the on-site debugging method for digital display projects. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 It is a schematic diagram of the function modules of the terminal device to which the remote debugging device of the present application belongs;

[0040] Figure 2 It is a schematic flowchart of the first exemplary embodiment of the remote debugging method of the present application;

[0041] Figure 3 It is a schematic diagram of the first application scenario involved in the remote debugging method of the present application;

[0042] Figure 4 It is a schematic diagram of the specifications of the device to be debugged in the second application scenario involved in the remote debugging method of the present application;

[0043] Figure 5 It is a schematic diagram of the specifications of the debugging end in the second application scenario involved in the remote debugging method of the present application;

[0044] Figure 6 It is a schematic flowchart of the second exemplary embodiment of the remote debugging method of the present application;

[0045] Figure 7 Schematic diagram of streaming and intranet penetration involved in the off-site debugging method of this application;

[0046] Figure 8 Schematic diagram of intranet penetration based on FRP penetration server involved in the off-site debugging method of this application;

[0047] Figure 9 Schematic diagram of end-to-end intranet penetration involved in the off-site debugging method of this application;

[0048] Figure 10 Schematic diagram of the process of the third exemplary embodiment of the off-site debugging method of this application;

[0049] Figure 11 Schematic diagram of the process of the fourth exemplary embodiment of the off-site debugging method of this application;

[0050] Figure 12 Schematic diagram of the process of the fifth exemplary embodiment of the off-site debugging method of this application;

[0051] Figure 13 Schematic diagram of display configuration parameter conversion involved in the off-site debugging method of this application;

[0052] Figure 14 Schematic diagram of the process of the sixth exemplary embodiment of the off-site debugging method of this application.

[0053] The realization, functional features and advantages of the purpose of this application will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners

[0054] It should be understood that the specific embodiments described herein are only used to explain this application and are not used to limit this application.

[0055] The main solution of the embodiment of this application is: receiving the on-site screen data sent by the device to be debugged; displaying a first on-site screen based on the on-site screen data; in response to the debugging operation of the user, sending a debugging control instruction to the device to be debugged for the device to be debugged to debug the second on-site screen displayed by the device to be debugged based on the debugging control instruction. Based on the solution of this application, the debugging end and the device to be debugged can be located in two different places respectively. The debugging end receives the on-site screen data of the device to be debugged and displays the first on-site screen, which can synchronize the screens of the debugging end and the device to be debugged. And because the number of screens of the debugging end and the device to be debugged is the same and the arrangement relationship is consistent, the display effects of the debugging end and the device to be debugged can be basically close, and the user of the debugging end can clearly and intuitively see the screen content of the device to be debugged. In addition, the user of the debugging end can also perform a debugging operation, and the debugging end sends a debugging control instruction to the device to be debugged, thereby debugging the second on-site screen displayed by the device to be debugged, solving the problem of low efficiency of the on-site debugging method for digital display projects.

[0056] Specifically, referring to Figure 1 , Figure 1 is a schematic diagram of the function modules of the terminal device to which the off-site debugging device of this application belongs. This off-site debugging device can be a device that is independent of the terminal device and can perform off-site debugging, and it can be carried on the terminal device in the form of hardware or software. This terminal device can be an intelligent mobile terminal with data processing functions such as a mobile phone or a tablet computer, and can also be a fixed terminal device or a server with data processing functions, etc.

[0057] In this embodiment, the terminal device to which the off-site debugging device belongs at least includes an output module 110, a processor 120, a memory 130, and a communication module 140.

[0058] The memory 130 stores an operating system and an off-site debugging program. The off-site debugging device can store information such as the on-site screen data received from the device to be debugged; the first on-site screen displayed based on the on-site screen data; and the debugging control instruction sent to the device to be debugged in response to the debugging operation of the user in this memory 130; the output module 110 can be a display screen, etc. The communication module 140 can include a WIFI module, a mobile communication module, a Bluetooth module, etc., and communicates with external devices or servers through the communication module 140.

[0059] Among them, when the off-site debugging program in the memory 130 is executed by the processor, the following steps are implemented:

[0060] Receiving the on-site screen data sent by the device to be debugged;

[0061] Displaying a first on-site screen based on the on-site screen data;

[0062] In response to the user's debugging operation, a debugging control instruction is sent to the device under debugging, so that the device under debugging can debug the second live video displayed based on the debugging control instruction.

[0063] Further, when the remote debugging program in the memory 130 is executed by the processor, the following steps are also implemented:

[0064] Based on a preset streaming program and an intranet penetration service, a communication connection is established between the debugging device and the device under debugging.

[0065] Further, when the remote debugging program in the memory 130 is executed by the processor, the following steps are also implemented:

[0066] Based on the hardware topology information of the debugging device and the device under debugging, the server of the debugging device and the server of the device under debugging are determined, where the hardware topology information includes the quantitative relationship and connection relationship between the server and the screen;

[0067] Based on the preset streaming program and the intranet penetration service, a communication connection is established between the server of the debugging device and the server of the device under debugging.

[0068] Further, when the remote debugging program in the memory 130 is executed by the processor, the following steps are also implemented:

[0069] Based on a preset video fusion program, video fusion processing is performed on the live video data to obtain a fused first live video;

[0070] The fused first live video is displayed on different screens of the debugging device.

[0071] Further, when the remote debugging program in the memory 130 is executed by the processor, the following steps are also implemented:

[0072] Obtain the display environment parameters of the device under debugging, where the display environment parameters include one or more of the number of screens, screen resolution, and viewing point position;

[0073] Based on a preset configuration parameter generator, the display environment parameters of the device under debugging are processed to obtain the display configuration parameters of the debugging device;

[0074] Based on the display configuration parameters of the debugging device and the preset video fusion program, video fusion processing is performed on the live video data to obtain the fused first live video.

[0075] Further, when the remote debugging program in the memory 130 is executed by the processor, the following steps are also implemented:

[0076] Send on-site video data to the debugging terminal for the debugging terminal to receive the on-site video data and display the first on-site video based on the on-site video data;

[0077] Receive a debugging control instruction sent by the debugging terminal to the device under debugging in response to a user's debugging operation;

[0078] Debug the second on-site video displayed by the device under debugging based on the debugging control instruction.

[0079] Through the above solution in this embodiment, specifically, receive the on-site video data sent by the device under debugging; display the first on-site video based on the on-site video data; in response to a user's debugging operation, send a debugging control instruction to the device under debugging for the device under debugging to debug the second on-site video displayed by the device under debugging based on the debugging control instruction. In this embodiment, the debugging terminal and the device under debugging can be located in two different places. The debugging terminal receives the on-site video data of the device under debugging and displays the first on-site video, which can synchronize the videos of the debugging terminal and the device under debugging. And since the number of screens of the debugging terminal and the device under debugging is the same and the arrangement relationship is consistent, the display effects of the debugging terminal and the device under debugging can be basically similar, and the user of the debugging terminal can clearly and intuitively see the video content of the device under debugging. In addition, the user of the debugging terminal can also perform debugging operations, and the debugging terminal sends a debugging control instruction to the device under debugging to further debug the second on-site video displayed by the device under debugging, solving the problem of low efficiency of the on-site debugging method for digital display projects.

[0080] The first and sixth embodiments of the off-site debugging method of this application can be used to solve the off-site debugging of digital display projects. Digital display is a technology that uses a computer as the main tool for visual design, production, and display. Its application scenarios range from large-scale opening ceremony visual effects to advertising screens in display cabinets. The content of digital display involves videos, music, PPTs, or other content forms.

[0081] During the deployment of digital display projects, software debugging needs to be carried out according to the hardware environment. The currently commonly used method is on-site debugging, that is, technicians need to go to the digital display project site for debugging. However, affected by various factors such as venue and communication, the on-site debugging method is inefficient, and a solution for off-site debugging needs to be proposed.

[0082] Existing preview software can import corresponding digital display content files and configuration files into the server for on-site broadcast control, mainly involving video broadcast control, lighting control, and mechanical control, and preview the content of digital display projects to avoid errors during the official exhibition. However, the actual debugging process is restricted by the thread hardware environment and needs to be based on the on-site hardware display effect. There is a large deviation between the display effect that the preview software can achieve and the actual on-site effect. Therefore, the existing preview software cannot achieve off-site debugging of digital display projects.

[0083] Referring to Figure 2 , a flowchart is provided for the first embodiment of the off-site debugging method of the present application. The off-site debugging method is applied to the debugging end, which establishes a communication connection with the debugged end. The number of screens of the debugging end is the same as that of the debugged end and the arrangement relationship is consistent. The off-site debugging method includes:

[0084] Step S10, receiving the on-site video data sent by the debugged end.

[0085] Specifically, the debugging end involved in this embodiment is the end operated by the technical personnel performing the debugging work, and the debugged end is the end at the site of the digital display project. The user of the debugging end generally refers to the technical personnel participating in off-site debugging.

[0086] The screens involved in digital display projects may be diverse, including straight screens, curved screens, multi-fold screens, etc., and even involve a three-dimensional display system constructed by multiple screens. If the technical personnel participating in off-site debugging cannot accurately see the spatial perspective relationship of the on-site display screen, it will be difficult to make appropriate debugging judgments or communicate with on-site personnel. Therefore, this embodiment establishes a consistent number relationship and arrangement relationship of screens between the debugging end and the debugged end. It should be noted that the arrangement relationship refers to the arrangement relationship of the screens in the physical space, such as the orientation of the screens and the included angle between the screens.

[0087] The first application scenario involved in this embodiment. As Figure 3 shown, Figure 3 is a schematic diagram of the first application scenario involved in the off-site debugging method of the present application. Among them, the debugged end includes four screens, and their arrangement is the four adjacent faces of a rectangle, thus creating a digital display space. Then, the debugging end also includes four screens, and their arrangement is the same as that of the debugged end. The screens of the debugging end are equivalent to the screens of the debugged end reduced in equal proportion. It should be noted that the screens of the debugging end and the debugged end are preferably the same in proportion (such as the aspect ratio). If it is impossible to achieve the same screen proportion, at least the proportion of the pictures displayed on the screens is the same.

[0088] The second application scenario involved in this embodiment. As Figure 4 shown, Figure 4It is a schematic diagram of the specifications of the device under test in the second application scenario involved in the off-site debugging method of this application. The screen of the device under test is an L screen composed of two LED screens (wall screen plus floor screen), with a physical point pitch of 4.0 mm, a wall screen size of 24.96 * 6.24 m, a floor screen size of 17.76 * 6.24 m, and the included angle between the floor screen and the ground is 1°. The total resolution is 6240 * 6000 (wall screen 6240 * 1560, floor screen 6240 * 4440), and it is directly driven by a professional server equipped with two NVIDIA RTX A6000 graphics cards. As Figure 5 shown, Figure 5 It is a schematic diagram of the specifications of the debugger in the second application scenario involved in the off-site debugging method of this application. The display platform of the debugger is built with aluminum profiles. The floor screen is installed by projection in the front projection mode, and the wall screen is installed by projection in the rear projection mode. The resolution of the projector is 1080P. The maximum display size of both the wall screen and the floor screen is 1340 * 700. Within this size range, the display size of the debugger can be adjusted proportionally according to the screen of the device under test.

[0089] After establishing the quantity relationship and arrangement relationship between the screen of the debugger and the screen of the device under test, the debugger receives the on-site picture data sent by the device under test. The on-site picture data is actually a kind of multimedia data, which can be understood as the real-time display data of the digital display project site.

[0090] Step S20: Display the first on-site picture based on the on-site picture data.

[0091] Specifically, after receiving the on-site picture data, the debugger parses and processes the on-site picture data to obtain the first on-site picture, and further controls the screen of the debugger to display the first on-site picture. Since the number of screens of the debugger is the same as that of the device under test and the arrangement relationship is consistent, the first on-site picture displayed by the debugger and the second on-site picture of the device under test (i.e., the on-site picture of the digital display project) have the same spatial perspective relationship. The technicians at the debugger can obtain a reasonable observation point for the first on-site picture, and the display effect seen at the debugger is the same as that at the device under test. Therefore, the technicians at the debugger can make reasonable debugging judgments based on the first on-site picture they see.

[0092] Step S30: In response to the debugging operation of the user, send a debugging control instruction to the device under test for the device under test to debug the second on-site picture displayed by the device under test based on the debugging control instruction.

[0093] Specifically, the debugging terminal provides a human-computer interaction interface and a human-computer interaction method, where the human-computer interaction method can be keyboard and mouse interaction. For example, the technician of the debugging terminal performs keyboard and mouse operations based on the human-computer interaction interface, enters text or clicks the mouse. Correspondingly, the debugging terminal will generate corresponding debugging control instructions in response to the user's debugging operations and send the debugging control instructions to the device under debugging. In this way, the device under debugging can debug the second live video based on the debugging control instructions.

[0094] For example, if the technician of the debugging terminal clicks on position A with the mouse, then the device under debugging will also produce the effect of clicking on position B. Position A and position B correspond to each other. It is equivalent to the debugging terminal remotely controlling the device under debugging. In this way, the problems that occur in the device under debugging can be directly solved by the technician of the debugging terminal through debugging operations.

[0095] In this embodiment, through the above solution, specifically by receiving the live video data sent by the device under debugging; displaying the first live video based on the live video data; and in response to the user's debugging operations, sending debugging control instructions to the device under debugging for the device under debugging to debug the second live video displayed by the device under debugging based on the debugging control instructions. In this embodiment, the debugging terminal and the device under debugging can be located in two different places. The debugging terminal receiving the live video data of the device under debugging and displaying the first live video can synchronize the videos of the debugging terminal and the device under debugging. And because the number of screens of the debugging terminal and the device under debugging is the same and the arrangement relationship is consistent, the display effects of the debugging terminal and the device under debugging can be basically similar, and the user of the debugging terminal can clearly and intuitively see the video content of the device under debugging. In addition, the user of the debugging terminal can also perform debugging operations, and the debugging terminal sends debugging control instructions to the device under debugging, thereby debugging the second live video displayed by the device under debugging, solving the problem of low efficiency of the on-site debugging method for digital display projects.

[0096] Further, referring to Figure 6 , the second embodiment of the off-site debugging method of the present application provides a process schematic diagram. Based on the embodiment shown above Figure 2 , before step S10, receiving the live video data sent by the device under debugging, it further includes:

[0097] Step S001, establishing a communication connection between the debugging terminal and the device under debugging based on a preset streaming program and an intranet penetration service.

[0098] In the actual production process, the debugging terminal and the device under debugging may be located in two geographically distant locations. To enable the debugging terminal to synchronously display the digital display content of the device under debugging, a stable, low-latency, and high-definition transmission-supported communication connection needs to be established in advance. The method adopted in this embodiment is as shown in Figure 7 , Figure 7This is a schematic diagram of streaming and intranet penetration involved in the off-site debugging method of this application. Based on the streaming program and the intranet penetration service, a communication connection is established between the debugging end and the device to be debugged.

[0099] Specifically, the debugging end is pre-installed with a streaming program. The streaming technology involved in the streaming program refers to the technology of compressing and transmitting audio and video through the network. In addition, the streaming program also supports the debugging end to control the device to be debugged.

[0100] However, the streaming program natively supports communication connections within a local area network. The device to be debugged may be outside the local area network to which the debugging end belongs. It is necessary to make the debugging end and the device to be debugged accessible based on the intranet penetration service, that is, to establish an intranet penetration connection relationship.

[0101] As Figure 8 described, Figure 8 This is a schematic diagram of intranet penetration based on the FRP penetration server involved in the off-site debugging method of this application. This is a traditional intranet penetration method, and its connection relationship is: internal network server - FRP penetration server - external network server. There are deficiencies in the traditional intranet penetration method. First, the penetration server requires certain expenses, increasing the cost of off-site debugging. Second, the penetration server directly determines the data transmission speed, and additional expenses are also required to improve the data transmission speed. In addition, the intranet penetration service based on the penetration server requires certain knowledge reserves to use. In other words, this traditional intranet penetration is not easy to implement.

[0102] Considering the above-mentioned disadvantages of the traditional intranet penetration method, in this embodiment, the ZeroTier intranet penetration tool is preferably used to achieve intranet penetration. As Figure 9 shown, Figure 9 This is a schematic diagram of end-to-end intranet penetration involved in the off-site debugging method of this application. The ZeroTier intranet penetration tool can achieve intranet penetration without a penetration server (or called a relay server). For the off-site debugging of this embodiment, it has the following advantages: improving the user-friendly operation method and reducing the operation difficulty of users; the end-to-end connection method can theoretically utilize the full bandwidth and improve the transmission rate; saving the cost of maintaining the penetration server and reducing the cost of intranet penetration; supporting multi-device intranet penetration and meeting the requirements of different application scenarios.

[0103] After the intranet penetration service is implemented, the device to be debugged becomes an accessible object for the debugging end. Similarly, the debugging end can also become an accessible object for the device to be debugged.

[0104] Based on the intranet penetration connection relationship between the debugging end and the device under debugging, the debugging end runs the streaming program, and the device under debugging enables the streaming function of the graphics card to establish a streaming connection relationship between the debugging end and the device under debugging. In this embodiment, it is preferred to use the Moonlight Game Streaming program to achieve intranet penetration. The debugging end pre-installs the streaming program and opens the streaming program after the intranet penetration service is implemented. The streaming program provides a device selection interface, and the display content of the device selection interface includes the server of the device under debugging or other associated devices. It should be noted that the device under debugging needs to enable the streaming function of the graphics card. For example, if the device under debugging is equipped with an Nvidia graphics card, then it is necessary to open the NVIDIA GeForce Experience program supporting the graphics card, enable the SHIELD function (i.e., the streaming function), and add the address "C:\Windows\System32\mstsc.exe".

[0105] Furthermore, the technician at the debugging end can click on the icon of the server or other associated device that needs to establish a streaming connection through the device selection interface. If it is the first time to establish a streaming connection, it is necessary to verify the verification code between the debugging end and the device under debugging. Once the verification is successful, the streaming connection relationship is established.

[0106] Thus, based on the established intranet penetration connection relationship and streaming connection relationship, the debugging end and the device under debugging can achieve stable, low-latency, and high-quality live video data transmission.

[0107] Through the above solution, this embodiment specifically establishes a communication connection between the debugging end and the device under debugging based on a preset streaming program and an intranet penetration service. This embodiment builds a communication bridge between the debugging end and the device under debugging based on the streaming technology and the intranet penetration service, which can achieve low-latency, high-stability, and high-quality display of the two ends' videos, enabling the technicians at the debugging end to see a highly restored digital display project site video, and thus making more accurate debugging judgments. Moreover, the streaming technology provides support for the remote control of the device under debugging by the debugging end, enabling the debugging operation to be carried out remotely and improving the software debugging efficiency of the digital display project.

[0108] Furthermore, referring to Figure 10 , the third embodiment of the remote debugging method of this application provides a flowchart. Based on the above Figure 6 shown embodiment, step S001, before establishing a communication connection between the debugging end and the device under debugging based on a preset streaming program and an intranet penetration service, further includes:

[0109] Step S002, determining the server of the debugging end and the server of the debugged end based on the hardware topology information of the debugging end and the debugged end, wherein the hardware topology information includes the quantity relationship and connection relationship between the server and the screen.

[0110] Specifically, in a digital display project, the image displayed on a specific screen is controlled by a specific server, especially when it involves a multi-fold screen or a more complex display environment, the number of servers may be multiple. In order to ensure that the display effects of the debugging end and the debugged end are highly consistent, the hardware topology information of the debugged end needs to be determined in advance, and the hardware topology information of the debugging end needs to be set based on the hardware topology information of the debugged end, so that the hardware topology information of the debugging end and the debugged end are consistent. Among them, the hardware topology information includes the number of servers, the number of screens, the connection relationship between the server and the screen, etc.

[0111] For example, the debugged end includes server B1, server B2, screen B1, screen B2, server B1 connects to and controls screen B1, and server B1 connects to and controls screen B1. Then, the debugging end also includes server A1, server A2, screen A1, screen A2, server A1 connects to and controls screen A1, and server A1 connects to and controls screen A1.

[0112] Step S001, based on a preset streaming program and an intranet penetration service, establishes a communication connection between the debugging end and the debugged end, further detailed, including:

[0113] Step S0011, based on the preset streaming program and the intranet penetration service, a communication connection is established between the server of the debugging end and the server of the debugged end.

[0114] Specifically, the server of the debugging end is pre-installed with a streaming program. The streaming technology involved in the streaming program refers to the technology of compressing and transmitting audio and video through the network. In addition, the streaming program also supports the debugging end to control the debugged end.

[0115] However, the streaming program supports LAN communication connections by default. The debugged end may be located outside the LAN to which the debugging end belongs. It is necessary to make the debugging end server and the debugged end server accessible based on the intranet penetration service, that is, to establish an intranet penetration connection relationship.

[0116] Based on the intranet penetration connection relationship between the server on the debugging side and the server on the side to be debugged, the server on the debugging side runs a streaming program, and the server on the side to be debugged enables the streaming function of the graphics card, establishing a streaming connection relationship between the server on the debugging side and the server on the side to be debugged. Thus, based on the established intranet penetration connection relationship and streaming connection relationship, the server on the debugging side and the server on the side to be debugged can achieve stable, low-latency, and high-quality on-site video data transmission.

[0117] In this embodiment, through the above solution, specifically, based on the hardware topology information of the debugging side and the side to be debugged, the server on the debugging side and the server on the side to be debugged are determined, where the hardware topology information includes the quantitative relationship and connection relationship between the server and the screen; based on the preset streaming program and intranet penetration service, a communication connection is established between the server on the debugging side and the server on the side to be debugged. To make the display effects of the debugging side and the side to be debugged highly consistent, this embodiment determines the servers involved in off-site debugging based on the hardware topology information, and establishes a communication relationship between the corresponding servers based on the streaming program and the intranet penetration service, which can improve the data transmission stability and transmission quality during off-site debugging.

[0118] Further, referring to Figure 11 , the fourth embodiment of the off-site debugging method of this application provides a flowchart. Based on the above Figure 2 illustrated embodiment, the number of screens on the debugging side is two or more. Step S20, further refining the display of the first on-site video based on the on-site video data, includes:

[0119] Step S201, perform video fusion processing on the on-site video data based on a preset video fusion program to obtain the fused first on-site video.

[0120] The digital display project on the side to be debugged may involve multi-screen display. To achieve a consistent display effect on the debugging side, the debugging side needs to perform video fusion processing on the received on-site video data. Specifically, the debugging side starts the pre-installed video fusion program, and after receiving the on-site video data, processes the on-site video data according to the preset display configuration parameters to obtain the fused first on-site video. For example, Figure 5 as shown, there are two screens on the debugging side, one is a wall screen based on an electric curtain, and the other is a floor screen based on a sunlight board, and projection is used for display. Then, the received on-site video data can be processed through ImmersiveDisplay PRO (a video fusion program) to obtain the first on-site video suitable for the wall screen and floor screen on the debugging side.

[0121] Step S202: Display the fused first live scene image on different screens of the debugging terminal.

[0122] Specifically, after obtaining the fused first live scene image, the debugging terminal controls the LED screen or the projection device to display the fused first live scene image on different screens of the debugging terminal. For example, the fused first live scene image may be divided into a wall screen image part and a floor screen image part. The debugging terminal controls the wall screen projector to project the wall screen image part onto the wall screen and controls the floor screen projector to project the floor screen image part onto the floor screen.

[0123] In this embodiment, through the above solution, specifically, the live scene data is processed by image fusion based on a preset image fusion program to obtain the fused first live scene image; and the fused first live scene image is displayed on different screens of the debugging terminal. This embodiment takes into account that digital display projects may involve multiple screens, such as multi-fold screens. In order to achieve a highly restored display effect, the debugging terminal performs image fusion processing on the live scene data based on the image fusion program to obtain the fused first live scene image. The fused first live scene image can actually be divided into several parts, and the several parts are correspondingly displayed on different screens of the debugging terminal. It is equivalent to the debugging terminal obtaining a display effect basically consistent with that of the device to be debugged, facilitating the technicians at the debugging terminal to accurately see the spatial perspective relationship of the on-site display image and make appropriate debugging judgments, improving the accuracy and efficiency of off-site debugging of digital display projects.

[0124] Further, referring to Figure 12 , a flowchart is provided in the fifth embodiment of the off-site debugging method of the present application. Based on the above Figure 11 illustrated embodiment, before step S201: performing image fusion processing on the live scene data based on a preset image fusion program to obtain the fused first live scene image, it further includes:

[0125] Step S003: Obtain the display environment parameters of the device to be debugged, where the display environment parameters include one or more of the number of screens, screen resolution, and viewing point position.

[0126] In actual application scenarios, the device to be debugged may be involved in a large-scale digital exhibition, such as a product launch event, while the debugging terminal may involve a smaller debugging console or a debugging space. It is necessary to reduce the screen content of the device to be debugged proportionally to be able to display it on the debugging terminal.

[0127] Therefore, during off-site debugging, it is necessary to obtain the display environment parameters of the device to be debugged, where the display environment parameters include one or more of the number of screens, screen resolution, and viewing point position. As Figure 13 shown, Figure 13 is a schematic diagram of display configuration parameter conversion involved in the off-site debugging method of the present application. It can be seen thatFigure 13 The display environment parameters of the device under debugging are as shown in Table 1 below. Table 1 is the display environment parameter table of the device under debugging.

[0128] Table 1 is the display environment parameter table of the device under debugging

[0129]

[0130] Step S004: Process the display environment parameters of the device under debugging based on a preset configuration parameter generator to obtain the display configuration parameters of the debugging device.

[0131] Specifically, a configuration parameter generator is installed on the debugging device, and the display environment parameters of the debugging device are pre-stored in the configuration parameter generator. The configuration parameter generator uses the display environment parameters of the device under debugging as input, performs a geometric ratio conversion on the display environment parameters of the device under debugging, and obtains the display configuration parameters of the debugging device. Applicable to Figure 13 The display configuration parameters of the debugging device in [[ ]] are as shown in Table 2 below. Table 2 is the display configuration parameter table of the debugging device.

[0132] Table 2 is the display configuration parameter table of the debugging device

[0133]

[0134]

[0135] Step S201: Perform a picture fusion process on the on-site picture data based on a preset picture fusion program to obtain a first on-site picture after fusion. Further refinement includes:

[0136] Step S2011: Perform a picture fusion process on the on-site picture data based on the display configuration parameters of the debugging device and the preset picture fusion program to obtain the first on-site picture after fusion.

[0137] Specifically, after obtaining the display configuration parameters of the debugging device, import the display configuration parameters of the debugging device into the picture fusion program. The picture fusion program performs a picture fusion process on the on-site picture data based on the display configuration parameters of the debugging device, and obtains a first on-site picture applicable to different screens of the debugging device, that is, obtains the first on-site picture after fusion.

[0138] In this embodiment, through the above solution, specifically, by obtaining the display environment parameters of the device to be debugged, the display environment parameters include one or more of the number of screens, screen resolution, and viewing point position; processing the display environment parameters of the device to be debugged by a preset configuration parameter generator to obtain the display configuration parameters of the debugging device; performing picture fusion processing on the on-site picture data based on the display configuration parameters of the debugging device and the preset picture fusion program to obtain the first on-site picture after fusion. In this embodiment, first, the display environment parameters of the device to be debugged are obtained, and then an automated tool - the configuration parameter generator is used to perform an equal ratio conversion on the display environment parameters of the device to be debugged to obtain the display configuration parameters applicable to the debugging device. The picture fusion program can further control the display of the first on-site picture based on the display configuration parameters. In this way, it is equivalent to processing the display content of the device to be debugged to obtain the display content of the debugging device with equal ratio. The picture seen by the technician on the debugging device is the same as the picture currently displayed on the device to be debugged, ensuring an excellent display effect on the debugging device. In addition, introducing the configuration parameter generator can effectively reduce the human and time resources consumed by manual conversion or input of display environment parameters, improving the efficiency of remote debugging.

[0139] Referring to Figure 14 , the sixth embodiment of the remote debugging method of this application provides a process schematic diagram. The remote debugging method is applied to the device to be debugged. The device to be debugged is communicatively connected to the debugging device. The number of screens of the device to be debugged is the same as that of the debugging device and the arrangement relationship is consistent. The remote debugging method includes:

[0140] Step A10: Send on-site picture data to the debugging device for the debugging device to receive the on-site picture data and display the first on-site picture based on the on-site picture data.

[0141] Specifically, the debugging device involved in this embodiment is the end operated by the technician performing the debugging work, and the device to be debugged is the end at the digital display project site.

[0142] The screens involved in digital display projects can be diverse, including straight screens, curved screens, multi-fold screens, etc., and even involve a three-dimensional display system constructed by multiple screens. If the technicians participating in remote debugging cannot accurately see the spatial perspective relationship of the on-site display picture, it will be difficult to make appropriate debugging judgments or communicate with on-site personnel. Therefore, this embodiment establishes a consistent screen number relationship and screen arrangement relationship between the debugging device and the device to be debugged. It should be noted that the arrangement relationship refers to the arrangement relationship of the screens in the physical space, such as the orientation of the screens and the angle between the screens.

[0143] The first application scenario involved in this embodiment. As Figure 3 shown, Figure 3This is the schematic diagram of the first application scenario involved in the off-site debugging method of this application. Among them, the device to be debugged includes four screens, and their arrangement is the adjacent four faces of a rectangle, thus creating a digital display space. Then, the debugging device also includes four screens, and their arrangement is the same as that of the device to be debugged. The screens of the debugging device are equivalent to the screens of the device to be debugged reduced in equal proportion.

[0144] The second application scenario involved in this embodiment. As Figure 4 shown, Figure 4 This is the schematic diagram of the specifications of the device to be debugged in the second application scenario involved in the off-site debugging method of this application. The screens of the device to be debugged are two LED screens, with a physical dot pitch of 4.0 mm, a wall screen size of 24.96 * 6.24 m, a floor screen size of 17.76 * 6.24 m, and the angle between the floor screen and the ground is 1°. The total resolution is 6240 * 6000 (wall screen 6240 * 1560, floor screen 6240 * 4440), and it is directly driven by a professional server equipped with two NVIDIA RTX A6000 graphics cards. As Figure 5 shown, Figure 5 This is the schematic diagram of the specifications of the debugging device in the second application scenario involved in the off-site debugging method of this application. The display platform of the debugging device is built with aluminum profiles. The floor screen is installed by projection and projected forward, and the wall screen is installed by projection and projected backward. The resolution of the projector is 1080P. The maximum display size of both the wall screen and the floor screen is 1340 * 700. Within this size range, the display size of the debugging device can be adjusted in equal proportion according to the screens of the device to be debugged.

[0145] After establishing the quantity relationship and arrangement relationship between the screens of the debugging device and the screens of the device to be debugged, the on-site picture data sent by the device to be debugged to the debugging device. The on-site picture data is actually a kind of multimedia data, which can be understood as the real-time display data of the digital display project site.

[0146] Step A20: Receive a debugging control instruction, where the debugging control instruction is sent by the debugging device to the device to be debugged in response to the user's debugging operation.

[0147] Specifically, after receiving the on-site picture data, the debugging device parses and processes the on-site picture data to obtain the first on-site picture, and further controls the screens of the debugging device to display the first on-site picture. Since the number of screens of the debugging device is the same as that of the device to be debugged and the arrangement relationship is consistent, the first on-site picture displayed by the debugging device and the second on-site picture of the device to be debugged (i.e., the on-site picture of the digital display project) have the same spatial perspective relationship. The technical personnel of the debugging device can obtain a reasonable observation point for the first on-site picture, and the display effect seen on the debugging device is the same as that of the device to be debugged. Therefore, the technical personnel of the debugging device can make a reasonable debugging judgment based on the first on-site picture seen.

[0148] The debugging terminal provides a human-computer interaction interface and a human-computer interaction method, where the human-computer interaction method can be keyboard and mouse interaction. For example, the technician at the debugging terminal performs keyboard and mouse operations based on the human-computer interaction interface, inputs text, or clicks the mouse. The debugging terminal will generate corresponding debugging control instructions in response to the user's debugging operations and send the debugging control instructions to the device under debugging. Correspondingly, the device under debugging receives the debugging control instructions.

[0149] Step A30: Debug the second live video displayed on the device under debugging based on the debugging control instructions.

[0150] Specifically, the device under debugging parses the received debugging control instructions and controls the display of the second live video based on the debugging control instructions.

[0151] For example, if the technician at the debugging terminal clicks on position A with the mouse, then the device under debugging will also produce the effect of clicking on position B. Positions A and B correspond to each other. This is equivalent to the debugging terminal remotely controlling the device under debugging. In this way, the problems that occur on the device under debugging can be directly solved by the technician at the debugging terminal through debugging operations.

[0152] In this embodiment, through the above solution, specifically, by sending the live video data to the debugging terminal for the debugging terminal to receive the live video data and display the first live video based on the live video data; receiving the debugging control instructions, where the debugging control instructions are sent by the debugging terminal to the device under debugging in response to the user's debugging operations; and debugging the second live video displayed on the device under debugging based on the debugging control instructions. In this embodiment, the debugging terminal and the device under debugging can be located in two different places. The device under debugging sends the live video data to the debugging terminal, and the debugging terminal receives and displays the first live video based on the live video data, which can synchronize the videos of the debugging terminal and the device under debugging. And because the number of screens of the debugging terminal and the device under debugging is the same and the arrangement relationship is consistent, the display effects of the debugging terminal and the device under debugging can be basically similar, and the user of the debugging terminal can clearly and intuitively see the video content of the device under debugging. In addition, the user of the debugging terminal can also perform debugging operations, and the debugging terminal sends the debugging control instructions to the device under debugging, thereby debugging the second live video displayed on the device under debugging, solving the problem of low efficiency of the on-site debugging method for digital display projects.

[0153] In addition, an embodiment of the present application also proposes a remote debugging device. The remote debugging device is applied to the debugging terminal. The debugging terminal establishes a communication connection with the device under debugging. The number of screens of the debugging terminal is the same as that of the device under debugging and the arrangement relationship is consistent. The remote debugging device includes:

[0154] A receiving module, configured to receive the live video data sent by the device under debugging;

[0155] A display module, configured to display a first live video based on the live video data;

[0156] A debugging module, configured to, in response to a debugging operation of a user, send a debugging control instruction to the device under debugging, so that the device under debugging debugs a second live video displayed by the device under debugging based on the debugging control instruction.

[0157] For the principle and implementation process of remote debugging in this embodiment, please refer to the above embodiments and will not be elaborated here.

[0158] In addition, an embodiment of the present application further provides a remote debugging device. The remote debugging device is applied to the device under debugging. The device under debugging establishes a communication connection with a debugging end. The number of screens of the device under debugging is the same as that of the debugging end and the arrangement relationship is consistent. The remote debugging device includes:

[0159] A sending module, configured to send live video data to the debugging end, so that the debugging end receives the live video data and displays a first live video based on the live video data;

[0160] A receiving module, configured to receive a debugging control instruction, where the debugging control instruction is sent by the debugging end to the device under debugging in response to a debugging operation of a user;

[0161] A debugging module, configured to debug a second live video displayed by the device under debugging based on the debugging control instruction.

[0162] For the principle and implementation process of remote debugging in this embodiment, please refer to the above embodiments and will not be elaborated here.

[0163] In addition, an embodiment of the present application further provides a terminal device. The terminal device includes a memory, a processor, and a remote debugging program stored on the memory and executable on the processor. When the remote debugging program is executed by the processor, the steps of the remote debugging method described above are implemented.

[0164] Since when the remote debugging program is executed by the processor, all the technical solutions of all the foregoing embodiments are adopted, it has at least all the beneficial effects brought by all the technical solutions of all the foregoing embodiments, which will not be elaborated one by one here.

[0165] In addition, an embodiment of the present application further provides a computer-readable storage medium. A remote debugging program is stored on the computer-readable storage medium. When the remote debugging program is executed by the processor, the steps of the remote debugging method described above are implemented.

[0166] Since all the technical solutions of the foregoing embodiments are adopted when the local and remote debugging program is executed by the processor, it has at least all the beneficial effects brought by all the technical solutions of the foregoing embodiments, which will not be elaborated herein one by one.

[0167] Compared with the prior art, the remote debugging method, device, terminal device and storage medium provided by the embodiments of the present application receive the on-site picture data sent by the device to be debugged; display the first on-site picture based on the on-site picture data; and in response to the user's debugging operation, send a debugging control instruction to the device to be debugged, so that the device to be debugged debugs the second on-site picture displayed by the device to be debugged based on the debugging control instruction. Based on the solution of the present application, the debugging end and the device to be debugged can be located in two different places. The debugging end receives the on-site picture data of the device to be debugged and displays the first on-site picture, which can synchronize the pictures of the debugging end and the device to be debugged. And since the number of screens of the debugging end and the device to be debugged is the same and the arrangement relationship is consistent, the display effects of the debugging end and the device to be debugged can be basically similar, and the user of the debugging end can clearly and intuitively see the picture content of the device to be debugged. In addition, the user of the debugging end can also perform debugging operations, and send a debugging control instruction from the debugging end to the device to be debugged, so as to debug the second on-site picture displayed by the device to be debugged, solving the problem of low efficiency of the on-site debugging method for digital display projects.

[0168] It should be noted that in this article, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, but also includes other elements not expressly listed, or also includes elements inherent to such process, method, article or system. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or system including the element.

[0169] The serial numbers of the embodiments of the present application above are only for description and do not represent the advantages and disadvantages of the embodiments.

[0170] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0171] The above are only the preferred embodiments of the present application, and do not limit the patent scope of the present application accordingly. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, shall be similarly included in the patent protection scope of the present application.

Claims

1. A remote debugging method, characterized in that, The off-site debugging method is applied to the debugging end. The debugging end establishes a communication connection with the device under debugging. The number of screens of the debugging end is the same as that of the device under debugging and their arrangement relationship is consistent. The arrangement relationship refers to the arrangement relationship of the screens in the physical space, such as the orientation of the screens and the included angle between the screens. The off-site debugging method includes: Receiving the on-site picture data sent by the device under debugging; Displaying the first on-site picture based on the on-site picture data; In response to the user's debugging operation, sending a debugging control instruction to the device under debugging for the device under debugging to debug the second on-site picture displayed based on the debugging control instruction; The number of screens of the debugging end is more than two. The step of displaying the first on-site picture based on the on-site picture data includes: Performing picture fusion processing on the on-site picture data based on a preset picture fusion program to obtain the fused first on-site picture; Displaying the fused first on-site picture on different screens of the debugging end; Before the step of performing picture fusion processing on the on-site picture data based on a preset picture fusion program to obtain the fused first on-site picture, it further includes: Obtaining the display environment parameters of the device under debugging, where the display environment parameters include one or more of the number of screens, screen resolution, and viewpoint position; Processing the display environment parameters of the device under debugging based on a preset configuration parameter generator to obtain the display configuration parameters of the debugging end; The step of performing picture fusion processing on the on-site picture data based on a preset picture fusion program to obtain the fused first on-site picture includes: Performing picture fusion processing on the on-site picture data based on the display configuration parameters of the debugging end and the preset picture fusion program to obtain the fused first on-site picture.

2. The off-site debugging method according to claim 1, characterized in that Before the step of receiving the on-site picture data sent by the device under debugging, it further includes: Establishing a communication connection between the debugging end and the device under debugging based on a preset streaming program and an intranet penetration service.

3. The off-site debugging method according to claim 2, wherein Before the step of establishing a communication connection between the debugging end and the device under debugging based on a preset streaming program and an intranet penetration service, it further includes: Determining the server of the debugging end and the server of the device under debugging based on the hardware topology information of the debugging end and the device under debugging, where the hardware topology information includes the quantity relationship and connection relationship between the server and the screens; The step of establishing a communication connection between the debugging end and the device under debugging based on a preset streaming program and an intranet penetration service includes: Establishing a communication connection between the server of the debugging end and the server of the device under debugging based on the preset streaming program and the intranet penetration service.

4. A remote debugging method, characterized in that, The off-site debugging method is applied to the device under debugging. The device under debugging establishes a communication connection with the debugging end. The number of screens of the device under debugging is the same as that of the debugging end and their arrangement relationship is consistent. The arrangement relationship refers to the arrangement relationship of the screens in the physical space, such as the orientation of the screens and the included angle between the screens. The off-site debugging method includes: Send the on-site video data to the debugging terminal for the debugging terminal to receive the on-site video data and display the first on-site video based on the on-site video data. The number of screens of the debugging terminal is two or more. The step of displaying the first on-site video based on the on-site video data includes: Perform video fusion processing on the on-site video data based on a preset video fusion program to obtain the fused first on-site video; Display the fused first on-site video on different screens of the debugging terminal; Before the step of performing video fusion processing on the on-site video data based on a preset video fusion program to obtain the fused first on-site video, it further includes: Obtain the display environment parameters of the device under debugging, where the display environment parameters include one or more of the number of screens, screen resolution, and viewpoint position; Process the display environment parameters of the device under debugging based on a preset configuration parameter generator to obtain the display configuration parameters of the debugging terminal; The step of performing video fusion processing on the on-site video data based on a preset video fusion program to obtain the fused first on-site video includes: Perform video fusion processing on the on-site video data based on the display configuration parameters of the debugging terminal and the preset video fusion program to obtain the fused first on-site video; Receive a debugging control instruction, which is sent by the debugging terminal to the device under debugging in response to a user's debugging operation; Debug the second on-site video displayed by the device under debugging based on the debugging control instruction.

5. A remote debugging device, characterized in that, The off-site debugging device is applied to a debugging terminal. The debugging terminal establishes a communication connection with the device under debugging. The number of screens of the debugging terminal is the same as that of the device under debugging and their arrangement relationship is consistent. The arrangement relationship refers to the arrangement relationship of the screens in the physical space such as the orientation of the screens and the angle between the screens. The off-site debugging device includes: A receiving module for receiving the on-site video data sent by the device under debugging; A display module for displaying the first on-site video based on the on-site video data; A debugging module for sending a debugging control instruction to the device under debugging in response to a user's debugging operation, so that the device under debugging debugs the second on-site video displayed by the device under debugging based on the debugging control instruction; The number of screens of the debugging terminal is two or more. The display module is further configured to perform video fusion processing on the on-site video data based on a preset video fusion program to obtain the fused first on-site video; and display the fused first on-site video on different screens of the debugging terminal; Obtain the display environment parameters of the device under debugging, where the display environment parameters include one or more of the number of screens, screen resolution, and viewpoint position; process the display environment parameters of the device under debugging based on a preset configuration parameter generator to obtain the display configuration parameters of the debugging terminal; Perform video fusion processing on the on-site video data based on the display configuration parameters of the debugging terminal and the preset video fusion program to obtain the fused first on-site video.

6. An off-site debugging device, characterized in that, The off-site debugging device is applied to the device to be debugged, which establishes a communication connection with the debugging device. The number of screens of the device to be debugged is the same as that of the debugging device and their arrangement relationship is consistent. The arrangement relationship refers to the arrangement relationship of the screens in the physical space, such as the orientation of the screens and the included angle between the screens. The off-site debugging device includes: A sending module, configured to send on-site picture data to the debugging device, so that the debugging device receives the on-site picture data and displays a first on-site picture based on the on-site picture data. The number of screens of the debugging device is two or more. The step of displaying the first on-site picture based on the on-site picture data includes: Performing picture fusion processing on the on-site picture data based on a preset picture fusion program to obtain a fused first on-site picture; Displaying the fused first on-site picture on different screens of the debugging device; Before the step of performing picture fusion processing on the on-site picture data based on a preset picture fusion program to obtain a fused first on-site picture, the method further includes: Obtaining the display environment parameters of the device to be debugged, where the display environment parameters include one or more of the number of screens, screen resolution, and viewpoint position; Processing the display environment parameters of the device to be debugged based on a preset configuration parameter generator to obtain the display configuration parameters of the debugging device; The step of performing picture fusion processing on the on-site picture data based on a preset picture fusion program to obtain a fused first on-site picture includes: Performing picture fusion processing on the on-site picture data based on the display configuration parameters of the debugging device and the preset picture fusion program to obtain the fused first on-site picture; A receiving module, configured to receive a debugging control instruction, where the debugging control instruction is sent by the debugging device to the device to be debugged in response to a user's debugging operation; A debugging module, configured to debug a second on-site picture displayed by the device to be debugged based on the debugging control instruction.

7. A terminal device, characterized in that, The terminal device includes a memory, a processor, and an off-site debugging program stored on the memory and executable on the processor. When the off-site debugging program is executed by the processor, it implements the steps of the off-site debugging method according to any one of claims 1-3 or 4.

8. A computer-readable storage medium, characterized in that, An off-site debugging program is stored on the computer-readable storage medium. When the off-site debugging program is executed by the processor, it implements the steps of the off-site debugging method according to any one of claims 1-3 or 4.

Images