Debugging method for remotely debugging terminal equipment, remote terminal and terminal equipment

Abstract

The invention relates to a debugging method for remotely debugging terminal equipment, a remote terminal, the terminal equipment and a computer readable storage medium. The debugging method applied to the remote terminal and used for remotely debugging the terminal equipment comprises the following steps: establishing connection with the terminal equipment; calling parameter information of the terminal equipment and a real-time terminal state corresponding to the parameter information; a parameter file is determined, and the parameter file comprises updated parameter information and character string information; and sending the parameter file to the terminal equipment, so that the terminal equipment correspondingly adjusts the terminal state based on the updated parameter information, and determines the current connection state based on the character string information. According to the debugging method for remotely debugging the terminal equipment provided by the embodiment of the invention, the parameters of the terminal equipment can be conveniently and remotely adjusted, the network stability is kept, the network delay is reduced, the network condition can be detected in real time, and operation and control errors caused by misjudgment of normal connection are avoided.

Description

Technical Field

[0001] The present invention relates to the field of communications, and in particular to a debugging method for remote debugging terminal equipment, a remote terminal, a terminal equipment and a computer-readable storage medium. Background Art

[0002] With the development of technology, various terminal devices are widely used in different scenarios. While the functions of terminal devices are more advanced and intelligent, the technical capabilities required for debugging terminal devices are also getting stronger and stronger. In addition, it is often necessary to carry out targeted debugging of different terminal devices according to specific scenarios, and technical personnel are required to go to the site for debugging, resulting in insufficient manpower, high costs, and low efficiency. In some related technologies, terminal devices are debugged through remote network connections, but network instability and long delays have an adverse effect on the debugging process. Especially in the case of large information transmission, network connection problems often cause remote debugging difficulties, or even debugging errors. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the first aspect of the present disclosure provides a debugging method for remote debugging of a terminal device, which is applied to a remote terminal, and the method includes: establishing a connection with the terminal device; retrieving parameter information of the terminal device and a real-time terminal status corresponding to the parameter information; determining a parameter file, wherein the parameter file includes updated parameter information and string information; and sending the parameter file to the terminal device, so that the terminal device adjusts the terminal status based on the updated parameter information and determines the current connection status based on the string information.

[0004] In some embodiments, sending the parameter file to the terminal device includes: sending the parameter file to the terminal device periodically; and / or sending the parameter file to the terminal device in response to a sending instruction.

[0005] In some embodiments, the terminal device includes a camera, and the terminal status includes a picture acquired by the camera based on current parameter information; the method further includes: displaying the picture based on the real-time terminal status.

[0006] In some embodiments, establishing a connection with the terminal device includes: connecting to a server; completing a connection with the terminal device based on an identification code of the terminal device, wherein the terminal device is connected to the server and does not establish a connection with other remote terminals.

[0007] In some embodiments, establishing a connection with the terminal device further includes: generating a random port for establishing a connection with the terminal device through the random port.

[0008] In some embodiments, establishing a connection with the terminal device further includes: in response to obtaining a key, matching the key information; in response to successful information matching, determining account permissions, wherein the account permissions include at least a first permission for controlling the terminal device.

[0009] A second aspect of the present disclosure provides a debugging method for remote debugging of a terminal device, which is applied to the terminal device, and the method includes: determining the terminal status in real time based on current parameter information; establishing a connection with a remote terminal; receiving a parameter file sent by the remote terminal, wherein the parameter file includes updated parameter information and string information; updating parameters based on the updated parameter information and adjusting the terminal status accordingly; and determining the current connection status based on the string information.

[0010] In some embodiments, determining the current connection status based on the string information includes: if the string information is correct, determining the connection status is normal; if the string information is wrong, or the string information is not received, determining the connection status is abnormal.

[0011] In some embodiments, the terminal device includes a camera device; the real-time determination of the terminal status based on the current parameter information includes: based on the current parameter information, obtaining a picture in real time through the camera device.

[0012] In some embodiments, establishing a connection with a remote terminal includes: connecting to a server; and completing a connection with the remote terminal in response to a connection request sent by the remote terminal via a corresponding identification code.

[0013] In some embodiments, establishing a connection with a remote terminal further includes: acquiring a random port generated by the remote terminal; and establishing a connection with the remote terminal through the random port.

[0014] In some embodiments, establishing a connection with a remote terminal further includes: in response to obtaining a key, matching the key information; in response to successful information matching, determining account permissions, wherein the account permissions include at least a second permission for updating parameter information of the terminal device.

[0015] The third aspect of the present disclosure provides a remote terminal, including: a first network connection module, used to establish a connection with the terminal device; a calling module, used to call parameter information of the terminal device and a real-time terminal status corresponding to the parameter information; a parameter determination module, used to determine a parameter file, wherein the parameter file includes updated parameter information and string information; the first network connection module is also used to send the parameter file to the terminal device, so that the terminal device adjusts the terminal status based on the updated parameter information and determines the current connection status based on the string information.

[0016] The fourth aspect of the present disclosure provides a terminal device, including: a state determination module, used to determine the terminal state in real time based on current parameter information; a second network connection module, used to establish a connection with a remote terminal and receive a parameter file sent by the remote terminal, wherein the parameter file includes updated parameter information and string information; an adjustment module, used to adjust the terminal state accordingly based on the updated parameter information; and a detection module, used to determine the current connection state based on the string information.

[0017] A fifth aspect of the present disclosure provides a computer-readable storage medium, which stores the following program, wherein the program is used to execute the debugging method for remote debugging a terminal device as described in the first aspect or the second aspect.

[0018] Through the debugging method for remote debugging of terminal equipment provided in this embodiment, the parameters of the terminal equipment can be conveniently adjusted remotely, the network is stable, the network delay is reduced, the network status can be detected in real time, and operational and control errors caused by misjudgment of normal connection can be avoided.

[0019] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The present invention may be better understood by describing exemplary embodiments of the present invention in conjunction with the accompanying drawings, in which:

[0021] Figure 1 It is a connection diagram for remote debugging of some related technologies;

[0022] Figure 2 A connection diagram of remote debugging of an exemplary embodiment of the present disclosure;

[0023] Figure 3 This is a flowchart of a debugging method for remote debugging a terminal device shown in an exemplary embodiment of the present disclosure;

[0024] Figure 4This is a flowchart of a debugging method for remote debugging a terminal device shown in another exemplary embodiment of the present disclosure;

[0025] Figure 5 A schematic diagram of a remote terminal shown in an exemplary embodiment of the present disclosure;

[0026] Figure 6 This is a schematic diagram of a terminal device shown in an exemplary embodiment of the present disclosure;

[0027] Figure 7 A connection diagram of remote debugging of another exemplary embodiment of the present disclosure;

[0028] Figure 8 This is a flowchart of a debugging method for remote debugging a terminal device shown in another exemplary embodiment of the present disclosure;

[0029] Fig. 9 This is a flowchart of a debugging method for remote debugging a terminal device shown in another exemplary embodiment of the present disclosure;

[0030] Fig.10 This is a flowchart of a debugging method for remote debugging a terminal device shown in another exemplary embodiment of the present disclosure;

[0031] Fig.11 This is a flowchart of a debugging method for remote debugging a terminal device shown in another exemplary embodiment of the present disclosure;

[0032] Fig.12 The figure is a schematic diagram of the structure of an electronic device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0033] The specific embodiments of the present invention will be described below. It should be noted that in the specific description of these embodiments, in order to provide a concise description, it is impossible for this specification to provide a detailed description of all the features of the actual embodiments. It should be understood that in the actual implementation of any embodiment, just as in the process of any engineering project or design project, in order to achieve the specific goals of the developer and to meet system-related or business-related restrictions, various specific decisions are often made, and this will also change from one embodiment to another. In addition, it can also be understood that although the efforts made in this development process may be complex and lengthy, for ordinary technicians in the field related to the content disclosed by the present invention, some changes such as design, manufacturing or production based on the technical content disclosed in this disclosure are just conventional technical means, and should not be understood as insufficient content of this disclosure.

[0034] Unless otherwise defined, the technical or scientific terms used in the claims and the specification shall have the usual meaning understood by persons with ordinary skills in the technical field to which the invention belongs. The words "first", "second" and similar words used in the patent application specification and the claims of the present invention do not indicate any order, quantity or importance, but are only used to distinguish different components. "One" or "one" and other similar words do not indicate a quantitative limitation, but indicate the existence of at least one. "Include" or "comprises" and other similar words mean that the elements or objects appearing before "include" or "comprises" include the elements or objects listed after "include" or "comprises" and their equivalent elements, and do not exclude other elements or objects. "Connected" or "connected" and other similar words are not limited to physical or mechanical connections, nor are they limited to direct or indirect connections.

[0035] In some related technologies, such as Figure 1 As shown, by running the debugging tool on the local computer in the actual application scenario, the terminal device is connected through USB and other methods. The remote computer controls the local computer through the third-party remote control computer software, fully controls the local computer through the remote control software, and performs debugging work by remotely operating the local computer. However, there are still some problems with the above-mentioned use of remote computers to control local computers to achieve on-site support: there is a risk of leaking the company's newly developed products by remotely controlling the other party's computer through third-party applications, and there are many outdoor scenarios without network, and it is difficult for local computers to obtain free networks. Using mobile phone hotspots to provide computers with networks requires a lot of traffic compared to new technologies. Every outdoor debugging requires a computer and terminal products, and the remote control application is not specially customized for debugging, and problems such as unstable connection often occur, which ultimately leads to a poor debugging experience and low efficiency.

[0036] In order to solve the above technical problems, the present disclosure provides a debugging method for remote debugging of a terminal device. Figure 2As shown, the terminal device can be connected to the set public server network through the network (for example: wifi or 4G, 5G signal), and TCP (Transmission Control Protocol) technology can be used. At the remote end, the public network server can be remotely connected through a remote terminal (such as a computer), or TCP technology can be used. And the remote terminal is installed with tool software for debugging the terminal device, and a connection is established between the remote terminal and the connected terminal device, and further debugging work can be performed. Through remote debugging, work efficiency is improved, debugging costs are reduced, and the debugging method provided by the present disclosure can further ensure network stability, reduce network delays, and timely discover network anomalies to avoid debugging errors. For example, when the terminal device includes a camera device, in development and debugging, it is often necessary to debug for various scenarios. The image signal processor (Image Signal Processor, ISP) manufacturer also involves technical support for terminal customers, and needs to assist customers in debugging for good results. Since the image debugging of the camera device involves a large number of different scenarios, the scenarios are often distributed in different locations, including outdoors without free networks, and mainly in the city where the terminal customer is located. Coupled with the complexity of the ISP, a large number of ISP parameters need to be repeatedly modified and verified. On the one hand, the workload is large, and on the other hand, the ISP manufacturer's technical personnel often need to travel to the terminal device site to debug and solve the problem. It is time-consuming, laborious, and often there is a shortage of technical personnel. It is difficult to support multiple projects at the same time, resulting in high costs. Through the disclosed embodiment, tool software for debugging terminal devices can be installed on the remote terminal. For example, when the debugged terminal device includes a camera device, the remote terminal can be installed with the ISP manufacturer's ISP image debugging tool, such as Tuning Tool.

[0037] Specifically, the embodiments of the present disclosure provide a debugging method for remote debugging of a terminal device, which is applied to a remote terminal, wherein the remote terminal can be set at any location (such as a computer), and the remote terminal can be installed with relevant debugging tools and can be operated by a technician to debug the terminal device remotely. Figure 3 As shown, the debugging method may include: step S11 to step S14, which are described in detail as follows.

[0038] Step S11, establishing a connection with the terminal device. In the embodiment of the present disclosure, the remote terminal can establish a network connection with the terminal device through TCP or other means. The terminal device can be an independent device set in an actual application scenario, having application functions in the scenario and certain network functions. In some embodiments, the terminal device may include a camera device for capturing images of the actual scene, and may also include a local computer connected to the camera device so that it can be more convenient to connect to the network, or the camera device with a network connection function can directly establish a connection with the network, thereby enabling the remote terminal to establish a connection with the terminal device.

[0039] Step S12, retrieve the parameter information of the terminal device and the real-time terminal status corresponding to the parameter information. After establishing a connection with the terminal device, the remote terminal can obtain the current parameter information of the terminal device for review and modification; and can also obtain the terminal status of the current terminal device, so that the parameter information can be conveniently adjusted according to the current status. Moreover, after adjusting the parameters, the current real-time terminal status can continue to be obtained, which meets the needs of timely feedback and facilitates the adjustment effect, so that the parameter information can be further adjusted to a better parameter.

[0040] Step S13, determining a parameter file, wherein the parameter file includes updated parameter information and string information. In the disclosed embodiment, the parameters of the terminal device can be adjusted at the remote terminal according to the retrieved parameter information and the real-time terminal status, so that the terminal device can better complete the corresponding functions in the scene where it is located. Among them, the updated parameter information can be the modified parameter information, or it can be the parameter information that has not been further modified. The remote terminal can generate corresponding parameters according to the terminal status of the terminal device and form a parameter file; it can also obtain new parameters according to the adjustment and modification of the technician and form a parameter file. Among them, the parameter file can be a file that the terminal device can perform data parsing, or it can be a program code. For example, in the case of debugging the camera device of the terminal device, the adjusted parameters can be exported as a JSON (JavaScript Object Notation) file through the Tuning tool of the ISP manufacturer, and the file can be directly integrated into the engineering code, that is, it can be burned into the software in the terminal device, and the software drives the normal operation of the terminal device.

[0041] Step S14, sending a parameter file to the terminal device, so that the terminal device can adjust the terminal state based on the updated parameter information and determine the current connection state based on the string information. In the disclosed embodiment, the terminal device can parse the parameter file, adjust the parameters based on the parameter information, and adjust the terminal state accordingly. For example, the camera device can adjust the shooting parameters according to the new parameter information to obtain pictures of different states.

[0042] In the disclosed embodiment, string information is added to the parameter file, and the string information can be a string of data agreed upon by the remote terminal and the terminal device. After the terminal device receives the parameter file, if it is found that the received digital string does not conform to the agreement, it means that the connection is abnormal. In the process of remote debugging, it is necessary to modify the effect parameter file, and the effect parameters at both ends of the remote terminal and the terminal device can be regularly updated through the connection, that is, the remote terminal can regularly send parameter files to the terminal device, wherein the parameter information in the parameter file can be modified or unmodified. By writing the string information into the parameter file, sending and receiving through a unified interface is conducive to reducing the delay of sending. Through testing, the network delay of sending the string information in the above manner is at least 5ms shorter than the network delay of sending the string information separately. In addition, the terminal device can detect the network status based on the string, and by regularly sending and regularly detecting the string information, it can timely discover and avoid the situation that the connection is still normal due to program deadlock or blocking, and further avoid the failure of remote debugging or debugging errors.

[0043] In some embodiments, the terminal device may include a camera, and the terminal state may include a picture obtained by the camera based on the current parameter information; the debugging method may also include: displaying the picture based on the real-time terminal state. In the embodiment of the present disclosure, the camera can be remotely debugged, and the camera may be a separate camera or other equipment, or a camera on a terminal such as a computer, a mobile phone, or a watch. In some cases, a terminal with a camera can be directly connected to the network, such as a terminal device such as a computer with a camera. In other cases, the camera does not have a network connection function and needs to be connected to a local computer to achieve network connection. The camera may need to debug its parameters in different scenarios to meet the corresponding image requirements. In the case of remote debugging of the camera, the picture obtained by the camera according to the current parameters can be obtained and displayed on the remote terminal, so as to facilitate the remote analysis of the picture obtained by the camera, such as analyzing the color, contrast, color, sharpness, gradient and other information of the picture through the remote terminal to determine how the parameters need to be adjusted; the parameter adjustment method can also be determined by the technician's viewing. During the remote debugging process, the disclosed embodiment can display the image of the camera device in real time, so that the parameters can be easily adjusted and real-time feedback can be obtained, which can meet the purpose of further precise debugging. On the other hand, since the images captured by the camera device need to be transmitted through the network in real time, there are higher requirements for the stability of network transmission and network delay. The debugging method provided by the disclosed embodiment can reduce network delay and ensure network stability, thereby better meeting the situation of remote debugging of terminal devices including camera devices, improving the real-time performance of the images displayed on the remote terminal, and being able to obtain the effect of adjusting parameter information in a timely manner. It can also be further determined whether further adjustment is needed according to the situation, thereby meeting efficient and accurate remote debugging and improving debugging efficiency and quality.

[0044] In some embodiments, step S14 sends a parameter file to the terminal device, which may include: sending a parameter file to the terminal device regularly; and / or, sending a parameter file to the terminal device in response to a sending instruction. In the embodiment of the present disclosure, the remote terminal may send a parameter file to the terminal device regularly, for example, once every second, and can adjust the parameters of the terminal device in real time, and can send string information through the parameter file, so that the terminal device can regularly detect whether the string information is received, thereby detecting the network status. If the string information is not received within a certain period, for example, at an interval of 2 seconds, the network can be judged to be abnormal, and the terminal device can be allowed to reconnect to the network. A prompt can also be issued to perform a network check or network connection on the personnel in the scene on the side of the terminal device. Among them, the time interval can be formulated according to actual needs, and a shorter interval can improve the real-time detection; a longer interval can reduce the network transmission burden to a certain extent. In the embodiment of the present disclosure, the remote terminal can also send a parameter file to the terminal device according to a sending instruction. For example, after modifying the parameters, the parameter file with the modified parameter information can be sent to the terminal device according to the instruction to adjust the parameters of the terminal device. It should be noted that the embodiment of the present disclosure can realize regular sending and sending in response to sending instructions, and the two do not conflict.

[0045] In some embodiments, step S11 establishes a connection with the terminal device, which may include: connecting to the server; completing the connection with the terminal device based on the identification code of the terminal device, wherein the terminal device is connected to the server and is not connected to other remote terminals. In the disclosed embodiment, the remote terminal can be connected to the server via TCP, and can achieve paired connection according to the hardware identification code corresponding to the terminal device. In addition, in order to ensure the reliability of debugging, the terminal device only establishes a connection with one remote terminal. If a connection has been established with a remote terminal, subsequent remote terminals cannot be connected to the terminal device to avoid confusion in parameter adjustment. After the remote terminal is connected to the public server, the hardware identification code can be input using tools such as Tuning Tool. The identification code is inherent in the terminal device, or it can be set by the terminal device startup or through tools such as Tuning Tool. If the input identification code is correct and the terminal device is not connected to other remote terminals through the public server, the remote terminal can connect to the terminal device to achieve the connection between the terminal device and the remote terminal.

[0046] In some embodiments, step S11 establishes a connection with a terminal device, and may further include: generating a random port for establishing a connection with the terminal device through the random port. In the disclosed embodiment, a random unfamiliar port may be used for each connection, which may avoid hacker attacks and thus protect the security of the company's products.

[0047] In some embodiments, step S11 establishes a connection with the terminal device, and may further include: in response to obtaining a key, matching with the key information; in response to successful information matching, determining the account authority, wherein the account authority includes at least a first authority for controlling the terminal device. In the disclosed embodiment, a physical key (Key) can be used, which can be an entity like a USB flash drive, communicating through a USB port, and a set of character information can be burned on each key, which can contain numbers and letters, etc., which contains the validity period of the key, project-related information, etc. And encrypted in an agreed manner. After inserting the key, matching can be performed, for example, by starting the tuning tool tool, the tool will identify and decrypt the relevant information in the key, if the information matches successfully, the function on the tool will start normally, thereby improving security. After the match is successful, the account login can be further performed. Compared with the key, it is equivalent to the collection of different permissions and personal use information. The key will not track the individual, and the account password will track the individual. And different account passwords will have different permissions. In this embodiment, the remote terminal needs to be able to remotely control the relevant functions of the terminal device, so the first permission level of the account can be relatively high, for example, it can have all permissions, can control the terminal device and modify the parameters of the terminal device. After key matching and account login, a random port can be generated to achieve corresponding connection and security control.

[0048] Based on the same inventive concept, the present disclosure also provides a debugging method for remote debugging of a terminal device, which is applied to a terminal device, wherein the terminal device may include terminal products used in some scenarios, such as cameras, speakers, various sensors or detection devices, etc. The terminal product may have a network connection function; or it may be connected to a terminal with a network connection function as a terminal device. Figure 4 As shown, the debugging method may include: Step S21-Step S25, which are described in detail as follows. It should be noted that some of the contents have been mentioned in the previous text of this disclosure, and the relevant contents can be referred to in the previous embodiments.

[0049] Step S21, based on the current parameter information, determine the terminal state in real time. In the embodiment of the present disclosure, the terminal device can work based on the current parameter information after normal startup to determine the terminal state through the current parameters. For example, the camera device can obtain images according to the current parameters.

[0050] Step S22, establish a connection with a remote terminal. In the disclosed embodiment, it is not necessary to debug the terminal device on site, but remote parameter debugging can be achieved by connecting to a remote terminal. Some terminals, such as mobile phones, can be directly connected to a remote terminal through the network; other terminals, such as video cameras without network functions, can be connected to a local computer or other terminal and connected to the network through the computer. After the connection is established, parameter information and terminal status can be sent to the remote terminal; the remote terminal can also directly retrieve parameter information and terminal status. The synchronization of the two sides can be maintained through the network connection.

[0051] Step S23, receiving a parameter file sent by the remote terminal, wherein the parameter file includes updated parameter information and string information. The remote terminal can form a parameter file and send it to the terminal device, and the updated parameter information in the parameter file can be consistent with the previous parameter information or can be modified parameter information.

[0052] Step S24, update the parameters based on the updated parameter information and adjust the terminal state accordingly. The parameter file contains parameter information, and the terminal device can adjust the relevant parameters according to the parameter information in the parameter file, and change the terminal state accordingly. For example, the camera device adjusts the relevant image parameters according to the new parameter information and captures images with the new parameters. Remote debugging is achieved and the state is adjusted in real time, so that the remote terminal can obtain the adjusted state of the terminal device in real time, so that further debugging can be conveniently performed.

[0053] Step S25, determine the current connection status based on the string information. In the disclosed embodiment, string information is added to the parameter file, and the string information can be a string of data agreed upon by the remote terminal and the terminal device. After the terminal device receives the parameter file, if it is found that the received digital string does not conform to the agreement, it means that the connection is abnormal. By writing the string information into the parameter file, sending and receiving through a unified interface is conducive to reducing the transmission delay. The terminal device can detect the network status based on the string, and can regularly detect the string information, timely discover and avoid the situation where the connection is misjudged as normal due to program deadlock or blocking, and further avoid the occurrence of remote debugging failure or debugging errors.

[0054] In some embodiments, the terminal device may include a camera; step S21 determines the terminal state in real time based on the current parameter information, which may include: based on the current parameter information, the screen obtained in real time by the camera. In the embodiment of the present disclosure, the camera can be debugged remotely, and the camera may be a separate camera or other equipment, or a camera on a terminal such as a computer, a mobile phone, or a watch. In some cases, a terminal with a camera can be directly connected to the network, such as a terminal device such as a computer with a camera. In other cases, the camera does not have a network connection function and needs to be connected to a local computer to achieve network connection. The camera may need to debug its parameters in different scenarios to meet the corresponding image requirements. After the camera of the terminal device is started, the screen can be obtained in real time according to the current parameter information, and the remote terminal can see the screen from the remote after the connection is established, so as to facilitate the debugging of the parameters of the terminal device. In addition, after adjusting the parameters, the screen of the terminal device changes in real time, which is convenient for the remote terminal to obtain feedback, and the effect of adjusting the parameter information can be obtained in time, and it can be further judged whether it needs to be adjusted according to the situation, so as to meet efficient and accurate remote debugging and improve the debugging efficiency and quality.

[0055] In some embodiments, step S25, determining the current connection state based on the string information, may include: if the string information is correct, determining that the connection state is normal; if the string information is wrong, or the string information is not received, determining that the connection state is abnormal. In the embodiment of the present disclosure, it is possible to determine whether the network is abnormal based on whether the string conforms to the agreement, that is, if a string conforming to the agreement is received, the network state is judged to be normal, and if the received string does not conform to the agreement, it proves that the network may have an abnormal situation, and the network needs to be reconnected or diagnosed. On the other hand, the string can be received or detected regularly. If the string information is not received beyond a certain time interval, that is, the parameter file is not received or the string information does not exist in the parameter file, it can also be judged that the network is interrupted, blocked or other abnormal situations. Based on the above method, the embodiment of the present disclosure can quickly and efficiently determine the network state, and avoid debugging errors and the like in the case of network abnormalities. And by writing the string information in the parameter file, the network burden is reduced, the network delay is reduced, and the network stability of the debugging process of the camera device for the picture transmission is especially guaranteed.

[0056] In some embodiments, step S22 of establishing a connection with a remote terminal may include: connecting to a server; completing the connection with the remote terminal in response to a connection request sent by the remote terminal through a corresponding identification code. In the disclosed embodiment, a connection may be established with a network server through TCP or the like, and a connection may be established with the remote terminal based on matching of the identification code of the remote terminal. This avoids misconnection and can also avoid being controlled by multiple remote terminals at the same time.

[0057] In some embodiments, step S22 establishing a connection with a remote terminal may further include: obtaining a random port generated by the remote terminal; and establishing a connection with the remote terminal through the random port. In the disclosed embodiment, after the remote terminal generates a random port, a connection with the remote terminal may be established through the random port, thereby improving security.

[0058] In some embodiments, step S22 establishes a connection with a remote terminal, and may further include: in response to obtaining a key, matching with the key information; in response to successful information matching, determining the account authority, wherein the account authority at least includes a second authority for updating the terminal device parameter information. In the disclosed embodiment, a physical key (Key) can be used, and each key can be burned with a set of character information, which can contain numbers and letters, etc., which contains the validity period of the key, project-related information, etc. And encrypted in an agreed manner. After inserting the key, matching can be performed, for example, by starting the tuning tool tool, the tool will identify and decrypt the relevant information in the key, and if the information matches successfully, the function on the tool will start normally, thereby improving security. After the match is successful, the account login can be further performed. In this embodiment, the terminal device does not need to control the remote terminal, and in the actual scenario of the terminal device, it can be controlled by local personnel, so the second authority level of the account can be relatively low, for example, it can only have the authority to modify the local device parameters. After key matching and account login, the corresponding connection can be realized according to the random port, and parameter debugging can be performed under the condition that security is guaranteed.

[0059] Based on the same inventive concept, the present disclosure also provides a remote terminal 100, such as Figure 5 As shown, the remote terminal 100 may include: a first network connection module 110, used to establish a connection with a terminal device; a call module 120, used to call parameter information of the terminal device, and a real-time terminal state corresponding to the parameter information; a parameter determination module 130, used to determine a parameter file, wherein the parameter file includes updated parameter information and string information; the first network connection module 110 is also used to send a parameter file to the terminal device, so that the terminal device can adjust the terminal state based on the updated parameter information and determine the current connection state based on the string information. The remote terminal 100 of the embodiment of the present disclosure can conveniently adjust the parameters of the terminal device remotely, the network is stable, the network delay is reduced, and the network status can be detected in real time to avoid operation and control errors caused by misjudging a normal connection.

[0060] Based on the same inventive concept, the present disclosure also provides a terminal device 200, such as Figure 6As shown, the terminal device 200 may include: a state determination module 210, which is used to determine the terminal state in real time based on the current parameter information; a second network connection module 220, which is used to establish a connection with a remote terminal and receive a parameter file sent by the remote terminal, wherein the parameter file includes updated parameter information and string information; an adjustment module 230, which is used to adjust the terminal state correspondingly based on the updated parameter information; and a detection module 240, which is used to determine the current connection state based on the string information. The terminal device 200 of the embodiment of the present disclosure can conveniently adjust the parameters of the terminal device 200 remotely, and can detect the network status in real time to avoid operation and control errors caused by misjudging the normal connection.

[0061] The debugging method provided by the present disclosure is described below through some specific embodiments.

[0062] In some embodiments, to remotely debug a terminal device, the terminal device must first be connected to a remote terminal for communication, such as Figure 7 As shown, the remote terminal may include a TCP client and a debugging tool, and the terminal device may include a nested word. The remote terminal and the terminal device may be connected via a server according to TCP technology. First, the terminal device is connected to the network of a pre-set server through WIFI or a 4G or 5G signal network. Then the remote terminal is connected to a server on the public network. After the remote terminal and the terminal device are respectively connected to the server network, the remote terminal and the terminal device respectively connected to the server network may be paired according to the hardware identification code, so that the remote terminal and the terminal device can be paired and connected, and the remote terminal can debug the terminal device. The remote terminal may be installed with a debugging tool for debugging the terminal device. The debugging tool installed on the remote terminal and the debugging tool of the terminal device are connected through TCP, so that the debugging tool installed on the remote terminal and the debugging tool of the terminal device are communicated and connected, and finally the connection between the remote terminal and the terminal device is completed for debugging.

[0063] like Figure 8 As shown, the process of remote debugging of a terminal device may include the following steps:

[0064] First, you can turn on the terminal device, point the terminal device at the screen that needs to be debugged, and run the script on the terminal device to ensure that it is connected to the server. First, you can turn on the terminal device. The terminal device can be a camera device. Aim the camera device at the screen that needs to be debugged. The terminal device can be fixed and supported by a tripod or other fixing device to keep the terminal device stable. After the terminal device is turned on, you can run the preset script directly on the terminal device. The preset script includes pre-set software instructions and configuration parameters for connecting to the server. When the preset script is running, it can assign a unique identification code to the terminal device. The identification code can be used for pairing when subsequently connecting to the remote terminal. Run the preset script directly,

[0065] The debugging tool is started on the remote terminal, wherein the debugging tool is used to debug various parameters and information of the terminal device. The debugging tool may be integrated with a virtual display interface, which can obtain the display interface of the terminal device or the information obtained by the terminal device, and display it on the remote terminal through the virtual display interface. The virtual display interface can transmit the information obtained by the terminal device to the remote terminal in real time and display it graphically on the remote terminal. In the case where the terminal device is a camera device, after the camera device is turned on, it can preview or capture images in real time, and the debugging tool can display the images captured by the camera device in real time on the remote terminal.

[0066] Pair and connect the debugging tool of the remote terminal with the terminal device. After the remote terminal is connected to the server, the identification code assigned to the terminal device can be entered in the debugging tool of the remote terminal, and the terminal device and the remote terminal can be paired and connected one by one according to the identification code through TCP technology. The pairing connection between the debugging tool of the remote terminal and the terminal device can be unique. Since the identification code assigned to the terminal device is unique, a terminal device can be connected to a remote terminal through the server according to the unique identification code. If a terminal device is already connected to the remote terminal, the identification code of the terminal device cannot be entered on other remote terminals to connect to the terminal device.

[0067] Read the ISP parameters and other information in the terminal device through the debugging tool. The debugging tool can be used to extract the ISP parameters and other parameter information on the terminal device, and the obtained parameter information of the terminal device can be displayed in real time on the remote terminal through the virtual display interface of the debugging tool, so as to facilitate the query of the terminal device information on the remote terminal.

[0068] Choose whether to import new parameters into the terminal device. The parameter information of the terminal device displayed in the virtual display interface of the debugging tool can be exported as a JSON (JavaScript Object Notation) file. According to the actual debugging situation, the parameter information exported as a JSON file can be incorporated into the project code for continued use, or the relevant files of the parameter information preset in the project code can be imported into the project code as new parameter information.

[0069] Modify the parameters for debugging, determine the final parameters, and complete the debugging. You can manually analyze and modify the parameters to debug the terminal device. You can view the information of the terminal device in real time according to the virtual display interface and debug the parameter information until the final parameters are determined. Through the debugging tool, export the parameter information and save it as a JSON file, merge the JSON file into the project code, and complete the debugging.

[0070] The method of this embodiment can debug the terminal device through the remote terminal, realize stable and efficient remote debugging, effectively reduce labor costs, and improve debugging efficiency. Connecting the terminal device and the remote terminal through the server through TCP can make the data transmission have better integrity, sequence and reliability, effectively improve the debugging efficiency, and obtain the terminal device information through the virtual display interface at the remote terminal, which has better real-time performance.

[0071] In some embodiments, Fig. 9 As shown, the terminal device can connect to the server via TCP, which can include the following steps:

[0072] Establish a network connection. First, a network connection can be established between the terminal device and the server. The terminal device and the server can be connected to the same network, either through a wired connection, a WIFI connection, or a mobile data network connection such as 4G or 5G. For the network connection between the terminal device and the server, a mobile data network connection or a WIFI connection can be used, while a wired connection or a WIFI connection is generally used for a remote terminal. Since the terminal device and the server need to be connected through a network, in order to ensure the stability of the network connection, in some embodiments, after the terminal device and the server are successfully connected through the network, the network settings can be controlled so that the debugging tool continues to be in the first network priority. The network menu of the debugging tool can be preset to ensure that the debugging tool continues to be in the first network priority, thereby ensuring that the debugging tool is in priority in the network connection, avoiding the terminal device from connecting to an unsafe network or disconnecting, and improving the security and stability of the network connection.

[0073] Get the server address and port. Get the server's host name or IP address and port number to determine the server that the terminal device needs to connect to. The server information that the terminal device needs to connect to is generally provided by the application or obtained through a service discovery mechanism. In this embodiment, the server information that the terminal device needs to connect to can be set in a preset script. By running the preset script on the terminal device, the server's host name or IP address and port number can be directly obtained. After obtaining the server address and port, the server's host name or IP address and port number can also be written into the remote terminal's debugging tool to facilitate subsequent connection between the remote terminal and the server.

[0074] Create a TCP socket. You can create a TCP socket in the application of the terminal device. The socket can be an endpoint of the communication chain between the server and the terminal device. It can be regarded as a virtual terminal for network communication between the server and the terminal device. It can realize two-way communication between the server and the terminal device in the network through the socket.

[0075] Initiate a connection request. The terminal device may initiate a connection request to the server. The connection request initiated by the terminal device may be sent to the server through a socket. The connection request may include the IP address and port number of the server to which the terminal device is to connect.

[0076] Three-way handshake. The server can obtain the connection request sent by the terminal device through the socket. After receiving the connection request, the server can respond to the terminal device with a synchronization message, which is the first handshake. After the terminal device receives the synchronization message from the server, it confirms the message and sends a synchronization confirmation message to the server, which is the second handshake. After receiving the synchronization confirmation message sent by the terminal device, the server confirms again and sends the synchronization message to the terminal device again. After the terminal device receives the synchronization message, the third handshake is completed, indicating that the TCP connection between the terminal device and the server is successfully established.

[0077] The connection is successful and data is transmitted. After the connection between the terminal device and the server is established, data can be transmitted between the terminal device and the server through the TCP connection. Since the TCP protocol can ensure the correct order and integrity of the data, the connection between the terminal device and the server has a high reliability.

[0078] Connecting terminal devices and servers through the TCP protocol can ensure that data will not be lost or damaged during transmission. In the event of data loss or damage, the data packet can be automatically retransmitted, with high data transmission stability. TCP can ensure orderly data transmission and high data reliability. It can ensure the quality of data transmission in complex network conditions and has high reliability.

[0079] In some embodiments, Fig.10 As shown, the connection security between the remote terminal and the terminal device can be ensured by using the key of the debugging tool, including the following steps:

[0080] The remote terminal inserts the debugging tool key. The key can be an entity that communicates through the USB port, such as a USB flash drive. The key can be burned with information about the key validity period and the project to be debugged. This information can be burned into the key in the form of a string. The string can contain numbers, letters and symbols, and is encrypted using a preset method to ensure data security. After the remote terminal inserts the key, the debugging tool is started. The debugging tool can automatically identify and decrypt the information contained in the string in the key and match the information. When the decrypted information matches the project information successfully, the debugging tool function can be enabled for debugging; if the information fails to match, the debugging tool remains locked and the debugging function cannot be enabled.

[0081] The debugging tool function can be fully enabled by entering the first-level account password. The first-level account password can be entered on the remote terminal to enable the first permission. The key can enable the debugging tool function through encrypted project information, but it cannot track individuals. The account includes the information of the specific individual who uses the debugging tool, and different levels of accounts have different permissions. By entering the account password to enable the debugging tool, the individual who enables the debugging function can be tracked, the information of the debugger can be collected, and debugging across account levels can be avoided, which can ensure the traceability of information. By entering the first-level account, the first permission can be enabled. The first permission can include all permissions of the debugging tool, such as the permission to remotely control other debugging tools, and the permission to the relevant debugging functions of the ISP, etc., so as to facilitate the debugging of terminal devices on the remote terminal.

[0082] The debugging tool automatically switches to a random port for connection. After the debugging tool function is enabled, the debugging tool can automatically switch ports randomly, so that each time the remote terminal and terminal device are connected, a random unfamiliar port is used to avoid using a single port, which can effectively avoid hacker attacks and protect the security of information related to the debugging project.

[0083] The terminal device inserts the key to start the debugging tool. Insert the key into the terminal device to be debugged. The key can be the same as the key used by the remote terminal, and is burned with the encrypted key validity period and information related to the project to be debugged. After the terminal device inserts the key, start the debugging tool. The debugging tool can automatically identify and decrypt the information contained in the string in the key and match the information. When the decrypted information matches the project information successfully, the debugging tool function of the terminal device can be enabled for debugging; if the information fails to match, the debugging tool of the terminal device remains locked and the debugging function cannot be enabled.

[0084] Log in to the debugging tool with the secondary account password. You can enter the secondary account password on the terminal device to enable the second permission. By entering the secondary account, you can enable the second permission of the debugging tool on the terminal device. The second permission includes some permissions of the debugging tool, but does not include the permission to remotely control other debugging tools and the permission for related debugging functions of the ISP. Logging in the secondary account password on the terminal device to enable the second permission of the debugging tool can avoid abuse of permissions, thereby preventing the terminal device from reversely controlling the debugging tool of the remote terminal, and has higher security.

[0085] Connect by entering the random port number sent by the remote terminal. After logging in to the secondary account and password of the terminal device and enabling the debugging tool of the terminal device, the remote terminal can send the random port number determined by the debugging tool of the remote terminal to the terminal device, enter the received random port number in the debugging tool of the terminal device, and connect the terminal device to the port connected to the remote terminal, thereby completing the connection between the terminal device and the remote terminal.

[0086] Through the method provided in this embodiment, the remote terminal and the terminal device use keys to start their corresponding debugging tools respectively, which can keep data confidential and ensure that the debugging tool starts the debugging function only under safe circumstances. By starting different permissions through accounts of different levels, it is possible to avoid cross-level permission calls, and the debugging information can be traced back to the individual who performs the debugging, which has higher security. By connecting the remote terminal and the terminal device through random ports, hacker attacks can be avoided to ensure the security of the information in the terminal device and the remote terminal. Through the method of this embodiment, the data security of the remote terminal and the terminal device can be effectively improved, data outflow and hacker attacks can be avoided, thereby protecting the information security of the remote terminal and the terminal device.

[0087] In some embodiments, Fig.11 As shown, the connection status between the remote terminal and the terminal device can be determined by the following steps:

[0088] The debugging tool of the remote terminal sends string information to the terminal device through the debugging effect parameter file at a fixed time. The debugging tool of the remote terminal can periodically send the debugging effect parameter file to the terminal device to ensure that the terminal device always runs in the best state during the debugging process, thereby ensuring the real-time performance of the terminal device. Different fixed times can be set to send the debugging effect parameter file to the terminal device according to different projects, such as sending it once per second. A string can be added to the debugging effect parameter file, and the string can be recognized by the remote terminal and the terminal device. The string information can be used to determine the connection status between the remote terminal and the terminal device.

[0089] The debugging tool of the terminal device receives the string information. If the string information is received, it is determined that the connection between the remote terminal and the terminal device is normal; if the string information is not received, it is determined that the connection between the remote terminal and the terminal device is abnormal. Refresh the control network settings and re-trigger the connection. When the remote terminal and the terminal device are normally connected, the strings recognized by the remote terminal and the terminal device are consistent or meet the preset values. If the strings recognized by the remote terminal and the terminal device are inconsistent or do not meet the preset values, it can be determined that the connection between the remote terminal and the terminal device is abnormal. When it is determined that the connection between the remote terminal and the terminal device is abnormal, the control network settings can be refreshed to re-pair and connect the remote terminal and the terminal device.

[0090] Sending string information for determining the connection status through the debugging effect parameter file can save interfaces, so that the debugging effect parameter file and the string information are transmitted through the same interface, which can effectively reduce the delay of sending the string information. According to experiments, the method of sending string information for determining the connection status through the debugging effect parameter file in this embodiment can reduce the delay of 5ms compared with directly sending string information through other interfaces to determine the connection status, and effectively enhance the real-time performance of data transmission. In addition, in this embodiment, the method of sending string information in combination with the debugging effect parameter file can determine whether the program is blocked or deadlocked according to the sending and receiving of the debugging effect parameter file, thereby eliminating the misjudgment of the connection status between the remote terminal and the terminal device due to program deadlock or blocking, improving the accuracy of the connection status judgment, and ensuring the security of the debugging process.

[0091] Based on the same inventive concept, Fig.12 As shown, the present disclosure also provides an electronic device, wherein the electronic device includes: a memory, a processor, and a data processing program stored in the memory and executable on the processor, and when the data processing program is executed by the processor, a debugging method for remote debugging a terminal device as in any of the above embodiments is implemented. Fig.12As shown, an embodiment of the present disclosure provides an electronic device 400. The electronic device 400 includes a memory 410, a processor 420, and an input / output (I / O) interface 430. The memory 410 is used to store instructions. The processor 420 is used to call the instructions stored in the memory 410 to execute the debugging method for remote debugging of the terminal device in the embodiment of the present disclosure. The processor 420 is connected to the memory 410 and the I / O interface 430, respectively, for example, through a bus system and / or other forms of connection mechanisms (not shown). The memory 410 can be used to store programs and data, including the program of the debugging method for remote debugging of the terminal device involved in the embodiment of the present disclosure, and the processor 420 executes various functional applications and data processing of the electronic device 400 by running the program stored in the memory 410.

[0092] In the embodiment of the present disclosure, the processor 420 can be implemented in at least one hardware form of a digital signal processor (DSP), a field programmable gate array (FPGA), and a programmable logic array (PLA). The processor 420 can be a central processing unit (CPU) or one or a combination of other forms of processing units with data processing capabilities and / or instruction execution capabilities.

[0093] Based on the same inventive concept, the present disclosure also provides a computer-readable storage medium, which stores the following program, and the program is used to execute the debugging method for remote debugging terminal equipment of any of the aforementioned embodiments. The memory 410 in the embodiment of the present disclosure may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (Random Access Memory, RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (Read-Only Memory, ROM), flash memory (Flash Memory), hard disk (Hard Disk Drive, HDD) or solid-state drive (Solid-State Drive, SSD), etc.

[0094] In the embodiment of the present disclosure, the I / O interface 430 may be used to receive input instructions (such as digital or character information, and key signal input related to user settings and function control of the electronic device 400), and may also output various information (such as images or sounds) to the outside. In the embodiment of the present disclosure, the I / O interface 430 may include one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a mouse, a joystick, a trackball, a microphone, a speaker, and a touch panel.

[0095] The present application uses specific words to describe the embodiments of the present application. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of the present application. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or multiple times in different positions in this specification does not necessarily refer to the same embodiment. In addition, some features, structures or characteristics in one or more embodiments of the present application can be appropriately combined.

[0096] In the context of this application, unless the context clearly indicates an exception, the words "a", "an", "a kind" and / or "the" do not refer to the singular, but may also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list, and the method or device may also include other steps or elements.

[0097] Similarly, it should be noted that in order to simplify the description of the disclosure of this application and thus help understand one or more application embodiments, in the above description of the embodiments of this application, multiple features are sometimes merged into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the object of this application are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0098] The basic concepts have been described above. Obviously, for those skilled in the art, the above disclosure is only for example and does not constitute a limitation of the present application. Although not explicitly stated herein, those skilled in the art may make various modifications, improvements and amendments to the present application. Such modifications, improvements and amendments are suggested in the present application, so such modifications, improvements and amendments still belong to the spirit and scope of the embodiments of the present application.

Claims

1. A debugging method for remote debugging terminal equipment, applied to a remote terminal, the method include: Establishing a connection with the terminal device; Retrieving parameter information of the terminal device and a real-time terminal status corresponding to the parameter information; Determine a parameter file, wherein the parameter file includes updated parameter information and character string information; The parameter file is sent to the terminal device, so that the terminal device can adjust the terminal state accordingly based on the updated parameter information and determine the current connection state based on the character string information.

2. The debugging method for remote debugging terminal equipment according to claim 1, in, The sending the parameter file to the terminal device includes: periodically sending the parameter file to the terminal device; and / or, In response to the sending instruction, the parameter file is sent to the terminal device.

3. The debugging method for remote debugging terminal equipment according to claim 1, in, The terminal device includes a camera device, and the terminal state includes a picture acquired by the camera device based on current parameter information; The method further comprises: Based on the real-time terminal status, the screen is displayed.

4. The debugging method for remote debugging terminal equipment according to claim 1, in, The establishing a connection with the terminal device includes: Connect to the server; Based on the identification code of the terminal device, a connection is completed with the terminal device, wherein the terminal device is connected to the server and no connection is established with other remote terminals.

5. The debugging method for remote debugging terminal equipment according to claim 4, in, The establishing a connection with the terminal device further includes: A random port is generated, and is used to establish a connection with the terminal device through the random port.

6. The debugging method for remote debugging terminal equipment according to claim 5, in, The establishing a connection with the terminal device further includes: In response to obtaining the key, matching with the key information; In response to successful information matching, account permissions are determined, wherein the account permissions include at least a first permission for controlling the terminal device.

7. A debugging method for remote debugging of a terminal device, applied to a terminal device, the method include: Determine the terminal status in real time based on the current parameter information; Establish a connection with a remote terminal; Receiving a parameter file sent by the remote terminal, wherein the parameter file includes updated parameter information and character string information; updating parameters based on the updated parameter information and adjusting the terminal state accordingly; The current connection status is determined based on the character string information.

8. The debugging method for remote debugging terminal equipment according to claim 7, in, The determining the current connection state based on the character string information includes: If the character string information is correct, the connection status is determined to be normal; If the character string information is wrong or the character string information is not received, it is determined that the connection state is abnormal.

9. The debugging method for remote debugging terminal equipment according to claim 7, in, The terminal device includes a camera device; The real-time determination of the terminal status based on the current parameter information includes: Based on the current parameter information, the image is acquired in real time by the camera device.

10. The debugging method for remote debugging terminal equipment according to claim 7, in, The establishing of connection with the remote terminal comprises: Connect to the server; In response to a connection request sent by the remote terminal through the corresponding identification code, a connection is completed with the remote terminal.

11. The debugging method for remote debugging terminal equipment according to claim 10, in, The establishing of connection with the remote terminal also includes: Obtaining a random port generated by the remote terminal; A connection is established with the remote terminal through the random port.

12. The debugging method for remote debugging terminal equipment according to claim 10, in, The establishing of connection with the remote terminal also includes: In response to obtaining the key, matching with the key information; In response to successful information matching, account permissions are determined, wherein the account permissions include at least a second permission for updating the terminal device parameter information.

13. A remote terminal, include: A first network connection module, used to establish a connection with the terminal device; A calling module, used to call the parameter information of the terminal device and the real-time terminal status corresponding to the parameter information; A parameter determination module, used to determine a parameter file, wherein the parameter file includes updated parameter information and character string information; The first network connection module is further used to send the parameter file to the terminal device, so that the terminal device can adjust the terminal state accordingly based on the updated parameter information and determine the current connection state based on the character string information.

14. A terminal device, include: A state determination module, used to determine the terminal state in real time based on current parameter information; A second network connection module, used for establishing a connection with a remote terminal and receiving a parameter file sent by the remote terminal, wherein the parameter file includes updated parameter information and character string information; An adjustment module, configured to adjust the terminal state accordingly based on the updated parameter information; The detection module is used to determine the current connection state based on the character string information.

15. A computer-readable storage medium storing the following program, wherein the program is used to execute the debugging method for remote debugging a terminal device according to any one of claims 1 to 12.

Images