Virtual debugging method and device, computer device and storage medium

Abstract

The present application relates to a virtual debugging method and apparatus, a computer device and a storage medium. The method displays a main window when a call action of a visual control window is detected, displays a target user control in the main window and determines user control information in response to a user control selection operation performed in the main window, determines signal connection information in response to a virtual debugging signal association operation for the target user control, embeds the user control information and signal connection information into a project file opened in a virtual simulation platform in response to a storage loading operation, and loads and displays the target user control in the main window based on the index and parsing results of the virtual simulation platform. Due to the establishment of an association relationship and the embedding of a virtual simulation platform, the loaded and displayed target user control represents the form and state of the actual operation object mapped by the virtual debugging signal associated with it during the virtual debugging process of the project file. By providing a visual user control, the efficiency of virtual debugging is improved.

Description

Technical Field

[0001] The present application relates to the field of virtual simulation technology, and in particular to a virtual debugging method and device, a computer device, and a storage medium. Background Art

[0002] With the development of virtual simulation technology, its application in industrial production is becoming more and more extensive. As one of the core tasks of virtual simulation, the virtual debugging process is crucial for virtual simulation design work. Siemens' Tecnomatix provides functions such as digital transformation, simulation, and debugging of industrial manufacturing processes.

[0003] However, the inventor found during the implementation process that as the application system becomes more and more complex, a large number of complex and abstract PLC (Programmable Logic Controller) signals flood the virtual simulation platform. During the debugging process, it becomes increasingly complex to operate on numerous signal points on the Tecnomatix signal panel and monitor the signals of the signal points, resulting in low virtual debugging efficiency. Summary of the Invention

[0004] Based on this, in view of the above technical problems, it is necessary to provide a virtual debugging method and device, a computer device, and a storage medium that can improve virtual debugging efficiency.

[0005] In a first aspect, a virtual debugging method is provided, which includes:

[0006] When a call action of a visualization control window is detected, display a main window;

[0007] In response to a user control selection operation performed on the main window, display a target user control on the main window and determine user control information; the target user control is at least one of the user controls, and the user control information is information characterizing the characteristics of the target user control;

[0008] In response to a virtual debugging signal association operation for the target user control, determine signal connection information; the signal connection information includes the association relationship between the target user control and the virtual debugging signal in the virtual simulation platform;

[0009] In response to a storage / loading operation performed on the main window, embed the user control information and the signal connection information into the project file opened in the virtual simulation platform, so that the user control information and the signal connection information in the project file are indexed and parsed in the virtual simulation platform to obtain a parsing result;

[0010] Based on the parsing result, load and display the target user control on the main window;

[0011] Among them, the target user control for loading and displaying is used to represent the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging process of the project file.

[0012] In one embodiment, the virtual debugging method further includes:

[0013] In response to the debugging operations on the target user controls of the main window, update the user control information and signal connection information embedded in the project file, so as to index and parse the updated user control information and signal connection information in the virtual simulation platform;

[0014] Based on the parsing result, update and load and display the target user control in the main window.

[0015] In one embodiment, a label adding control is displayed on the main window, and the virtual debugging method further includes:

[0016] In response to the operation on the label adding control, create and display a label page in the main window;

[0017] In response to the user control selection operation performed in the main window, display the target user control in the main window and determine the user control information, including:

[0018] In response to the user control selection operation performed in the main window, display the target user control in the activated label page under the main window and determine the label control information and user control information of the activated label page;

[0019] In response to the storage and loading operation performed in the main window, embed the user control information and signal connection information into the project file opened in the virtual simulation platform, so as to index and parse the user control information and signal connection information of the project file in the virtual simulation platform, including:

[0020] In response to the storage and loading operation performed in the main window, embed the label control information, user control information and signal connection information of the activated label page into the project file opened in the virtual simulation platform, so as to index and parse the label control information, user control information and signal connection information of the activated label page of the project file in the virtual simulation platform.

[0021] In one embodiment, an edit mode control control is displayed on the main window, and the virtual debugging method further includes:

[0022] In response to the activation operation on the edit mode control control, activate the operation permissions of all user controls displayed in the main window.

[0023] In one embodiment, the main window displays a function control for adding user controls. In response to a user control selection operation performed on the main window, a target user control is displayed on the main window and user control information is determined, including:

[0024] In response to a trigger operation on the function control for adding user controls, a user control selection interface is displayed; several user controls to be selected are displayed on the user control selection interface;

[0025] In response to a user control selection operation performed on the user control selection interface, a target user control is newly created and displayed on the main window.

[0026] In one embodiment, the main window displays a function control for storage and loading. In response to a storage and loading operation performed on the main window, the user control information and signal connection information are embedded into the project file opened in the virtual simulation platform, including:

[0027] In response to a trigger operation on the function control for storage and loading, a storage control and a loading control are displayed;

[0028] In response to a trigger operation on the storage control, the user control information and signal connection information are embedded into the project file opened in the virtual simulation platform;

[0029] In response to a trigger operation on the loading control, the user control information and signal connection information of the project file are indexed and parsed in the virtual simulation platform, and as a result of the parsing, the target user control is loaded and displayed on the main window.

[0030] In one embodiment, the main window displays a signal connection control control. In response to a virtual debugging signal association operation on the target user control, signal connection information is determined, including:

[0031] In response to a trigger operation on the signal connection control control, a signal connection interface is displayed;

[0032] In response to an association operation on the target user control and the virtual debugging signal in the virtual simulation platform on the signal connection interface, signal connection information is determined.

[0033] In one embodiment, the main window displays a signal storage and control control. The method further includes:

[0034] In response to a trigger operation on the signal storage and control control, the identifier of the target user control is determined, and a correspondence table between the identifier of the target user control and the virtual debugging signal associated with the target user control is displayed.

[0035] In one embodiment, in response to an operation on the label adding control, a label page is newly created and displayed on the main window, including:

[0036] In response to an operation on the label addition control, a label is newly created and displayed in the main window;

[0037] In response to a classification operation on the label, the label pages corresponding to each label are classified and displayed in the main window.

[0038] In a second aspect, a virtual debugging device is provided, including:

[0039] A main window display module, configured to display the main window when a call action of the visualization control window is detected;

[0040] A control selection response module, configured to, in response to a user control selection operation performed in the main window, display a target user control in the main window and determine user control information; the target user control is at least one of the user controls, and the user control information is information characterizing the characteristics of the target user control;

[0041] A connection information determination module, configured to, in response to a virtual debugging signal association operation on the target user control, determine signal connection information; the signal connection information includes the association relationship between the target user control and the virtual debugging signal in the virtual simulation platform;

[0042] A virtual simulation platform link module, configured to, in response to a storage and loading operation performed in the main window, embed the user control information and the signal connection information into the project file opened in the virtual simulation platform, so that the user control information and the signal connection information in the project file are indexed and parsed in the virtual simulation platform;

[0043] An association loading and display module, configured to, based on the parsing result, load and display the target user control in the main window;

[0044] Wherein, the loaded and displayed target user control is used to characterize the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging of the project file.

[0045] In a third aspect, a computer device is provided, including a memory and a processor, where the memory stores a computer program, and when the processor executes the computer program, the steps of the above virtual debugging method are implemented.

[0046] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above virtual debugging method are implemented.

[0047] The above virtual debugging method, device, computer device, and storage medium have at least the following beneficial effects:

[0048] When a call action of the visualization control window is detected, the main window is displayed. By responding to the user control selection operation performed on the main window, the target user control is displayed on the main window and the user control information is determined. The user can further associate the user control with numerous virtual debugging signals on the signal panel in the virtual simulation platform. By responding to the virtual debugging signal association operation for the target user control, the signal connection information is determined. After the association configuration is completed, the storage and loading operation can be further performed to embed the configuration content on the main window into the virtual simulation platform based on the association configuration. By responding to the storage and loading operation performed on the main window, the user control information and the signal connection information can be embedded into the project file opened in the virtual simulation platform. In this way, the virtual simulation platform can index and parse the user control information and the signal connection information of the project file. Based on the parsing result of the virtual simulation platform, the target user control is further loaded and displayed on the main window. Due to the establishment of the association relationship and the embedding into the virtual simulation platform, the loaded and displayed target user control can represent the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging process of the project file. By providing the visual user control in this application, a large number of complex related signals in the virtual simulation platform are associated with the corresponding visual user controls, and the signal operation of the virtual simulation platform is transformed into the operation of the visual user controls, visualizing the signals. There is no need to perform individual selection operations on the signals on the signal panel of the virtual simulation platform, making the operation process simpler and the visualization effect better, thus greatly improving the virtual debugging efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] To more clearly illustrate the technical solutions in the embodiments of the present application or in the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0050] Figure 1 It is a schematic flowchart of the virtual debugging method in an embodiment;

[0051] Figure 2 It is a schematic diagram of the default interface of the main window in an embodiment;

[0052] Figure 3 It is a schematic diagram of the display of multiple tab pages in an embodiment;

[0053] Figure 4 It is a schematic diagram showing that the target user control on the main window in the editing mode in an embodiment can be deleted, moved, etc.;

[0054] Figure 5A schematic diagram of adding a user control in a user control selection interface in one embodiment;

[0055] Figure 6 A schematic diagram showing a storage control and a loading control in response to a trigger operation on a storage loading function control in one embodiment;

[0056] Figure 7 A schematic diagram of a correspondence table between an identifier of a target user control and a virtual debugging signal in one embodiment;

[0057] Figure 8a A schematic diagram of an interface for associating a target user control with a virtual debugging signal through a tag-controlled signal connection interface in one embodiment;

[0058] Figure 8b A schematic diagram of modifying the association relationship between a target user control and a virtual debugging signal by exporting and importing in Excel in one embodiment;

[0059] Figure 9 A schematic diagram of an embodiment in which, when a debugging operation is performed on a target user control, a PLC signal associated with the target user control performs a joint action to implement PLC signal control;

[0060] Figure 10 is a structural block diagram of a virtual debugging device in an embodiment;

[0061] Figure 11 A schematic diagram of a portion of the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0062] In order to facilitate understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the present application are provided in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thorough and comprehensive.

[0063] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0064] It can be understood that the terms "first", "second", etc. used in the present application can be used in this article to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element.

[0065] It should be noted that when an element is considered to be "connected" to another element, it can be directly connected to the other element or connected to the other element through an intermediate element. In addition, in the following embodiments, "connection", if there is transmission of electrical signals or data between the connected objects, should be understood as "electrical connection", "communication connection", etc.

[0066] As used herein, the singular forms "a", "an" and "the" may also include the plural forms unless the context clearly dictates otherwise. It should also be understood that the terms "comprises / include" or "has" etc. specify the presence of the stated features, wholes, steps, operations, components, parts or combinations thereof, but do not preclude the possibility of the presence or addition of one or more other features, wholes, steps, operations, components, parts or combinations thereof.

[0067] The solution provided by the embodiments of the present application can be applied to technical fields such as the industrial robot field, the automotive field, the home appliance field, digital intelligent manufacturing, medical devices, etc., that is, it can be applied to all scenarios that require virtual simulation debugging, and will not be enumerated here.

[0068] Virtual simulation refers to establishing a digital model through software and based on this model to simulate and debug the production process, robot program, PLC program, etc. in the actual workshop. Through the simulation results, it can be debugged until a solution that meets the user's design requirements is produced. For example, it can be virtual simulation and debugging including but not limited to processes such as PLC programs, robot offline programs, and in-plant material turnover.

[0069] Tecnomatix is a comprehensive portfolio of digital manufacturing solutions provided by Siemens, which can digitally transform, simulate, debug, etc. industrial manufacturing and the process of transforming innovative ideas and raw materials into actual products. However, in the virtual commissioning process (which can be achieved based on the Process Simulate function of Tecnomatix), operations such as selection, display, setting, and resetting of numerous signal points on the signal panel in the Tecnomatix software are required. In the signal point configuration mode, each device (such as a grating, emergency stop device, safety door, lamp, button, etc.) is presented in the form of signal points, and the form of the device itself cannot be reflected. Moreover, a device often has a very large number of signal points. If all the signal points are added to the signal panel, it will be very cumbersome and increase the complexity. Due to the development of devices towards increasing complexity, in the virtual commissioning process, due to the complexity and abstraction of the signals, often a single operation will take a lot of time in retrieval, and the monitoring and operation complexity of various signals is high. Due to the above characteristics, it is determined that only engineers who are very familiar with the commissioning and project content can be competent for this signal operation, which has the characteristics of high professionalism, is not conducive to project handover, and is also not conducive to project development.

[0070] Among them, the grating, which can refer to a safety grating, is an optoelectronic device for detecting whether personnel on the production line enter the risk area, and can ensure production safety. The emergency stop device refers to a manual control device used to activate the emergency stop function at the production line site. Its form can be a button, and it has the function of urgently stopping target objects such as the line body, and is used to ensure safety. The safety door is a door lock structure on the production line. Personnel can enter the target area through the door lock, and it belongs to safety equipment.

[0071] For the above reasons, in one embodiment, as Figure 1 shown, a virtual commissioning method is provided. This method includes:

[0072] S102, when a call action of the visualization control window is detected, display the main window. The call action of the visualization control window refers to a trigger action that can characterize the user's need for visual user control configuration operations. For example, call a computer program product storing the virtual commissioning method in Siemens Tecnomatix virtual simulation platform Process Simulate. The main window can provide a container for all contents during the visual commissioning process. When a call action of the visualization control window is detected, the main window can be presented in the default form. For example, in the default form as Figure 2 shown. Display function controls such as the display edit mode, add tab pages, storage and loading, and signal connection.

[0073] The content displayed in the main window should at least include relevant content that can realize user control selection and the establishment of the association relationship between user controls and virtual commissioning signals. For example, the content as shown in Figure 2 -8 can be displayed. For example, it can be used to display a label control interface as shown in Figure 3 shown, an interface about user controls as shown in Figure 4 and Figure 5 shown, and an interface about function control as shown in Figure 6 and as shown in Figure 8. The display of the main window can be implemented based on the TxViewer underlying architecture that realizes the interface in Tecnomatix. Optionally, in the container provided by the main window, it can be divided into a fixed display container part and a dynamic display container part. The content in the fixed display container is fixed. When performing interface jumps or commissioning operations, the content in the fixed display container of the main window still remains in the display state. As Figure 2 shown, function controls such as "edit mode", "add tab page", "add element", "storage and loading", "signal connection", etc. can be fixedly displayed in the fixed display container part to quickly enable functions such as adding labels, edit mode, storage and loading. And the area where the "signal connection window" is located is the dynamic display container part of the main window. Based on the operations of different function controls, this dynamic display container part can dynamically display as Figure 2- The content of Figure 8. For example, when the "Add Element" control (user control function control) is triggered, a user control selection interface as shown in Figure 5 is displayed in the dynamic display container section. The user control selection interface shows several user controls to be selected, such as "Lamp", "Button", "Switch", "Emergency Stop", "Safety Door", and "Raster / Area Scan".

[0074] For another example, when the user activates the "Edit Mode" (edit mode control control), as shown in Figure 4 , the user controls selected by the user can be displayed in the dynamic display container section of the main window, and these user controls can be deleted and moved and are in an editable state.

[0075] For another example, as shown in Figure 3 , when the "Add Tab Page" function control is triggered, the labels "Enviroment", "Robot", and "Safety" added by the user are displayed in the dynamic display container section. It is also possible to respond to the deletion operation of the labels displayed in the dynamic display container section and delete the labels. For example, after the "Enviroment" is deleted, the tab pages displayed in the dynamic display container section change to "Robot" and "Safety".

[0076] When the "Signal Connection" function control is triggered, the "Signal Connection Window" control is displayed in the dynamic display container section. The user can trigger an operation on the "Signal Connection Window" control to trigger the display of a signal connection configuration interface as shown in Figure 7 in the dynamic display container section of the main window, and can configure the correspondence between the identification of the target user control and the virtual debugging signal associated with the target user control and view the configuration result.

[0077] When the "Storage / Loading" control is triggered, the "Save Layout" and "Load Layout" function controls as shown in Figure 6 are displayed in the dynamic display container section of the main window, and in response to the operations on the "Save Layout" and "Load Layout", the user control information and signal connection information are embedded into the project file opened in the virtual simulation platform.

[0078] S104. In response to a user control selection operation performed in the main window, display a target user control in the main window and determine user control information. The target user control is at least one of the user controls (i.e., user controls available for selection), and the user control information is information characterizing the characteristics of the target user control. The user control is a visual element and is the carrier for visualizing virtual debugging signals in the virtual simulation platform, and can activate virtual debugging signals. Displaying the target user control in the main window here can be to display the target user control in the dynamic display container part. At this time, since virtual debugging has not been performed yet, the display of the target user control can be in the default state. For example, if the target user control is a switch and the default state is off, then a target user control in the form of a switch and in the off state can be displayed. The virtual debugging signal refers to a signal available for selection on the signal panel of the virtual simulation platform. For example, in the PLC program debugging scenario, the virtual debugging signal can be a PLC signal. The PLC signal is an analog signal modulated by a PLC device and is the carrier for industrial control information transmission. The PLC device can load control instructions into memory for storage and execution at any time and is often used as the control center of the production line in the industrial field. The selection operation for the user control can be in ways such as clicking, dragging, moving, checking, etc. For example, drag the user control to be selected to the target user control display area in the main window. The user control to be selected can be displayed in a drawer on the side of the main window, and when the mouse moves to this side position, the user control to be selected is expanded and displayed. The user control information can include, but is not limited to, the identifier of the user control, the graphic (the graphic is designed based on the principle of being able to represent the form and state of the actual operation object corresponding to the user control), the graphic-identifier correspondence, the state of the user control (for example, a switch has two states: off and on), etc.

[0079] S106. In response to a virtual debugging signal association operation for the target user control, determine signal connection information. The signal connection information includes the association relationship between the target user control and the virtual debugging signal in the virtual simulation platform. The virtual debugging signal association operation can be implemented through ways such as table import and association operation on the interface. By responding to this operation, the existing user controls (i.e., the target user controls) in the main window of the control panel are associated with multiple virtual debugging signals stored in Process Simulate in the virtual simulation platform.

[0080] S108. In response to a storage loading operation performed in the main window, embed user control information and signal connection information into the project file opened in the virtual simulation platform, so that the user control information and signal connection information of the project file can be indexed and parsed in the virtual simulation platform. For the process of the virtual simulation platform embedding information into the project file and indexing and parsing the information of the project file, refer to the process of embedding project file information and indexing and parsing project file information in Process Simulate in Tecnomatix, which will not be elaborated here. The project file can be created in Process Simulate in Tecnomatix before the main window is displayed, or the main window still displays a "project creation" function control. In one embodiment, the virtual debugging method further includes: in response to a trigger operation on the "project creation" function control, create and open a project file. Optionally, the project file can be opened in the background Process Simulate without affecting the display of the content of the main window.

[0081] S110. Based on the parsing result, load and display the target user control in the main window; wherein, the loaded and displayed target user control is used to represent the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging process of the project file. It is not difficult to understand that the virtual debugging process is a process of simulating the state change process of the actual operation object during the debugging operation of the actual operation object, and the change of the virtual debugging signal has a mapping relationship with the state change of the actual operation object. The user control provided in the embodiment of the present application can correspond to the actual operation object in terms of form. Based on the association relationship between the target user control and the virtual debugging signal, the state change of the target user control can represent the state change of the actual operation object during the debugging process. By utilizing the virtual debugging ability of software such as Tecnomatix, the change of the debugging signal that can reflect the state change of the actual operation object during the virtual debugging process is displayed through the state change of the target user control, greatly improving the visualization degree and effect.

[0082] Specifically, when a call action of the visualization control window is detected, the main window is displayed. By responding to the user control selection operation performed on the main window, the target user control is displayed on the main window and the user control information is determined. The user can further associate the user control with numerous virtual debugging signals on the signal panel in the virtual simulation platform. By responding to the virtual debugging signal association operation for the target user control, the signal connection information is determined. After the association configuration is completed, the storage and loading operation can be further performed to embed the configuration content on the main window in the virtual simulation platform based on the association configuration. By responding to the storage and loading operation performed on the main window, the user control information and the signal connection information can be embedded into the project file opened in the virtual simulation platform. In this way, the virtual simulation platform can index and parse the user control information and the signal connection information of the project file, and based on the parsing result of the virtual simulation platform, the target user control is further loaded and displayed on the main window. Due to the establishment of the association relationship and the embedding of the virtual simulation platform, the loaded and displayed target user control can represent the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging process of the project file. By providing visual user controls, a large number of complex related signals in the virtual simulation platform are associated with the relevant visual user controls, and the signal operations in the virtual simulation platform are transformed into operations of the visual user controls, making the signals concrete. There is no need to operate on the signals on the signal panel of the virtual simulation platform anymore, and the operation becomes simple, reducing the complexity, thereby greatly improving the virtual debugging efficiency.

[0083] Considering that many virtual debuggings need to debug user controls in different states. For example, debugging in two states of switch closing and opening, or debugging with a voltage regulator device and without a voltage regulator device in an electrical system. This leads to the need to change the user control information and signal connection information embedded in the project file to meet different debugging requirements of users.

[0084] Based on this, in one embodiment, the virtual debugging method further includes:

[0085] In response to the debugging operation on each target user control of the main window, the user control information and the signal connection information embedded in the project file are updated, so that the updated user control information and signal connection information are indexed and parsed in the virtual simulation platform. The user control can be associated with virtual debugging signals, and the operation on the user control (for example, operations on operation-type user controls such as switches and safety doors) can replace the operation of the user on the virtual debugging signals, or the viewing of the user control can replace the monitoring of the user on the virtual debugging signals (for example, the viewing operation of a display-type user control such as a "lamp").

[0086] Based on the parsing result, the target user control is updated and loaded for display on the main window.

[0087] By responding to the debugging operation on the target user control, the debugging under different test conditions in the same test scenario can be realized. The debugging process of the virtual debugging signal is converted into the debugging operation on the target user control, which is intuitive, quick and convenient to operate, and is beneficial to improving the overall efficiency of virtual debugging.

[0088] Considering that in the process of virtual debugging, for a certain system, there may be multiple objects to be debugged. For example, in a smart home control system, it involves a controller, a wireless router, and multiple home devices. When the number is too large, the number of user controls to be selected will be too large, affecting the debugging efficiency.

[0089] Therefore, in one embodiment, a label adding control (for example, the "Add Tab Page" as shown in Figure 2 is displayed on the main window. The virtual debugging method further includes:

[0090] Responding to the operation on the label adding control, a tab page is newly created and displayed on the main window. The operation on the label adding control can be an operation such as clicking or checking the control, and specifically depends on the actions configured in the background to trigger the addition and display of the tab page. Creating and displaying a tab page on the main window means adding the tab page content to the container provided on the main window and displaying it. If operations such as modifying or deleting the name, color, etc. of the tab page are performed during this process, the corresponding tab page displayed on the main window is updated and displayed with the name, color, etc. Based on this, the addition of tab pages and the distinction of multiple tab pages can be realized.

[0091] The step S104 of displaying the target user control on the main window and determining the user control information in response to the user control selection operation performed on the main window includes:

[0092] Responding to the user control selection operation performed on the main window, the target user control is displayed on the activated tab page under the main window, and the label control information and user control information of the activated tab page are determined. The user control is added into the main window according to the user's needs and is classified and retrieved under the label control.

[0093] The tab page provides a container for the user control to be presented in the form of a paging label on the main window. When the user adds a user control, the activated tab page at this time becomes the container to which the user control belongs. Therefore, by adding user controls under different activated tab pages, the user controls can be classified and sorted.

[0094] In one embodiment, the method further includes:

[0095] In response to an operation for adjusting the order of tab pages, update the order of the tab pages displayed in the main window. For example, the order of the tabs can be adjusted by dragging, using up and down function buttons, etc., which is also a form of classifying and organizing user controls. For example, as Figure 3 shown, under three different tab pages of Enviroment, Robot, and Safety, operations such as deleting and adjusting the order of each tab page are supported.

[0096] In one embodiment, the virtual debugging method further includes:

[0097] Obtain application scenario information. In different scenarios, different types of user controls are commonly used. For example, in the smart home scenario, household appliances such as lights and refrigerators, as well as communication devices, etc. are often used. While in industrial production and manufacturing, PLCs, controlled operating devices, etc. are often used. Therefore, by obtaining the application scenario information, it can be used for the display of candidate user controls.

[0098] Based on the application scenario information, determine the user controls available for selection in the application scenario corresponding to the project file.

[0099] In response to an operation for adding a control to a tab, display the available tab page types in the main window;

[0100] In response to a selection operation for the tab page type, create and display a tab page of this type in the main window.

[0101] By combining the reduction of the number of candidate user controls in the scenario and the associated classification of tab page types, the classification management of user controls can be quickly carried out, thereby further improving the efficiency of virtual debugging.

[0102] In response to a storage and loading operation performed in the main window, embedding the user control information and signal connection information into the project file opened in the virtual simulation platform, and the step S108 of indexing and parsing the user control information and signal connection information of the project file in the virtual simulation platform includes:

[0103] In response to a storage and loading operation performed in the main window, embedding the label control information, user control information, and signal connection information of the activated tab page into the project file opened in the virtual simulation platform, so as to index and parse the label control information, user control information, and signal connection information of the activated tab page of the project file in the virtual simulation platform. The label control information refers to the relevant information that can characterize the attributes of the tab page, such as the name, sorting, included user controls, and associated virtual debugging signals of the tab page.

[0104] Through the embedding, indexing, and parsing of the label control information, user control information, and signal connection information, the loading and calling based on label classification management are realized.

[0105] In one embodiment, the main window displays an edit mode control control (e.g., "Edit Mode" as in Figure 2 ), and the virtual debugging method further includes:

[0106] In response to an activation operation on the edit mode control control, activate the operation permissions of all user controls displayed in the main window. The ways of the activation operation include but are not limited to checking it, dragging it to a specified position, clicking, and double-clicking. Activating the operation permissions of all user controls displayed in the main window means that the user controls can be operated, for example, deleted, moved, etc. For reference, as in Figure 4 shown, when the edit mode is enabled to unlock the user controls, the illustrated user controls can be moved or deleted.

[0107] In one embodiment, the main window displays an add user control function control (such as "Add Element" as in Figure 2 ), and in response to a user control selection operation performed in the main window, display a target user control in the main window and determine user control information, including:

[0108] In response to a trigger operation on the add user control function control, display a user control selection interface; the user control selection interface displays several user controls to be selected;

[0109] In response to a user control selection operation performed in the user control selection interface, create and display a target user control in the main window.

[0110] By trigger operations such as clicking and dragging on the add user control function control, generate an add element command, and this command is used for the display of the user control selection interface. For example, trigger a pop-up menu for the user to select the required user control. After the user selects the user control to be added (i.e., the user control selection operation), create a selected user control and add it to the activated tab page. The user can move the user control and change the name of the user control at this time to meet the usage requirements of the user control. As in Figure 5 shown, it is an example of the user control selection interface in an example. User controls such as "Light", "Button", "Switch", "Emergency Stop", "Safety Door", "Grating / Area Scan" can be selected in this menu. When as shown, "Emergency Stop", "Safety Door", and "Grating" are selected, display the graphics of the devices corresponding to the user controls.

[0111] In one embodiment, the main window displays a storage and loading function control (e.g., "Storage Loading" as in Figure 2 ), and in response to a storage and loading operation performed in the main window, embed the user control information and signal connection information into the project file opened in the virtual simulation platform, including:

[0112] In response to a trigger operation for a storage and loading function control, as shown Figure 6 below, storage controls (e.g., "Save Layout" as shown in the figure) and loading controls (e.g., "Load Layout" as shown in the figure) can be displayed. There are various ways to trigger the operation, not limited to clicking, checking, etc.

[0113] In response to a trigger operation for a storage control, user control information and signal connection information are embedded into the project file opened in the virtual simulation platform. When the storage control is triggered, it indicates that all the user controls selected in the main window are the controls required for the project file to run. Based on this, the user control information and signal connection information are traversed and stored, and then embedded into the project file opened in the virtual simulation platform. Optionally, under the label classification management, in response to a trigger operation for the storage control, all the label control information, all the user control information, and the signal connection information included in the main window are traversed and stored, and then embedded into the currently opened project file in Process Simulate.

[0114] In response to a trigger operation for a loading control, the user control information and signal connection information of the project file are indexed and parsed in the virtual simulation platform, and the parsed results are used to load and display the target user controls in the main window. After the user controls are configured, by triggering the loading control, the virtual simulation platform will index and parse the stored label control information, user control information, and signal connection information of the currently opened project file in Process Simulate, and perform the loading work in the main window according to the parsed results, so that the main window returns to the state before storage.

[0115] In one embodiment, a signal connection control control (e.g., the "Signal Connection" button as shown Figure 2 below) is displayed in the main window. In response to an operation of associating a virtual debugging signal of a target user control, signal connection information is determined, including:

[0116] In response to a trigger operation for the signal connection control control, a signal connection interface is displayed, e.g., the "Signal Connection Window" as shown Figure 2 below.

[0117] In response to an operation of associating a target user control with a virtual debugging signal in the virtual simulation platform on the signal connection interface, signal connection information is determined.

[0118] In one embodiment, a signal storage and control control is displayed in the main window. The virtual debugging method further includes:

[0119] In response to a trigger operation on the signal storage and control control, determine the identifier of the target user control, and display a correspondence table between the identifier of the target user control and the virtual debugging signal associated with the target user control. For example, as Figure 7 shown in the correspondence table between the identifier (item) of the target user control and the virtual debugging signal (Signal1).

[0120] When the user control needs to bind or modify signals, the signal connection control can be triggered, and the target user control can be associated with the virtual debugging signal through various association operation methods on the signal connection interface. For example, the following two operations can be adopted, as Figure 8a shown, the target user control and the virtual debugging signal can be associated through the signal connection interface controlled by the label. In addition, as Figure 8b shown, the existing target user control in the main window can be exported to Excel. After the user manually enters the specified virtual debugging signal associated with the target user control in Excel, a new Excel can be imported.

[0121] In one embodiment, in response to an operation on the label adding control, a label page is newly created and displayed in the main window, including:

[0122] In response to an operation on the label adding control, a label is newly created and displayed in the main window;

[0123] In response to a classification operation on the label, the label pages corresponding to each label are classified and displayed in the main window. Classification can be carried out by color, label naming, etc. The label pages corresponding to each label are classified and displayed in the main window, and the label pages provide containers for the target user controls. By classifying and displaying the label pages, the classified management of the target user controls in different containers can be realized, which is beneficial to improving the virtual debugging efficiency.

[0124] Taking the virtual debugging signal as a PLC signal as an example, after the association between the target user control and the PLC signal and the embedding of the above user control information are completed, when the Process Simulate environment is in the simulation state, the PLC signal control function will be automatically activated. At this time, when the user performs debugging operations such as clicking on the target user control, the software will respond to the user's operation. At this time, the PLC signal control function will switch the state of the target user control and activate the actions of the relevant PLC signals, so as to control the PLC signals bound to the user control. For example, as Figure 9 shown, click on the "OpenDoor" user control to change the opening and closing state of the door control switch, that is, change the state of the user control. Based on this change, the user control information embedded in the virtual simulation platform is changed, thereby changing the actions of the corresponding PLC signals.

[0125] The virtual debugging method provided by the embodiment of the present application can associate relevant virtual debugging signals with relevant user controls by providing visual user controls (which can be displayed as visual elements), convert signal operations into visual device operations, and visualize the signals. After the relevant device virtual debugging signals are associated with the corresponding user controls, there is no need to operate the virtual debugging signals on the signal panel anymore. The operation becomes simple, the complexity is reduced, and the debugging efficiency is improved.

[0126] In addition, by managing user controls through label classification, the complex virtual debugging signals are replaced by visually arranged visual elements and displayed in categories. The process time for retrieving elements and operating signals during debugging is greatly reduced, further improving the debugging efficiency.

[0127] The way of visualizing signals in the visualization solution reduces the complexity, makes it more concrete and easy to be learned and accepted, thus reducing the professional level. During the process of project handover, new personnel learning debugging or training, etc., the efficiency is improved.

[0128] It should be understood that although the steps in the flowchart are shown sequentially according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the figure may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0129] In one embodiment, as Figure 10 shown, a virtual debugging device is provided, including: a main window display module 1002, a control selection response module 1004, a connection information determination module 1006, a virtual simulation platform link module 1008, and an association loading display module 1010, where:

[0130] When the main window display module 1002 detects a call action of the visualization control window, it displays the main window. The control selection response module 1004 is configured to respond to a user control selection operation performed on the main window, display a target user control on the main window, and determine user control information; the target user control is at least one of the user controls, and the user control information is information characterizing the characteristics of the target user control. The connection information determination module 1006 responds to a virtual debugging signal association operation for the target user control and determines signal connection information; the signal connection information includes the association relationship between the target user control and the virtual debugging signal in the virtual simulation platform. The virtual simulation platform link module 1008 responds to a storage and loading operation performed on the main window, embeds the user control information and the signal connection information into the project file opened in the virtual simulation platform, so that the user control information and the signal connection information in the project file can be indexed and parsed in the virtual simulation platform. The association loading display module 1010 loads and displays the target user control on the main window based on the parsing result. Among them, the loaded and displayed target user control is used to characterize the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging of the project file. By calling the visualization control interface, an association operation between the visualization user control and the virtual regulation signal on the virtual simulation platform is performed, and the signal operation is transformed into an operation of the visualization user control, which is vivid and intuitive. The images of different types of user controls are different. By performing debugging operations on these visually distinct user controls, the virtual debugging of the virtual debugging signal associated with them under the project file can be realized. Based on the establishment of the association relationship, the virtual simulation platform can parse the project file and display the results during the virtual debugging of the project file through the state of the visualization user control.

[0131] For the specific limitations of the virtual debugging control device, reference can be made to the limitations on the virtual debugging method in the above text, which will not be elaborated here. Each module in the above virtual debugging device can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor in the computer device in hardware form or be independent of it, or be stored in the memory in the computer device in software form, so that the processor can call and execute the operations corresponding to the above modules. It should be noted that the division of modules in the embodiments of the present application is illustrative, only a logical function division, and there may be other division methods in actual implementation.

[0132] In one embodiment, a computer device is provided. The computer device can be a terminal, and its internal structure diagram can be as Figure 11As shown. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected via a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner, and the wireless manner can be implemented through WIFI, carrier network, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it realizes a virtual debugging method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a button, trackball, or touchpad set on the computer device housing, or an external keyboard, touchpad, or mouse, etc.

[0133] Those skilled in the art can understand that Figure 11 the structure shown in is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0134] In one embodiment, a computer device is provided, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, it realizes the steps of the above virtual debugging method and achieves the corresponding beneficial effects, which will not be elaborated here.

[0135] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by the processor, it realizes the steps of the above virtual debugging method and achieves the corresponding beneficial effects, which will not be elaborated here.

[0136] In one embodiment, a computer program product is provided, on which a computer program is stored. When the computer program is executed by the processor, it realizes the steps of the above virtual debugging method and achieves the corresponding beneficial effects, which will not be elaborated here.

[0137] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0138] In the description of this specification, the description with reference to terms such as "some embodiments", "other embodiments", "ideal embodiments", etc. means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic description of the above terms does not necessarily refer to the same embodiment or example.

[0139] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0140] The above-described embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A virtual debugging method, characterized in that, the method includes: When a call action of the visualization control window is detected, display the main window; In response to a user control selection operation performed on the main window, display a target user control on the main window and determine user control information; the target user control is at least one of the user controls, and the user control information is information characterizing the characteristics of the target user control; In response to a virtual debugging signal association operation for the target user control, determine signal connection information; the signal connection information includes the association relationship between the target user control and the virtual debugging signal in the virtual simulation platform; In response to a storage / loading operation performed on the main window, embed the user control information and the signal connection information into the project file opened in the virtual simulation platform, so that the user control information and the signal connection information of the project file are indexed and parsed in the virtual simulation platform to obtain a parsing result; Based on the parsing result, load and display the target user control on the main window; Among them, the loaded and displayed target user control is used to characterize the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging process of the project file.

2. The method according to claim 1, characterized in that, the method further includes: In response to a debugging operation on each of the target user controls on the main window, update the user control information and the signal connection information embedded in the project file, so that the updated user control information and signal connection information are indexed and parsed in the virtual simulation platform; Based on the parsing result, update and load and display the target user control on the main window.

3. The method according to claim 1, characterized in that, A label adding control is displayed on the main window, and the method further includes: In response to an operation on the label adding control, create and display a label page on the main window; The step of, in response to a user control selection operation performed on the main window, displaying a target user control on the main window and determining user control information includes: In response to a user control selection operation performed on the main window, display the target user control on the activated label page under the main window and determine the label control information and user control information of the activated label page; The step of, in response to a storage / loading operation performed on the main window, embedding the user control information and the signal connection information into the project file opened in the virtual simulation platform, so that the user control information and the signal connection information of the project file are indexed and parsed in the virtual simulation platform includes: In response to a storage / loading operation performed on the main window, embed the label control information, the user control information, and the signal connection information of the activated label page into the project file opened in the virtual simulation platform, so that the label control information, the user control information, and the signal connection information of the activated label page of the project file are indexed and parsed in the virtual simulation platform.

4. The method according to claim 1, wherein, an editing mode control control is displayed on the main window, and the method further includes: Responding to an activation operation on the editing mode control control, activating the operation permissions of all user controls displayed in the main window.

5. The method according to claim 1, wherein, a user control adding function control is displayed on the main window, and the responding to a user control selection operation performed on the main window and presenting a target user control and determining user control information on the main window includes: Responding to a triggering operation on the user control adding function control, presenting a user control selection interface; a plurality of user controls to be selected are presented on the user control selection interface; Responding to a user control selection operation performed on the user control selection interface, creating and presenting the target user control on the main window.

6. The method according to claim 1, wherein, a storage and loading function control is displayed on the main window, and the responding to a storage and loading operation performed on the main window and embedding the user control information and the signal connection information into a project file opened in the virtual simulation platform includes: Responding to a triggering operation on the storage and loading function control, presenting a storage control and a loading control; Responding to a triggering operation on the storage control, embedding the user control information and the signal connection information into a project file opened in the virtual simulation platform; Responding to a triggering operation on the loading control, indexing and parsing the user control information and the signal connection information of the project file in the virtual simulation platform, and loading and displaying the target user control on the main window according to the parsing result.

7. The method according to claim 1, wherein, a signal connection control control is displayed on the main window, and the responding to a virtual debugging signal association operation on the target user control and determining signal connection information includes: Responding to a triggering operation on the signal connection control control, displaying a signal connection interface; Responding to an association operation on the target user control and the virtual debugging signal in the virtual simulation platform on the signal connection interface, determining the signal connection information.

8. The method according to claim 7, wherein, a signal storage and control control is displayed on the main window, and the method further includes: Responding to a triggering operation on the signal storage and control control, determining the identifier of the target user control, and presenting a correspondence table between the identifier of the target user control and the virtual debugging signal associated with the target user control.

9. The method according to claim 3, wherein, the responding to an operation on the label adding control and creating and presenting a tab page on the main window includes: Responding to an operation on the label adding control, creating and presenting a label on the main window; Responding to a classification operation on the label, classifying and presenting tab pages corresponding to the respective labels on the main window.

10. A virtual debugging device, wherein, comprising: A main window display module, configured to display the main window when a call action of the visualization control window is detected; A control selection response module, configured to, in response to a user control selection operation performed on the main window, display a target user control on the main window and determine user control information; the target user control is at least one of the user controls, and the user control information is information characterizing the characteristics of the target user control; A connection information determination module, configured to, in response to a virtual debugging signal association operation for the target user control, determine signal connection information; the signal connection information includes the association relationship between the target user control and the virtual debugging signal in the virtual simulation platform; A virtual simulation platform link module, configured to, in response to a storage and loading operation performed on the main window, embed the user control information and the signal connection information into a project file opened in the virtual simulation platform, so that the user control information and the signal connection information of the project file are indexed and parsed in the virtual simulation platform to obtain a parsing result; An association loading display module, configured to, based on the parsing result, load and display the target user control on the main window; Wherein, the loaded and displayed target user control is used to characterize the form and state of the actual operation object mapped by the virtual debugging signal associated with the target user control during the virtual debugging process of the project file.

11. A computer device, comprising a memory and a processor, the memory storing a computer program, wherein, when the processor executes the computer program, the steps of the method according to any one of claims 1 to 9 are implemented.

12. A computer-readable storage medium, having a computer program stored thereon, wherein, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images