Visual program construction method, device, readable medium and electronic device

Abstract

This application belongs to the technical field of software development, and specifically relates to a method, device, readable medium and electronic device for visual program construction. This application obtains a program construction instruction, and parses the basic information of the device to be constructed in the program construction instruction; then, based on the basic information of the device to be constructed, retrieves the parameter information of the device to be constructed from a database; based on the basic information and the parameter information, retrieves a visual model from a visual template library, and then constructs a visual program of the device to be constructed based on the visual model. Through the visual program construction method of this application, a visual program can be automatically constructed based on the user's program construction instruction, without manual code writing and component dragging, improving the construction efficiency of the visual program and facilitating the realization of the Internet of Everything scenario.

Description

Technical Field

[0001] This application belongs to the technical field of software development, and particularly relates to a method for constructing a visual program, an apparatus for constructing a visual program, a computer-readable medium, and an electronic device. Background Art

[0002] In the context of the Internet of Everything, a wide range of device physical models need to construct visual programs for control and operation. The existing conventional method is to use low-code or no-code technology, enabling developers with different experience levels to create web and mobile applications through a graphical user interface, using drag-and-drop components and model-driven logic.

[0003] However, the existing construction of visual programs mainly adopts two forms. The first is in the form of code writing, which involves a huge workload for developers in constructing a vast number of device physical models and application programs across various industries. The second is the development using a drag-and-drop component-based low-code platform: developers need to manually select the physical model type for each device, configure components, and various parameters one by one. The construction steps are cumbersome, and it is impossible to intelligently and automatically construct visual applications for devices.

[0004] It should be noted that the information disclosed in the above background art section is only used to enhance the understanding of the background of this application, and thus may include information that does not constitute the prior art known to those of ordinary skill in the art. Summary of the Invention

[0005] The purpose of this application is to provide a method for constructing a visual program, an apparatus for constructing a visual program, a computer-readable medium, and an electronic device, which at least to a certain extent overcomes the technical problems in the related art that constructing a visual program requires manual drag-and-drop configuration or code writing configuration, resulting in a large workload and low construction efficiency.

[0006] Other features and advantages of this application will become apparent through the following detailed description, or will be partially learned through the practice of this application.

[0007] According to one aspect of the embodiments of this application, a method for constructing a visual program is provided, including:

[0008] Obtain a program construction instruction, where the program construction instruction includes the basic information of the device to be constructed;

[0009] Analyze the basic information of the device to be constructed in the program construction instruction;

[0010] Retrieve the parameter information of the device to be constructed from the database through the basic information of the device to be constructed;

[0011] Retrieve a visualization model from the visualization template library based on the basic information and the parameter information, and construct a visualization program for the device to be constructed based on the visualization model.

[0012] In some embodiments of the present application, based on the above technical solution, the program construction instruction includes a voice construction instruction. Obtaining the program construction instruction includes:

[0013] Obtain the voice construction information sent by the user.

[0014] In some embodiments of the present application, based on the above technical solution, parsing the basic information of the device to be constructed in the program construction instruction includes:

[0015] Perform voice recognition on the voice construction information to obtain text construction information;

[0016] Parse the basic information of the device to be constructed in the program construction instruction based on the text construction information.

[0017] In some embodiments of the present application, based on the above technical solution, the visualization template library includes a device template library and a component template library, and the visualization model includes a device model and a component model. Retrieving a visualization model from the visualization template library based on the basic information and the parameter information, and constructing a visualization program for the device to be constructed based on the visualization model includes:

[0018] Retrieve a device model from the device template library based on the basic information;

[0019] Retrieve a component model from the component template library based on the parameter information;

[0020] Configure the component model in the device model to form a visualization program for the device to be constructed.

[0021] In some embodiments of the present application, based on the above technical solution, the basic information of the device to be constructed includes the device type and device model of the device to be constructed. The visualization program construction method further includes:

[0022] Establish a mapping relationship between the device type and device model of the device to be constructed and the parameter information of the device to be constructed to form a device parameter table;

[0023] Store the device parameter table in the database.

[0024] In some embodiments of the present application, based on the above technical solution, the method further includes:

[0025] Establish a mapping relationship between the device model and the device type and device model of the device to be constructed to form a device template library;

[0026] Establish a mapping relationship between the parameter information of the device to be constructed and the component model to form a component template library;

[0027] Combine the device template library and the component template library to form a visualization template library;

[0028] Store the visualization template library into the database.

[0029] In some embodiments of the present application, based on the above technical solutions, retrieve the parameter information of the device to be constructed from the database through the basic information of the device to be constructed, including:

[0030] If the device type and device model exist in the device parameter table, retrieve the parameter information of the device to be constructed from the device parameter table;

[0031] If the device type and device model do not exist in the device parameter table, send a voice message of no parameter match to the user.

[0032] According to another aspect of the embodiments of the present application, there is provided a device for constructing a visualization program, including:

[0033] An acquisition module, configured to acquire a program construction instruction, where the program construction instruction includes the basic information of the device to be constructed;

[0034] An analysis module, configured to analyze the basic information of the device to be constructed in the program construction instruction;

[0035] A parameter matching module, configured to retrieve the parameter information of the device to be constructed from the database through the basic information of the device to be constructed;

[0036] A program construction module, configured to retrieve a visualization model in the visualization template library based on the basic information and the parameter information, and construct a visualization program of the device to be constructed based on the visualization model.

[0037] In some embodiments of the present application, based on the above technical solutions, the program construction instruction includes a voice construction instruction, and the acquisition module includes:

[0038] A voice acquisition unit, configured to acquire the voice construction information sent by the user.

[0039] In some embodiments of the present application, based on the above technical solutions, the analysis module includes:

[0040] A voice recognition unit, configured to perform voice recognition on the voice construction information to obtain text construction information;

[0041] A parsing unit for parsing the basic information of the device to be constructed in the program construction instruction based on the text to construct information.

[0042] In some embodiments of the present application, based on the above technical solutions, the visualization template library includes a device template library and a component template library, the visualization model includes a device model and a component model, and the program construction module includes:

[0043] A device retrieval unit for retrieving a device model from the device template library based on the basic information.

[0044] A component retrieval unit for retrieving a component model from the component template library based on the parameter information.

[0045] A construction unit for configuring the component model in the device model to form a visualization program of the device to be constructed.

[0046] In some embodiments of the present application, based on the above technical solutions, the basic information of the device to be constructed includes the device type and device model of the device to be constructed, and the construction device of the visualization program further includes a parameter mapping module, and the parameter mapping module includes:

[0047] A parameter mapping unit for establishing a mapping relationship between the device type and device model of the device to be constructed and the parameter information of the device to be constructed to form a device parameter table.

[0048] A parameter storage unit for storing the device parameter table in the database.

[0049] In some embodiments of the present application, based on the above technical solutions, the construction device of the visualization program further includes a template library creation module, and the template library creation module includes:

[0050] A device mapping unit for establishing a mapping relationship between the device model and the device type and device model of the device to be constructed to form a device template library.

[0051] A component mapping unit for establishing a mapping relationship between the parameter information of the device to be constructed and the component model to form a component template library.

[0052] A combination unit for combining the device template library and the component template library to form a visualization template library.

[0053] A template library storage unit for storing the visualization template library in the database.

[0054] According to one aspect of the embodiments of the present application, there is provided a computer-readable medium having a computer program stored thereon, and when the computer program is executed by a processor, it implements the visualization program construction method in the above technical solutions.

[0055] According to one aspect of the embodiments of the present application, an electronic device is provided. The electronic device includes: a processor; and a memory for storing executable instructions of the processor. Wherein, the processor is configured to execute the visualization program construction method in the above technical solution by executing the executable instructions.

[0056] According to one aspect of the embodiments of the present application, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the visualization program construction method in the above technical solution.

[0057] In the technical solution provided by the embodiments of the present application, the present application obtains a program construction instruction, and parses the basic information of the device to be constructed in the program construction instruction; then, based on the basic information of the device to be constructed, retrieves the parameter information of the device to be constructed from a database; based on the basic information and the parameter information, retrieves a visualization model from a visualization template library, and then constructs a visualization program of the device to be constructed based on the visualization model. Through the visualization program construction method of the present application, a visualization program can be automatically constructed based on a user's program construction instruction, without manual code writing and component dragging, improving the construction efficiency of the visualization program and facilitating the realization of the Internet of Everything scenario.

[0058] Furthermore, the present application can complete the automatic construction of a visualization program based on voice, reducing the development time of developers and improving the construction efficiency.

[0059] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. Obviously, the accompanying drawings in the following description are only some embodiments of the present application, and those of ordinary skill in the art can obtain other drawings based on these drawings without creative efforts.

[0061] Figure 1 Schematically shows an exemplary system architecture block diagram applying the technical solution of the present application.

[0062] Figure 2 Schematically shows a flowchart of the visualization program construction method of the present application.

[0063] Figure 3 Schematically shows a flowchart of the device parameter mapping method of the present application.

[0064] Figure 4 Schematically shows a schematic diagram of the device parameter table of the present application.

[0065] Figure 5 Schematically shows a schematic diagram of a visualization model of the present application.

[0066] Figure 6 Schematically shows a flowchart of the construction method of the visualization template library of the present application.

[0067] Figure 7 Schematically shows a flowchart of the method for constructing a visualization program of a device to be constructed based on basic information and parameter information of the present application.

[0068] Figure 8 Schematically shows a schematic diagram of the visualization program of a TV remote control.

[0069] Figure 9 Schematically shows a structural block diagram of the construction device of the visualization program of the present application.

[0070] Figure 10 Schematically shows a flowchart of the use of each module of the construction device of the visualization program of the present application.

[0071] Figure 11 Schematically shows a structural block diagram of a computer system of an electronic device suitable for implementing the embodiments of the present application. Detailed implementation manners

[0072] Now, example embodiments will be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more complete and comprehensive, and will fully convey the concept of the example embodiments to those skilled in the art.

[0073] In addition, the described features, structures or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present application. However, those skilled in the art will realize that the technical solutions of the present application can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, well-known methods, devices, implementations or operations are not shown or described in detail to avoid obscuring various aspects of the present application.

[0074] The block diagrams shown in the drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0075] The flowcharts shown in the drawings are only exemplary illustrations and do not necessarily include all contents and operations / steps, nor are they necessarily executed in the described order. For example, some operations / steps can be decomposed, while some operations / steps can be combined or partially combined. Therefore, the actual execution order may change according to the actual situation.

[0076] In the scenario of the Internet of Everything, a wide range of device object models need to build visualization programs for control and operation. For example, for a remote control, there is no need for a physical remote control, but a visualization remote control can be built to control various electrical appliances in the home. Another example is electronic devices such as thermometers and sphygmomanometers. In the scenario of the Internet of Everything, visualization programs can be built to control them.

[0077] The visualization program is based on the programming concept of "what you see is what you get" and tries to achieve the visualization of programming work, that is, the result can be seen at any time, and the adjustment of the program is synchronized with the result. Visual programming is compared with the traditional programming method. Here, "visual" means that the interface design work can be completed only through intuitive operation methods without programming.

[0078] For the visualization program in the scenario of the Internet of Everything in this application, visualization programs for various device object models can be built. For example, for a remote control, its visualization program is a virtual electronic remote control, and there are buttons similar to those on the physical remote control on this electronic remote control. Users can click these buttons to achieve corresponding control and achieve what you see is what you get. For example, if a user wants to use the remote control to turn on the air conditioner, they can directly click the power-on button of the visualization program. Therefore, the construction of the visualization program brings a lot of convenience to people's production and life.

[0079] Currently, there are mainly two ways to build a visualization program. The first is code writing, that is, developers build a visualization program by manually writing code. However, for the construction of a large number of and extensive device models and application programs in various industries, the workload of developers is huge. For example, if developers need to add devices 1 to N to an application program, they need to design the Software Development Kit (SDK) for each of the N devices and write a large amount of code. The second is to use low-code technology. Low-code technology provides a development environment for developers to create application software by using a low-code development platform (LCDP). Different from traditional code IDEs, the low-code development platform provides a higher-dimensional and easier-to-use visualization IDE. In most cases, developers do not need to program in the traditional way of writing code by hand, but can complete the development work through more efficient ways such as graphical dragging and parameter configuration. However, when using the second method for construction, developers need to manually select the physical model type, configure components and various parameters for each device one by one. They cannot intelligently construct the visualization application program of the device, and the construction efficiency is low.

[0080] To solve the above technical problems, the present application discloses a method for building a visualization program, a device for building a visualization program, a computer-readable medium, and an electronic device. The content of the present application will be further described in the following aspects.

[0081] Figure 1 Schematically shown is an exemplary system architecture block diagram applying the technical solution of the present application.

[0082] As Figure 1 shown, the system architecture 100 may include a terminal device 110, a network 120, and a server 130. The terminal device 110 may include various electronic devices such as smartphones, tablets, laptops, and desktop computers. The server 130 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The network 120 may be a communication medium of various connection types capable of providing a communication link between the terminal device 110 and the server 130. For example, it may be a wired communication link or a wireless communication link.

[0083] According to the implementation requirements, the system architecture in the embodiments of the present application may have any number of terminal devices, networks, and servers. For example, the server 130 may be a server group composed of multiple server devices. In addition, the technical solution provided by the embodiments of the present application may be applied to the terminal device 110, or may be applied to the server 130, or may be jointly implemented by the terminal device 110 and the server 130. The present application makes no special limitation on this.

[0084] The present application can utilize the terminal device 110 or the server 130 to obtain program construction instructions, wherein the program construction instructions can come from the terminal device 110, and the user inputs the program construction instructions through the terminal device 110 by voice or text. Then, the terminal device 110 or the server 130 is used to parse the basic information of the device to be constructed in the program construction instructions; and then, the parameter information of the device to be constructed is retrieved from the database based on the basic information of the device to be constructed. Among them, the database here can be a storage device of the terminal device 110 or the server 130. Finally, the terminal device 110 or the server 130 retrieves the visualization model in the visualization template library based on the basic information and parameter information, and then constructs the visualization program of the device to be constructed based on the visualization model. For example, if the terminal device 110 or the server 130 obtains the user's blood pressure monitor program creation instruction, the terminal device 110 or the server 130 can parse the basic information of the blood pressure monitor in the blood pressure monitor program creation instruction and retrieve relevant parameter information from the database, such as systolic pressure, diastolic pressure, etc. Then, based on the basic information and parameter information, the visualization model in the visualization template library is called, and then the visualization program of the device to be built is constructed based on the visualization model. Finally, a visualization program for the blood pressure monitor can be formed. The user can directly use the visualization program of the blood pressure monitor to operate the blood pressure monitor, which effectively improves the construction efficiency of the visualization program.

[0085] The above section introduces the contents of the exemplary system architecture applying the technical solution of this application. Next, we will continue to introduce the visual program construction method of this application.

[0086] like Figure 2 As shown, Figure 2 The flowchart of the visualization program construction method of the present application is schematically shown. The present application provides a visualization program construction method, comprising steps S210 to S240.

[0087] In step S210: a program building instruction is obtained, where the program building instruction includes basic information of the device to be built.

[0088] Devices to be built are devices for which visualization programs need to be built. In the Internet of Everything (IoE) scenario, any device that participates in network control can also be considered a device to be built. Examples include blood pressure monitors, thermometers, and remote controls.

[0089] The program construction instructions of this application can be obtained by receiving the text input instructions of the user. The user can input the program construction instructions on the terminal device 110. For example, the user inputs: Build a visualization program for the sphygmomanometer with model number A12345. At this time, the terminal device 110 or the server 130 can obtain a program construction instruction for the sphygmomanometer, and the program construction instruction includes the basic information of the sphygmomanometer with model number A12345. Among them, the basic information of the device to be constructed includes the device type and device model of the device to be constructed.

[0090] In an embodiment of this application, the program construction instruction includes a voice construction instruction. Obtaining the program construction instruction includes:

[0091] Obtain the voice construction information sent by the user.

[0092] This application can construct a visualization program based on voice. The user can input voice construction information through the terminal device 110. For example, the user inputs the voice message: "Build a visualization program for the sphygmomanometer with model number A12345". At this time, the corresponding terminal device 110 or the server 130 can obtain the voice construction information.

[0093] Using voice to construct a visualization program reduces the development time of developers, provides a new option for developers, and improves the development efficiency at the same time.

[0094] In step S220: Analyze the basic information of the device to be constructed in the program construction instruction.

[0095] After obtaining the program construction instruction through step S210, the basic information in the program construction instruction can be analyzed. For example, the basic information: "Device: Sphygmomanometer; Model: A12345" is analyzed.

[0096] When the obtained is voice construction information, in an embodiment of this application, analyzing the basic information of the device to be constructed in the program construction instruction includes:

[0097] Perform speech recognition on the voice construction information to obtain text construction information. Among them, for speech recognition, the hidden Markov model or a method based on a neural network can be used. Through speech recognition, the text construction information can be obtained. After obtaining the text construction information, the basic information of the device to be constructed in the program construction instruction can be analyzed based on the text construction information. For example, the basic information: "Device: Sphygmomanometer; Model: A12345" is obtained through analysis.

[0098] Among them, the process of the parsing program constructing instructions can utilize a convolutional neural network, that is, perform recognition on the text construction information and the device information appearing in the visualization template library. If the device information appearing in the visualization template library is present, then output this device information as the basic information of the device to be constructed.

[0099] In an embodiment of the present application, the method for the parsing program of the present application to construct instructions can also utilize a similarity comparison algorithm to compare the similarity between the text construction information in the program construction instructions and the device information appearing in the visualization template library. If the similarity exceeds the set threshold, then the device basic information with a high similarity to this text construction information can be used as the basic information of the device to be constructed. Using this solution can improve the success rate of speech recognition. For example, the user's voice input constructs a visualization program for a sphygmomanometer with model number A12345, but there is no sphygmomanometer with model number A12345 in the visualization template library. At this time, using the similarity comparison algorithm of the present application, "Device: Sphygmomanometer; Model: A12345" can be parsed as the basic information of this voice instruction. Using this method can effectively improve the recognition efficiency and avoid the situation where developers cannot parse due to different meanings or incorrect pronunciations of some words during input.

[0100] In step S230: Retrieve the parameter information of the device to be constructed from the database through the basic information of the device to be constructed.

[0101] In an embodiment of the present application, the basic information of the device to be constructed includes the device type and device model of the device to be constructed. Before step S230, the visualization program construction method further includes a device parameter mapping method.

[0102] As Figure 3 shown, Figure 3 schematically shows a flowchart of the device parameter mapping method of the present application. The device parameter mapping method of the present application includes steps S310 - step S320.

[0103] Step S310: Establish a mapping relationship between the device type, device model of the device to be constructed and the parameter information of the device to be constructed to form a device parameter table.

[0104] The parameter information of the device to be constructed is control information related to the device to be constructed, and different devices correspond to different control information. For example, for a sphygmomanometer, it is necessary to control the systolic blood pressure and diastolic blood pressure. Therefore, both the systolic blood pressure and diastolic blood pressure are the parameter information of the sphygmomanometer. Another example is a household electric fan, and its corresponding remote control parameters include wind speed, head shaking, and timing shutdown time, etc.

[0105] Before performing step S230 of the present application, a mapping relationship between the device type, device model of the device to be constructed, and the parameter information of the device to be constructed is established to form a device parameter table. Among them, the device parameter table includes the devices participating in the interconnection and the corresponding parameters of the devices. Using this device parameter table, parameter information can be obtained based on the device information.

[0106] As Figure 4 shown, Figure 4 Figure 7 schematically shows a schematic diagram of the device parameter table of the present application. Through the device parameter table, a mapping relationship can be established between the device types, device models of multiple devices, and the parameter information of the device to be constructed.

[0107] Step S320: Store the device parameter table in the database.

[0108] After forming the device parameter table, the device parameter table can be stored in the database. The database here can be the storage device of the terminal device 110 or the server 130, or it can be a database independent of the terminal device 110 or the server 130.

[0109] After forming the device parameter table through mapping, the present application can retrieve the parameter information of the device to be constructed from the database based on the basic information of the device to be constructed. For example, the corresponding parameters of systolic blood pressure and diastolic blood pressure can be retrieved through the device: sphygmomanometer; model: A12345.

[0110] The above discloses the situation where the device type and device model exist in the device parameter table. If the device type and device model do not exist in the device parameter table, the present application can send a voice message of no parameter match to the user. Let the user change the program construction instruction to improve the construction efficiency.

[0111] In step S240: Based on the basic information and parameter information, retrieve the visualization model in the visualization template library, and construct the visualization program of the device to be constructed based on the visualization model.

[0112] The visualization template library can be stored in the database. Among them, the visualization template library includes a device template library and a component template library. The device template library contains the device templates of the visualization program. For example, when constructing a sphygmomanometer visualization program, the pattern of the sphygmomanometer can be retrieved from the device template library, such as an oval device visualization pattern as the device template. And in the device template library, there are device templates of multiple devices. For example, for a remote control, its device template can retrieve different types according to different models, which can be rectangular or oval, depending on the remote control model.

[0113] In one embodiment of the present application, the visualization model of the present application includes a device model and a component model. The device model is the outline of the corresponding visualization program for the device to be constructed, and the component model is the control button or other control device of the corresponding visualization program for the device to be constructed.

[0114] As Figure 5 shown, Figure 5 Figure 1 schematically shows a visualization model of the present application. Figure 5 The corresponding visualization model can be used in a remote control. Among them, it includes a device model 510 and a series of component model combinations 520. Among them, the device model 510 is rectangular in shape, similar to the shape of a physical remote control. And the component model combination 520 includes some controls corresponding to parameters, such as power on, pause, etc.

[0115] The above part discloses the visualization template library and the content of the visualization model. The following continues to disclose the specific implementation method of step S240 of the present application.

[0116] In one embodiment of the present application, as Figure 6 shown, Figure 6 Figure 2 schematically shows a flowchart of the construction method of the visualization template library of the present application. Before step S240, the visualization program construction method further includes steps S610 - S640.

[0117] Step S610: Establish a mapping relationship between the device model and the device type and device model of the device to be constructed to form a device template library.

[0118] The device template library stores the device type and device model, that is, the corresponding device model. For example, the device model corresponding to the device "blood pressure monitor; model: A12345" is model A, and the shape is rectangular. Another example is that the device model corresponding to the device type of a TV remote control and the device model of B1234 is the device model 510 as Figure 5 shown.

[0119] Therefore, the present application can first establish a mapping relationship between the device model and the device type and device model of the device to be constructed before construction to form a device template library, so as to obtain the corresponding device model according to the device type and device model during construction.

[0120] Step S620: Establish a mapping relationship between the parameter information of the device to be constructed and the component model to form a component template library.

[0121] There's a one-to-one correspondence between component models and parameter information. For example, for a blood pressure monitor, parameter information includes systolic and diastolic pressure. The corresponding component models could be systolic and diastolic pressure controls. These controls form a visual program that directly controls the blood pressure monitor. The component template library stores parameter information and component models for multiple devices.

[0122] Step S630: combining the device template library and the component template library to form a visualization template library.

[0123] After the device template library and the component template library are formed, they can be combined to form a visualization template library.

[0124] Step S640: storing the visualization template library in the database.

[0125] Finally, the visualization template library is stored in the database so that it can be called when constructing the visualization program.

[0126] After the visualization template library is constructed, the content of step S240 can be directly performed.

[0127] like Figure 7 Show, Figure 7 The flowchart of the method for constructing a visualization program for a device to be constructed based on basic information and parameter information is schematically shown. In one embodiment of the present application, a method for retrieving a visualization model from a visualization template library based on the basic information and parameter information and constructing a visualization program for the device to be constructed based on the visualization model includes steps S710 to S730.

[0128] Step S710: Based on the basic information, retrieve the device model from the device template library.

[0129] After obtaining the basic information, you can retrieve the device model based on the device type and device model of the device to be built in the basic information. For example, when the device to be built is a TV remote control and the device model is B1234, the corresponding model is as follows Figure 5 The device model 510 in FIG.

[0130] Step S720: Based on the parameter information, retrieve the component model from the component template library.

[0131] After obtaining the parameter information, the component model can be retrieved from the component template library based on the parameter information. For example, the parameter information includes power on / off, pause, next, previous, volume up, volume down, and the corresponding component models can be retrieved from the component template library. For example, Figure 5 Component model combination 520 in.

[0132] Step S730: Configuring the component model in the device model to form a visualization program of the device to be constructed.

[0133] Once the component model and device model are obtained, the component model can be configured on the device model. The configuration scheme can be based on a user configuration template. For example, the power on / off component model can be placed in the upper left corner of the device model, while the pause, next, previous, volume up, and volume down component models can be placed together. Alternatively, the configuration scheme can be based on historical configuration records. If historical configuration records and user schemes are not available, random configuration can be performed, where the component models are sequentially configured on the device model.

[0134] like Figure 8 As shown, Figure 8 The schematic diagram of the visualization program of the TV remote control is shown schematically. Figure 5 After the corresponding component model and device model are created, the component model can be configured in the device model to form a visualization program for the device to be built. The user can then directly execute the visualization program on the server 130 or terminal device 110. For example, by clicking the power button, the corresponding TV will turn on and off.

[0135] In the technical solution provided in the embodiment of the present application, the present application obtains the program construction instruction and parses the basic information of the device to be constructed in the program construction instruction; then the parameter information of the device to be constructed is retrieved from the database through the basic information of the device to be constructed; based on the basic information and parameter information, the visualization model in the visualization template library is retrieved, and then the visualization program of the device to be constructed is constructed based on the visualization model. Through the visualization program construction method of the present application, the visualization program can be automatically constructed based on the user's program construction instruction, and code writing is no longer required, nor is there any need to manually drag components to construct the object model application for each device one by one. Through voice recognition, the present application automatically matches the device object model, related components and parameter configurations in the voice instruction, and automatically generates a visualization application. It helps developers to carry out intelligent and efficient low-code development, further reduces the development workload, improves the construction efficiency of the visualization program, and is conducive to the realization of the Internet of Things scenario.

[0136] It should be noted that although the steps of the method of the present application are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all steps must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0137] The above part introduced the content of the method for constructing the data visualization program of this application. Next, the content of the device for constructing the visualization program of this application will be continued to be introduced.

[0138] According to another aspect of the embodiments of this application, as Figure 9 shown, Figure 9 a schematic block diagram of the device for constructing the visualization program of this application is shown.

[0139] This application provides a device 900 for constructing a visualization program, including:

[0140] An acquisition module 910, configured to acquire a program construction instruction, where the program construction instruction includes the basic information of the device to be constructed;

[0141] An analysis module 920, configured to analyze the basic information of the device to be constructed in the program construction instruction;

[0142] A parameter matching module 930, configured to retrieve the parameter information of the device to be constructed from the database through the basic information of the device to be constructed;

[0143] A program construction module 940, configured to retrieve a visualization model from the visualization template library based on the basic information and the parameter information, and construct a visualization program of the device to be constructed based on the visualization model.

[0144] In an embodiment of this application, the program construction instruction includes a voice construction instruction, and the acquisition module 910 includes:

[0145] A voice acquisition unit, configured to acquire the voice construction information sent by the user.

[0146] In an embodiment of this application, the analysis module 920 includes:

[0147] A voice recognition unit, configured to perform voice recognition on the voice construction information to obtain text construction information;

[0148] An analysis unit, configured to analyze the basic information of the device to be constructed in the program construction instruction based on the text construction information.

[0149] In an embodiment of this application, the visualization template library includes a device template library and a component template library, the visualization model includes a device model and a component model, and the program construction module 940 includes:

[0150] A device retrieval unit, configured to retrieve a device model from the device template library based on the basic information;

[0151] A component retrieval unit, configured to retrieve a component model from the component template library based on the parameter information;

[0152] A building unit for configuring a component model in a device model to form a visualization program of a device to be built.

[0153] In an embodiment of the present application, the basic information of the device to be built includes the device type and device model of the device to be built. The building device of the visualization program further includes a parameter mapping module, and the parameter mapping module includes:

[0154] A parameter mapping unit for establishing a mapping relationship between the device type and device model of the device to be built and the parameter information of the device to be built, and forming a device parameter table;

[0155] A parameter storage unit for storing the device parameter table into a database.

[0156] In an embodiment of the present application, the building device of the visualization program further includes a template library creation module, and the template library creation module includes:

[0157] A device mapping unit for establishing a mapping relationship between the device model and the device type and device model of the device to be built, and forming a device template library;

[0158] A component mapping unit for establishing a mapping relationship between the parameter information of the device to be built and the component model, and forming a component template library;

[0159] A combination unit for combining the device template library and the component template library to form a visualization template library;

[0160] A template library storage unit for storing the visualization template library into a database.

[0161] The content of the building device of the visualization program of the present application is disclosed above. Next, the specific usage process of the building device 900 of the visualization program of the present application is disclosed.

[0162] As Figure 10 shown, Figure 10 Schematically shows the usage flow chart of each module of the building device of the visualization program of the present application. The usage process of each module in the building device of the visualization program of the present application retains steps S1010 - step S1050.

[0163] Step S1010: The acquisition module 910 acquires a program building instruction input in a voice form from the user.

[0164] Step S1020: The acquisition module 910 sends the program building instruction to the parsing module 920, and the parsing module 920 parses the program building instruction to parse out the basic information of the device to be built.

[0165] Step S1030: The parsing module 920 sends the basic information of the device to be constructed to the parameter matching module 930, and the parameter matching module 930 retrieves the parameter information of the device to be constructed from the database through the basic information of the device to be constructed.

[0166] Step S1040: The parameter matching module 930 transmits the parameter information and basic information of the device to be constructed to the program construction module 940. The program construction module 940 retrieves the visualization model from the visualization template library based on the basic information and the parameter information, and constructs the visualization program of the device to be constructed based on the visualization model.

[0167] Step S1050: The program construction module 940 outputs the visualization program of the device to be constructed, and the user can operate and control through the visualization program of the device to be constructed.

[0168] Through the visualization program construction device of the present application, through voice recognition, the devices in the voice commands can be automatically matched with device physical models, related components and parameter configurations, and a visualization application program can be automatically generated. It helps developers to perform intelligent and high-efficiency low-code development, further reduces the development workload, improves the construction efficiency of the visualization program, and is beneficial to the realization of the Internet of Everything scenario.

[0169] The specific details of the visualization program construction device provided in each embodiment of the present application have been described in detail in the corresponding method embodiments, and will not be repeated here.

[0170] The above part introduces the content of the data similarity calculation device of the present application. Next, the content of other aspects of the present application will be continued to be introduced.

[0171] According to one aspect of the embodiments of the present application, a computer-readable medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, it implements the visualization program construction method in the above technical solution.

[0172] According to one aspect of the embodiments of the present application, an electronic device is provided, which includes: a processor; and a memory for storing executable instructions of the processor; wherein, the processor is configured to execute the visualization program construction method in the above technical solution by executing the executable instructions.

[0173] According to one aspect of the embodiments of the present application, a computer program product or a computer program is provided, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the visualization program construction method in the above technical solution.

[0174] Figure 11 A block diagram of a computer system for implementing the electronic device according to an embodiment of the present application is schematically shown.

[0175] It should be noted that Figure 11 the computer system 1100 of the shown electronic device is only an example, and should not impose any limitations on the functions and usage scope of the embodiments of the present application.

[0176] As Figure 11 shown, the computer system 1100 includes a central processing unit 1101 (Central Processing Unit, CPU), which can execute various appropriate actions and processes according to a program stored in a read-only memory 1102 (Read-Only Memory, ROM) or a program loaded from a storage section 1108 into a random access memory 1103 (Random Access Memory, RAM). In the random access memory 1103, various programs and data required for system operations are also stored. The central processing unit 1101, the read-only memory 1102, and the random access memory 1103 are connected to each other via a bus 1104. An input / output interface 1105 (Input / Output interface, i.e., I / O interface) is also connected to the bus 1104.

[0177] The following components are connected to the input / output interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including, for example, a cathode ray tube (Cathode Ray Tube, CRT), a liquid crystal display (Liquid Crystal Display, LCD), etc., and a speaker, etc.; a storage section 1108 including a hard disk, etc.; and a communication section 1109 including a network interface card such as a local area network card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the input / output interface 1105 as required. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as required, so that a computer program read from it can be installed into the storage section 1108 as required.

[0178] In particular, according to the embodiments of the present application, the processes described in each method flowchart can be implemented as computer software programs. For example, embodiments of the present application include a computer program product that includes a computer program carried on a computer-readable medium, and the computer program includes program code for performing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from the network through the communication section 1109, and / or installed from the removable medium 1111. When the computer program is executed by the central processing unit 1101, various functions defined in the system of the present application are performed.

[0179] It should be noted that the computer-readable medium shown in the embodiments of the present application can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, the computer-readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, apparatus, or device. In the present application, the computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium other than the computer-readable storage medium, and the computer-readable medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0180] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a segment of a program, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that, in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, as well as combinations of blocks in the block diagram or flowchart, may be implemented by a dedicated hardware-based system that performs the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0181] It should be noted that although several modules or units of devices for action execution are mentioned in the above detailed description, such a division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of the two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided and embodied by multiple modules or units.

[0182] From the description of the above embodiments, those skilled in the art can easily understand that the example embodiments described herein can be implemented by software, or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0183] After considering the specification and practicing the invention disclosed herein, those skilled in the art will readily conceive of other embodiments of the present application. The present application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include known common general knowledge or conventional technical means in the technical field not disclosed in the present application.

[0184] It should be understood that the present application is not limited to the exact structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the present application is only limited by the appended claims.

Claims

1. A method for visual program construction, characterized in that, Including: Obtain a program construction instruction, where the program construction instruction includes basic information of the device to be constructed; the basic information includes at least one of the device type and device model of the device to be constructed; Parse the basic information of the device to be constructed in the program construction instruction; Retrieve the parameter information of the device to be constructed from the database through the basic information of the device to be constructed; The parameter information is a control parameter type related to the device to be constructed; Retrieve a visualization model from the visualization template library based on the basic information and the parameter information, and construct a visualization program for the device to be constructed based on the visualization model; the visualization program is formed by configuring the component model corresponding to the parameter information in the device model corresponding to the basic information, the visualization program is a virtual object model of the device to be constructed, including the virtual appearance of the device to be constructed, and the virtual appearance includes virtual buttons corresponding to the buttons of the device to be constructed; the component model includes the virtual button pattern of the button belonging to the control parameter type; the device model includes the appearance contour pattern of the device to be constructed; the visualization template library includes a device template library for storing device models and a component template library for storing component models; The program construction instruction includes voice construction information sent by the user, and parsing the basic information of the device to be constructed in the program construction instruction includes: Perform voice recognition on the voice construction information to obtain text construction information; Compare the similarity between the device information included in the text construction information and the device information appearing in the visualization template library, and use the basic information corresponding to the device information in the visualization template library whose similarity with the device information in the text construction information exceeds a set threshold as the basic information of the device to be constructed.

2. The visualization program construction method according to claim 1, wherein The program construction instruction includes a voice construction instruction, and obtaining the program construction instruction includes: Obtain the voice construction information sent by the user.

3. The visualization program construction method according to claim 1, wherein The visualization model includes a device model and a component model, and retrieving the visualization model from the visualization template library based on the basic information and the parameter information, and constructing a visualization program for the device to be constructed based on the visualization model includes: Retrieve the device model from the device template library based on the basic information; Retrieve the component model from the component template library based on the parameter information; Configure the component model in the device model to form a visualization program for the device to be constructed.

4. The visualization program construction method according to claim 1, wherein The basic information of the device to be constructed includes the device type and device model of the device to be constructed, and the method further includes: Establish a mapping relationship between the device type and device model of the device to be constructed and the parameter information of the device to be constructed to form a device parameter table; Store the device parameter table in the database.

5. The visualization program construction method according to claim 1, characterized in that The method further includes: Establish a mapping relationship between the device model and the device type and device model of the device to be constructed to form a device template library; Establish a mapping relationship between the parameter information of the device to be constructed and the component model to form a component template library; Combine the device template library and the component template library to form a visualization template library; Store the visualization template library in the database.

6. The visualization program construction method according to claim 5, wherein Retrieve the parameter information of the device to be constructed from the database based on the basic information of the device to be constructed, including: If the device type and device model exist in the device parameter table, retrieve the parameter information of the device to be constructed from the device parameter table; If the device type and device model do not exist in the device parameter table, send a voice message of no parameter match to the user.

7. A construction device for a visualization program, characterized in that, Including: An acquisition module for acquiring a program construction instruction, where the program construction instruction includes the basic information of the device to be constructed; the basic information includes at least one of the device type and device model of the device to be constructed; A parsing module for parsing the basic information of the device to be constructed in the program construction instruction; A parameter matching module for retrieving the parameter information of the device to be constructed from the database based on the basic information of the device to be constructed; The parameter information is a control parameter type related to the device to be constructed; A program construction module for retrieving a visualization model from the visualization template library based on the basic information and the parameter information, and constructing a visualization program of the device to be constructed based on the visualization model; The visualization program is formed by configuring the component model corresponding to the parameter information in the device model corresponding to the basic information. The visualization program is a virtual object model of the device to be constructed, including the virtual appearance of the device to be constructed, and the virtual appearance includes virtual buttons corresponding to the buttons of the device to be constructed; the component model includes the virtual button pattern of the button to which the control parameter type belongs; the device model includes the appearance contour pattern of the device to be constructed; the visualization template library includes a device template library for storing device models and a component template library for storing component models; The program construction instruction includes a voice construction message sent by the user. Parsing the basic information of the device to be constructed in the program construction instruction includes: Performing voice recognition on the voice construction message to obtain a text construction message; Comparing the similarity between the device information included in the text construction message and the device information appearing in the visualization template library, and using the basic information corresponding to the device information with a similarity exceeding a set threshold between the text construction message and the device information in the visualization template library as the basic information of the device to be constructed.

8. A computer-readable medium having a computer program stored thereon, where the computer program, when executed by a processor, implements the visualization program construction method according to any one of claims 1 to 6.

9. An electronic device, characterized in that, Including: A processor; And A memory for storing executable instructions of the processor; Wherein, the processor is configured to execute the visualization program construction method according to any one of claims 1 to 6 by executing the executable instructions.

Images