Parameter setting method and device for industrial control terminal, industrial control terminal and storage medium

Abstract

The present application relates to a method, device, industrial control terminal and storage medium for setting parameters of an industrial control terminal. The method comprises: receiving a request voice input by a user through a voice module; when the request voice belongs to a parameter setting request and is recognized by voice, generating and displaying a decryption interface for prompting the user to input decryption information; obtaining the gesture action and gesture trajectory input by the user according to the decryption interface through a gesture recognition module; when it is determined that the user meets the parameter setting conditions according to the gesture action and gesture trajectory, returning to the parameter setting interface, so that the user sets the parameters according to the parameter setting interface. The use of this method can improve the security of parameter setting of the industrial control terminal while improving work efficiency.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a parameter setting method and device for an industrial control terminal, an industrial control terminal and a storage medium. Background Art

[0002] The industrial control terminal for commercial large units is the control core of commercial large units. Therefore, in order to ensure security, the parameter settings on the industrial control terminal for commercial large units, especially the factory-level parameter settings, usually have a high confidentiality level. The existing confidentiality methods are mostly to decrypt and set parameters by inputting static passwords or receiving dynamic passwords in real time.

[0003] However, static passwords are simple to set up and have low security performance. Dynamic passwords usually require certain calculations to be performed in the background before they can be returned to employees, which reduces work efficiency in scenarios where parameters need to be set frequently, such as on-site debugging. Summary of the invention

[0004] The present invention aims to solve the problem that existing static passwords and dynamic passwords lead to low security and reduced work efficiency in industrial control terminal parameter setting, and proposes a parameter setting method, device, industrial control terminal and storage medium for an industrial control terminal. The parameter setting method for the industrial control terminal can achieve the technical effect of ensuring security while improving work efficiency.

[0005] A method for setting parameters of an industrial control terminal, the method comprising:

[0006] Receiving a request voice input by a user through a voice module;

[0007] When the request voice belongs to a parameter setting request and passes voice recognition, generating and displaying a decryption interface for prompting the user to input decryption information;

[0008] Acquiring the gesture action and gesture trajectory input by the user according to the decryption interface through a gesture recognition module;

[0009] When it is determined according to the gesture action and the gesture trajectory that the user meets the parameter setting condition, the parameter setting interface is returned to allow the user to set the parameters according to the parameter setting interface.

[0010] In one embodiment, the step of determining whether the user meets the parameter setting condition according to the gesture action and the gesture trajectory includes:

[0011] The gesture action and the gesture trajectory are compared with the stored gesture action and the stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions.

[0012] In one embodiment, comparing the gesture action and the gesture trajectory with the stored gesture action and the stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions includes:

[0013] Comparing the gesture action with the stored gesture action to determine whether the user meets the first level setting condition;

[0014] When the user does not meet the first level setting condition, determining that the user does not meet the parameter setting condition;

[0015] When the user meets the first-level setting condition, comparing the gesture trajectory with the stored gesture trajectory to determine whether the user meets the second-level setting condition;

[0016] When the user does not meet the second-level setting condition, determining that the user does not meet the parameter setting condition;

[0017] When the user meets the second-level setting condition, it is determined that the user meets the parameter setting condition.

[0018] In one embodiment, the step of acquiring the gesture action and gesture trajectory input by the user according to the decryption interface through the gesture recognition module includes:

[0019] The gesture recognition module collects the user's gesture operation to obtain depth information and video stream;

[0020] generating a corresponding 3D image sequence according to the depth information and the video stream;

[0021] Based on the transformation of the gesture position and angle on each 3D image in the 3D image sequence, the gesture movement trajectory of the user is obtained, and the gesture action of the user is obtained according to the 3D image.

[0022] In one embodiment, the step of determining whether the request voice is a parameter setting request and whether it passes voice recognition includes:

[0023] Performing voice recognition and voice analysis on the request voice to obtain the user's voice and the requested setting content;

[0024] respectively comparing the timbre with the pre-stored timbre, and the request setting content with the pre-stored request setting content;

[0025] When the comparison determines that the timbre is consistent and the request setting content belongs to the parameter setting content, it is determined that the request voice is a super parameter setting request and passes the voice recognition.

[0026] In one embodiment, when it is determined according to the gesture action and the gesture trajectory that the user meets the parameter setting condition, returning to the parameter setting interface so that the user sets the parameters according to the parameter setting interface includes:

[0027] When it is determined that the user meets the parameter setting conditions, determining the setting authority of the user;

[0028] A parameter setting interface corresponding to the setting authority is obtained and returned, so that the user can set parameters according to the parameter setting interface.

[0029] In one embodiment, the obtaining and returning a parameter setting interface corresponding to the setting authority includes:

[0030] Determining, according to the setting authority of the user, parameters that the user can set on the industrial control terminal;

[0031] Generate and return a parameter setting interface, wherein the parameter setting interface includes parameters that can be set by the user on the industrial control terminal.

[0032] A parameter setting device for an industrial control terminal, the device comprising:

[0033] A receiving module, used for receiving a request voice input by a user through a voice module;

[0034] A display module, configured to generate and display a decryption interface for prompting the user to input decryption information when the request voice belongs to a parameter setting request and passes voice recognition;

[0035] A recognition module, used for acquiring the gesture action and gesture trajectory input by the user according to the decryption interface through a gesture recognition module;

[0036] The display module is further configured to return to a parameter setting interface when it is determined according to the gesture action and the gesture trajectory that the user meets a parameter setting condition, so that the user can set parameters according to the parameter setting interface.

[0037] An industrial control terminal comprises a memory, a processor, a voice module connected to the processor, and a gesture recognition module, wherein the memory stores a computer program, and the processor implements the steps of any of the above-mentioned parameter setting methods for the industrial control terminal when executing the computer program.

[0038] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of any of the above-mentioned methods for setting parameters of an industrial control terminal.

[0039] The parameter setting method, device, industrial control terminal and storage medium of the above-mentioned industrial control terminal receive a setting request of the type of voice information input by the user through the voice module. When the setting request passes the voice recognition and belongs to the parameter setting, a decryption interface for prompting the user to input the decryption information is generated and displayed, and then the gesture recognition module obtains the gesture action and gesture trajectory input by the user according to the decryption interface and judges that the user meets the parameter setting conditions, and returns to the parameter setting interface, so that the user sets the parameters according to the parameter setting interface. This method combines voice recognition and gesture recognition to realize the parameter setting of the industrial control terminal. Compared with static passwords, the password is complex and has double protection, and there is no need to wait for the background calculation, thereby improving security while also improving work efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A schematic diagram of a flow chart of a parameter setting method of an industrial control terminal in one embodiment;

[0041] Figure 2 A flowchart of a step of comparing a gesture action and a gesture trajectory with a stored gesture action and a stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting condition in an embodiment;

[0042] Figure 3 is a schematic diagram of a motion trajectory in one embodiment;

[0043] Figure 4 It is a structural block diagram of a parameter setting device of an industrial control terminal in one embodiment;

[0044] Figure 5 FIG. 4 is a diagram showing the internal structure of an industrial control terminal in an embodiment. DETAILED DESCRIPTION

[0045] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0046] In one embodiment, Figure 1 As shown, a parameter setting method for an industrial control terminal is provided, and the method is applied to a processor in the industrial control terminal as an example for explanation, and includes the following steps:

[0047] Step S102: receiving a request voice input by a user through a voice module.

[0048] The voice module is the hardware in the industrial control terminal for receiving voice, and the request voice is the voice command sent by the user through the voice module for requesting relevant setting operations on the industrial control terminal.

[0049] Specifically, when the debugger needs to set relevant operations on the industrial control terminal, the debugger can input voice through the voice module in the industrial control terminal, and the voice input by the debugger is the debugger's request voice. When the voice module in the industrial control terminal receives the request voice input by the debugger, the voice module sends the request voice to the core processor in the industrial control terminal.

[0050] Step S104: when the request voice belongs to a parameter setting request and passes the voice recognition, a decryption interface for prompting the user to input decryption information is generated and displayed.

[0051] Among them, the parameter setting request refers to the instruction of the user requesting to set the parameters in the industrial control terminal, for example, the debugger requests to set the factory-level parameters in the industrial control terminal. The decryption interface is a generated display page used to prompt the user to enter the corresponding decryption information. The decryption information is the verification information used to display the parameter setting interface. The parameter setting interface can only be displayed to the user for parameter setting after the decryption is passed.

[0052] Specifically, when the processor obtains the request voice received through the voice module, the request voice is parsed for voice content, and the processor determines the content requested by the user through the analysis of the voice content. At the same time, the request voice is recognized for voice, and the processor determines whether the user has the corresponding authority to the content requested by the user through voice recognition. When the processor determines through content analysis and voice recognition that the request voice belongs to a parameter setting request and determines that the voice recognition is passed, it means that the user has the authority to set parameters for the industrial control terminal. Therefore, the processor generates a decryption interface and displays the decryption interface on the industrial control screen of the industrial control terminal to prompt the user to enter the decryption information used to verify the entry into the parameter setting interface.

[0053] The information prompted on the decryption interface and the input box for receiving the decryption information can be generated according to the type of decryption information that the user needs to input. For example, this embodiment prefers gestures and gesture trajectories as interface information, and the prompt information on the corresponding decryption interface can be "Please enter gestures", and the input box for receiving decryption information is a gesture collection box. The gesture collection box is used to display the gestures and gesture trajectories collected by the gesture recognition module.

[0054] Step S106, acquiring the gesture action and gesture trajectory input by the user according to the decryption interface through the gesture recognition module.

[0055] The gesture recognition module is the hardware in the industrial control terminal responsible for collecting the user's gestures and gesture trajectories. Since the gesture trajectory needs to be obtained in this embodiment, that is, the user's gesture is a spatial gesture rather than a contact gesture, the gesture recognition module in this embodiment is preferably a 3D (three-dimensional) camera module, including a depth imaging module and a color imaging module, which can simultaneously collect the depth information of the video stream and the image.

[0056] Specifically, after the decryption interface is displayed, the user can clearly know the decryption information that needs to be entered according to the prompt information and input box on the decryption interface, and then enter the decryption information. That is, after the user raises his hand to an angle where he can see the entire hand in the input box, he makes the corresponding gesture operation. At this time, the gesture recognition module in the industrial control terminal collects data while the user makes the corresponding gesture operation, obtains the video stream and depth information, and sends the collected video stream and depth information to the processor of the industrial control terminal. The processor processes the video stream and depth information collected by the gesture recognition module to obtain the gesture action and gesture trajectory.

[0057] Step S108, when it is determined according to the gesture action and the gesture trajectory that the user meets the parameter setting conditions, returning to the parameter setting interface, so that the user can set the parameters according to the parameter setting interface.

[0058] Specifically, after the processor obtains the gesture action and gesture trajectory for decryption, it determines whether the user meets the parameter setting conditions based on the gesture action and gesture trajectory. That is, it determines whether the user's gesture action and gesture trajectory are correct. When both are correct, it is determined that the user meets the parameter setting conditions. After determining that the user meets the parameter setting conditions, the processor returns the parameter setting interface provided to the user for parameter setting to the industrial control screen. The user can change the configuration of the parameters on the parameter setting interface through the input device of the industrial control terminal, such as buttons, touch screens, etc., to achieve parameter setting of the industrial control terminal.

[0059] The parameter setting method of the above industrial control terminal receives a setting request of the type of voice information input by the user through the voice module. When the setting request passes the voice recognition and belongs to the parameter setting, a decryption interface for prompting the user to input the decryption information is generated and displayed, and then the gesture recognition module obtains the gesture action and gesture trajectory input by the user according to the decryption interface and judges that the user meets the parameter setting conditions, and returns to the parameter setting interface, so that the user sets the parameters according to the parameter setting interface. This method combines voice recognition and gesture recognition to realize the parameter setting of the industrial control terminal. Compared with static passwords, the password is complex and has double protection, and there is no need to wait for the background calculation, thereby improving security while improving work efficiency.

[0060] In one embodiment, the step of determining whether the user meets the parameter setting conditions based on the gesture action and the gesture trajectory includes: comparing the gesture action and the gesture trajectory with the stored gesture action and the stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions.

[0061] The stored gestures and stored gesture trajectories are gestures and gesture trajectories that are pre-generated and stored in the storage unit of the industrial control terminal by the processor for the user when the user registers the parameter setting authority in the industrial control terminal. The processor generates different stored gestures and stored gesture trajectories for different users according to their different levels. For example, the gestures and gesture trajectories of an administrator can be fist + drawing a circle, while the gestures of ordinary employees can be fist + drawing a five-pointed star.

[0062] Specifically, when determining whether the user meets the parameter setting conditions based on the gesture action and the gesture trajectory, the stored gesture and the stored gesture trajectory corresponding to the user are determined. To determine the stored gesture and the stored gesture trajectory corresponding to the user, the user who entered the request voice can be determined by first performing timbre recognition on the request voice, that is, determining who the user is through timbre recognition. Then, the stored gestures and stored gesture trajectories generated in advance for the user are obtained. For example, when it is determined through timbre recognition that the user who inputs the request voice is user A, the processor obtains the stored gesture actions and stored gesture trajectories corresponding to user A from the storage unit. Then, the processor compares the gesture actions and gesture trajectories input by user A for decryption this time with the corresponding stored gesture actions and stored gesture trajectories. When the comparison determines that the gesture actions and gesture trajectories input by user A this time are correct, it means that the decryption information of user A is verified, and it is determined that the user meets the parameter setting conditions.

[0063] In this embodiment, by comparing gesture information to determine whether the user meets the parameter setting conditions, the security of parameter setting can be ensured. At the same time, different gesture actions and gesture trajectories are set for different users to ensure the uniqueness of the decrypted information, thereby further improving security.

[0064] In one embodiment, Figure 2 As shown, the step of comparing the gesture action and the gesture trajectory with the stored gesture action and the stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions includes:

[0065] Step S202, compare the gesture action with the stored gesture action to determine whether the user meets the first level setting condition, if the first level setting condition is met, go to step S204. If the first level setting condition is not met, go to step S208.

[0066] Step S204, compare the gesture trajectory with the stored gesture trajectory to determine whether the user meets the second level setting conditions, if the second level setting conditions are met, proceed to step S206. If the second level setting conditions are not met, proceed to step S208.

[0067] Step S206, determining that the user meets the parameter setting conditions, and returning to display the parameter setting interface.

[0068] Step S208, determining that the user does not meet the parameter setting conditions, prompting a password error, and asking the user to re-enter the password.

[0069] Specifically, when performing the decryption information comparison, this embodiment is preferably divided into two steps. First, the gesture action is compared with the stored gesture to determine the first-level setting conditions. If the gesture action is the same as the stored gesture action, it means that the user meets the first-level setting conditions. If the gesture action is different from the stored gesture action, it means that the user does not meet the first-level setting conditions. After determining that the user meets the first-level setting conditions, the user's gesture trajectory is compared with the stored gesture trajectory to determine the second-level setting conditions. Similarly, if the gesture trajectory is the same as the stored gesture trajectory, it means that the user meets the second-level setting conditions. If the gesture trajectory is different from the stored gesture trajectory, it means that the user does not meet the second-level setting conditions. Only when both the first-level setting conditions and the second-level setting conditions are determined to be met, it is determined that the user meets the parameter setting conditions. It should be understood that the comparison of gesture trajectories can also be used as the basis for determining the first-level setting conditions, and the gesture action can be used as the basis for determining the second-level setting conditions.

[0070] In this embodiment, determination is performed in two steps. Once the first level determination fails, there is no need to perform subsequent determinations, which can reduce the number of determination steps, speed up processing, and improve efficiency.

[0071] In one embodiment, step S106 includes: collecting the user's gesture operation through a gesture recognition module to obtain depth information and a video stream; generating a corresponding 3D image sequence according to the depth information and the video stream; obtaining the user's gesture movement trajectory based on the transformation of the gesture position and angle on each 3D image in the 3D image sequence, and obtaining the user's gesture action according to the 3D image.

[0072] Specifically, after the processor obtains the video image and depth information collected by the 3D camera module, a corresponding 3D image sequence is generated through a 3D imaging method. Among them, the 3D imaging method in this embodiment adopts any one of binocular ranging method, TOF (Time offlight, time of flight method) and 3D structured light. Taking 3D structured light as an example, the depth value of each point on the imaging image is obtained by calculating the row-direction translation relationship between the object speckle pattern and the reference speckle pattern. After the processor obtains the 3D image sequence through imaging, image recognition is performed on the 3D images in the 3D image sequence, and the movement of the user's hand in the 3D image is determined to obtain the gesture action. At the same time, the gesture trajectory of the gesture action is determined according to the transformation of the gesture position and angle in each 3D image in the 3D image sequence. As Figure 3 The schematic diagram of the motion trajectory provided is shown in FIG. Figure 3 Take a circle (gesture action is a circle) as an example, with the center point of the circle as the reference point, when the circle is at position 1 in the image corresponding to time T1, and the circle moves to position 2 in the image corresponding to time T2, the angle and position coordinates of the center point of the circle at position 2 relative to position 1 will change, and so on, we can get position 3, position 4, position 5, position 6, position 7 and position 8 respectively. When the position after position 8 overlaps with position 1, a complete gesture trajectory can be obtained.

[0073] In this embodiment, the spatial gestures collected by the 3D camera module are used to obtain gesture actions and gesture trajectories for subsequent decryption. Compared with static passwords, the passwords are complex and have double protection, and there is no need to wait for background calculations, thereby improving security while also improving work efficiency.

[0074] In one embodiment, the step of determining whether the request voice is a parameter setting request and whether it passes voice recognition includes: performing timbre recognition and voice analysis on the request voice to obtain the user's timbre and the request setting content; comparing the timbre with the pre-stored timbre, and the request setting content with the pre-stored request setting content; when the comparison determines that the timbre is consistent and the request setting content belongs to the parameter setting content, determining that the request voice is a parameter setting request and passes voice recognition.

[0075] Specifically, the processor obtains the user's timbre and the request setting content included in the request voice by performing timbre recognition and voice analysis on the request voice. Then, the timbre pre-stored when the user registers and the pre-stored request setting content are compared. The pre-stored request setting content includes parameter setting content. For example, the parameter setting content can be a sentence carrying keywords such as "enter factory-level parameter setting" and "setting". If the processor determines through comparison that the timbre of the user of the current request voice is consistent with the pre-stored timbre, it means that the user is a user with request setting authority. At the same time, after the request setting content is obtained by content analysis, keywords are extracted from the request setting content. Match with the keywords of the pre-stored request setting content respectively to determine the pre-stored request setting content that matches the request setting content. Furthermore, when the matched pre-stored request setting content is the parameter setting content, it is determined that the user's setting request voice belongs to the parameter setting request and the user has passed the voice recognition.

[0076] The timbre recognition can be performed by extracting features from the request voice and then matching the extracted features with a model to determine the timbre of the user. The model matching can adopt any one or more of a template matching method, a nearest neighbor method, a neural network method, a clustering method, and a hidden Markov model.

[0077] In this embodiment, whether the user requests parameters and whether the user has the authority is determined through tone recognition and content analysis, so that the security of parameter setting of the industrial control terminal can be ensured.

[0078] In one embodiment, step S108 includes: when it is determined that the user meets the parameter setting conditions, determining the user's setting authority; obtaining a parameter setting interface corresponding to the setting authority and returning it, so that the user sets the parameters according to the parameter setting interface.

[0079] Specifically, the industrial control terminal has a large number of parameters, but not all users with the authority to set parameters can set parameters on all parameter setting interfaces. Therefore, during registration, the user's level is used to configure the setting authority based on the interface to limit the parameter setting interface that the user can set. That is, the parameter setting interface in which the user can set parameters can be determined by setting the authority. Therefore, when the processor determines that the user can set the parameters, the preset setting authority is further obtained. Then, the parameter setting interface corresponding to the setting authority is obtained and returned to the industrial control screen for the user to set the parameters.

[0080] In one embodiment, obtaining and returning a parameter setting interface corresponding to setting permissions includes: determining the parameters that the user can set on the industrial control terminal according to the user's setting permissions; generating and returning a parameter setting interface, wherein the parameter setting interface includes the parameters that the user can set on the industrial control terminal.

[0081] Specifically, depending on the user's level, there may be parameters in the same parameter setting interface, some of which are parameters that the user cannot set. Therefore, when configuring the setting permissions, the parameters that the user cannot set can be further restricted by using parameters as a dimension. When it is determined that the user can set the parameters, the user's non-settable parameters are removed from the parameters by setting permissions, and the parameters that the user can set on the industrial control terminal are obtained. Based on the parameters that can be set, the corresponding parameter setting interface is rearranged and generated and returned to the industrial control screen for the user to set.

[0082] Alternatively, when a parameter setting interface corresponding to the setting authority is obtained, the user's non-settable parameters in the parameter setting interface are further determined by setting the authority. The non-settable parameters are removed from the parameter setting interface or set as inoperable. The user cannot operate the inoperable parameters, thereby limiting the user's setting actions. Then, the parameter setting interface is returned to the industrial control screen for the user to change the settings.

[0083] In this embodiment, by setting permissions to limit the parameter setting interface that can be returned, users can only set parameters corresponding to their permissions, thereby ensuring the security of parameter settings on the industrial control terminal.

[0084] It should be understood that although Figure 1-2 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1-2 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0085] In one embodiment, Figure 4 As shown, a parameter setting device for an industrial control terminal is provided, including: a receiving module 402, a display module 404 and an identification module 406, wherein:

[0086] The receiving module 402 is used to receive a request voice input by a user through a voice module.

[0087] The display module 404 is used to generate and display a decryption interface for prompting the user to input decryption information when the request voice belongs to a parameter setting request and passes the voice recognition.

[0088] The recognition module 406 is used to obtain the gesture action and gesture trajectory input by the user according to the decryption interface through the gesture recognition module.

[0089] The display module 404 is further configured to return to the parameter setting interface when it is determined based on the gesture action and the gesture trajectory that the user meets the parameter setting conditions, so that the user can set the parameters based on the parameter setting interface.

[0090] In one embodiment, the parameter setting device of the industrial control terminal further includes a determination module for comparing the gesture action and gesture trajectory with the stored gesture action and stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions.

[0091] In one embodiment, the determination module is also used to compare gesture actions with stored gesture actions to determine whether the user meets the first-level setting conditions; when the user does not meet the first-level setting conditions, it is determined that the user does not meet the parameter setting conditions; when the user meets the first-level setting conditions, the gesture trajectory is compared with the stored gesture trajectory to determine whether the user meets the second-level setting conditions; when the user does not meet the second-level setting conditions, it is determined that the user does not meet the parameter setting conditions; when the user meets the second-level setting conditions, it is determined that the user meets the parameter setting conditions.

[0092] In one embodiment, the recognition module 406 is also used to collect the user's gesture operations through the gesture recognition module to obtain depth information and video streams; generate a corresponding 3D image sequence based on the depth information and video streams; obtain the user's gesture movement trajectory based on the transformation of the gesture position and angle on each 3D image in the 3D image sequence, and obtain the user's gesture actions based on the 3D images.

[0093] In one embodiment, the determination module is also used to perform timbre recognition and voice analysis on the request voice to obtain the user's timbre and the requested setting content; respectively compare the timbre with the pre-stored timbre, and the requested setting content with the pre-stored request setting content; when the comparison determines that the timbre is consistent and the requested setting content belongs to the parameter setting content, the request voice is determined to be a parameter setting request and passes the voice recognition.

[0094] In one embodiment, the display module 404 is also used to determine the user's setting authority when it is determined that the user meets the parameter setting conditions; obtain the parameter setting interface corresponding to the setting authority and return it, so that the user can set the parameters according to the parameter setting interface.

[0095] In one embodiment, the display module 404 is further used to determine the parameters that the user can set in the industrial control terminal according to the user's setting authority; generate and return a parameter setting interface, which includes the parameters that the user can set in the industrial control terminal.

[0096] For the specific definition of the parameter setting device of the industrial control terminal, please refer to the definition of the parameter setting method of the industrial control terminal in the above text, which will not be repeated here. Each module in the parameter setting device of the above industrial control terminal can be implemented in whole or in part by software, hardware and a combination thereof. The above modules can be embedded in or independent of the processor in the industrial control terminal in the form of hardware, or can be stored in the memory of the industrial control terminal in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0097] In one embodiment, an industrial control terminal is provided, and its internal structure diagram can be shown as follows: Figure 5 As shown. The industrial control terminal includes a processor, a memory, a communication interface, a gesture recognition module, a voice module, a display screen and an input device connected through a system bus. Among them, the processor of the industrial control terminal is used to provide computing and control capabilities. The memory of the industrial control terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the industrial control terminal is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a parameter setting method for an industrial control terminal is implemented. The display screen of the industrial control terminal can be a liquid crystal display screen or an electronic ink display screen, and the input device of the industrial control terminal can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the shell of the industrial control terminal, or an external keyboard, touchpad or mouse.

[0098] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present application, and does not constitute a limitation on the industrial control terminal to which the scheme of the present application is applied. The specific industrial control terminal may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0099] In one embodiment, an industrial control terminal is provided, including a memory, a processor, a voice module connected to the processor, and a gesture recognition module. The memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0100] Receiving a request voice input by a user through a voice module;

[0101] When the request voice belongs to a parameter setting request and passes the voice recognition, a decryption interface for prompting the user to input decryption information is generated and displayed;

[0102] The gesture recognition module is used to obtain the gesture actions and gesture trajectories input by the user according to the decryption interface;

[0103] When it is determined according to the gesture action and the gesture trajectory that the user meets the parameter setting conditions, the parameter setting interface is returned to allow the user to set the parameters according to the parameter setting interface.

[0104] In one embodiment, when the processor executes the computer program, the following steps are further implemented: comparing the gesture action and gesture trajectory with the stored gesture action and stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions.

[0105] In one embodiment, when the processor executes the computer program, the following steps are also implemented: comparing the gesture action with the stored gesture action to determine whether the user meets the first-level setting conditions; when the user does not meet the first-level setting conditions, determining that the user does not meet the parameter setting conditions; when the user meets the first-level setting conditions, comparing the gesture trajectory with the stored gesture trajectory to determine whether the user meets the second-level setting conditions; when the user does not meet the second-level setting conditions, determining that the user does not meet the parameter setting conditions; when the user meets the second-level setting conditions, determining that the user meets the parameter setting conditions.

[0106] In one embodiment, when the processor executes the computer program, the following steps are also implemented: collecting the user's gesture operation through a gesture recognition module to obtain depth information and a video stream; generating a corresponding 3D image sequence based on the depth information and the video stream; obtaining the user's gesture movement trajectory based on the transformation of the gesture position and angle on each 3D image in the 3D image sequence, and obtaining the user's gesture action based on the 3D image.

[0107] In one embodiment, when the processor executes the computer program, the following steps are also implemented: performing timbre recognition and voice analysis on the request voice to obtain the user's timbre and the requested setting content; comparing the timbre with the pre-stored timbre, and the requested setting content with the pre-stored requested setting content; when the comparison determines that the timbre is consistent and the requested setting content belongs to the parameter setting content, determining that the request voice is a parameter setting request and passing the voice recognition.

[0108] In one embodiment, when the processor executes the computer program, the following steps are also implemented: when it is determined that the user meets the parameter setting conditions, the user's setting authority is determined; the parameter setting interface corresponding to the setting authority is obtained and returned, so that the user sets the parameters according to the parameter setting interface.

[0109] In one embodiment, when the processor executes the computer program, it also implements the following steps: determining the parameters that the user can set on the industrial control terminal according to the user's setting authority; generating and returning a parameter setting interface, which includes the parameters that the user can set on the industrial control terminal.

[0110] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0111] Receiving a request voice input by a user through a voice module;

[0112] When the request voice belongs to a parameter setting request and passes the voice recognition, a decryption interface for prompting the user to input decryption information is generated and displayed;

[0113] The gesture recognition module is used to obtain the gesture actions and gesture trajectories input by the user according to the decryption interface;

[0114] When it is determined according to the gesture action and the gesture trajectory that the user meets the parameter setting conditions, the parameter setting interface is returned to allow the user to set the parameters according to the parameter setting interface.

[0115] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: the gesture action and the gesture trajectory are compared with the stored gesture action and the stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions.

[0116] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: comparing gesture actions with stored gesture actions to determine whether the user meets the first-level setting conditions; when the user does not meet the first-level setting conditions, determining that the user does not meet the parameter setting conditions; when the user meets the first-level setting conditions, comparing the gesture trajectory with the stored gesture trajectory to determine whether the user meets the second-level setting conditions; when the user does not meet the second-level setting conditions, determining that the user does not meet the parameter setting conditions; when the user meets the second-level setting conditions, determining that the user meets the parameter setting conditions.

[0117] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: collecting the user's gesture operation through a gesture recognition module to obtain depth information and a video stream; generating a corresponding 3D image sequence based on the depth information and the video stream; obtaining the user's gesture movement trajectory based on the transformation of the gesture position and angle on each 3D image in the 3D image sequence, and obtaining the user's gesture action based on the 3D image.

[0118] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: performing timbre recognition and voice analysis on the request voice to obtain the user's timbre and the requested setting content; comparing the timbre with the pre-stored timbre, and the requested setting content with the pre-stored requested setting content; when the comparison determines that the timbre is consistent and the requested setting content belongs to the parameter setting content, determining that the request voice is a parameter setting request and passing the voice recognition.

[0119] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when it is determined that the user meets the parameter setting conditions, the user's setting authority is determined; the parameter setting interface corresponding to the setting authority is obtained and returned, so that the user sets the parameters according to the parameter setting interface.

[0120] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining the parameters that the user can set on the industrial control terminal based on the user's setting permissions; generating and returning a parameter setting interface, the parameter setting interface includes the parameters that the user can set on the industrial control terminal, so that the user sets the parameters according to the parameter setting interface.

[0121] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0122] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0123] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A parameter setting method for an industrial control terminal, characterized in that: The method comprises: Receiving a request voice input by a user through a voice module; When the request voice belongs to a parameter setting request and passes voice recognition, a decryption interface for prompting the user to input decryption information is generated and displayed on the industrial control screen of the industrial control terminal; the parameter setting request refers to an instruction by which the user requests to set the factory-level parameters in the industrial control terminal; Based on the prompt information and input box on the decryption interface, when the user raises his hand to an angle where the entire hand can be seen in the input box, the gesture action and gesture trajectory input by the user according to the decryption interface are acquired through a gesture recognition module; the prompt information and input box on the decryption interface are generated according to the type of decryption information that the user needs to input; Comparing the gesture action and the gesture trajectory with the stored gesture action and the stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions; the stored gesture actions and the stored gesture trajectory corresponding to users of different levels are different, and the stored gesture actions and the stored gesture trajectory corresponding to users of the same level are the same; When the user meets the parameter setting conditions, determining the setting authority of the user; According to the setting authority, determining the parameters that the user can set and the parameters that cannot be set on the industrial control terminal; Generate and return a parameter setting interface so that the user can set parameters according to the parameter setting interface; the parameter setting interface includes the parameters that the user can set on the industrial control terminal, or the parameter setting interface includes the parameters that the user can set on the industrial control terminal and the non-settable parameters, and the non-settable parameters are in an inoperable state in the parameter setting interface.

2. The method according to claim 1, characterized in that The step of comparing the gesture action and the gesture trajectory with the stored gesture action and the stored gesture trajectory corresponding to the user to determine whether the user meets the parameter setting conditions includes: Comparing the gesture action with the stored gesture action to determine whether the user meets the first level setting condition; When the user does not meet the first level setting condition, determining that the user does not meet the parameter setting condition; When the user meets the first-level setting condition, comparing the gesture trajectory with the stored gesture trajectory to determine whether the user meets the second-level setting condition; When the user does not meet the second-level setting condition, determining that the user does not meet the parameter setting condition; When the user meets the second-level setting condition, it is determined that the user meets the parameter setting condition.

3. The method according to claim 1, characterized in that: The step of acquiring the gesture action and gesture trajectory input by the user according to the decryption interface through the gesture recognition module includes: The gesture recognition module collects the user's gesture operation to obtain depth information and video stream; generating a corresponding 3D image sequence according to the depth information and the video stream; Based on the transformation of the gesture position and angle on each 3D image in the 3D image sequence, the gesture movement trajectory of the user is obtained, and the gesture action of the user is obtained according to the 3D image.

4. The method according to claim 3, characterized in that The gesture recognition module includes a depth imaging module and a color imaging module; the depth imaging module is used to collect the depth information, and the color imaging module is used to collect the video stream.

5. The method according to claim 1, characterized in that The step of determining whether the request voice is a parameter setting request and whether it passes voice recognition comprises: Performing voice recognition and voice analysis on the request voice to obtain the user's voice and the requested setting content; respectively comparing the timbre with the pre-stored timbre, and the request setting content with the pre-stored request setting content; When the comparison determines that the timbre is consistent and the request setting content belongs to the parameter setting content, it is determined that the request voice is a parameter setting request and passes the voice recognition.

6. The method according to claim 5, characterized in that The method further comprises: After extracting features from the request voice, the extracted features are model matched to determine the user's timbre; wherein the model matching adopts any one or more of a template matching method, a nearest neighbor method, a neural network method, a clustering method, and a hidden Markov model.

7. The method according to claim 1, characterized in that The method further comprises: The request voice is subjected to timbre recognition to obtain the stored gesture action and stored gesture trajectory corresponding to the user.

8. A parameter setting device for an industrial control terminal, characterized in that: The device comprises: A receiving module, used for receiving a request voice input by a user through a voice module; A display module is used to generate and display a decryption interface on the industrial control screen of the industrial control terminal for prompting the user to input decryption information when the request voice belongs to a parameter setting request and passes voice recognition; the parameter setting request refers to an instruction of the user requesting to set the factory-level parameters in the industrial control terminal; A recognition module, configured to obtain, based on the prompt information and input box on the decryption interface, a gesture action and a gesture trajectory input by the user according to the decryption interface through a gesture recognition module when the user raises his hand to an angle where the user can see the entire hand in the input box; the prompt information and input box on the decryption interface are generated according to the type of decryption information that the user needs to input; A determination module, used to compare the gesture action and the gesture trajectory with the stored gesture action and the stored gesture trajectory corresponding to the user, to determine whether the user meets the parameter setting conditions; the stored gesture actions and the stored gesture trajectories corresponding to users of different levels are different, and the stored gesture actions and the stored gesture trajectories corresponding to users of the same level are the same; The display module is also used to determine the setting authority of the user when the user meets the parameter setting conditions; determine the parameters that the user can set and the parameters that cannot be set on the industrial control terminal based on the setting authority; generate and return a parameter setting interface so that the user can set the parameters according to the parameter setting interface; the parameter setting interface includes the parameters that the user can set on the industrial control terminal, or the parameter setting interface includes the parameters that the user can set on the industrial control terminal and the parameters that cannot be set, and the parameters that cannot be set are in an inoperable state in the parameter setting interface.

9. An industrial control terminal, comprising a memory, a processor, a voice module connected to the processor, and a gesture recognition module, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images