Program, programmable display, setting device, and setting method

Abstract

A setting device (10) comprises: a display control unit (101) that causes a display unit (12) to display a design screen for designing a control screen of a programmable display; an object generating unit (102) that generates an object to be set on the control screen of the programmable display on the basis of input into the design screen by a user; a label assigning unit (103) that automatically generates a control keyword on the basis of the content of the object and assigns a label including the control keyword to the object; and a setting unit (104) that sets the object and the label assigned to the object on the programmable display.

Description

Program, programmable display, setting device and setting method

[0001] The present disclosure relates to a program, a programmable display, a setting device, and a setting method.

[0002] Programmable displays are used in production sites to monitor and control equipment. Programmable displays display objects for displaying information about the equipment and objects for controlling the equipment on a control screen. The control screen of a programmable display can be designed by the user, allowing it to be customized according to the production site.

[0003] On the other hand, when there are a large number of objects, it becomes impossible to display all of the objects on a single control screen. Therefore, when there are a large number of objects, it is conceivable to display only some of the objects on a single control screen. However, in this case, in order for a user to access a hidden object, an operation to transition to a screen on which the object is displayed and an operation to display the hidden object are required. This increases the user's workload.

[0004] As a related technology, Patent Document 1 discloses a programmable display that allows a user to easily specify a control target by speech by setting a search keyword and a calculation formula for converting the search keyword into a numerical value. Therefore, this technology reduces the user's effort in accessing hidden objects.

[0005] Japanese Patent Application Laid-Open No. 2021-081622

[0006] However, with the technology of Patent Document 1, when setting up a programmable display, the user needs to set up a large number of search keywords and calculation formulas in advance, which places a heavy burden on the user when setting up.

[0007] In view of the above circumstances, the object of the present disclosure is to provide a program, a programmable display, a setting device, and a setting method that can reduce the effort required to access objects when using a programmable display without placing a heavy burden on the user when setting up the programmable display.

[0008] In order to achieve the above-mentioned object, the program of the present disclosure causes a computer to function as: a display control means for displaying on a display device a design screen for designing a control screen for a programmable display; an object generation means for generating an object to be set on the control screen of the programmable display based on a user's input to the design screen; a label assignment means for automatically generating a control keyword based on the content of the object and assigning a label including the control keyword to the object; and a setting means for setting the object and the label assigned to the object on the programmable display.

[0009] According to the present disclosure, it is possible to reduce the effort required to access objects when using a programmable display device without placing a significant burden on the user when setting up the programmable display device.

[0010] FIG. 1 is a diagram showing the overall configuration of a control system according to an embodiment of the present disclosure. FIG. 2 is a diagram showing an example of a control screen of a programmable display according to an embodiment of the present disclosure. FIG. 3 is a diagram showing an example of a control screen of a programmable display according to an embodiment of the present disclosure. FIG. 4 is a diagram showing an example of voice recognition by a programmable display according to an embodiment of the present disclosure. FIG. 5 is a diagram showing an example of image recognition by a programmable display according to an embodiment of the present disclosure. FIG. 6 is a diagram showing the functional configuration of a setting device according to an embodiment of the present disclosure. FIG. 7 is a diagram showing an example of control keywords automatically generated by a label assignment unit of a setting device according to an embodiment of the present disclosure. FIG. 8 is a diagram showing an example of control keywords added by a label assignment unit of a setting device according to an embodiment of the present disclosure in response to a user's specification. FIG. 9 is a diagram showing the functional configuration of a programmable display according to an embodiment of the present disclosure. FIG. 10 is a diagram showing an example of the hardware configuration of a setting device and a programmable display according to an embodiment of the present disclosure.

[0011] Hereinafter, an embodiment in which a setting device and a programmable display according to the present disclosure are applied to a control system will be described with reference to the drawings. In each drawing, the same or equivalent parts are denoted by the same reference numerals.

[0012] (Embodiment) A control system 1 according to an embodiment will be described with reference to Fig. 1. The control system 1 includes a setting device 10, a programmable display device 20, a microphone 21, a camera 22, and one or more devices 30. The setting device 10 and the programmable display device 20 are communicatively connected. The programmable display device 20 is communicatively connected to the microphone 21 and the camera 22. The programmable display device 20 and the devices 30 are communicatively connected.

[0013] The programmable display 20, microphone 21, camera 22, and device 30 are provided at the production site. The setting device 10 may be provided at the production site or at a location different from the production site. As will be described later, the setting device 10 is used when setting the programmable display 20, and therefore the setting device 10 may be connected to the programmable display 20 only when setting the programmable display 20.

[0014] The setting device 10 sets the programmable display device 20. The setting device 10 is used particularly for designing a control screen to be displayed on the programmable display device 20. The setting device 10 is, for example, a computer such as a personal computer or a tablet terminal on which an engineering tool program is installed. The setting device 10 is an example of a setting device according to the present disclosure.

[0015] The programmable display device 20 has a touch screen that can be touched and displays a control screen on the touch screen. A user can operate the programmable display device 20 on the control screen by touching the touch screen of the programmable display device 20. Furthermore, as will be described in detail later, a user can also operate the programmable display device 20 by voice recognition based on voice input to the microphone 21 and image recognition based on images captured by the camera 22. The programmable display device 20 is an example of a programmable display according to the present disclosure.

[0016] The control screen displayed on the programmable display device 20 includes objects for displaying information about the device 30, objects for controlling the device 30, etc. The control screen is, for example, as shown in FIGS.

[0017] FIG. 2 shows a control screen including a main screen SC1 that is normally displayed. A tab TB1 for displaying the main screen SC1 is selected. The main screen SC1 includes an object OB1 that displays a list of device values ​​and an object OB2 that indicates the operating status of the device 30. The user can check the device values ​​of each device in the device display field DV included in the object OB1. The user can also change the device values ​​by touching the change button BT included in the object OB1. The user can check the operating status of each device 30 in the device display field AP included in the object OB2. The tab TB1, the main screen SC1, a tab TB2 (described below), a graph screen SC2 (described below), the object OB1, the device display field DV, the change button BT, the object OB2, the device display field AP, and a graph G (described below) are all objects.

[0018] 3 shows a control screen including a graph screen SC2 on which a graph G showing changes in the device value of device 3 is displayed, and a tab TB2 for displaying the graph screen SC2 is selected. On the graph screen SC2, the user cannot change the device value by touch operation. In order to change the device value by touch operation, the user must first touch the tab TB1 to transition to the main screen SC1 shown in FIG. 2, and then touch the change button BT of object OB1.

[0019] On the other hand, the user can change the device value by voice recognition without transitioning to the main screen SC1. For example, as shown in FIG. 4 , when the user US speaks into the microphone 21, "Change the device value of device 1 to 20," the programmable display device 20 recognizes the voice input to the microphone 21 and changes the device value of device 1, which is a different device from device 3 displayed in graph G, to 20. The programmable display device 20 then displays a notification NT on the control screen informing the user US that the device value of device 1 has been changed to 20. In this way, the user can operate the programmable display device 20 by voice recognition, regardless of the content displayed on the control screen, without transitioning to the main screen SC1.

[0020] If the device value of device 3 is highly dependent on the device value of device 1, as shown in FIG. 4 , the device value of device 3 will also change significantly in response to a change in the device value of device 1. Changing the device value using voice recognition does not require screen transitions, so the device value can be changed while graph G is displayed on the control screen. This allows the user US to fully confirm that the device value of device 3 will change significantly in response to a change in the device value of device 1. On the other hand, changing the device value using a touch operation requires transitioning to the main screen SC1, so the user US cannot change the device value while viewing graph G, and therefore cannot fully confirm the change in the device value of device 3.

[0021] The user can also change the device value by image recognition without transitioning to the main screen SC1. For example, as shown in FIG. 5 , when the user uses the camera 22 to capture an image of the page PP on which the character string "Change device value of device 1 to 20" is drawn, the programmable display device 20 recognizes the image captured by the camera 22 and changes the device value of device 1 to 20. The programmable display device 20 then displays a notification NT on the control screen to notify the user that the device value of device 1 has been changed to 20. Note that instead of capturing an image of the page PP, the user may also capture an image of a smartphone, tablet device, or the like on which the character string is drawn.

[0022] In addition to changing the device values ​​described above, the user can also check the device values ​​and operating status using voice or image recognition. For example, when the user is viewing the graph screen SC2 as shown in FIG. 3, if the user utters "operating status of sensor 2," the operating status of sensor 2 will be displayed on the control screen. Voice and image recognition are also possible when the main screen SC1 is displayed. For example, if the user is wearing thick gloves while working at a production site, touch operations are not possible, but the user can change the device value of the device displayed in object OB1 on the main screen SC1 using voice or image recognition.

[0023] Furthermore, the user can issue an instruction to switch between displaying and hiding an object by voice recognition or image recognition. For example, as shown in FIG. 2, when the main screen SC1 is displayed, the user can hide the object OB2 that displays the operating status by uttering "hide operating status." Furthermore, when the object OB2 that displays the operating status is hidden, the user can display the object OB2 that displays the operating status by uttering "display operating status."

[0024] In this way, the user of the programmable display device 20 can control the programmable display device 20 through voice recognition and image recognition.

[0025] In addition to the above, the control screen of the programmable display device 20 may include an object for starting and stopping the device 30, an object for displaying the current time, an object for contacting the manufacturer of the device 30, etc. The control screen may also include tabs other than the tab TB1 for displaying the main screen SC1 and the tab TB2 for displaying the graph screen SC2.

[0026] The functional configuration of the setting device 10 will be described with reference to Fig. 6. The setting device 10 includes a communication unit 11, a display unit 12, an input unit 13, a display control unit 101, an object generation unit 102, a label assignment unit 103, and a setting unit 104.

[0027] The communication unit 11 communicates with the programmable display device 20. In particular, the communication unit 11 transmits information indicating the setting contents to the programmable display device 20 when an object and a label are set by a setting unit 104 (to be described later).

[0028] The display unit 12 displays a design screen that provides a user interface necessary for a user of the setting device 10 to design a control screen for the programmable display device 20, based on the control of the display control unit 101. The display unit 12 is, for example, a liquid crystal display. Note that the display unit 12 may be a touch screen integrated with the input unit 13 described below. The display unit 12 is an example of a display device according to the present disclosure.

[0029] The input unit 13 receives input operations by a user of the setting device 10 and outputs a signal corresponding to the input operation. The input unit 13 is, for example, a keyboard and a mouse. Alternatively, the input unit 13 may be a touch screen integrated with the display unit 12.

[0030] The display control unit 101 causes the display unit 12 to display a design screen for designing a control screen for the programmable display device 20. When an object is generated by the object generation unit 102 (described later) or when a label is assigned to the object by the label assignment unit 103 (described later), the display control unit 101 causes the display unit 12 to display information about the object and the label. The display control unit 101 is an example of a display control means according to the present disclosure.

[0031] The object generation unit 102 generates an object to be set on the control screen of the programmable display device 20 based on an input made by the user via the input unit 13 to the design screen displayed on the display unit 12. Specifically, in response to an operation by the user to create an object and place it on the design screen, the object generation unit 102 generates an object corresponding to the user's operation. The object generation unit 102 is an example of an object generation means according to the present disclosure.

[0032] For example, in the example control screens shown in FIGS. 2 and 3 , as described above, the tab TB1, main screen SC1, tab TB2, graph screen SC2, object OB1, device display field DV, change button BT, object OB2, equipment display field AP, and graph G are all objects. Furthermore, objects do not have to be displayed. For example, a user can create a device on the design screen as a hidden object. When creating the device display field DV, the user can associate a previously created device, which is an object, with the device display field DV, thereby creating a device display field DV that displays the name and device values ​​of the device corresponding to the device display field. In addition to devices, the user can also create, for example, the internal functions of the programmable display device 20 as hidden objects.

[0033] The label assignment unit 103 automatically generates a control keyword based on the content of the object generated by the object generation unit 102, and assigns a label including the generated control keyword to the object. The control keyword is a keyword required when specifying an object by the above-mentioned voice recognition, image recognition, or the like to control the programmable display device 20. By the label assignment unit 103 assigning a label including the control keyword to the object, the user of the programmable display device 20 can control the programmable display device 20 by voice recognition and image recognition. The label assignment unit 103 is an example of a label assignment means according to the present disclosure.

[0034] An example of a control keyword automatically generated by the labeling unit 103 will be described with reference to FIG. 7 . As shown in FIG. 7 , the labeling unit 103 automatically generates a character string as a control keyword, which is a combination of a name corresponding to the type of object and a serial number assigned to each type. For example, if a user sets a character string to be displayed on an object when creating the object, the character string may be used as the control keyword. For example, on the control screen shown in FIG. 2 , if a user sets the character string "Device Value List" as the character string to be displayed when creating object OB1, the labeling unit 103 may generate the character string "Device Value List" as the control keyword for object OB1.

[0035] In this way, the labeling unit 103 automatically generates control keywords based on the content of the object and assigns labels including the control keywords to the object. This eliminates the need for the user to manually assign labels to all objects in order to control the programmable display device 20 using voice recognition and image recognition. In particular, since there are many devices and equipment, automatically generating control keywords and assigning labels to device and equipment objects can significantly reduce the burden on the user.

[0036] On the other hand, automatically generated control keywords alone may not be sufficient for voice recognition and image recognition operations. For example, as shown in Figure 8, it may be preferable to specify some devices by names such as "production quantity." It may also be preferable to specifically identify the type of equipment as "sensor" or "servo." It may also be preferable to specify objects by names such as "main screen" or "graph screen" rather than "user screen 1" or "user screen 2."

[0037] Therefore, the user of the setting device 10 can specify any additional control keyword for the object by operating the design screen. The label assignment unit 103 assigns a new label to the object, including the new control keyword additionally specified by the user of the setting device 10. This allows the user of the programmable display device 20 to control the programmable display device 20 based on the new control keyword added by the user of the setting device 10, using voice recognition, image recognition, or the like.

[0038] The setting unit 104 sets the objects generated by the object generation unit 102 and the labels assigned to the objects by the label assignment unit 103 in the programmable display device 20 via the communication unit 11. Specifically, the setting unit 104 sets the objects and labels in the programmable display device 20 by transmitting information indicating the settings for the objects and labels to the programmable display device 20 via the communication unit 11. With this setting, the control screen designed by the user of the setting device 10 is reflected in the programmable display device 20, and the user of the programmable display device 20 can control the programmable display device 20 based on control keywords through voice recognition and image recognition. The setting unit 104 sets the programmable display device 20 when, for example, the user performs an operation to set the programmable display device 20 on the design screen. The setting unit 104 is an example of a setting means according to the present disclosure.

[0039] The functional configuration of the programmable display device 20 will be described with reference to Fig. 9. The programmable display device 20 includes a communication unit 200, a setting reception unit 201, a storage unit 202, a display unit 203, a recognition unit 204, and an object execution unit 205.

[0040] The communication unit 200 communicates with the setting device 10 and the device 30. In particular, the communication unit 200 receives information indicating the setting contents of objects and labels from the setting device 10, and communicates with the device 30 under the control of an object execution unit 205 described below.

[0041] The setting reception unit 201 receives settings of objects and labels assigned to the objects by the setting unit 104 of the setting device 10. Specifically, when the communication unit 200 receives information indicating the setting contents transmitted by the setting unit 104 of the setting device 10 via the communication unit 11, the setting reception unit 201 stores the received information indicating the setting contents in the storage unit 202. The setting reception unit 201 sets objects and labels based on the information indicating the setting contents, generates a control screen based on the objects, and displays it on the display unit 203 described below. The setting reception unit 201 is an example of a setting reception means according to the present disclosure.

[0042] The storage unit 202 stores information indicating the setting contents received by the setting reception unit 201. Therefore, the storage unit 202 stores information about objects and information about corresponding labels.

[0043] The display unit 203 displays a screen based on the control of the setting reception unit 201 and an object execution unit 205 (described later). The display unit 203 particularly displays a control screen such as that shown in Figures 2 and 3. The display unit 203 is an example of a display means according to the present disclosure.

[0044] The recognition unit 204 recognizes voice input via the microphone 21 and converts it into information indicating a character string. The recognition unit 204 recognizes an image captured by the camera 22 and converts it into information indicating a character string. The recognition unit 204 outputs the obtained information indicating the character string to the object execution unit 205. The recognition unit 204 attempts voice recognition of the input voice under the assumption that it is a human speech, and outputs the recognition result as a character string. The recognition unit 204 attempts image recognition of the captured image under the assumption that it is an image on which a character string is drawn, and outputs the recognition result as a character string. If the character string includes a control keyword, the user has performed an operation based on voice recognition or image recognition targeting the control keyword.

[0045] The object execution unit 205 interprets the information indicating the character string output by the recognition unit 204 based on the object information stored in the storage unit 202 and the control keyword indicated by the label information corresponding to the object, and identifies the control content for the programmable display device 20. The object execution unit 205 executes an operation based on the identified control content. In other words, the object execution unit 205 executes an operation based on the labeled object based on an operation targeting the control keyword included in the label. The object execution unit 205 updates the control screen according to the execution result. For example, the object execution unit 205 displays a notification indicating the execution result on the control screen. The object execution unit 205 is an example of an object execution means according to the present disclosure.

[0046] As explained above using Figure 3, control of the object corresponding to the keyword can be performed even when the target object is not displayed on the control screen, so the object execution unit 205 executes an operation based on the object regardless of whether the object is displayed on the control screen or not.

[0047] An example of the hardware configuration of the setting device 10 and the programmable display device 20 will be described with reference to FIG. 10 . As described above, the setting device 10 is realized by a computer such as a personal computer or tablet terminal on which an engineering tool program is installed. The programmable display device 20 is realized by a computer such as a personal computer or microcontroller. Hereinafter, the setting device 10 and the programmable display device 20 will be collectively referred to as the "setting device 10, etc."

[0048] The setting device 10 etc. includes a processor 1001 , a memory 1002 , an interface 1003 , and a secondary storage device 1004 , which are connected to each other via a bus 1000 .

[0049] The processor 1001 is, for example, a CPU (Central Processing Unit). The processor 1001 loads an operating program stored in the secondary storage device 1004 into the memory 1002 and executes it, thereby realizing various functions of the setting device 10 and the like.

[0050] The memory 1002 is a main storage device configured, for example, by a RAM (Random Access Memory). The memory 1002 stores the operating program that the processor 1001 reads from the secondary storage device 1004. The memory 1002 also functions as a working memory when the processor 1001 executes the operating program.

[0051] The interface 1003 is an I / O (Input / Output) interface such as a serial port, a USB (Universal Serial Bus) port, or a network interface.

[0052] The secondary storage device 1004 is, for example, a flash memory, a hard disk drive (HDD), or a solid state drive (SSD). The secondary storage device 1004 stores the operating programs executed by the processor 1001.

[0053] An example of the operation of setting the programmable display device 20 by the setting device 10 will be described with reference to Fig. 11. The operation shown in Fig. 11 is executed, for example, when a user of the setting device 10 starts a program for setting the programmable display device 20.

[0054] The display control unit 101 of the setting device 10 causes the display unit 12 to display a design screen for designing a control screen for the programmable display device 20 (step S101). Note that, as shown in Figure 11, this step is reached multiple times depending on the user's operations. This design screen appropriately reflects the user's operations.

[0055] The setting device 10 accepts an operation of the input unit 13 by the user (step S102).

[0056] If the user's operation is an operation for setting the programmable display device 20 (step S103: Yes), the setting unit 104 of the setting device 10 sets the object generated in step S106 (described later) and the label assigned to the object in steps S108 and S110 in the programmable display device 20 (step S104). Then, the setting device 10 ends the operation for setting the programmable display device 20.

[0057] If the user's operation is not an operation for setting the programmable display device 20 (step S103: No), the operations from step S105 are executed.

[0058] When the user's operation is an operation to add an object (step S105: Yes), the object generation unit 102 of the setting device 10 generates an object to be set on the control screen of the programmable display device 20 based on the input made by the input unit 13 (step S106).

[0059] The labeling unit 103 of the setting device 10 automatically generates a control keyword based on the content of the generated object (step S107).

[0060] The labeling unit 103 assigns a label including the automatically generated control keyword to the object (step S108), and the setting device 10 then repeats the operations from step S101.

[0061] If the user's operation is not an operation for adding an object (step S105: No), the operations from step S109 are executed.

[0062] If the user operation is an operation to add a control keyword (step S109: Yes), the labeling unit 103 assigns a label including the new control keyword added by the user to the object (step S110).The setting device 10 then repeats the operations from step S101.

[0063] If the user's operation is not an operation for adding a control keyword (step S109: No), the setting device 10 repeats the operations from step S101.

[0064] An example of the operation of a voice recognition operation by the programmable display device 20 will be described with reference to Figure 12. The operation shown in Figure 12 is executed, for example, after the programmable display device 20 is started and the control screen is displayed. It is assumed that the setting device 10 has already configured the programmable display device 20, and that object information and label information are stored in the storage unit 202. It is also assumed that an operation based on a touch operation by the user is also executed as appropriate in parallel with the operation shown in Figure 12. The operation based on image recognition is similar to the case of voice recognition, except that image capture and image recognition are used instead of voice input and voice recognition.

[0065] The recognition unit 204 of the programmable display device 20 waits for a user's voice input via the microphone 21 (step S201).

[0066] When a voice is input, the recognition unit 204 attempts to recognize the input voice (step S202).

[0067] The recognition unit 204 outputs information indicating the character string resulting from the speech recognition to the object execution unit 205 (step S203).

[0068] The object execution unit 205 of the programmable display device 20 refers to the control keyword indicated by the label information stored in the storage unit 203 and interprets the character string output by the recognition unit 204 (step S204).

[0069] The object execution unit 205 identifies the control content for the programmable display device 20 based on the interpretation result of step S204 (step S205).

[0070] The object execution unit 205 executes an operation based on the specified control content (step S206).

[0071] The object execution unit 205 updates the control screen in accordance with the execution result of the control content (step S207), and the programmable display device 20 repeats the operations from step S201.

[0072] The control system 1 according to the embodiment has been described above. According to the control system 1, the label assignment unit 103 of the setting device 10 automatically assigns a label including a control keyword to an object based on the content of the object. The user of the programmable display device 20 can then execute an action based on the object without changing screens by performing an operation based on voice recognition or image recognition targeting the control keyword. Therefore, the setting system 1 can reduce the effort required to access objects when using the programmable display device 20 without placing a significant burden on the user when setting up the programmable display device 20.

[0073] On the other hand, since the label assignment unit 103 can assign labels to objects that include control keywords added by the user, the control system 1 can further reduce the effort required to access objects when using the programmable display device 20.

[0074] (Modification) In the embodiment, the programmable display device 20 performs the voice recognition and image recognition. Alternatively, a device external to the programmable display device 20 may perform the voice recognition and image recognition, and transmit information indicating character strings resulting from the voice recognition and image recognition to the programmable display device 20. For example, a smartphone may perform all of the voice input, voice recognition, image capture, and image recognition. Alternatively, a cloud server may perform the voice recognition and image recognition.

[0075] In the embodiment, operations are performed using voice recognition and image recognition to target control keywords. Alternatively, or in addition to this, operations may be performed using character strings entered via a keyboard to target control keywords.

[0076] In the image recognition in the embodiment, an image of a character string is captured and recognized. Alternatively, or in addition to this, a two-dimensional code representing the character string may be captured and recognized.

[0077] 10 , the setting device 10 or the like includes a secondary storage device 1004. However, this is not limiting, and the secondary storage device 1004 may be provided outside the setting device 10 or the like, and the setting device 10 or the like and the secondary storage device 1004 may be connected via an interface 1003. In this configuration, removable media such as a USB flash drive or memory card can also be used as the secondary storage device 1004.

[0078] 10, the setting device 10 may be configured by a dedicated circuit using an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc. In the hardware configuration shown in FIG. 10, some of the functions of the setting device 10 may be realized by a dedicated circuit connected to the interface 1003, for example.

[0079] The programs used in the setting device 10 and the like can be stored and distributed on computer-readable recording media such as CD-ROMs (Compact Disc Read Only Memory), DVDs (Digital Versatile Discs), USB flash drives, memory cards, HDDs, etc. By installing such programs on a specific or general-purpose computer, the computer can function as the setting device 10 and the like.

[0080] Furthermore, the above-mentioned program may be stored in a storage device owned by another server on the Internet, and the program may be downloaded from that server.

[0081] The present disclosure allows various embodiments and modifications without departing from the broad spirit and scope of the present disclosure. Furthermore, the above-described embodiments are intended to explain the present disclosure and do not limit the scope of the present disclosure. In other words, the scope of the present disclosure is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and the meaning of equivalent disclosures are considered to be within the scope of the present disclosure.

[0082] 1 Control system, 10 Setting device, 11 Communication unit, 12 Display unit, 13 Input unit, 20 Programmable display, 21 Microphone, 22 Camera, 30 Equipment, 101 Display control unit, 102 Object generation unit, 103 Label assignment unit, 104 Setting unit, 200 Communication unit, 201 Setting reception unit, 202 Storage unit, 203 Display unit, 204 Recognition unit, 205 Object execution unit, 1000 Bus, 1001 Processor, 1002 Memory, 1003 Interface, 1004 Secondary storage device, AP Equipment display column, BT Change button, DV Device display column, G Graph, NT Notification, OB1, OB2 Object, PP Paper, SC1 Main screen, SC2 Graph screen, TB1, TB2 Tab, US User.

Claims

1. Computer, a display control means for displaying a design screen for designing a control screen for the programmable display device on a display device; an object generating means for generating an object to be set on the control screen of the programmable display device based on an input by a user on the design screen; a labeling means for automatically generating a control keyword based on the content of the object and assigning a label including the control keyword to the object; a setting means for setting the object and the label assigned to the object on the programmable display; A program that functions as a

2. The label assignment means further assigns a new label including the new control keyword input by the user to the object. The program according to claim 1.

3. a display means for displaying a control screen; a setting receiving unit that receives settings of the object and the label assigned to the object by the setting unit of the program according to claim 1 or 2; an object execution means for executing an operation based on the object to which the label is assigned, based on an operation targeted at the control keyword included in the label; A programmable display comprising:

4. the object execution means executes an action based on the object regardless of whether the object is displayed on the control screen.

4. The programmable display according to claim 3.

5. The operation targeted at the control keyword included in the label includes at least one of an operation by voice recognition based on a voice in which the control keyword is spoken and an operation by image recognition based on an image in which the control keyword is drawn.

4. The programmable display according to claim 3.

6. a display control means for displaying a design screen for designing a control screen for the programmable display device on a display device; an object generating means for generating an object to be set on the control screen of the programmable display device based on an input by a user on the design screen; a labeling means for automatically generating a control keyword based on the content of the object and assigning a label including the control keyword to the object; a setting means for setting the object and the label assigned to the object on the programmable display; A setting device comprising:

7. displaying a design screen for designing a control screen for the programmable display on a display device; generating an object to be set on the control screen of the programmable display device based on an input by a user on the design screen; automatically generating control keywords based on the content of the object; assigning a label including the control keyword to the object; setting the object and the label assigned to the object on the programmable display; How to set it up.