Screen data creation program, screen data creation device, programmable display system, programmable display device, and screen data creation method

Abstract

The screen data creation device (50) creates screen data (500) which is data for the display screen of the programmable display device. The screen setting unit (511) sets an image display area in which an image captured by a camera is displayed on the display screen. The event setting unit (512) sets an event to be executed when an image is displayed in the image display area. The screen data creation unit (513) creates screen data (500) which indicates that the image display area set by the screen setting unit (511) is displayed on the display screen and that the event set by the event setting unit (512) is associated with a relative position with respect to the image display area.

Description

[Technical field]

[0001] The present disclosure relates to a screen data creating program, a screen data creating device, a programmable display system, a programmable display, and a screen data creating method. [Background technology]

[0002] A programmable display is known as a human machine interface (HMI) for a programmable logic controller (PLC) that controls manufacturing equipment in manufacturing sites such as production lines and manufacturing plants. A user can monitor or operate the equipment through the display screen of the programmable display. Regarding such technology, for example, Patent Document 1 discloses a plant operation monitoring system that can remotely monitor and operate equipment in a plant. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2006-302316 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned programmable display device, it is desired to reduce the time and effort required of the user for setting.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a screen data creation program and the like that can reduce the effort required for setting up a programmable display device. [Means for solving the problem]

[0006] In order to achieve the above object, the screen data creation program according to the present disclosure First aspect of teeth, A screen data creation program for creating screen data, which is data of a display screen to be displayed on a programmable display device, comprising: Computer, a screen setting unit that sets an image display area on the display screen in which an image captured by a camera is to be displayed; When the image is displayed in the image display area The programmable display To be executed It is a process event and its relative position with respect to the video display area; An event setting section for setting On the display screen The image display area set by the screen setting unit When the trigger set by the event setting unit is established while the video is being displayed on the The event setting unit The above contents The above event The programmable display is caused to execute A screen data creating unit that creates the screen data. height, The image display area displays the image of the device captured by the camera, the trigger is established when a user operation is input to the relative position set by the event setting unit, The content includes executing a process related to the device captured in the video. In order to achieve the above object, a second aspect of the screen data creation program according to the present disclosure includes: A screen data creation program for creating screen data, which is data of a display screen to be displayed on a programmable display device, comprising: Computer, a screen setting unit that sets an image display area on the display screen in which an image captured by a camera is to be displayed; an event setting unit that sets a trigger and content of an event, which is a process executed by the programmable display device when the image is displayed in the image display area, and a relative position of the event with respect to the image display area; a screen data creating unit that creates the screen data for causing the programmable display device to execute the event having the content set by the event setting unit when the trigger set by the event setting unit is established while the video is being displayed in the video display area set by the screen setting unit on the display screen, the trigger is established when a user operation is input at the relative position set by the event setting unit, The content includes changing the shooting direction of the camera, or switching the image displayed in the image display area to an image shot by a camera different from the above camera. In order to achieve the above object, a third aspect of the screen data creation program according to the present disclosure includes: A screen data creation program for creating screen data, which is data of a display screen to be displayed on a programmable display device, comprising: Computer, a screen setting unit that sets an image display area on the display screen in which an image captured by a camera is to be displayed; an event setting unit that sets a trigger and content of an event, which is a process executed by the programmable display device when the image is displayed in the image display area, and a relative position of the event with respect to the image display area; a screen data creating unit that creates the screen data for causing the programmable display device to execute the event having the content set by the event setting unit when the trigger set by the event setting unit is established while the video is being displayed in the video display area set by the screen setting unit on the display screen, The content includes displaying an image corresponding to the trigger at the relative position set by the event setting unit. Effect of the Invention

[0007] Books According to the disclosure, it is possible to reduce the effort required for setting up a programmable display device. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a configuration of a programmable display system according to a first embodiment. [Diagram 2] FIG. 1 is a diagram showing an example of a display screen of a programmable display device according to the first embodiment; [Diagram 3] FIG. 1 is a block diagram showing a configuration of a screen data creation device according to a first embodiment. [Figure 4] FIG. 1 shows a setting screen for a video display area in the screen data creating device according to the first embodiment; [Diagram 5] FIG. 1 is a diagram showing an example of camera data according to the first embodiment; [Figure 6] FIG. 1 shows an example of setting an event area in a video display area in the screen data creating device according to the first embodiment. [Figure 7] FIG. 1 is a diagram showing an example of a trigger table according to the first embodiment; [Figure 8] FIG. 1 is a diagram showing examples of gesture parameters according to the first embodiment; [Figure 9] FIG. 1 shows an example of an event content table according to the first embodiment. [Figure 10] FIG. 1 shows an example of an event setting file according to the first embodiment. [Figure 11] FIG. 1 shows an example of the arrangement of video display areas in a screen data creation device according to a first embodiment; [Figure 12] FIG. 1 is a diagram showing an example of the arrangement of a video display area and objects in a screen data creation device according to a first embodiment; [Figure 13] 1 is a flowchart showing a flow of a screen data creation process executed by the screen data creation device according to the first embodiment; [Figure 14] FIG. 1 is a block diagram showing a configuration of a programmable display device according to a first embodiment. [Figure 15] FIG. 13 is a diagram showing an example in which an event region is pressed in the programmable display device according to the first embodiment; [Figure 16] FIG. 13 is a diagram showing an example in which an alarm is displayed in an event region in the programmable display device according to the first embodiment; [Figure 17] FIG. 13 is a diagram showing an example in which an image display area is moved in the programmable display device according to the first embodiment; [Figure 18] FIG. 1 is a diagram showing an example in which a video display area is expanded in a programmable display device according to the first embodiment; [Figure 19] 1 is a flowchart showing a flow of a display process executed by a programmable display device according to the first embodiment. [Figure 20] FIG. 13 is a diagram showing an example in which an image displayed in an image display area is switched in a programmable display device according to a second embodiment; [Figure 21] FIG. 13 is a diagram showing an example of an event setting file according to the second embodiment. [Figure 22] FIG. 13 is a diagram showing an example in which two images are displayed in the image display area in the programmable display device according to the third embodiment; [Figure 23] FIG. 13 is a diagram showing an example in which an event region is reset in a programmable display device according to a fourth embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments will be described in detail with reference to the drawings, in which the same or corresponding parts are designated by the same reference numerals.

[0010] (Embodiment 1) A control system 1 according to the first embodiment is an FA (Factory Automation) system installed at a manufacturing site such as a manufacturing line or a manufacturing plant, and corresponds to a production system that produces products. The control system 1 performs various processes, such as processing, monitoring, and inspection, on products flowing through the manufacturing line.

[0011] 1, the control system 1 includes a plurality of cameras 5, a plurality of sensors 6, a plurality of servo amplifiers 7, a plurality of PLCs 10, a programmable display device 30, and a screen data creation device 50. The programmable display device 30 and the screen data creation device 50 are collectively referred to as a programmable display system.

[0012] Each of the multiple cameras 5 is a network camera installed at various locations in the manufacturing site. Each camera 5 captures images of products manufactured in the FA, devices installed in the manufacturing site, and the like. Images captured by each camera 5 are used for various purposes such as product inspection and measurement. Images captured by each camera 5 may be still images or moving images. Furthermore, images captured by each camera 5 may be real-time images or past recorded images.

[0013] Each of the multiple sensors 6 is installed at various locations in the manufacturing site and measures temperature, humidity, pressure, current value, voltage value, etc. Each of the multiple servo amplifiers 7 operates output devices such as actuators and arm robots.

[0014] Each of the multiple PLCs 10 is a controller for controlling a control object in the FA. Here, the control object is a manufacturing device, a conveying device, an inspection device, etc. installed at the manufacturing site, and includes a camera 5, a sensor 6, and a servo amplifier 7. Each PLC 10 transmits various control commands to each of the multiple control objects. For example, each PLC 10 transmits a control command to the servo amplifier 7 based on values ​​acquired by the camera 5 and the sensor 6, and operates the servo amplifier 7. In this way, each PLC 10 comprehensively controls the manufacturing line in the FA.

[0015] The programmable display 30 functions as a human-machine interface in the control system 1. The programmable display 30 is used for monitoring, controlling, changing settings, etc. of equipment at the manufacturing site. Here, the equipment at the manufacturing site is various facility equipment installed at the manufacturing site, including, for example, a camera 5, a sensor 6, a servo amplifier 7, a sequencer, etc. The programmable display 30 communicates with such equipment, and can give operation commands to the equipment and check the operating status of the equipment.

[0016] The programmable display 30 is communicatively connected to a plurality of cameras 5, a plurality of sensors 6, a plurality of servo amplifiers 7, a plurality of PLCs 10, etc., via a communication network N and a hub 3. The communication network N is an industrial control network realized by communication lines installed at a manufacturing site. The communication network N may be, for example, a network based on USB (Universal Serial Bus) or EtherNET (registered trademark), or a network based on EtherCAT (registered trademark) or EtherNet / IP (registered trademark) used as an industrial network protocol.

[0017] As an example, the programmable display device 30 displays a display screen 100 shown in Fig. 2 on the display unit 34. On the display screen 100, the programmable display device 30 displays an image display area 110. The image display area 110 is an area that displays an image captured by a camera 5 associated with the image display area 110, among the multiple cameras 5. In the example of Fig. 2, the image display area 110 displays images captured of multiple products flowing on a production line and multiple devices installed at a production site.

[0018] In addition to such an image display area 110, the programmable display device 30 displays objects OB such as switches, buttons, graphs, etc. on the display screen 100. The programmable display device 30 can display display objects and operation objects as objects OB on the display screen 100. The display objects are objects such as graphs, figures, numbers, character strings, etc. that represent the status of products, equipment, etc. The display objects enable a user to remotely monitor the status of products, equipment, etc. at a manufacturing site. The operation objects are objects such as switches, buttons, etc. for operating equipment. The user can transmit various control commands to the equipment by operating the operation objects.

[0019] <Screen data creation device 50> The screen data creation device 50 is a device for creating screen data 500, which is data for the display screen 100 of the programmable display device 30. Here, the screen data 500 is data representing an image to be displayed on the display screen 100 of the programmable display device 30 and a manner of transition of the display contents of the display screen 100. The screen data creation device 50 is also called an engineering tool. A user can freely design the configuration of the display screen 100 of the programmable display device 30 using the screen data creation device 50.

[0020] More specifically, the screen data creation device 50 is a general-purpose or industrial computer such as a personal computer, a tablet terminal, etc. The screen data creation device 50 is communicatively connected to the programmable display device 30 via a USB cable, a LAN (Local Area Network), or other communication line. As shown in Fig. 3, the screen data creation device 50 includes a processor 51, a memory 52, an operation unit 53, a display unit 54, and a communication unit 55. These elements are connected via an internal bus.

[0021] The processor 51 includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), etc. The processor 51 executes programs stored in the memory 52 to realize various functions of the screen data creation device 50 and execute the processes described below.

[0022] The memory 52 includes a main memory which is a volatile storage device such as a dynamic random access memory (DRAM) or a static random access memory (SRAM), and an auxiliary memory which is a non-volatile storage device such as a read only memory (ROM) or a flash memory. Programs are loaded into the main memory from the auxiliary memory. The main memory is also used as a working area for the processor 51. The auxiliary memory stores various data used in the processing of the processor 51. The auxiliary memory supplies the processor 51 with data used by the processor 51 according to instructions from the processor 51, and stores the data supplied from the processor 51.

[0023] Specifically, the memory 52 stores a screen data creation program 521, camera data 522, a trigger table 523, gesture parameters 524, an event content table 525, an event setting file 526, and screen data 500. These will be described in detail later.

[0024] The operation unit 53 includes input devices such as a touch panel, switches, input keys, etc., and receives operations from a user. The operation unit 53 acquires information input by the user, and notifies the processor 51 of the acquired information.

[0025] The display unit 54 includes a display device such as a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The display unit 54 is driven by a display drive circuit (not shown), and displays various images according to instructions from the processor 51.

[0026] The communication unit 55 includes a communication interface circuit for communicating with an external device in accordance with a known communication standard such as USB or LAN. Specifically, the external device is the programmable display device 30. The communication unit 55 receives a signal from the external device and outputs data indicated by the received signal to the processor 51. The communication unit 55 also transmits a signal indicating the data output from the processor 51 to the external device.

[0027] The processor 51 functionally comprises a screen setting unit 511, an event setting unit 512, and a screen data creation unit 513. Each of these functions is realized in the processor 51 by software, firmware, or a combination of software and firmware. Specifically, the processor 51 realizes each function by executing a screen data creation program 521 stored in the memory 52. ​​The screen data creation program 521 is a program for creating screen data 500, which is data for the display screen 100 of the programmable display device 30.

[0028] The screen setting unit 511 sets an image display area 110 in which an image captured by the camera 5 is displayed on the display screen 100 of the programmable display device 30. More specifically, when a user operates the operation unit 53 to execute the screen data creation program 521, the screen setting unit 511 displays a creation screen for the screen data 500 on the display unit 54. On the creation screen for the screen data 500, the screen setting unit 511 first displays the image display area 110 as a reference.

[0029] 4, the screen setting unit 511 displays the reference image display area 110 on the entire screen of the display unit 54. Here, the entire screen of the display unit 54 corresponds to the display screen 100 displayed on the display unit 34 of the programmable display device 30. The user assumes that the screen of the display unit 54 is the display screen 100 of the programmable display device 30, and places the image display area 110, display objects, operation objects, and other objects OB within the screen of the display unit 54. This allows the user to freely design the display screen 100 displayed on the programmable display device 30.

[0030] When the reference image display area 110 is displayed, the screen setting unit 511 selects a camera 5 that will display an image in the image display area 110 on the display screen 100. More specifically, the screen setting unit 511 displays, for example, camera data 522 as shown in FIG. 5 on the display unit 54. The camera data 522 is data in which the number of the camera 5 and identification information of the camera 5 are associated with each of the multiple cameras 5 from which the programmable display device 30 can acquire images. The screen data creation device 50 acquires such camera data 522 from the programmable display device 30 in advance and stores it in the memory 52.

[0031] The user operates operation unit 53 to select a camera 5, from among the multiple cameras 5 defined in camera data 522, which is to be the subject of image display in image display area 110 displayed on the creation screen. Screen setting unit 511 associates the camera 5 selected by the user in this manner with image display area 110 displayed on the creation screen.

[0032] 3, the event setting unit 512 sets an event to be executed when a video is displayed in the video display area 110 set by the screen setting unit 511 on the display screen 100 of the programmable display device 30. Here, the event means a process that is executed when a predetermined trigger is established.

[0033] First, the event setting unit 512 sets the position of the event, which is a position associated with the event. Specifically, the event setting unit 512 sets a position relative to the video display area 110 as the position of the event. Here, the position relative to the video display area 110 means a position represented by relative coordinates with any position on the video display area 110 as the reference. The event setting unit 512 sets a relative coordinate system with the video display area 110 in the screen as the reference.

[0034] 6, the event setting unit 512 sets an xy coordinate system with an origin P1 at the upper left position of the video display area 110. The event setting unit 512 sets the position of the event using coordinates determined by such an xy coordinate system.

[0035] More specifically, the event setting unit 512 sets the event region 120 in the video display area 110 as the position of the event. As shown in FIG. 6, the user operates the operation unit 53 to perform, for example, a tracing operation on a touch panel or an operation of dragging a cursor. This selects the range of the event region 120 in the video display area 110. In the example of FIG. 6, the event setting unit 512 sets a rectangular range of width w1 and height h1 from the coordinates (x1, y1) as the event region 120. The event setting unit 512 sets the event region 120 in the video display area 110 based on such a user operation.

[0036] Here, the xy coordinate system is not a fixed coordinate system based on the entire screen, but a coordinate system relative to the video display area 110. Therefore, as described below, when the position or size of the video display area 110 is changed within the display screen 100, the xy coordinate system is changed in accordance with the change. As a result, the position or size of the event area 120 determined by the xy coordinate system is also changed at the same rate as the video display area 110, following the change.

[0037] In this manner, the event setting section 512 sets, as the position of the event, the event area 120 represented by the xy coordinate system which is the coordinate system of the video display area 110. The event area 120 is an example of a relative position with respect to the video display area 110.

[0038] After setting the event area 120, the event setting unit 512 secondly sets the trigger of the event and the content of the event to be executed when the trigger of the event is established. Here, the trigger of the event means a condition that becomes a trigger for generating the event. The event setting unit 512 sets the trigger of the event from among a plurality of triggers defined in a trigger table 523 shown in Fig. 7 based on the user's operation. The trigger table 523 defines candidates of triggers that the event setting unit 512 can set.

[0039] Specifically, the trigger table 523 defines two types of triggers as settable triggers. The first trigger, which is the first type of trigger, is a trigger associated with the event area 120, in other words, a trigger associated with position information within the screen. In the example of FIG. 7, the trigger table 523 defines "pressing the event area 120," "gesture on the event area," and the like as the first trigger. In other words, the trigger table 523 defines a trigger that is established when a user operation on the event area 120 is input as the first trigger.

[0040] The second trigger, which is the second type of trigger, is a trigger that is not associated with the event region 120, in other words, a trigger that is not associated with position information within the screen. In the example of Fig. 7, the trigger table 523 defines "alarm occurrence", "gesture on the screen", etc. as the second trigger.

[0041] Here, "pressing the event area 120" corresponds to a user pressing within the range set in the event area 120. "Alarm occurrence" corresponds to some abnormality occurring in a product, device, or the like at the manufacturing site. For example, when a sensor value such as temperature or voltage measured by the sensor 6 exceeds a predetermined allowable range, a trigger for alarm occurrence is established.

[0042] A "gesture" refers to a specific operation such as tracing in a specific direction, such as right, left, up, down, etc., or long press. Specifically, a gesture on the event area 120 corresponds to tracing the event area 120, long press on the event area 120, etc. Also, a gesture on the screen refers to a tracing operation, long press, etc. that may be performed on any position on the screen, not limited to the event area 120.

[0043] Here, parameters that are thresholds for determining whether or not a gesture has been made are determined in gesture parameters 524 shown in FIG. 8. For example, a gesture of tracing to the right is determined to have been made when the distance of the tracing is Tr or more. A gesture of tracing to the left is determined to have been made when the distance of the tracing is Tl or more. As the thresholds Tr and Tl, for example, a movement amount of 1 / 4 of the size of the video display area 110 is considered. A long press gesture is determined to have been made when the button is pressed for a time period of Tk or more. Such parameters can be freely set by the user.

[0044] Note that the tracing operation on the event area 120 may end outside the range of the event area 120 as long as the tracing operation starts from a coordinate within the range of the event area 120. Also, the direction of the tracing operation on the event area 120 or the screen is not limited to one direction, and an operation of drawing a figure such as a circle, triangle, or square can be set as a gesture.

[0045] Event setting unit 512 can set an event trigger from among these two types of triggers. When a trigger is set, event setting unit 512 sets the content of an event to be executed when the set trigger is established. Event setting unit 512 sets the content of an event from among a plurality of event contents defined in event content table 525 shown in Fig. 9 based on a user operation. Event content table 525 defines candidates for event contents that event setting unit 512 can set.

[0046] Specifically, like a trigger, event content table 525 defines two types of content as settable event content. The first content, which is the first type of content, is content associated with event area 120, in other words, content associated with position information within the screen. In the example of FIG. 9, event content table 525 defines, as the first content, "display device status in event area 120," "display alarm in event area 120," and the like. In other words, event content table 525 defines, as the first content, displaying an image corresponding to a trigger in event area 120.

[0047] The second content, which is the second type of content, is content that is not associated with the event area 120, in other words, content that is not associated with position information within the screen. In the example of Fig. 9, the event content table 525 defines "display overlapping window", "control device", etc. as the second content.

[0048] Here, "displaying the device status in the event area 120" corresponds to displaying in the event area 120 an image showing sensor values ​​such as the current temperature and voltage value of the target device. "displaying an alarm in the event area 120" corresponds to displaying a warning image in the event area 120. "displaying an overlapping window" corresponds to displaying, for example, a device manual in an overlapping window at any position on the screen. "controlling the device" corresponds to sending a control command to the target device to switch the device's operation ON / OFF, change the state, etc. Furthermore, if the target device is a camera 5, "controlling the device" may also mean sending a change command to change the shooting direction of the camera 5.

[0049] The event setting unit 512 sets a trigger and an event content for the event region 120 by combining any of the triggers defined in the trigger table 523 with any of the event contents defined in the event content table 525. At this time, the event setting unit 512 combines the trigger and the event content such that at least one of the trigger and the event content is associated with the event region 120. Specifically, the event setting unit 512 sets a combination of a first trigger and a first event content, a combination of a first trigger and a second event content, or a combination of a second trigger and a first event content as the trigger and the event content for the event region 120.

[0050] After setting the event position, trigger, and content as event information in this way, event setting unit 512 generates event setting file 526 indicating the set information. As shown in Fig. 10, event setting file 526 defines the number of camera 5 displaying video in video display area 110 and event information set in that video display area 110 in association with each other. The event information includes identification information and coordinate range of event area 120, and the trigger and content of the event. Note that the trigger and content of the event in Fig. 10 are represented by numbers in trigger table 523 and event content table 525, respectively.

[0051] 10 shows an example in which one event is set for one camera 5, but event setting unit 512 can set multiple events for one video display area 110. Every time event setting unit 512 sets an event, it updates event setting file 526 with information about the set event.

[0052] When an event is set by the event setting unit 512, the screen setting unit 511 sets the position and size of the video display area 110 in which the event area 120 is set, within the display screen 100 of the programmable display device 30. More specifically, the user operates the operation unit 53 to place the video display area 110 in which the event area 120 is set, within the screen. For example, as shown in FIG. 11, the user places the video display area 110 in which the event area 120 is set, with a width W1 and a height H1, at coordinates (X1, Y1) in the XY coordinate system, which is the screen coordinate system. The width, height, and enlargement / reduction rate of the video display area 110 can be freely set.

[0053] Here, the XY coordinate system in which the position and size of the video display area 110 are determined is a screen coordinate system fixed to the screen of the display unit 54, and more specifically, is a coordinate system with the upper left position of the screen as the origin P2. In contrast, the xy coordinate system in which the position and size of the event area 120 are determined is a coordinate system relative to the video display area 110, with the upper left position of the video display area 110 as the origin P1, as described above. Therefore, the position and size of the event area 120 are automatically set to a position and size based on the position and size of the video display area 110 after it has been arranged on the screen.

[0054] Based on such user operations, the screen setting unit 511 sets the position and size of the video display area 110 in the display screen 100 of the programmable display device 30. As a result, one video display area 110 in which at least one event is set is set in the display screen 100. Furthermore, as shown in Fig. 12, the screen setting unit 511 places objects OB such as switches, buttons, graphs, figures, etc. in addition to the video display area 110 based on user operations. In this way, the user can freely design the display screen 100 by placing various objects OB.

[0055] 3, the screen data creation unit 513 creates screen data 500. The screen data 500 is data that represents an image to be displayed on the display screen 100 of the programmable display device 30 and a manner of transition of the display contents on the display screen 100. The screen data 500 is written to the programmable display device 30 and used for display processing of the display screen 100.

[0056] The screen data 500 includes information on the video display area 110 set by the screen setting unit 511 and information on the event set by the event setting unit 512. Specifically, the screen data 500 indicates that the video display area 110 set by the screen setting unit 511 is displayed on the display screen 100, and that the event set by the event setting unit 512 is associated with a relative position with respect to the video display area 110.

[0057] More specifically, the screen data creation unit 513 creates data representing information on the arrangement of the video display area 110 and the object OB in the display screen 100 as shown in FIG. 12, and information on the camera 5 and the event set in the video display area 110 in the event setting file 526, as the screen data 500. As described above, the information on the arrangement of the video display area 110 and the object OB is expressed in the screen coordinate system. Furthermore, the event is associated with the event area 120, which is a relative position with respect to the video display area 110. At least one of the trigger and the content of the event is associated with the event area 120. Therefore, the screen data creation unit 513 creates the screen data 500 in which such event information is set.

[0058] Next, a flow of the screen data creation process executed by the screen data creation device 50 will be described with reference to Fig. 13. The screen data creation process shown in Fig. 13 is started when a user operates the operation unit 53 to execute the screen data creation program 521. Note that the screen data creation process shown in Fig. 13 is an example of a screen data creation method.

[0059] When the screen data creation process starts, the processor 51 displays the reference image display area 110 (step S11). Specifically, the processor 51 displays the reference image display area 110 on the entire screen of the display unit 54, as shown in FIG.

[0060] When the video display area 110 is displayed, the processor 51 selects, based on user operation, from among the multiple cameras 5 under the control of the programmable display device 30, a camera 5 whose video will be displayed in the video display area 110 (step S12).

[0061] When the camera 5 is selected, the processor 51 sets the event area 120 in the video display area 110 based on the user's operation (step S13). Specifically, as shown in Fig. 6, the processor 51 sets the event area 120 at a relative position represented by xy coordinates, which are coordinates relative to the video display area 110.

[0062] When the event region 120 is set, the processor 51 sets the trigger and the content of the event (step S14). Specifically, the processor 51 refers to the trigger table 523 and the event content table 525, and sets the trigger and the event content so that at least one of the trigger and the event content is associated with the event region 120 set in step S13.

[0063] After setting the trigger and contents of the event, the processor 51 determines whether or not to set a further event in the currently displayed video display area 110 based on a user operation (step S15). If a further event is to be set (step S15; YES), the processor 51 returns the process to step S13. The processor 51 then sets the event area 120 and the trigger and contents of the event as information of the further event. The processor 51 saves information of at least one event thus set in the event setting file 526 in association with the video display area 110.

[0064] If no further event is set (step S15; NO), the processor 51 arranges the video display area 110 within the screen based on the user's operation (step S16). Specifically, the processor 51 arranges the video display area 110 in which at least one event is set, at a position represented by the XY coordinate system, which is the screen coordinate system, as shown in Fig. 11.

[0065] After arranging the video display area 110, the processor 51 further arranges objects OB, such as display objects and operation objects, within the screen based on the user's operation (step S17). Note that if the user does not arrange objects OB, step S17 is omitted.

[0066] Once the video display area 110 has been arranged, the processor 51 creates screen data 500 (step S18). More specifically, the processor 51 generates screen data 500 representing information related to the display screen 100 set in the processes of steps S11 to S17, and stores the data in the memory 52. ​​The created screen data 500 is transmitted to the programmable display device 30 at an appropriate timing. This completes the screen data creation process shown in FIG. 13.

[0067] <Programmable Display 30> Next, a description will be given of the configuration and operation of the programmable display device 30. The programmable display device 30 executes display processing of the display screen 100 based on the screen data 500 created by the screen data creating device 50.

[0068] As shown in Fig. 14, the programmable display device 30 includes a processor 31, a memory 32, an operation unit 33, a display unit 34, and a communication unit 35. These elements are connected via an internal bus. The hardware configurations of these units are similar to the processor 51, memory 52, operation unit 53, display unit 54, and communication unit 55 of the screen data creation device 50 described with reference to Fig. 3, so differences in functional configuration will be described below.

[0069] In the programmable display device 30, the communication unit 35 communicates with the screen data creation device 50 via a LAN, a USB, Ethernet (registered trademark), or the like. The communication unit 35 also communicates with a plurality of cameras 5, a plurality of PLCs 10, and the like via a communication network N. The memory 32 stores screen data 500. The screen data 500 is acquired from the screen data creation device 50 by the communication unit 35 communicating with the screen data creation device 50.

[0070] The processor 31 functionally comprises a display control unit 311 and an event execution unit 312. Each of these functions is realized in the processor 31 by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in the memory 32. The processor 31 realizes each function by executing the programs stored in the memory 32.

[0071] The display control unit 311 displays the display screen 100 based on the screen data 500 acquired from the screen data creating device 50 on the display unit 34. To be more specific, the display control unit 311 displays the video display area 110 and other objects OB shown in the screen data 500 in the arrangement shown in the screen data 500. As a result, the display control unit 311 displays the display screen 100 on which the video display area 110 and other objects are arranged on the display unit 34, for example, as shown in FIG.

[0072] More specifically, the display control unit 311 displays the image captured by the camera 5 in the image display area 110 in the display screen 100. To be more specific, the display control unit 311 identifies the camera 5 selected to display the image in the image display area 110 from among the multiple cameras 5 under the management of the programmable display device 30 based on the screen data 500. The display control unit 311 communicates with the identified camera 5 via the communication unit 35 and the communication network N, and continuously acquires the image captured by the camera 5 at a predetermined cycle. Then, the display control unit 311 displays the acquired image in the image display area 110 in the display screen 100.

[0073] The display control unit 311 makes the event area 120 set in the video display area 110 in the screen data 500 transparent so that the user cannot see it, that is, makes it invisible. In FIG. 2, the frame of the event area 120 is shown with a dashed line for ease of understanding, but the display control unit 311 also displays the frame of the event area 120 transparently. The same applies to the subsequent figures. By not displaying the event area 120 in this way, it is possible to avoid the visibility of the video being impaired by the event area 120.

[0074] 14, when the display screen 100 is displayed by the display control unit 311, the event executing unit 312 executes an event associated with the event area 120, which is a relative position with respect to the video display area 110 on the display screen 100. The screen data 500 includes information on the event set in the event setting file 526 in the screen data creating device 50. The event executing unit 312 determines whether or not a trigger for the event set for the video display area 110 has been established based on the screen data 500. Then, if the trigger has been established, the event executing unit 312 executes an event whose contents are associated with the trigger in the screen data 500.

[0075] As a first example, a case will be described in which an event whose trigger is "pressing event area 120" and whose content is "control device" is set for video display area 110 displayed on display screen 100. In this case, event execution unit 312 determines whether event area 120 has been pressed. For example, if operation unit 33 has a touch panel, a user presses event area 120 by touching the position of event area 120 on display screen 100 with a finger, as shown in FIG.

[0076] When such an operation on the event area 120 is detected, the event execution unit 312 determines that a trigger has been established. In this case, the event execution unit 312 transmits a control command to the device displayed at the position of the event area 120. As an example, the event execution unit 312 transmits a control command to turn the operation on / off, a control command to change the state, etc. to the device via the communication unit 35. This allows the user to control the device displayed in the video by intuitive operations.

[0077] As a second example, a case will be described in which an event whose trigger is "alarm occurrence" and whose content is "display alarm in event area 120" is set for video display area 110 displayed on display screen 100. In this case, event execution unit 312 communicates with the device displayed at the position of event area 120 via communication unit 35, and periodically monitors sensor values ​​such as the temperature and voltage value of the device.

[0078] If the sensor value exceeds a predetermined allowable range as a result of monitoring, the event executing unit 312 determines that the trigger has been established. In this case, the event executing unit 312 displays an image indicating a warning in the event area 120, as shown in Fig. 16. This allows the user to easily check the status of the device displayed in the video.

[0079] As another example (not shown), when the trigger is a "gesture on the event region 120", the event executing unit 312 determines whether or not an operation defined in the gesture parameters 524, such as an operation of tracing in a specific direction or a long press, has been performed on the event region 120. When the trigger is a "gesture on the screen", the event executing unit 312 determines whether or not an operation defined in the gesture parameters 524 has been performed on any position on the display screen 100.

[0080] Furthermore, if the event content is "display device status in event area 120", event execution unit 312 acquires sensor values ​​such as the current temperature and voltage of the device displayed in event area 120, and displays an image showing the acquired sensor values ​​in event area 120. If the event content is "display overlap window", event execution unit 312 displays an overlap window in an arbitrary position within display screen 100, and displays, within the overlap window, the manual for the device displayed in event area 120.

[0081] On the display screen 100 on which such an event is executed, the user of the programmable display device 30 can operate the operation unit 33 to input a change operation for changing the position or size of the video display area 110. When the change operation is input, the display control unit 311 changes the position or size of the video display area 110 in accordance with the input change operation. When the position or size of the video display area 110 is changed on the display screen 100, the event is associated with a position relative to the video display area 110 after the position or size has been changed.

[0082] More specifically, as described above, the event area 120 is set at a position represented by the xy coordinate system, which is a coordinate system relative to the video display area 110. Therefore, when the position or size of the video display area 110 on the display screen 100 is changed, the display control unit 311 also changes the position and coordinate size of the origin P1 of the xy coordinate system. Accordingly, the position or size of the event area 120 is also changed so as to follow the video display area 110.

[0083] As a first example, when a change operation to change the position of the video display area 110 is input, the display control unit 311 moves the video display area 110 within the display screen 100 in accordance with the input change operation, as shown in Fig. 17. In this case, the display control unit 311 moves the position of the event area 120 in the same direction as the video display area 110 by the same amount.

[0084] As a second example, when a change operation to enlarge the size of the video display area 110 is input, the display control unit 311 enlarges the size of the video display area 110 within the display screen 100 in accordance with the input change operation, as shown in Fig. 18. In this case, the display control unit 311 enlarges the size of the event area 120 by the same enlargement ratio as the video display area 110. The same applies when reducing the size.

[0085] In this way, even if the position or size of the video display area 110 is changed, the positional relationship between the video and the event area 120 is maintained. Therefore, the event area 120 can adapt to the change in the video display area 110, and the user does not need to reset the event area 120. As a result, the user's effort in setting the event area 120 can be reduced.

[0086] Next, a flow of the display process executed by the programmable display device 30 will be described with reference to Fig. 19. The display process shown in Fig. 19 is started when the user operates the operation unit 33 to start up the programmable display device 30.

[0087] When the display process starts, the processor 31 reads the screen data 500 acquired from the screen data creation device 50 (step S21). After reading the screen data 500, the processor 31 acquires an image of the camera 5 (step S22). Specifically, the processor 31 communicates with the camera 5 that displays an image in the image display area 110 in the read screen data 500 via the communication unit 35, and acquires the image captured by the camera 5.

[0088] When the image of the camera 5 is acquired, the processor 31 displays the display screen 100 based on the read screen data 500 (step S23). The processor 31 displays the display screen 100, in which the image display area 110 and other objects OB are arranged, on the display unit 34, as shown in Fig. 2, for example. At this time, the processor 31 displays the image acquired in step S22 in the image display area 110.

[0089] When display screen 100 is displayed, processor 31 determines whether or not a trigger for any event set in video display area 110 in display screen 100 has been established (step S24). If a trigger has been established (step S24; YES), processor 31 executes an event whose content corresponds to the established trigger (step S25). On the other hand, if a trigger has not been established (step S24; NO), processor 31 skips step S25.

[0090] Next, the processor 31 determines whether or not a change operation to change the position or size of the video display area 110 in the display screen 100 has been received from the user (step S26). If a change operation has been received (step S26; YES), the processor 31 changes the position or size of the video display area 110 in the display screen 100 in accordance with the received change operation (step S27). At this time, the position or size of the event area 120 is changed following the change in the position or size of the video display area 110, as shown in Figs. 17 and 18. On the other hand, if a change operation has not been received (step S26; NO), the processor 31 skips step S27.

[0091] After that, the processor 31 returns the process to step S24. Then, every time any of the triggers set in the video display area 110 in the display screen 100 is established, the processor 31 executes an event of the corresponding content. Also, every time the processor 31 receives a change operation, the processor 31 changes the position or size of the video display area 110 in accordance with the received change operation. In this way, the processor 31 repeats the processes of steps S24 to S27 while the programmable display device 30 is operating normally.

[0092] As described above, the screen data creation device 50 according to the first embodiment sets the video display area 110 in which the video captured by the camera 5 is displayed and an event, and creates screen data 500 which indicates that the set video display area 110 is displayed on the display screen 100 and that the set event is associated with a relative position with respect to the video display area 110. The programmable display device 30 according to the first embodiment displays the display screen 100 based on the screen data 500 created by the screen data creation device 50.

[0093] In this way, since events are not defined in the screen coordinate system but are associated with relative positions with respect to the video display area 110, the positional relationship between the video displayed in the video display area 110 and the events can be maintained even if the position or size of the video display area 110 is changed. Therefore, the user does not need to reset events even if the position or size of the video display area 110 is changed. As a result, the user's effort in setting can be reduced, and the usability of the programmable display device 30 can be improved.

[0094] Particularly in recent manufacturing sites, there is an increasing need to use the camera 5 for purposes such as quality control, finding people, and crime prevention. However, the display screen 100 of the programmable display device 30 is not specialized for displaying images from the camera 5. When a user at the manufacturing site wants to check the image from the camera 5 in detail, he or she often enlarges the image display area 110 to display the image over the entire display screen 100, or moves the position of the image display area 110. The programmable display device 30 according to the first embodiment can reduce the effort required for the user to make settings when changing the position or size of the image display area 110 in this way.

[0095] (Embodiment 2) Next, a description will be given of embodiment 2. Descriptions of configurations and functions similar to those of embodiment 1 will be omitted where appropriate.

[0096] In the above-mentioned first embodiment, the programmable display device 30 displays one image captured by one camera 5 in the image display area 110. In contrast, in the second embodiment, the programmable display device 30 displays multiple images captured by multiple cameras 5 in the image display area 110.

[0097] In the second embodiment, on the display screen 100 of the programmable display device 30, an image displayed in the image display area 110 among a plurality of images captured by a plurality of cameras 5 is switched in response to a user operation. Specifically, as shown in Fig. 20, the display control unit 311 switches the image displayed in the image display area 110 between two images captured by two different cameras 5. Note that the display control unit 311 may switch between images captured by three or more cameras 5 and display them in the image display area 110.

[0098] The screen data creation device 50 creates data of such a display screen 100 as screen data 500. First, in the screen data creation device 50, a screen setting unit 511 sets an image display area 110 in which a plurality of images captured by a plurality of cameras 5 are displayed.

[0099] The screen setting unit 511 selects a plurality of cameras 5 whose images are to be displayed in the video display area 110. To be more specific, the user operates the operation unit 53 to select a plurality of cameras 5 whose images are to be displayed in the video display area 110 from among the plurality of cameras 5 defined in the camera data 522. The screen setting unit 511 associates the plurality of cameras 5 selected by the user in this manner with the video display area 110.

[0100] The event setting unit 512 sets an event individually for each of the multiple cameras 5 whose video is to be displayed in the video display area 110 set by the screen setting unit 511. In other words, the event setting unit 512 sets an event that is to be executed when the video captured by each camera 5 is displayed in the video display area 110 for each of the multiple cameras 5 that are to be displayed.

[0101] Specifically, the event setting unit 512 sets an event area 120, which is a relative position with respect to the video display area 110, and an event trigger and content, for each of the multiple target cameras 5. The method of setting an event for one camera 5 is the same as in embodiment 1. The event setting unit 512 can set different event areas 120 for each of the multiple target cameras 5, and can set different event triggers and content. Note that the event setting unit 512 may set only one event or multiple events for one camera 5.

[0102] When the event setting unit 512 sets at least one event for each camera 5, it generates an event setting file 526 indicating information about the set events. As an example, when two cameras 5 numbered 1 and 2 are selected as the cameras 5 whose images are to be displayed in the image display area 110, the event setting unit 512 generates the event setting file 526 shown in Fig. 21. In the example of Fig. 21, one event is set for the camera 5 numbered "1," and two events are set for the camera 5 numbered "2."

[0103] The screen data creation unit 513 creates screen data 500 that represents the information set by the screen setting unit 511 and the event setting unit 512. In other words, the screen data creation unit 513 creates screen data 500 that represents that the video display area 110 set by the screen setting unit 511 is displayed on the display screen 100, and that the event set by the event setting unit 512 is associated with a relative position with respect to the video display area 110.

[0104] In the programmable display device 30, the display control unit 311 displays the display screen 100 based on the screen data 500 created by the screen data creation device 50. Then, when an image is displayed in the image display area 110 on the display screen 100, if a trigger for any of the events associated with the camera 5 that captured the image is established, the event execution unit 312 executes the event.

[0105] The display control unit 311 displays a first video captured by the first camera 5 in the video display area 110, for example, as in the display screen 100 shown in the upper part of Fig. 20. In this example, one event area 120 is set in the first video, and one event is associated with the first camera 5. Therefore, when the trigger for that one event is established, the event execution unit 312 executes that event.

[0106] In this case, when the user operates the operation unit 33 to input a switching operation for switching the video, the display control unit 311 displays a second video captured by a second camera 5 different from the first camera 5 in the video display area 110, as in the display screen 100 shown in the lower part of Fig. 20. In this example, two event areas 120 are set in the second video, and two events are associated with the second camera 5. Therefore, when the trigger of one of the two events is established, the event execution unit 312 executes the event corresponding to the trigger.

[0107] Each time the user inputs a switching operation, the display control unit 311 switches the display screen 100 between the screen shown in the upper part of Fig. 20 and the screen shown in the lower part of Fig. 20. Here, the switching operation is, for example, an operation in which the user traces the display screen 100 in a specific direction such as right, left, up, down, etc.

[0108] Event setting unit 512 may set a switching operation as one of the triggers of an event, and set a process of switching the video displayed in video display area 110 as the content of the event corresponding to the trigger. For example, event setting unit 512 sets a gesture on event area 120 or the screen as the trigger of an event associated with first camera 5, and sets a process of switching the video displayed in video display area 110 to the video captured by second camera 5 as the content of the event. The same applies to the event associated with second camera 5.

[0109] As described above, the programmable display device 30 according to the second embodiment displays a plurality of videos captured by a plurality of cameras 5 in a switchable manner in the video display area 110. An event is set for each of the plurality of cameras 5, and is associated with a relative position in the video display area 110. Since an event is set for each camera 5, when the displayed video is switched, the executable event is automatically switched to an event associated with the camera 5 of the switched-to video. Therefore, the user does not need to reset events when the video is switched, improving usability.

[0110] (Embodiment 3) Next, a description will be given of embodiment 3. Descriptions of configurations and functions similar to those of embodiments 1 and 2 will be omitted where appropriate.

[0111] The programmable display device 30 according to the above-mentioned second embodiment displays a plurality of videos captured by a plurality of cameras 5 in a switchable manner in the video display area 110. In contrast, the programmable display device 30 according to the third embodiment displays a plurality of videos captured by a plurality of cameras 5 in the video display area 110 simultaneously.

[0112] Specifically, the display control unit 311 divides one video display area 110 on the display screen 100 into a plurality of partial areas, and displays videos captured by a plurality of different cameras 5 in the plurality of partial areas. As an example, as shown in Fig. 22, the display control unit 311 simultaneously displays videos captured by two different cameras 5 in one video display area 110. Note that the display control unit 311 may simultaneously display three or more videos in one video display area 110.

[0113] Even when multiple images are displayed simultaneously in one image display area 110 in this manner, events are set for each camera 5, thereby improving usability in changing the position or size of the image display area 110, switching images, etc.

[0114] (Embodiment 4) Next, a description will be given of embodiment 4. Descriptions of configurations and functions similar to those of embodiments 1 to 3 will be omitted where appropriate.

[0115] The programmable display device 30 according to the fourth embodiment can reconfigure the event area 120 set by the event setting unit 512 on the display screen 100 in response to a user operation. The user of the programmable display device 30 can operate the operation unit 33 to input an edit start operation for starting editing of the event area 120 set in the video display area 110 displayed on the display screen 100. When an edit start operation is input while the video display area 110 is displayed on the display screen 100, the display control unit 311 transitions to an edit mode for the event area 120.

[0116] Specifically, as shown in FIG. 23, in the edit mode, the user operates the operation unit 33 to select the event area 120 to be reset in the video display area 110. Then, the user selects an area other than the event area 120 to be reset in the video display area 110 as the new event area 120. The user selects, for example, the area shaded in FIG. 23 as the new event area 120 by tracing the finger on the touch panel. The display control unit 311 sets the area selected by the user in this manner as the new event area 120. Note that the trigger and contents of the event set in the new event area 120 may be the same as those of the original event area 120, or may be resettable. Information on the reset event is saved in the screen data 500.

[0117] By such processing, the position or size of the event region 120 set in the screen data creating device 50 can be reset in the programmable display device 30. In the screen data creating device 50, the screen data creating unit 513 creates screen data 500 indicating that the event region 120 is reset in response to a user operation on the display screen 100 by such processing.

[0118] The event setting unit 512 may set an edit start operation as one of the triggers of an event, and may set a process of transitioning to the edit mode as the content of the event corresponding to the trigger. For example, the event setting unit 512 may set an operation such as pressing or a gesture on the event area 120 to be reset as a trigger for executing an event of transitioning to the edit mode.

[0119] (Embodiment 5) Next, a description will be given of embodiment 5. Descriptions of configurations and functions similar to those of embodiments 1 to 4 will be omitted where appropriate.

[0120] In the above-mentioned first to fourth embodiments, the display control unit 311 hides the event region 120 set in the video display region 110 in the screen data 500 so that the user cannot view it. In contrast, in the fifth embodiment, the display control unit 311 switches between displaying and hiding the event region 120 on the display screen 100 in response to a user operation.

[0121] Specifically, when the video display area 110 is displayed on the display screen 100 by the display control unit 311, the user operates the operation unit 33 to input a switching operation for switching between displaying and hiding the event area 120. When a switching operation is input when the event area 120 set in the video display area 110 is not displayed, the display control unit 311 visualizes the event area 120 to display the event area 120. On the other hand, when a switching operation is input when the event area 120 is displayed, the display control unit 311 switches the event area 120 to hidden.

[0122] Here, the visualization mode of the event region 120 may be any mode that is visible to the user, such as coloring the frame or the entire region of the event region 120, blinking, etc. In the screen data creating device 50, the screen data creating unit 513 creates screen data 500 that indicates that the event region 120 is switched between display and non-display in response to a user operation by such processing on the display screen 100.

[0123] By temporarily visualizing the event area 120 in this manner, it is possible to easily confirm which part of the video display area 110 the event is set in. In particular, even a user other than the user who set the event area 120 can confirm the position of the event area 120 set in the video display area 110. Furthermore, by temporarily visualizing the event area 120, it is possible to improve convenience when resetting the event area 120 as described in the fourth embodiment.

[0124] The event setting unit 512 may set a switching operation for switching between display and non-display of the event region 120 as one of the triggers of the event, and may set a process for switching between display and non-display of the event region 120 as the content of the event corresponding to the trigger. For example, the event setting unit 512 may set a gesture such as a long press or a tracing operation on the screen as the trigger.

[0125] (Modification) Although the embodiments have been described above, it is possible to combine the embodiments, or to modify or omit the embodiments as appropriate.

[0126] For example, in the above embodiment, the event setting unit 512 sets the event region 120 as the position of the event. However, the event setting unit 512 may set a point as the position of the event, not limited to an area having a two-dimensional extent, as long as the position is a relative position with respect to the video display region 110 on the display screen 100.

[0127] In the above embodiment, in the screen data creation device 50, the processor 51 executes a program to function as each of the screen setting unit 511, the event setting unit 512, and the screen data creation unit 513. In the programmable display device 30, the processor 31 executes a program to function as each of the display control unit 311 and the event execution unit 312. However, the processors 51 and 31 may be dedicated hardware. The dedicated hardware may be, for example, a single circuit, a composite circuit, a programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination of these. When the processors 51 and 31 are dedicated hardware, the functions of each unit may be realized by individual hardware, or the functions of each unit may be realized together by a single piece of hardware.

[0128] In addition, some of the functions of each unit may be realized by dedicated hardware, and other parts may be realized by software or firmware. In this way, the processors 51 and 31 can realize each of the above-mentioned functions by hardware, software, firmware, or a combination of these.

[0129] By applying an operating program that specifies the operation of the screen data creation device 50 or the programmable display device 30 to an existing personal computer, information terminal device, or other computer, it is also possible to cause the computer to function as the screen data creation device 50 or the programmable display device 30.

[0130] Furthermore, such programs may be distributed in any manner, and may be distributed by storing them on a computer-readable recording medium such as a CD-ROM (Compact Disk ROM), a DVD (Digital Versatile Disk), an MO (Magneto Optical Disk), or a memory card, or may be distributed via a communications network such as the Internet.

[0131] Various embodiments and modifications of the present disclosure are possible without departing from the broad spirit and scope of the present disclosure. The above-described embodiments are for explaining the present disclosure and do not limit the scope of the present disclosure. That is, the scope of the present disclosure is indicated by the claims, not the embodiments. Various modifications made within the scope of the claims and the scope of the disclosure equivalent thereto are considered to be within the scope of the present disclosure. [Explanation of symbols]

[0132] 1 control system, 3 hub, 5 camera, 6 sensor, 7 servo amplifier, 10 PLC, 30 programmable display, 31, 51 processor, 32, 52 memory, 33, 53 operation unit, 34, 54 display unit, 35, 55 communication unit, 50 screen data creation device, 100 display screen, 110 video display area, 120 event area, 311 display control unit, 312 event execution unit, 500 screen data, 511 screen setting unit, 512 event setting unit, 513 screen data creation unit, 521 screen data creation program, 522 camera data, 523 trigger table, 524 gesture parameter, 525 event content table, 526 event setting file, N communication network, OB object

Claims

1. A screen data creation program that creates screen data, which is the data of the display screen shown in a programmable display, Computers, A screen setting unit sets the video display area on the aforementioned display screen where the video captured by the camera is displayed. An event setting unit that sets events to be executed when the video is displayed in the video display area. The screen data creation unit is configured to create screen data that indicates that the video display area set by the screen setting unit is displayed on the display screen, and that the event set by the event setting unit is associated with a relative position to the video display area. A program for creating screen data.

2. The event setting unit sets the trigger for the event and the content of the event to be executed when the trigger is met. At least one of the trigger and the content of the event is associated with the relative position. The screen data creation program according to claim 1.

3. The trigger is associated with the relative position, The event setting unit sets the trigger which is activated when a user operation is input regarding the relative position on the display screen. The screen data creation program according to claim 2.

4. The content of the aforementioned event is related to the aforementioned relative position, The event setting unit sets the content of the event to display the image corresponding to the trigger at the relative position on the display screen. The screen data creation program according to claim 2.

5. The screen data creation unit creates screen data indicating that, when the position or size of the video display area on the display screen is changed, the event set by the event setting unit is associated with the relative position of the video display area after the position or size has been changed. A screen data creation program according to any one of claims 1 to 4.

6. The screen setting unit sets the video display area in which multiple videos captured by multiple cameras are displayed, The event setting unit sets the event individually for each of the multiple cameras. The screen data creation unit creates screen data that indicates that the video display area set by the screen setting unit is displayed on the display screen, and that the events set for each of the multiple cameras by the event setting unit are associated with their relative positions to the video display area. A screen data creation program according to any one of claims 1 to 4.

7. The screen data creation unit creates screen data that indicates that, in the display screen, the video displayed in the video display area among the multiple videos is switched according to user operation. The screen data creation program according to claim 6.

8. The screen data creation unit creates screen data in the display screen that indicates that the relative position is reset in response to user operations. A screen data creation program according to any one of claims 1 to 4.

9. The screen data creation unit creates screen data that indicates that the display and hiding of the relative position are switched in response to user operations on the display screen. A screen data creation program according to any one of claims 1 to 4.

10. A screen data creation device that creates screen data, which is the data of the display screen displayed in a programmable display, The aforementioned display screen includes a screen setting unit that sets a video display area in which video captured by the camera is displayed, An event setting unit that sets events to be executed when the video is displayed in the video display area, The system includes a screen data creation unit that creates screen data indicating that the video display area set by the screen setting unit is displayed on the display screen, and that the event set by the event setting unit is associated with a relative position to the video display area. Screen data creation device.

11. A screen data creation device according to claim 10, The system includes a programmable display that displays the display screen based on the screen data created by the screen data creation device, Programmable display system.

12. A programmable display that displays a screen based on screen data created by a screen data creation device, The display control unit displays the image captured by the camera in the image display area of ​​the aforementioned display screen, The system includes an event execution unit that executes an event associated with a position relative to the video display area when the video is displayed in the video display area by the display control unit, Programmable display.

13. A method for creating screen data, which is the data of the display screen shown in a programmable display, Set an event that will be executed when the video captured by the camera is displayed in the video display area. The system creates screen data that indicates the video display area is displayed on the display screen and that the event is associated with a relative position to the video display area. How to create screen data.

Images