Screen data creation program, screen data creation device, programmable display system, programmable display device, and screen data creation method

Abstract

A screen data creation device (50) creates screen data (500), which is data on a display screen of a programmable display device. A screen-setting unit (511) sets a video display area in which a video captured by a camera is displayed on the display screen. An event-setting unit (512) sets an event to be executed when the video is displayed in the video display area. A screen data creation unit (513) creates screen data (500) indicating that the video display area set by the screen-setting unit (511) is to be displayed on the display screen, and the event set by the event-setting unit (512) is associated with a position relative to the video display area.

Description

Screen data creation program, screen data creation device, programmable display system, programmable display device, and screen data creation method

[0001] The present disclosure relates to a screen data creation program, a screen data creation device, a programmable display system, a programmable display, and a screen data creation method.

[0002] A programmable display is known as a human-machine interface (HMI) for a programmable logic controller (PLC) that controls manufacturing equipment at manufacturing sites such as production lines and manufacturing plants. A user can monitor or operate the equipment through a display screen of the programmable display. Regarding such technology, for example, Patent Document 1 discloses a plant operation monitoring system that can remotely monitor and operate equipment within a plant.

[0003] Japanese Patent Application Laid-Open No. 2006-302316

[0004] In the programmable display device described above, there is a demand for reducing the effort required for the user to perform setting operations.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide a screen data creation program etc. that can reduce the effort required for setting up a programmable display device.

[0006] In order to achieve the above object, the screen data creation program of the present disclosure is a screen data creation program that creates screen data, which is data for a display screen displayed on a programmable display device, and causes a computer to function as: a screen setting unit that sets a video display area in which video captured by a camera is displayed on the display screen; an event setting unit that sets an event that is executed when the video is displayed in the video display area; and a screen data creation unit that creates screen data that indicates that the video display area set by the screen setting unit is displayed on the display screen and that the event set by the event setting unit is associated with a relative position with respect to the video display area.

[0007] In the present disclosure, a video display area is set on a display screen displayed on a programmable display device, in which an image captured by a camera is displayed, an event is set to be executed when the image is displayed in the video display area, and screen data is created that indicates that the video display area is displayed on the display screen and that the event is associated with a position relative to the video display area. Thus, according to the present disclosure, it is possible to reduce the effort required for setting up the programmable display device.

[0008] FIG. 1 is a diagram showing the configuration of a programmable display system according to the first embodiment; FIG. 2 is a block diagram showing the configuration of a screen data creation device according to the first embodiment; FIG. 3 is a diagram showing an example of a setting screen for a video display area in the screen data creation device according to the first embodiment; FIG. 4 is a diagram showing an example of camera data according to the first embodiment; FIG. 5 is a diagram showing an example of setting an event area in a video display area in the screen data creation device according to the first embodiment; FIG. 6 is a diagram showing an example of a trigger table according to the first embodiment; FIG. 7 is a diagram showing an example of gesture parameters according to the first embodiment; FIG. 8 is a diagram showing an example of an event content table according to the first embodiment; FIG. 1 is a block diagram showing the configuration of a programmable display according to the first embodiment; FIG. 2 is a diagram showing an example of pressing an event region on a programmable display according to the first embodiment; FIG. 3 is a diagram showing an example of displaying an alarm in the event region on a programmable display according to the first embodiment; FIG. 4 is a diagram showing an example of moving a video display region on a programmable display according to the first embodiment; FIG. 5 is a diagram showing an example of enlarging a video display region on a programmable display according to the first embodiment;

[0009] Hereinafter, embodiments will be described in detail with reference to the drawings, in which the same or corresponding parts are designated by the same reference numerals.

[0010] (First Embodiment) A control system 1 according to a first embodiment is a factory automation (FA) system installed at a manufacturing site such as a manufacturing line or manufacturing plant, and corresponds to a production system that produces products. The control system 1 performs various processes, such as processing, monitoring, and inspection, on products flowing through the manufacturing line.

[0011] 1, the control system 1 includes a plurality of cameras 5, a plurality of sensors 6, a plurality of servo amplifiers 7, a plurality of PLCs 10, a programmable display device 30, and a screen data creation device 50. The programmable display device 30 and the screen data creation device 50 are collectively referred to as a programmable display system.

[0012] Each of the multiple cameras 5 is a network camera installed at various locations in the manufacturing site. Each camera 5 captures images of products manufactured in the factory automation system, equipment installed in the manufacturing site, and the like. The images captured by each camera 5 are used for various purposes, such as product inspection and measurement. The images captured by each camera 5 may be still images or moving images. Furthermore, the images captured by each camera 5 may be real-time images or past recorded images.

[0013] The plurality of sensors 6 are installed at various locations in the manufacturing site and measure temperature, humidity, pressure, current value, voltage value, etc. The plurality of servo amplifiers 7 operate output devices such as actuators and arm robots.

[0014] Each of the multiple PLCs 10 is a controller for controlling a control object in the FA. Here, the control object is a manufacturing device, a conveying device, an inspection device, etc. installed at the manufacturing site, and includes a camera 5, a sensor 6, and a servo amplifier 7. Each PLC 10 transmits various control commands to each of the multiple control objects. For example, each PLC 10 transmits a control command to the servo amplifier 7 based on values ​​acquired by the camera 5 and the sensor 6, and operates the servo amplifier 7. In this way, each PLC 10 comprehensively controls the manufacturing line in the FA.

[0015] The programmable display 30 functions as a human-machine interface in the control system 1. The programmable display 30 is used to monitor, control, change settings, etc. of equipment at the manufacturing site. Here, the equipment at the manufacturing site refers to various equipment installed at the manufacturing site, including, for example, cameras 5, sensors 6, servo amplifiers 7, sequencers, etc. The programmable display 30 communicates with such equipment, can issue operation commands to the equipment, and can check the operating status of the equipment.

[0016] The programmable display 30 is communicably connected to a plurality of cameras 5, a plurality of sensors 6, a plurality of servo amplifiers 7, a plurality of PLCs 10, etc. via a communication network N and a hub 3. The communication network N is an industrial control network realized by communication lines installed at a manufacturing site. The communication network N may be, for example, a network based on USB (Universal Serial Bus) or EtherNET (registered trademark), or a network based on EtherCAT (registered trademark) or EtherNet / IP (registered trademark), which are used as industrial network protocols.

[0017] As an example, the programmable display device 30 displays a display screen 100 shown in Fig. 2 on the display unit 34. On the display screen 100, the programmable display device 30 displays a video display area 110. The video display area 110 is an area that displays video captured by a camera 5 associated with the video display area 110, among the multiple cameras 5. In the example of Fig. 2, the video display area 110 displays video captured of multiple products flowing on a production line and multiple devices installed at a production site.

[0018] In addition to this video display area 110, the programmable display device 30 displays objects OB such as switches, buttons, graphs, etc. on the display screen 100. The programmable display device 30 can display display objects and operation objects as objects OB on the display screen 100. Display objects are objects such as graphs, figures, numbers, character strings, etc. that represent the status of products, equipment, etc. The display objects allow users to remotely monitor the status of products, equipment, etc. at the manufacturing site. Operation objects are objects such as switches, buttons, etc. that are used to operate equipment. By operating the operation objects, users can send various control commands to the equipment.

[0019] <Screen Data Creation Device 50> The screen data creation device 50 is a device for creating screen data 500, which is data for the display screen 100 of the programmable display device 30. Here, the screen data 500 is data representing the image to be displayed on the display screen 100 of the programmable display device 30 and the manner in which the display content of the display screen 100 transitions. The screen data creation device 50 is also called an engineering tool. The user can use the screen data creation device 50 to freely design the configuration of the display screen 100 of the programmable display device 30.

[0020] More specifically, the screen data creation device 50 is a general-purpose or industrial computer such as a personal computer, a tablet terminal, etc. The screen data creation device 50 is communicatively connected to the programmable display device 30 via a USB cable, a local area network (LAN), or other communication line. As shown in FIG. 3 , the screen data creation device 50 includes a processor 51, a memory 52, an operation unit 53, a display unit 54, and a communication unit 55. These elements are connected via an internal bus.

[0021] The processor 51 includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), etc. The processor 51 executes programs stored in the memory 52 to realize various functions of the screen data creation device 50 and execute the processes described below.

[0022] The memory 52 includes a main memory, which is a volatile storage device such as a dynamic random access memory (DRAM) or a static random access memory (SRAM), and an auxiliary memory, which is a non-volatile storage device such as a read only memory (ROM) or a flash memory. Programs are loaded into the main memory from the auxiliary memory. The main memory is also used as a working area for the processor 51. The auxiliary memory stores various data used in processing by the processor 51. The auxiliary memory supplies the processor 51 with data used by the processor 51 in accordance with instructions from the processor 51, and stores data supplied from the processor 51.

[0023] Specifically, the memory 52 stores a screen data creation program 521, camera data 522, a trigger table 523, gesture parameters 524, an event content table 525, an event setting file 526, and screen data 500. These will be described in detail later.

[0024] The operation unit 53 includes input devices such as a touch panel, switches, and input keys, and receives operations from the user. The operation unit 53 acquires information input by the user and notifies the processor 51 of the acquired information.

[0025] The display unit 54 includes a display device such as a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The display unit 54 is driven by a display drive circuit (not shown), and displays various images according to instructions from the processor 51.

[0026] The communication unit 55 includes a communication interface circuit for communicating with an external device in accordance with a known communication standard such as USB or LAN. Specifically, the external device is the programmable display 30. The communication unit 55 receives a signal from the external device and outputs data indicated by the received signal to the processor 51. The communication unit 55 also transmits a signal indicating the data output from the processor 51 to the external device.

[0027] The processor 51 functionally includes a screen setting unit 511, an event setting unit 512, and a screen data creation unit 513. Each of these functions is realized in the processor 51 by software, firmware, or a combination of software and firmware. Specifically, the processor 51 realizes each function by executing a screen data creation program 521 stored in the memory 52. ​​The screen data creation program 521 is a program for creating screen data 500, which is data for the display screen 100 of the programmable display device 30.

[0028] The screen setting unit 511 sets the image display area 110 on the display screen 100 of the programmable display device 30, where the image captured by the camera 5 is displayed. Specifically, when the user operates the operation unit 53 to execute the screen data creation program 521, the screen setting unit 511 displays a creation screen for the screen data 500 on the display unit 54. On the creation screen for the screen data 500, the screen setting unit 511 first displays the image display area 110 as a reference.

[0029] 4 , the screen setting unit 511 displays a reference image display area 110 on the entire screen of the display unit 54. Here, the entire screen of the display unit 54 corresponds to the display screen 100 displayed on the display unit 34 of the programmable display device 30. The user assumes that the screen of the display unit 54 is the display screen 100 of the programmable display device 30, and arranges the image display area 110 and objects OB such as display objects and operation objects within the screen of the display unit 54. This allows the user to freely design the display screen 100 displayed on the programmable display device 30.

[0030] When the reference image display area 110 is displayed, the screen setting unit 511 selects a camera 5 that will display an image in the image display area 110 on the display screen 100. Specifically, the screen setting unit 511 displays, for example, camera data 522 as shown in FIG. 5 on the display unit 54. The camera data 522 is data in which the number of the camera 5 and identification information of the camera 5 are associated with each other for each of the multiple cameras 5 from which the programmable display device 30 can acquire images. The screen data creation device 50 acquires such camera data 522 in advance from the programmable display device 30 and stores it in the memory 52.

[0031] The user operates operation unit 53 to select a camera 5 from among the multiple cameras 5 defined in camera data 522, the camera 5 whose video is to be displayed in video display area 110 displayed on the creation screen. Screen setting unit 511 associates the camera 5 selected by the user in this manner with video display area 110 displayed on the creation screen.

[0032] 3 , the event setting unit 512 sets an event to be executed when a video is displayed in the video display area 110 set by the screen setting unit 511 on the display screen 100 of the programmable display device 30. Here, the event means a process that is executed when a predetermined trigger is established.

[0033] First, the event setting unit 512 sets the position of the event, which is a position associated with the event. Specifically, the event setting unit 512 sets a position relative to the video display area 110 as the position of the event. Here, the position relative to the video display area 110 means a position expressed by relative coordinates with any position on the video display area 110 as the reference. The event setting unit 512 sets a relative coordinate system within the screen with the video display area 110 as the reference.

[0034] 6, the event setting unit 512 sets an xy coordinate system with origin P1 at the top left position of the video display area 110. The event setting unit 512 sets the position of the event using coordinates determined by such an xy coordinate system.

[0035] More specifically, the event setting unit 512 sets an event region 120 within the video display region 110 as the position of the event. As shown in FIG. 6 , the user operates the operation unit 53, for example, by tracing on a touch panel or by dragging a cursor. This selects the range of the event region 120 within the video display region 110. In the example of FIG. 6 , the event setting unit 512 sets a rectangular region with a width w1 and a height h1 from the coordinates (x1, y1) as the event region 120. The event setting unit 512 sets the event region 120 within the video display region 110 based on such a user operation.

[0036] Here, the xy coordinate system is not a fixed coordinate system based on the entire screen, but a coordinate system relative to the video display area 110. Therefore, as will be described later, when the position or size of the video display area 110 is changed within the display screen 100, the xy coordinate system is changed accordingly. As a result, the position or size of the event area 120 determined by the xy coordinate system is also changed at the same rate as the video display area 110, following the change.

[0037] In this way, the event setting unit 512 sets the event region 120, which is represented by the xy coordinate system that is the coordinate system of the video display region 110, as the position of the event. The event region 120 is an example of a position relative to the video display region 110.

[0038] After setting the event area 120, the event setting unit 512 secondly sets an event trigger and the content of the event that will be executed when the event trigger is established. Here, the event trigger refers to the condition that triggers the occurrence of the event. The event setting unit 512 sets the event trigger from among multiple triggers defined in a trigger table 523 shown in FIG. 7 based on a user operation. The trigger table 523 defines candidate triggers that the event setting unit 512 can set.

[0039] Specifically, the trigger table 523 defines two types of triggers that can be set. The first type of trigger, a first trigger, is associated with the event area 120, in other words, a trigger associated with position information on the screen. In the example of Fig. 7, the trigger table 523 defines "pressing the event area 120," "gesture on the event area," etc. as the first trigger. In other words, the trigger table 523 defines a trigger that is established when a user operation is input on the event area 120 as the first trigger.

[0040] The second trigger, which is the second type of trigger, is a trigger that is not associated with the event region 120, in other words, a trigger that is not associated with position information on the screen. In the example of Fig. 7, the trigger table 523 defines "alarm occurrence", "gesture on the screen", etc. as the second trigger.

[0041] Here, "pressing the event area 120" corresponds to a user pressing within the range set in the event area 120. "Alarm generation" corresponds to the occurrence of some abnormality in a product, device, or the like at the manufacturing site. For example, when a sensor value such as temperature or voltage measured by the sensor 6 exceeds a predetermined allowable range, a trigger for generating an alarm is established.

[0042] A "gesture" refers to a specific operation such as tracing in a specific direction, such as right, left, up, or down, or a long press. Specifically, a gesture on the event area 120 corresponds to tracing the event area 120, long pressing the event area 120, etc. Furthermore, a gesture on the screen refers to a tracing operation, long pressing, etc. that may be performed on any position on the screen, not limited to the event area 120.

[0043] Here, parameters that serve as thresholds for determining whether a gesture has been made are defined as gesture parameters 524 shown in FIG. 8 . For example, a rightward swiping gesture is determined to have been made if the distance of the swiping is Tr or more. A leftward swiping gesture is determined to have been made if the distance of the swiping is Tl or more. The thresholds Tr and Tl may be, for example, a movement amount that is ¼ of the size of the video display area 110. A long press gesture is determined to have been made if the user presses the screen for a time period equal to or longer than Tk. Such parameters can be freely set by the user.

[0044] Note that the tracing operation on the event area 120 may end outside the range of the event area 120 as long as the tracing operation starts from a coordinate within the range of the event area 120. Furthermore, the direction of the tracing operation on the event area 120 or the screen is not limited to one direction, and an operation of drawing a shape such as a circle, triangle, or square can also be set as a gesture.

[0045] The event setting unit 512 can set an event trigger from among these two types of triggers. Once a trigger is set, the event setting unit 512 sets the content of the event that will be executed when the set trigger is established. Based on a user operation, the event setting unit 512 sets the content of the event from among a plurality of event contents defined in an event content table 525 shown in FIG. 9. The event content table 525 defines candidate event contents that the event setting unit 512 can set.

[0046] Specifically, the event content table 525 defines two types of content as settable event content, similar to triggers. The first type of content, or first content, is content associated with the event area 120, in other words, content associated with position information on the screen. In the example of Fig. 9, the event content table 525 defines, as the first content, "display the device status in the event area 120," "display an alarm in the event area 120," etc. In other words, the event content table 525 defines, as the first content, displaying an image corresponding to a trigger in the event area 120.

[0047] The second type of content, or second content, is content that is not associated with the event area 120, in other words, content that is not associated with position information on the screen. In the example of Fig. 9, the event content table 525 defines "display overlapping window," "control device," etc. as the second content.

[0048] Here, "display device status in event area 120" corresponds to displaying an image showing sensor values ​​such as the current temperature and voltage of the target device in the event area 120. "display alarm in event area 120" corresponds to displaying a warning image in the event area 120. "display overlap window" corresponds to displaying, for example, a device manual in an overlap window at any position on the screen. "control device" corresponds to sending a control command to the target device to switch operation ON / OFF, change the state, etc. Furthermore, if the target device is a camera 5, "control device" may also mean sending a change command to change the shooting direction of the camera 5.

[0049] The event setting unit 512 sets a trigger and an event content for the event area 120 by combining any one of the triggers defined in the trigger table 523 with any one of the event contents defined in the event content table 525. At this time, the event setting unit 512 combines the trigger and the event content such that at least one of the trigger and the event content is associated with the event area 120. Specifically, the event setting unit 512 sets a combination of a first trigger and the first event content, a combination of the first trigger and the second event content, or a combination of the second trigger and the first event content as the trigger and the event content for the event area 120.

[0050] After setting the event location, trigger, and content as event information in this manner, the event setting unit 512 generates an event setting file 526 that indicates the set information. As shown in Fig. 10 , the event setting file 526 associates the number of the camera 5 that displays video in the video display area 110 with the event information set in that video display area 110. The event information includes identification information and coordinate range of the event area 120, and the event trigger and content. Note that the event trigger and content in Fig. 10 are represented by numbers in the trigger table 523 and the event content table 525, respectively.

[0051] 10 shows an example in which one event is set for one camera 5, but the event setting unit 512 can set multiple events for one video display area 110. Every time the event setting unit 512 sets an event, it updates the event setting file 526 with information about the set event.

[0052] When an event is set by the event setting unit 512, the screen setting unit 511 sets the position and size of the video display area 110, in which the event area 120 is set, within the display screen 100 of the programmable display device 30. Specifically, the user operates the operation unit 53 to place the video display area 110, in which the event area 120 is set, within the screen. For example, as shown in Figure 11, the user places the video display area 110, in which the event area 120 is set, at coordinates (X1, Y1) in the XY coordinate system, which is the screen coordinate system, with a width W1 and a height H1. The width, height, and enlargement / reduction rate of the video display area 110 can be freely set.

[0053] Here, the XY coordinate system in which the position and size of video display area 110 are determined is a screen coordinate system fixed to the screen of display unit 54, and more specifically, is a coordinate system with origin P2 at the top left position of the screen. In contrast, the XY coordinate system in which the position and size of event area 120 are determined is, as described above, a coordinate system relative to video display area 110, with origin P1 at the top left position of video display area 110. Therefore, the position and size of event area 120 are automatically set to a position and size based on the position and size of video display area 110 after it has been placed on the screen.

[0054] Based on such user operations, the screen setting unit 511 sets the position and size of the video display area 110 within the display screen 100 of the programmable display device 30. As a result, one video display area 110, in which at least one event is set, is set within the display screen 100. Furthermore, as shown in FIG. 12 , in addition to the video display area 110, the screen setting unit 511 places objects OB such as switches, buttons, graphs, and figures based on user operations. In this way, the user can freely design the display screen 100 by placing various objects OB.

[0055] 3 , the screen data creation unit 513 creates screen data 500. The screen data 500 is data that represents an image to be displayed on the display screen 100 of the programmable display device 30 and how the display content on the display screen 100 changes. The screen data 500 is written to the programmable display device 30 and used for display processing on the display screen 100.

[0056] The screen data 500 includes information on the video display area 110 set by the screen setting unit 511 and information on the event set by the event setting unit 512. Specifically, the screen data 500 indicates that the video display area 110 set by the screen setting unit 511 is displayed on the display screen 100, and that the event set by the event setting unit 512 is associated with a position relative to the video display area 110.

[0057] More specifically, the screen data creation unit 513 creates, as the screen data 500, data representing information on the arrangement of the video display area 110 and the objects OB within the display screen 100 as shown in FIG. 12 , and information on the camera 5 and the event set in the video display area 110 in the event setting file 526. As described above, the information on the arrangement of the video display area 110 and the objects OB is expressed in the screen coordinate system. Furthermore, the event is associated with the event area 120, which is a relative position with respect to the video display area 110. At least one of the trigger and content of the event is associated with the event area 120. Therefore, the screen data creation unit 513 creates the screen data 500 in which such event information is set.

[0058] Next, the flow of the screen data creation process executed by the screen data creation device 50 will be described with reference to Fig. 13. The screen data creation process shown in Fig. 13 starts when the user operates the operation unit 53 to execute the screen data creation program 521. Note that the screen data creation process shown in Fig. 13 is an example of a screen data creation method.

[0059] When the screen data creation process starts, the processor 51 displays the reference image display area 110 (step S11). Specifically, the processor 51 displays the reference image display area 110 on the entire screen of the display unit 54, as shown in FIG.

[0060] When the video display area 110 is displayed, the processor 51 selects, based on the user's operation, a camera 5 from among the multiple cameras 5 under the control of the programmable display device 30 to display video in the video display area 110 (step S12).

[0061] When camera 5 is selected, processor 51 sets event region 120 in video display region 110 based on a user operation (step S13). Specifically, as shown in Fig. 6, processor 51 sets event region 120 at a relative position expressed by x and y coordinates, which are coordinates relative to video display region 110.

[0062] After setting the event region 120, the processor 51 sets the trigger and the content of the event (step S14). Specifically, the processor 51 references the trigger table 523 and the event content table 525 and sets the trigger and the event content so that at least one of the trigger and the event content is associated with the event region 120 set in step S13.

[0063] After setting the trigger and content of the event, the processor 51 determines, based on a user operation, whether or not to set a further event in the currently displayed video display area 110 (step S15). If a further event is to be set (step S15; YES), the processor 51 returns the process to step S13. The processor 51 then sets the event area 120 and the trigger and content of the event as information about the further event. The processor 51 stores the information about at least one event set in this way in the event setting file 526, associating it with the video display area 110.

[0064] If no further events are to be set (step S15; NO), processor 51 places video display area 110 on the screen based on a user operation (step S16). Specifically, as shown in Fig. 11, processor 51 places video display area 110, in which at least one event is set, at a position represented by the XY coordinate system, which is the screen coordinate system.

[0065] After arranging the video display area 110, the processor 51 further arranges objects OB, such as display objects and operation objects, on the screen based on the user's operation (step S17). Note that if the user does not arrange any objects OB, step S17 is omitted.

[0066] After arranging the video display area 110, the processor 51 creates screen data 500 (step S18). Specifically, the processor 51 generates the screen data 500 representing information related to the display screen 100 set in the processes of steps S11 to S17, and stores the generated screen data 500 in the memory 52. ​​The generated screen data 500 is transmitted to the programmable display device 30 at an appropriate timing. This completes the screen data generation process shown in FIG. 13.

[0067] <Programmable Display Device 30> Next, a description will be given of the configuration and operation of the programmable display device 30. The programmable display device 30 executes display processing of the display screen 100 based on the screen data 500 created by the screen data creating device 50.

[0068] 14, the programmable display device 30 includes a processor 31, a memory 32, an operation unit 33, a display unit 34, and a communication unit 35. These elements are connected via an internal bus. The hardware configuration of these units is similar to that of the processor 51, memory 52, operation unit 53, display unit 54, and communication unit 55 of the screen data creation device 50 described with reference to FIG. 3, so differences in functional configuration will be described below.

[0069] In the programmable display device 30, the communication unit 35 communicates with the screen data creation device 50 via a LAN, USB, Ethernet (registered trademark), etc. The communication unit 35 also communicates with a plurality of cameras 5, a plurality of PLCs 10, etc. via a communication network N. The memory 32 stores screen data 500. The screen data 500 is acquired from the screen data creation device 50 by the communication unit 35 communicating with the screen data creation device 50.

[0070] The processor 31 functionally comprises a display control unit 311 and an event execution unit 312. Each of these functions is realized in the processor 31 by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in the memory 32. The processor 31 then realizes each function by executing the programs stored in the memory 32.

[0071] The display control unit 311 displays the display screen 100 based on the screen data 500 acquired from the screen data creation device 50 on the display unit 34. Specifically, the display control unit 311 displays the video display area 110 and other objects OB shown in the screen data 500 in the arrangement shown in the screen data 500. As a result, the display control unit 311 displays the display screen 100 on which the video display area 110 and other objects are arranged on the display unit 34, for example, as shown in FIG.

[0072] More specifically, the display control unit 311 displays the video captured by the camera 5 in the video display area 110 on the display screen 100. More specifically, the display control unit 311 identifies, based on the screen data 500, a camera 5 selected from the multiple cameras 5 under the management of the programmable display device 30 to display the video in the video display area 110. The display control unit 311 communicates with the identified camera 5 via the communication unit 35 and the communication network N, and continuously acquires the video captured by the camera 5 at predetermined intervals. The display control unit 311 then displays the acquired video in the video display area 110 on the display screen 100.

[0073] The display control unit 311 makes the event area 120 set in the video display area 110 in the screen data 500 transparent, i.e., makes it invisible, so that it cannot be seen by the user. In FIG. 2, the frame of the event area 120 is shown with a dashed line for ease of understanding, but the display control unit 311 also displays the frame of the event area 120 transparently. This also applies to the subsequent figures. By not displaying the event area 120 in this way, it is possible to avoid the event area 120 impairing the visibility of the video.

[0074] 14 , when the display screen 100 is displayed by the display control unit 311, the event execution unit 312 executes an event associated with the event area 120, which is located relative to the video display area 110 on the display screen 100. The screen data 500 includes information about the event set in the event setting file 526 in the screen data creation device 50. The event execution unit 312 determines, based on the screen data 500, whether a trigger for the event set for the video display area 110 has been established. If the trigger has been established, the event execution unit 312 executes an event whose content is associated with the trigger in the screen data 500.

[0075] As a first example, a case will be described in which an event whose trigger is "pressing event area 120" and whose content is "control device" is set for video display area 110 displayed on display screen 100. In this case, event execution unit 312 determines whether event area 120 has been pressed. For example, if operation unit 33 has a touch panel, the user presses event area 120 by touching the position of event area 120 on display screen 100 with a finger, as shown in FIG. 15 .

[0076] When such an operation on the event area 120 is detected, the event execution unit 312 determines that a trigger has been established. In this case, the event execution unit 312 transmits a control command to the device displayed in the event area 120. As an example, the event execution unit 312 transmits a control command to turn the device on / off, a control command to change the state, or the like, via the communication unit 35. This allows the user to control the device displayed in the video with intuitive operations.

[0077] As a second example, a case will be described in which an event whose trigger is "alarm occurrence" and whose content is "display alarm in event area 120" is set for video display area 110 displayed on display screen 100. In this case, event execution unit 312 communicates with the device displayed in event area 120 via communication unit 35, and periodically monitors sensor values ​​such as the temperature and voltage of the device.

[0078] If the sensor value exceeds a predetermined allowable range as a result of monitoring, the event execution unit 312 determines that a trigger has occurred. In this case, the event execution unit 312 displays a warning image in the event area 120, as shown in Fig. 16. This allows the user to easily check the status of the device displayed in the video.

[0079] As another example (not shown), when the trigger is a "gesture on the event region 120," the event execution unit 312 determines whether an operation defined in the gesture parameters 524, such as tracing in a specific direction or a long press, has been performed on the event region 120. When the trigger is a "gesture on the screen," the event execution unit 312 determines whether an operation defined in the gesture parameters 524 has been performed on any position on the display screen 100.

[0080] Furthermore, if the event content is "display device status in event area 120," event execution unit 312 acquires sensor values ​​such as the current temperature and voltage of the device displayed in the event area 120, and displays an image showing the acquired sensor values ​​in the event area 120. If the event content is "display overlap window," event execution unit 312 displays an overlap window at any position within display screen 100, and displays the manual for the device displayed in the event area 120 within the overlap window.

[0081] On the display screen 100 on which such an event is executed, the user of the programmable display device 30 can operate the operation unit 33 to input a change operation to change the position or size of the video display area 110. When the change operation is input, the display control unit 311 changes the position or size of the video display area 110 in accordance with the input change operation. When the position or size of the video display area 110 on the display screen 100 is changed, the event is associated with a position relative to the video display area 110 after the position or size has been changed.

[0082] More specifically, as described above, the event area 120 is set at a position represented by an xy coordinate system, which is a coordinate system relative to the video display area 110. Therefore, when the position or size of the video display area 110 on the display screen 100 is changed, the display control unit 311 similarly changes the position and coordinate size of the origin P1 of the xy coordinate system. Accordingly, the position or size of the event area 120 is also changed to follow the position or size of the video display area 110.

[0083] As a first example, when a change operation to change the position of video display area 110 is input, display control unit 311 moves video display area 110 within display screen 100 in accordance with the input change operation, as shown in Fig. 17. In this case, display control unit 311 moves the position of event area 120 in the same direction and by the same amount as video display area 110.

[0084] As a second example, when a change operation to enlarge the size of video display area 110 is input, display control unit 311 enlarges the size of video display area 110 within display screen 100 in accordance with the input change operation, as shown in Fig. 18. In this case, display control unit 311 enlarges the size of event area 120 at the same enlargement rate as video display area 110. The same applies when reducing the size.

[0085] In this way, even if the position or size of the video display area 110 is changed, the positional relationship between the video and the event area 120 is maintained. Therefore, the event area 120 can adapt to changes in the video display area 110, and the user does not need to reset the event area 120. As a result, the user's effort in setting the event area 120 can be reduced.

[0086] Next, the flow of the display process executed by the programmable display device 30 will be described with reference to Fig. 19. The display process shown in Fig. 19 is started when the user operates the operation unit 33 to start up the programmable display device 30.

[0087] When the display process starts, the processor 31 reads the screen data 500 acquired from the screen data creation device 50 (step S21). After reading the screen data 500, the processor 31 acquires the image captured by the camera 5 (step S22). Specifically, the processor 31 communicates with the camera 5, which displays the image in the image display area 110 in the read screen data 500, via the communication unit 35, and acquires the image captured by the camera 5.

[0088] When the image from camera 5 is acquired, processor 31 displays display screen 100 based on the read screen data 500 (step S23). Processor 31 displays display screen 100, on which image display area 110 and other objects OB are arranged, on display unit 34, as shown in Fig. 2, for example. At this time, processor 31 displays the image acquired in step S22 in image display area 110.

[0089] When display screen 100 is displayed, processor 31 determines whether or not a trigger for any of the events set in video display area 110 on display screen 100 has been established (step S24). If a trigger has been established (step S24; YES), processor 31 executes an event whose content corresponds to the established trigger (step S25). On the other hand, if a trigger has not been established (step S24; NO), processor 31 skips step S25.

[0090] Next, processor 31 determines whether a change operation to change the position or size of video display area 110 on display screen 100 has been received from the user (step S26). If a change operation has been received (step S26; YES), processor 31 changes the position or size of video display area 110 on display screen 100 in accordance with the received change operation (step S27). At this time, the position or size of event area 120 is changed in accordance with the change in position or size of video display area 110, as shown in Figures 17 and 18. On the other hand, if a change operation has not been received (step S26; NO), processor 31 skips step S27.

[0091] Thereafter, processor 31 returns the process to step S24. Then, processor 31 executes an event with the corresponding content each time any of the triggers set in video display area 110 on display screen 100 is established. Furthermore, processor 31 changes the position or size of video display area 110 in accordance with the accepted change operation each time a change operation is accepted. In this way, processor 31 repeats the processes of steps S24 to S27 while programmable display device 30 is operating normally.

[0092] As described above, the screen data creating device 50 according to the first embodiment sets the video display area 110 in which the video captured by the camera 5 is displayed and an event, and creates screen data 500 that indicates that the set video display area 110 is displayed on the display screen 100 and that the set event is associated with a relative position with respect to the video display area 110. The programmable display device 30 according to the first embodiment then displays the display screen 100 based on the screen data 500 created by the screen data creating device 50.

[0093] In this way, because events are not defined in the screen coordinate system but are associated with relative positions with respect to the video display area 110, the positional relationship between the video displayed in the video display area 110 and the events can be maintained even if the position or size of the video display area 110 is changed. Therefore, the user does not need to reset the events even if the position or size of the video display area 110 is changed. As a result, the user's setup work can be reduced, and the usability of the programmable display device 30 can be improved.

[0094] In particular, in recent manufacturing sites, there has been an increasing need to use cameras 5 for purposes such as quality control, people search, and crime prevention. However, the display screen 100 of the programmable display device 30 is not specialized for displaying images from the camera 5. When a user at a manufacturing site wants to check the image from the camera 5 in detail, they often enlarge the image display area 110 to display the image over the entire display screen 100, or move the position of the image display area 110. The programmable display device 30 according to the first embodiment can reduce the effort required for the user to perform setting operations when changing the position or size of the image display area 110 in this way.

[0095] (Embodiment 2) Next, a description will be given of embodiment 2. Descriptions of the same configurations and functions as those of embodiment 1 will be omitted where appropriate.

[0096] In the first embodiment, the programmable display device 30 displays one image captured by one camera 5 in the image display area 110. In contrast, in the second embodiment, the programmable display device 30 displays multiple images captured by multiple cameras 5 in the image display area 110.

[0097] In the second embodiment, on the display screen 100 of the programmable display device 30, the image displayed in the image display area 110 from among the multiple images captured by the multiple cameras 5 is switched in response to a user operation. Specifically, as shown in Fig. 20 , the display control unit 311 switches the image displayed in the image display area 110 between two images captured by two different cameras 5. Note that the display control unit 311 may switch between images captured by three or more cameras 5 and display them in the image display area 110.

[0098] The screen data creation device 50 creates data of such a display screen 100 as screen data 500. First, in the screen data creation device 50, the screen setting unit 511 sets the image display area 110 in which a plurality of images captured by a plurality of cameras 5 are displayed.

[0099] Screen setting unit 511 selects a plurality of cameras 5 from which images are to be displayed in image display area 110. Specifically, the user operates operation unit 53 to select a plurality of cameras 5 from among the plurality of cameras 5 defined in camera data 522, the plurality of cameras 5 from which images are to be displayed in image display area 110. Screen setting unit 511 associates the plurality of cameras 5 selected by the user in this manner with image display area 110.

[0100] The event setting unit 512 sets an event individually for each of the multiple cameras 5 whose video is to be displayed in the video display area 110 set by the screen setting unit 511. In other words, the event setting unit 512 sets an event individually for each of the multiple cameras 5 whose video is to be displayed in the video display area 110.

[0101] Specifically, the event setting unit 512 sets an event area 120, which is a relative position with respect to the video display area 110, as well as an event trigger and content, for each of the multiple cameras 5 that are the target. The method of setting an event for one camera 5 is the same as in embodiment 1. The event setting unit 512 can set different event areas 120 for each of the multiple cameras 5 that are the target, and can set different event triggers and content. Note that the event setting unit 512 may set only one event for one camera 5, or may set multiple events.

[0102] When the event setting unit 512 sets at least one event for each camera 5, it generates an event setting file 526 that indicates information about the set events. As an example, when two cameras 5 numbered 1 and 2 are selected as the cameras 5 whose images are to be displayed in the image display area 110, the event setting unit 512 generates the event setting file 526 shown in Fig. 21. In the example of Fig. 21, one event is set for the camera 5 numbered "1," and two events are set for the camera 5 numbered "2."

[0103] The screen data creation unit 513 creates screen data 500 that represents the information set by the screen setting unit 511 and the event setting unit 512. In other words, the screen data creation unit 513 creates screen data 500 that represents that the video display area 110 set by the screen setting unit 511 is displayed on the display screen 100, and that the event set by the event setting unit 512 is associated with a position relative to the video display area 110.

[0104] In the programmable display device 30, the display control unit 311 displays the display screen 100 based on the screen data 500 created by the screen data creation device 50. Then, when an image is displayed in the image display area 110 on the display screen 100, if the trigger of any of the events associated with the camera 5 that captured the image is established, the event execution unit 312 executes the event.

[0105] The display control unit 311 displays a first video captured by the first camera 5 in the video display area 110, as shown in the display screen 100 in the upper part of Fig. 20. In this example, one event area 120 is set in the first video, and one event is associated with the first camera 5. Therefore, when the trigger for that one event is established, the event execution unit 312 executes that event.

[0106] In this case, when the user operates the operation unit 33 to input a switching operation to switch the video, the display control unit 311 displays a second video captured by a second camera 5 different from the first camera 5 in the video display area 110, as shown in the display screen 100 at the bottom of Fig. 20. In this example, two event areas 120 are set in the second video, and two events are associated with the second camera 5. Therefore, when a trigger for one of the two events is established, the event execution unit 312 executes the event corresponding to that trigger.

[0107] Each time the user inputs a switching operation, the display control unit 311 switches the display screen 100 between the screen shown in the upper part of Fig. 20 and the screen shown in the lower part of Fig. 20. Here, the switching operation is, for example, an operation in which the user traces the display screen 100 in a specific direction such as right, left, up, or down.

[0108] Note that the event setting unit 512 may set a switching operation as one of the triggers of an event, and set, as the content of the event corresponding to the trigger, a process of switching the video displayed in the video display area 110. For example, the event setting unit 512 may set, as the trigger of an event associated with the first camera 5, a gesture on the event area 120 or the screen, and set, as the content of the event, a process of switching the video displayed in the video display area 110 to the video captured by the second camera 5. The same applies to the event associated with the second camera 5.

[0109] As described above, the programmable display device 30 according to the second embodiment displays a plurality of videos captured by a plurality of cameras 5 in a switchable manner in the video display area 110. An event associated with the relative position of each of the plurality of cameras 5 in the video display area 110 is set individually for each of the cameras 5. Because an event is set for each camera 5, when the displayed video is switched, the executable events are automatically switched to the events associated with the camera 5 of the switched-to video. Therefore, when the video is switched, the user does not need to reset the events, improving usability.

[0110] Third Embodiment Next, a third embodiment will be described. Descriptions of the same configurations and functions as those of the first and second embodiments will be omitted where appropriate.

[0111] The programmable display device 30 according to the second embodiment switches between and displays multiple images captured by multiple cameras 5 in the image display area 110. In contrast, the programmable display device 30 according to the third embodiment simultaneously displays multiple images captured by multiple cameras 5 in the image display area 110.

[0112] More specifically, the display control unit 311 divides one video display area 110 on the display screen 100 into a plurality of partial areas, and displays, in the plurality of partial areas, videos captured by a plurality of different cameras 5. As an example, as shown in Fig. 22 , the display control unit 311 simultaneously displays videos captured by two different cameras 5 in one video display area 110. Note that the display control unit 311 may simultaneously display three or more videos in one video display area 110.

[0113] Even when multiple images are displayed simultaneously in one image display area 110 in this way, events are set for each camera 5, which improves usability when changing the position or size of the image display area 110, switching images, etc.

[0114] (Fourth Embodiment) Next, a fourth embodiment will be described. Descriptions of the same configurations and functions as those of the first to third embodiments will be omitted where appropriate.

[0115] The programmable display device 30 according to the fourth embodiment can reconfigure the event area 120 set by the event setting unit 512 on the display screen 100 in response to a user operation. The user of the programmable display device 30 can operate the operation unit 33 to input an edit start operation to start editing the event area 120 set in the video display area 110 displayed on the display screen 100. When an edit start operation is input while the video display area 110 is displayed on the display screen 100, the display control unit 311 transitions to an edit mode for the event area 120.

[0116] Specifically, as shown in FIG. 23 , in the edit mode, the user operates the operation unit 33 to select an event area 120 to be reset within the video display area 110. Then, the user selects an area within the video display area 110 that is different from the event area 120 to be reset as the new event area 120. The user selects the new event area 120, for example, by tracing the hatched area in FIG. 23 with their finger on the touch panel. The display control unit 311 sets the area selected by the user in this manner as the new event area 120. Note that the trigger and content of the event to be set in the new event area 120 may be the same as those of the original event area 120, or may be reconfigurable. Information about the reset event is saved in the screen data 500.

[0117] By this processing, the position or size of the event area 120 set in the screen data creation device 50 can be reset in the programmable display device 30. In the screen data creation device 50, the screen data creation unit 513 creates screen data 500 that indicates that the event area 120 is reset in response to a user operation on the display screen 100 by this processing.

[0118] The event setting unit 512 may set the edit start operation as one of the triggers of the event, and may set a process of transitioning to the edit mode as the content of the event corresponding to the trigger. For example, the event setting unit 512 may set an operation such as pressing or a gesture on the event area 120 to be reset as a trigger for executing the event of transitioning to the edit mode.

[0119] (Embodiment 5) Next, a description will be given of embodiment 5. Descriptions of the same configurations and functions as those of embodiments 1 to 4 will be omitted where appropriate.

[0120] In the above-described first to fourth embodiments, the display control unit 311 hides the event area 120 set in the video display area 110 in the screen data 500 so that the user cannot see it. In contrast, in the fifth embodiment, the display control unit 311 switches between displaying and hiding the event area 120 on the display screen 100 in response to a user operation.

[0121] Specifically, when the video display area 110 is displayed on the display screen 100 by the display control unit 311, the user operates the operation unit 33 to input a switching operation to switch between displaying and hiding the event area 120. If a switching operation is input when the event area 120 set in the video display area 110 is not displayed, the display control unit 311 visualizes the event area 120, thereby displaying the event area 120. On the other hand, if a switching operation is input when the event area 120 is displayed, the display control unit 311 switches the event area 120 from visible to hidden.

[0122] Here, the visualization mode of the event region 120 may be any mode that is visible to the user, such as coloring the frame or the entire region of the event region 120 or blinking. In the screen data creation device 50, the screen data creation unit 513 creates screen data 500 that indicates that the event region 120 can be switched between displayed and hidden in response to a user operation on the display screen 100 through such processing.

[0123] By temporarily visualizing the event area 120 in this manner, it is possible to easily confirm which part of the video display area 110 the event is set in. In particular, even a user other than the user who set the event area 120 can confirm the position of the event area 120 set in the video display area 110. Furthermore, by temporarily visualizing the event area 120, it is possible to improve convenience when resetting the event area 120, as described in the fourth embodiment.

[0124] The event setting unit 512 may set a switching operation for switching between displaying and hiding the event area 120 as one of the triggers of the event, and may set, as the content of the event corresponding to the trigger, a process for switching between displaying and hiding the event area 120. For example, the event setting unit 512 may set a gesture such as a long press or a tracing operation on the screen as a trigger.

[0125] (Modifications) Although the embodiments have been described above, it is possible to combine the embodiments, or to modify or omit the embodiments as appropriate.

[0126] For example, in the above embodiment, the event setting unit 512 sets the event region 120 as the location of the event. However, the event setting unit 512 may set the event region as a point, not limited to a region having a two-dimensional extent, as long as the position is relative to the video display region 110 on the display screen 100.

[0127] In the above embodiment, in the screen data creation device 50, the processor 51 executes a program to function as the screen setting unit 511, the event setting unit 512, and the screen data creation unit 513. In the programmable display device 30, the processor 31 executes a program to function as the display control unit 311 and the event execution unit 312. However, the processors 51 and 31 may be dedicated hardware. Dedicated hardware may be, for example, a single circuit, a composite circuit, a programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof. When the processors 51 and 31 are dedicated hardware, the functions of each unit may be realized by separate hardware, or the functions of each unit may be realized together by a single piece of hardware.

[0128] In addition, some of the functions of each unit may be realized by dedicated hardware, and other parts may be realized by software or firmware. In this way, the processors 51 and 31 can realize each of the above-mentioned functions by hardware, software, firmware, or a combination of these.

[0129] By applying an operating program that specifies the operation of the screen data creation device 50 or the programmable display device 30 to an existing computer such as a personal computer or information terminal device, it is also possible to make the computer function as the screen data creation device 50 or the programmable display device 30.

[0130] Furthermore, the method of distribution of such a program is arbitrary, and for example, it may be stored on a computer-readable recording medium such as a CD-ROM (Compact Disk ROM), a DVD (Digital Versatile Disk), an MO (Magneto Optical Disk), or a memory card and distributed, or it may be distributed via a communication network such as the Internet.

[0131] The present disclosure allows various embodiments and modifications without departing from the broad spirit and scope of the present disclosure. Furthermore, the above-described embodiments are intended to illustrate the present disclosure and do not limit the scope of the present disclosure. That is, the scope of the present disclosure is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and the meaning of equivalent disclosures are considered to be within the scope of the present disclosure.

[0132] 1 Control system, 3 Hub, 5 Camera, 6 Sensor, 7 Servo amplifier, 10 PLC, 30 Programmable display, 31, 51 Processor, 32, 52 Memory, 33, 53 Operation unit, 34, 54 Display unit, 35, 55 Communication unit, 50 Screen data creation device, 100 Display screen, 110 Video display area, 120 Event area, 311 Display control unit, 312 Event execution unit, 500 Screen data, 511 Screen setting unit, 512 Event setting unit, 513 Screen data creation unit, 521 Screen data creation program, 522 Camera data, 523 Trigger table, 524 Gesture parameters, 525 Event content table, 526 Event setting file, N Communication network, OB Object

Claims

1. A screen data creation program for creating screen data, which is data for a display screen to be displayed on a programmable display device, causing a computer to function as: a screen setting unit that sets an image display area on said display screen where an image captured by a camera is to be displayed; an event setting unit that sets an event that is executed when said image is displayed in said image display area; and a screen data creation unit that creates screen data that indicates that said image display area set by said screen setting unit is displayed on said display screen and that said event set by said event setting unit is associated with a relative position with respect to said image display area.

2. The screen data creation program according to claim 1, wherein the event setting unit sets a trigger for the event and the content of the event that is executed when the trigger is established, and at least one of the trigger and the content of the event is associated with the relative position.

3. The screen data creation program according to claim 2, wherein the trigger is associated with the relative position, and the event setting unit sets the trigger to be established when a user operation is input at the relative position on the display screen.

4. A screen data creation program as described in claim 2 or 3, wherein the content of the event is associated with the relative position, and the event setting unit sets the content of the event to display an image corresponding to the trigger at the relative position on the display screen.

5. A screen data creation program as claimed in any one of claims 1 to 4, wherein the screen data creation unit creates screen data indicating that when the position or size of the video display area on the display screen is changed, the event set by the event setting unit is associated with the relative position with respect to the video display area after the position or size has been changed.

6. A screen data creation program as described in any one of claims 1 to 5, wherein the screen setting unit sets the video display area in which multiple videos taken by multiple cameras are displayed, the event setting unit sets the event individually for each of the multiple cameras, and the screen data creation unit creates the screen data indicating that the video display area set by the screen setting unit is displayed on the display screen and that the event set for each of the multiple cameras by the event setting unit is associated with a relative position with respect to the video display area.

7. The screen data creation program according to claim 6, wherein the screen data creation unit creates the screen data indicating that the image displayed in the image display area of ​​the display screen, among the plurality of images, can be switched in response to a user operation.

8. A screen data creation program according to any one of claims 1 to 7, wherein the screen data creation unit creates the screen data indicating that the relative position is reset on the display screen in response to a user operation.

9. A screen data creation program according to any one of claims 1 to 8, wherein the screen data creation unit creates the screen data indicating that the relative position can be switched between displayed and hidden on the display screen in response to a user operation.

10. A screen data creation device that creates screen data, which is data for a display screen to be displayed on a programmable display device, comprising: a screen setting unit that sets a video display area in which video captured by a camera is to be displayed on the display screen; an event setting unit that sets an event that is executed when the video is displayed in the video display area; and a screen data creation unit that creates screen data that indicates that the video display area set by the screen setting unit is displayed on the display screen and that the event set by the event setting unit is associated with a relative position with respect to the video display area.

11. A programmable display system comprising: the screen data creation device according to claim 10; and a programmable display that displays the display screen based on the screen data created by the screen data creation device.

12. A programmable display that displays a display screen based on screen data created by a screen data creation device, comprising: a display control unit that displays an image captured by a camera in an image display area on the display screen; and an event execution unit that executes an event associated with a relative position with respect to the image display area when the image is displayed in the image display area by the display control unit.

13. A screen data creation method for creating screen data, which is data for a display screen to be displayed on a programmable display device, comprising: setting an event to be executed when an image captured by a camera is displayed in an image display area; and creating the screen data that indicates that the image display area is displayed on the display screen and that the event is associated with a relative position with respect to the image display area.

Images