Programmable display apparatus, screen synchronization system, and screen synchronization method

Abstract

A programmable display apparatus (1) comprises a display unit (10) and a control device. If having permitted the connection of remote appliances (2A, 2B) in a synchronous mode and permitted the connection of a remote appliance (2C) in an asynchronous mode, the control device prohibits the operation of a same content area on the screen of another appliance, from among the programmable display apparatus (1) and the remote appliances (2A-2C), other than an operated appliance of which the screen is being operated, the same content area containing the same content as the screen of the operated appliance.

Description

Programmable display, screen synchronization system, and screen synchronization method

[0001] The present invention relates to a programmable display, a screen synchronization system, and a screen synchronization method.

[0002] Patent Document 1 discloses a control system including a programmable logic controller (PLC), a management device, and multiple human machine interface (HMI) devices. The management device acquires necessary data from the PLC and creates screen data for the multiple HMI devices to create operation and monitoring screens. The control system has a non-occupied mode in which all of the multiple HMI devices can accept user operations, and an occupied mode in which only a specific HMI device can accept user operations.

[0003] When a user performs an exclusive operation on one of the multiple HMI devices, only operations on the HMI device on which the exclusive operation was performed will be accepted. In the exclusive mode, the management device has a function to disable user operations on HMI devices other than the HMI device on which the exclusive operation was performed.

[0004] Japanese Patent Application Publication No. 2014-085782

[0005] The control system disclosed in Patent Document 1 does not anticipate enabling or disabling user operations on the same content area of ​​a screen that has the same content between a management device and multiple HMI devices. One aspect of the present invention aims to prevent simultaneous operations on the same content area of ​​a screen that includes the same content area between a programmable display device and multiple remote devices.

[0006] In order to solve the above problem, one aspect of the present invention provides a programmable display that can be connected to multiple remote devices including a first remote device and a second remote device, and includes a display unit that displays a screen, and a control device that allows each of the multiple remote devices to connect in synchronous mode or asynchronous mode, wherein the synchronous mode is a mode in which the remote device displays a synchronized screen that is at least partially synchronized with the display screen displayed by the display unit, and the asynchronous mode is a mode in which the remote device is allowed to display a screen other than the synchronized screen, and the control device allows the first remote device to connect in synchronous mode and a second remote device to connect in asynchronous mode, and in a first case in which the control device allows the first remote device to connect in synchronous mode and a second remote device to connect in asynchronous mode, and when the second remote device is displaying a screen that has at least partially the same content as the display screen, the control device prohibits operation of a same content area of ​​the screen displayed by the first other device, which has the same content as the screen displayed by the first operating device, for a first other device among the programmable display, the first remote device, and the second remote device, other than the first operating device whose screen is being operated.

[0007] Furthermore, a screen synchronization method according to one aspect of the present invention is a screen synchronization method for synchronizing screens using a programmable display device connectable to multiple remote devices including a first remote device and a second remote device, the method including: a display step of displaying a screen on a display unit of the programmable display device; and a connection step of permitting connection in a synchronous mode or asynchronous mode for each of the multiple remote devices, wherein the synchronous mode is a mode in which the remote devices display a synchronized screen at least partially synchronized with the display screen displayed by the display unit, and the asynchronous mode is a mode in which the remote devices are permitted to display a screen other than the synchronized screen, and when connection of the first remote device is permitted in the synchronous mode and connection of the second remote device is permitted in the asynchronous mode, and when the second remote device is displaying a screen at least partially identical to the display screen, the screen synchronization method further includes a prohibition step of prohibiting other devices among the programmable display device, the first remote device, and the second remote device, other than the operating device whose screen is being operated, from operating a same content area of ​​the screen displayed by the other device, the same content area having the same content as the screen displayed by the operating device.

[0008] According to one aspect of the present invention, simultaneous operations on the same content area of ​​a screen including the same content area with the same content can be prevented between a programmable display device and a plurality of remote devices.

[0009] 1 is a block diagram showing an example of the configuration of a screen synchronization system, a PLC, and devices according to an embodiment of the present invention. FIG. 1 is a diagram showing an example of communication between a programmable display and a remote device in the screen synchronization system shown in FIG. 1. FIG. 2 is a diagram showing another example of communication between a programmable display and a remote device in the screen synchronization system shown in FIG. 2. FIG. 3 is a diagram for explaining prohibition of operation on the same content area of ​​the screen in the screen synchronization system shown in FIG. 1. FIG. 4 is a flow chart showing a process in which a control device included in the programmable display shown in FIG. 1 permits an operation on a screen displayed by the remote device. FIG. 5 is a timing chart showing a process in which a control device included in the programmable display shown in FIG. 1 or a control device included in the remote device permits or prohibits an operation on a screen displayed by the remote device. FIG. 6 is a flowchart showing a process in which a control device included in the programmable display shown in FIG. 1 or a control device included in the remote device overlaps an image of identification information and an image of operation on the screen.

[0010] 1 is a block diagram showing an example of the configuration of a screen synchronization system 100, a PLC 3, and a device 4 according to an embodiment of the present invention. The following description will mainly focus on the screen synchronization system 100, but will also include a description of a screen synchronization method for synchronizing screens using a programmable display device 1.

[0011] 1, the screen synchronization system 100 includes a programmable display device 1 and multiple remote devices 2A, 2B, 2C, 2D, and 2E. The screen synchronization system 100 may further include remote devices other than the remote devices 2A to 2E. The screen synchronization system 100 is a system in which at least a portion of the screens displayed by each of the multiple remote devices 2A to 2E can be synchronized with the display screen displayed by the programmable display device 1.

[0012] (Programmable display device 1) The programmable display device 1 includes a display unit 10, an input unit 11, a storage unit 12, an interface unit 13, and a control device 14. The programmable display device 1 is connectable to a plurality of remote devices including remote devices 2A to 2E and a PLC 3. The programmable display device 1 communicates with the PLC 3 by being connected to the PLC 3 via a communication cable. The programmable display device 1 also communicates with the remote devices 2A to 2E via wireless communication.

[0013] The programmable display device 1 is a dedicated computer that displays screens for operation and display, thereby realizing operation and display functions specific to the programmable display device, and is used as an HMI device. The programmable display device 1 also functions as a server.

[0014] The display unit 10 displays a display screen for operating and displaying the device 4 or a display screen showing the state of the device 4 (display step). The input unit 11 is, for example, a touch panel that receives input of a touch operation by a user and is provided so as to overlap the display unit 10.

[0015] The storage unit 12 stores screen files that define the display screens to be displayed on the display unit 10. The screen files are files in a file format called a project, which includes multiple screens, each of which includes at least one object. The interface unit 13 is a communication unit that enables the programmable display device 1 to communicate with multiple remote devices, including the remote devices 2A to 2E, and the PLC 3.

[0016] The control device 14 executes an operation of displaying the state of the device 4 connected to the PLC 3 and an operation of controlling the state of the device 4 in response to an operation on the input unit 11. The control device 14 also permits connection in synchronous mode or asynchronous mode to each of the multiple remote devices including the remote devices 2A to 2E (connection step).

[0017] The synchronous mode is a mode in which a synchronized screen that is at least partially synchronized with the display screen displayed by the display unit 10 is displayed on the remote device, and the asynchronous mode is a mode in which the remote device is permitted to display a screen other than the synchronized screen. "Synchronization" means that the content of multiple synchronized screens matches and the timing at which the content changes is approximately synchronized. Note that "synchronization" also includes a case in which a time lag occurs in the timing at which the content changes due to communication speed. Note that the synchronous mode may also be a mode in which only the synchronized screen is displayed on the remote device.

[0018] The PLC 3 is a control device that reads out the status of the device 4 at predetermined scan times in accordance with a sequence program created by a user and issues control instructions to the device 4. The device 4 may include, for example, input devices such as sensors or switches, and output devices such as actuators, relays, solenoid valves, or displays.

[0019] (Remote Devices 2A to 2E) The remote device 2A is a terminal device that can be connected to and communicate with the programmable display device 1. The remote device 2A is also a terminal device that can execute an operation to display the state of the device 4 via the programmable display device 1 by operating the screen displayed by the remote device 2A, and an operation to control the state of the device 4 in response to an operation on the touch panel 21.

[0020] A plurality of remote devices including remote devices 2A to 2E are connected to the programmable display device 1, and each of a plurality of users can use each remote device to remotely operate the controlled device 4 or monitor the status of the controlled device 4. A portable device such as a tablet terminal is suitable as a device that constitutes the remote device 2A, but a device such as a personal computer may also be used.

[0021] The remote device 2A includes a display panel 20, a touch panel 21, a data memory 22, an interface unit 23, and a control device 24. The display panel 20 is a display unit capable of displaying a synchronized screen at least part of which is synchronized with the display screen displayed by the display unit 10 of the programmable display device 1. The display panel 20 is also capable of displaying a screen other than the synchronized screen.

[0022] The touch panel 21 is an input unit that accepts touch operation input by the user and is provided so as to overlap the display panel 20. The data memory 22 stores the contents of processing by the control device 24. The interface unit 23 is a communication unit that enables the remote device 2A to communicate with the programmable display device 1. The control device 24 controls each unit of the remote device 2A.

[0023] The remote device 2A may include, for example, a mouse and keyboard as an input unit instead of the touch panel 21. In this case, the mouse and keyboard accept input of operations by the user. The remote devices 2B to 2E have the same configuration as the remote device 2A. That is, like the remote device 2A, the remote devices 2B to 2E include a display panel 20, a touch panel 21, a data memory 22, an interface unit 23, and a control device 24.

[0024] (Communication Between the Programmable Display Device 1 and the Remote Devices 2A to 2E) Figure 2 is a diagram showing an example of communication between the programmable display device 1 and the remote devices 2A to 2E in the screen synchronization system 100 shown in Figure 1. Hereinafter, it is assumed that the control device 14 of the programmable display device 1 allows connection of the remote devices 2A and 2B in synchronous mode, and allows connection of the remote devices 2C to 2E in asynchronous mode. Figure 2 mainly describes the case where the device whose screen is being operated is the remote device 2A connected to the programmable display device 1 in synchronous mode.

[0025] The screens displayed by the remote devices 2A and 2B connected to the programmable display device 1 in synchronous mode change in accordance with the change in the display screen displayed by the programmable display device 1. The remote devices 2C to 2E connected to the programmable display device 1 in asynchronous mode maintain the display of the currently displayed screen unless an operation is performed by the user, regardless of the change in the display screen displayed by the programmable display device 1.

[0026] (Display state of the screen of each device) As shown in Figure 2, the display unit 10 of the programmable display device 1 displays screen P1, which is an example of a display screen. Screen P1 has areas 30, 31, 32, and 33. Screen P1 is a screen that defines a composite image formed by overlapping multiple layer images. Screens PA, PB, PC, and PD, which will be described later, are also screens that define a composite image formed by overlapping multiple layer images. Areas 30 to 33 overlap each other, and each of areas 30 to 33 defines a layer image.

[0027] Area 30 is an area that defines images that display objects for operating device 4 and objects that indicate the status of device 4. Area 31 is an area that defines images of input keys that allow the user to input numerical values ​​by touching input unit 11. Area 31 overlaps area 30, and is an area that defines an image of a pop-up display that appears in response to a touch operation by the user while area 30 is displayed. Areas 32 and 33 will be described later.

[0028] The display panel 20 of the remote device 2A displays a screen PA. The screen PA has areas 30A and 31A. The areas 30A and 31A overlap each other, and each of the areas 30A and 31A defines a layer image. The screen PA is a synchronized screen at least part of which is synchronized with the screen P1 displayed by the programmable display device 1. A screen PB, which will be described later, is also a synchronized screen. The area 30A is synchronized with the area 30 included in the screen P1, and the area 31A is synchronized with the area 31 included in the screen P1.

[0029] The display panel 20 of the remote device 2B displays a screen PB. The screen PB has areas 30B, 31B, 32B, and 33B. Areas 30B to 33B overlap one another, and each of the areas 30B to 33B defines a layer image. Area 30B is an area synchronized with area 30 included in screen P1, and area 31B is an area synchronized with area 31 included in screen P1. Areas 32B and 33B will be described later.

[0030] The display panel 20 of the remote device 2C displays a screen PC. The screen PC has areas 30C, 31C, 32C, and 33C. Areas 30C to 33C overlap each other, and each of areas 30C to 33C defines a layer image. Area 30C has the same content as area 30 included in screen P1, and area 31C has the same content as area 31 included in screen P1. Areas 32C and 33C will be described later.

[0031] The display panel 20 of the remote device 2D displays a screen PD. The screen PD has areas 40D, 41D, and 42D. Areas 40D to 42D overlap each other, and each of the areas 40D to 42D defines a layer image. The screen PD is a screen separate from the synchronized screen. Area 40D is an area that defines an image displaying an object for operating the device 4 and an object indicating the status of the device 4. Areas 41D and 42D will be described later.

[0032] The display panel 20 of the remote device 2E displays a screen PE. The screen PE has an area 40E. The screen PE is a screen having at least a portion of the same content as the screen PD displayed on the display panel 20 of the remote device 2D. The content of the area 40E is the same as the content of the area 40D included in the screen PD.

[0033] (Communication when a touch operation is performed) When a user A1 of the remote device 2A performs a touch operation on the touch panel 21 of the remote device 2A, the control device 24 of the remote device 2A transmits operation request data to the programmable display device 1. An example of the contents of the operation request data is shown in Table 1 below. Table 1 shows the item name, data type, and numerical value range.

[0034] In Table 1, the operation type indicates the type of touch operation. The X coordinate is the coordinate position of the touch operation in the X direction defined within the screen. The X direction is the horizontal direction of the screen. The Y coordinate is the coordinate position of the touch operation in the Y direction defined within the screen. The Y direction is the vertical direction of the screen. The X direction and the Y direction are perpendicular to each other.

[0035] The latitude of the location information is the latitude of the location information of the operating device whose screen is being operated. Hereinafter, among the programmable display device 1 and the remote devices 2A to 2E, the device whose screen is being operated will be referred to as the operating device, and devices other than the operating device will be referred to as other devices. The longitude of the location information is the longitude of the location information of the operating device. The touch identification ID is an ID assigned to each touch operation and identifies the touch operation. The data type of the operation request data shown in Table 1 is a numeric value. The latitude and longitude of the location information of the operating device are acquired by the operating device. Other devices other than the operating device may convert the latitude and longitude of the location information received from the operating device into an address.

[0036] The control device 14 of the programmable display device 1 receives operation request data from the remote device 2A. Upon receiving the operation request data, the control device 14 creates operation information indicating the content of the operation on the screen PA displayed by the remote device 2A. An example of the content of the operation information is shown in Table 2 below. Table 2 shows the item name, data type, and numerical value range.

[0037] In Table 2, the terminal identifier is identification information that uniquely identifies the operating device. The user name is the user name of the operating device user, and is registered in the screen file stored in the storage unit 12. The data type of the terminal identifier and the user name is a character string. The screen distribution mode is the distribution mode of the screen of the operating device. If the operating device is one of the remote devices 2A to 2E, the screen distribution mode indicates whether the remote device is connected to the programmable display device 1 in synchronous mode or asynchronous mode. If the operating device is the programmable display device 1, the screen distribution mode indicates synchronous mode.

[0038] The start point X coordinate indicates the coordinate position at the time of operation in the X direction if the operation type in Table 2 is any of 0 to 12, and indicates the coordinate position at the start of the action if the operation type in Table 2 is 13. The start point Y coordinate indicates the coordinate position at the time of operation in the Y direction if the operation type in Table 2 is any of 0 to 12, and indicates the coordinate position at the start of the action if the operation type in Table 2 is 13.

[0039] The X-direction movement speed indicates the flick speed in the X direction when the operation type in Table 2 is 11, and indicates 0 when the operation type in Table 2 is other than 11. The Y-direction movement speed indicates the flick speed in the Y direction when the operation type in Table 2 is 11, and indicates 0 when the operation type in Table 2 is other than 11.

[0040] The pinch movement amount is the amount of change in the distance between the two touched points when the operation type in Table 2 is 13, and indicates 0 when the operation type in Table 2 is other than 13. The magnification change amount indicates the ratio between the screen scale magnification due to the previous pinch operation and the screen scale magnification due to the current pinch operation when the operation type in Table 2 is 13, and indicates 0 when the operation type in Table 2 is other than 13.

[0041] The touch identification ID is identification information for identifying two or more touches when the operation type in Table 2 is 0 to 4, and indicates 0 when the operation type in Table 2 is 5 to 13. Of the operation information shown in Table 2, the data type of the operation information other than the terminal identifier and the user name is a numeric value.

[0042] The control device 14 displays the created operation information on the screen P1. Specifically, the control device 14 creates an image based on the operation information and displays the image on the screen P1. As a result, areas 32 and 33 are added to the screen P1 that has areas 30 and 31, and the screen P1 now has areas 30 to 33.

[0043] Area 32 defines an image showing a portion of screen P1 corresponding to a location touched by user A1 on screen PA. Area 33 defines an image identifying user A1, who is the user of remote device 2A, which is the operating device, among programmable display device 1 and remote devices 2A to 2C, which display screens having at least some of the same content.

[0044] Furthermore, the control device 14 displays operation information on the screen PB and PC displayed by the other devices other than the operation device among the remote devices 2A to 2C that are displaying screens having at least some of the same content as the screen P1. Specifically, the control device 14 transmits the operation information to the remote devices 2B and 2C. After the control device 14 transmits the operation information to the remote devices 2B and 2C, the control device 24 of the remote device 2B receives the operation information from the control device 14, creates an image based on the received operation information, and displays the image on the screen PB.

[0045] As a result, areas 32B and 33B are added to screen PB having areas 30B and 31B, so that screen PB now has areas 30B to 33B. Area 32B defines an image showing the portion of screen PB corresponding to the location of touch on screen PA by user A1. Area 33B defines an image identifying user A1, who is the user of remote device 2A, which is the operating device.

[0046] Similarly, the control device 24 of the remote device 2C receives operation information from the control device 14, creates an image based on the received operation information, and displays the image on the screen PC. As a result, areas 32C and 33C are added to the screen PC having areas 30C and 31C, resulting in the screen PC having areas 30C to 33C. Area 32C defines an image showing the portion of the screen PC corresponding to the location of the touch on screen PA by user A1. Area 33C defines an image identifying user A1, the user of the remote device 2A, which is the operating device.

[0047] (When user A5 of remote device 2E performs a touch operation on remote device 2E) When user A5 of remote device 2E performs a touch operation on the touch panel 21 of the remote device 2E, the control device 24 of the remote device 2E sends operation request data to the programmable display device 1. The control device 14 of the programmable display device 1 receives the operation request data from the remote device 2E. Upon receiving the operation request data, the control device 14 creates operation information indicating the content of the operation on the screen PE displayed by the remote device 2E.

[0048] The control device 14 displays operation information on the screen PD, which displays a screen having at least a portion of the same content as the screen PE. Specifically, the control device 14 transmits the operation information to the remote device 2D. After the control device 14 transmits the operation information to the remote device 2D, the control device 24 of the remote device 2D receives the operation information from the control device 14, creates an image based on the received operation information, and displays the image on the screen PD.

[0049] As a result, areas 41D and 42D are added to screen PD having area 40D, so that screen PD now has areas 40D to 42D. Area 41D defines an image showing the portion of screen PD corresponding to the location of touch on screen PE by user A5. Area 42D defines an image identifying user A5, who is the user of remote device 2E, the operating device, of remote devices 2D and 2E, which display screens having at least some of the same content.

[0050] The following configuration is derived from the above description of Figure 2. Remote devices 2A and 2B are referred to as first remote devices, and remote devices 2C to 2E are referred to as second remote devices. Furthermore, a first case is when the control device 14 permits connection of the first remote device in synchronous mode and permits connection of the second remote device in asynchronous mode. Furthermore, of the programmable display device 1, the first remote device, and the second remote device, the device whose screen is being operated is referred to as the first operating device, and devices other than the first operating device are referred to as first other devices.

[0051] In the first case, when the second remote device is displaying a screen that has at least some of the same content as the display screen displayed by the display unit 10, the control device 14 displays operation information on the screen displayed by the first other device. The operation information indicates content related to operations on the screen displayed by the first manipulation device. This allows the user of the first other device to recognize content related to operations on the screen displayed by the first manipulation device by checking the screen of the device held by the user.

[0052] The operation information that the control device 14 causes to be displayed on the screen displayed by the other device may include at least one of the plurality of pieces of operation information shown in Table 2. Furthermore, the control device 14 may convert the latitude and longitude of the location information shown in Table 2 into an address and display this as operation information on the screen displayed by the other device. This allows the user of the other device to intuitively recognize in real time the location of the user and the device performing the operation, and the content of the operation on the screen displayed by the device.

[0053] Furthermore, the control device 14 may display operation information on a screen displayed only by a device other than the operating device among the programmable display device 1, the first remote device, and the second remote device that displays a screen including a same content area having the same content as the screen displayed by the operating device. The "same content area" is an area on a screen displayed by a device other than the operating device that shows the same content as the screen displayed by the operating device.

[0054] Furthermore, consider a state in which the second remote device is displaying a screen having at least a portion of the same content as the display screen displayed by the display unit 10. In the first case, in this state, the control device 14 sets, for the screen displayed by the first other device, layer images among the plurality of layer images, excluding the layer image defined by the same content area, as images displaying operation information.

[0055] For example, the control device 14 determines, as images for displaying operation information, layer images among the plurality of layer images for the screen P1 displayed by the programmable display device 1, excluding layer images defined by areas 30 and 31, which are identical content areas having the same content as the screen PA displayed by the remote device 2A. Here, the areas defining the images for displaying operation information are areas 32 and 33.

[0056] Similarly, the control device 14 sets, as images for displaying operation information, layer images of the screen PB displayed by the remote device 2B, excluding layer images defined by areas 30B and 31B, which are the same content areas as the screen PA displayed by the remote device 2A. Here, the areas defining the images for displaying operation information are areas 32B and 33B. Therefore, the control device 14 can easily display operation information on the first other device other than the first operating device whose screen is being operated.

[0057] In the first case, consider a state in which the second remote device is displaying a screen that has at least some of the same content as the display screen displayed by the display unit 10. In this state, the control device 14 sets some of the layer images of the screen displayed by the first remote device to images displayed in the first display format. In other words, the control device 14 sets some of the images of the screen displayed by the first remote device connected to the programmable display device 1 in synchronous mode to images displayed in the first display format.

[0058] For example, the control device 14 sets the image in the area 31B that defines some of the layer images on the screen PB displayed by the remote device 2B to an opaque image. In this case, the first display format is a format in which the image is displayed opaquely.

[0059] Furthermore, the control device 14 sets some of the layer images of the screen displayed by the second remote device to images displayed in a second display format different from the first display format. In other words, the control device 14 sets some of the images of the screen displayed by the second remote device connected to the programmable display device 1 in asynchronous mode to images displayed in the second display format.

[0060] For example, the control device 14 sets the image of the area 31C, which defines some of the layer images among the multiple layer images, as a semi-transparent image for the screen PC displayed by the remote device 2C. In this case, the second display format is a format in which the image is displayed semi-transparently. Because the image of the area 31C is a semi-transparent image, the portion of the area 30C that overlaps with the area 31C is also displayed.

[0061] This allows the user of the remote device to recognize whether their device is connected to the programmable display device 1 in synchronous mode or asynchronous mode. Area 31C is an area whose content is the same as area 31 included in screen P1 displayed by the programmable display device 1, except for the display format.

[0062] (Variation 1) The control device 14 may determine whether an operation on a screen displayed by the first manipulation device is a valid operation. A fourth case is when the control device 14 determines that the operation on the screen displayed by the first manipulation device is a valid operation, and a fifth case is when the control device 14 determines that the operation on the screen displayed by the first manipulation device is an invalid operation.

[0063] In the first case, consider a state in which the second remote device displays a screen having at least a portion of the same content as the display screen displayed by the display unit 10. In this state, in the fourth case, the control device 14 causes the first other device to display operation information on the screen displayed, and in the fifth case, the control device 14 does not cause the first other device to display operation information on the screen displayed.

[0064] Operation information indicating the content of an operation determined to be a valid operation is displayed on a screen displayed by a first other device other than the first manipulation device. Also, operation information indicating the content of an operation determined to be an invalid operation is not displayed on a screen displayed by the first other device. Therefore, the user of the first other device other than the first manipulation device can recognize only the content of the valid operation.

[0065] 1, a user of a plurality of remote devices including remote devices 2A to 2E can select either the synchronous mode or the asynchronous mode by touching the remote device when connecting the remote device to the programmable display device 1. Information about the selected mode is sent from the remote device to the programmable display device 1, and the mode is confirmed when the control device 14 authorizes the mode information.

[0066] (Communication between the programmable display device 1 and the remote devices 2A to 2E) Figure 3 is a diagram showing another example of communication between the programmable display device 1 and the remote devices 2A to 2E in the screen synchronization system 100 shown in Figure 1. Figure 3 illustrates a case where the operating device is the remote device 2C connected to the programmable display device 1 in asynchronous mode.

[0067] When user A3 of remote device 2C performs a touch operation on the touch panel 21 of the remote device 2C, the control device 24 of the remote device 2C transmits operation request data to the programmable display device 1. The control device 14 of the programmable display device 1 receives the operation request data from the remote device 2C. Upon receiving the operation request data, the control device 14 creates operation information indicating the content of the operation for the screen PC displayed by the remote device 2C.

[0068] The control device 14 displays the created operation information on the screen P1. As a result, areas 32 and 33 are added to the screen P1 that has areas 30 and 31, so that the screen P1 now has areas 30 to 33. Area 32 defines an image showing the portion of the screen P1 that corresponds to the location where user A3 touched the screen PC. Area 33 defines an image that identifies user A3, who is the user of remote device 2C, the operating device, among the programmable display device 1 and remote devices 2A to 2C that display screens with at least some of the content identical to screen P1.

[0069] Furthermore, the control device 14 displays operation information on screens PA and PB displayed by other devices other than the operation device among the remote devices 2A to 2C that are displaying screens having at least some of the same content as screen P1. Specifically, the control device 14 transmits the operation information to the remote devices 2A and 2B. After the control device 14 transmits the operation information to the remote devices 2A and 2B, the control device 24 of the remote device 2A receives the operation information from the control device 14, creates an image based on the received operation information, and displays the image on screen PA.

[0070] As a result, areas 32A and 33A are added to screen PA having areas 30A and 31A, so that screen PA now has areas 30A to 33A. Area 32A defines an image showing the portion of screen PA corresponding to the location where user A3 touched the screen PC. Area 33A defines an image identifying user A3, who is the user of remote device 2C, which is the operating device.

[0071] Similarly, the control device 24 of the remote device 2B receives operation information from the control device 14, creates an image based on the received operation information, and displays the image on the screen PB. As a result, areas 32B and 33B are added to the screen PB having areas 30B and 31B, so that the screen PB now has areas 30B to 33B. Area 32B defines an image showing the portion of the screen PB corresponding to the location where user A3 touched the screen PC. Area 33B defines an image identifying user A3, the user of the remote device 2C, which is the operating device.

[0072] Furthermore, the control device 14 sets the image in the area 31C that defines some of the layer images on the screen PC displayed by the remote device 2C to an opaque image. In this case, the second display format is a format in which the image is displayed opaquely.

[0073] The control device 14 may set the image in area 31, which defines some of the layer images, of the screen P1 displayed by the programmable display device 1, to a translucent image. The control device 14 also sets the image in area 31A, which defines some of the layer images, of the screen PA displayed by the remote device 2A to a translucent image. In this case, the first display format is a format in which the image is displayed translucently. Similarly, the control device 14 sets the image in area 31B, which defines some of the layer images, of the screen PB displayed by the remote device 2B to a translucent image.

[0074] (State transitions of remote devices 2A and 2C) Fig. 4 is a diagram showing state transitions of remote devices 2A and 2C in screen synchronization system 100 shown in Fig. 2. First, as shown in Fig. 4, user A1 of remote device 2A starts an operation on touch panel 21 of remote device 2A (S1). User A1 also performs an operation on touch panel 21 to display a pop-up (S2).

[0075] As a result, in the remote device 2A, the control device 24 causes the display panel 20 to execute a pop-up display by displaying the area 31A on the screen PA displayed by the remote device 2A (S3). Next, the control device 24 transmits operation request data to the programmable display device 1. Upon receiving the operation request data, the control device 14 of the programmable display device 1 creates operation information and transmits the created operation information to the remote device 2C.

[0076] As a result, the control device 14 displays the operation information and a semi-transparent pop-up on the screen PC displayed by the remote device 2C (S4). As a result, the screen PC includes the areas 31C to 33C.

[0077] Next, user A1 interrupts the operation on the touch panel 21 of the remote device 2A (S5). A first predetermined time period elapses from the point in time when the operation on the touch panel 21 was interrupted (S6). After the first predetermined time period has elapsed, the control device 14 causes the display PC to erase the operation information and the semi-transparent pop-up (S7). As a result, areas 31C to 33C are erased from the display PC.

[0078] User A1 resumes operation on the touch panel 21 of the remote device 2A (S8). When operation on the touch panel 21 is resumed, the control device 14 displays operation information and a semi-transparent pop-up on the screen PC, as in step S4 (S9). Therefore, the screen PC includes areas 31C to 33C.

[0079] Furthermore, the user A1 performs an operation on the touch panel 21 of the remote device 2A to close the pop-up display (S10). As a result, the control device 24 of the remote device 2A causes the pop-up to disappear from the screen PA displayed by the remote device 2A. As a result, the area 31A disappears from the screen PA.

[0080] Furthermore, the control device 14 causes the semi-transparent pop-up to disappear from the screen PC displayed by the remote device 2C (S11). Accordingly, the area 31C disappears from the screen PC. Furthermore, the user A1 ends the operation on the touch panel 21 of the remote device 2A (S12). Then, a first predetermined time elapses from the point in time when the operation on the touch panel 21 ends (S13). After the first predetermined time elapses, the control device 14 causes the screen PC to erase the operation information (S14). Accordingly, the areas 32C and 33C disappear from the screen PC displayed by the remote device 2C.

[0081] (Prohibition of operations on the same content area on the screen) Figure 5 is a diagram for explaining the prohibition of operations on the same content area on the screen in the screen synchronization system 100 shown in Figure 1. Note that the remote device 2E is omitted from Figure 5. As shown by reference numeral 501 in Figure 5, consider the case where a user A1 of the remote device 2A performs a touch operation on the touch panel 21 of the remote device 2A connected to the programmable display device 1 in the synchronization mode.

[0082] In this case, the control device 14 of the programmable display device 1 prohibits the programmable display device 1 and the remote devices 2B and 2C, which are other devices than the operation device, from operating the same content area among the devices displaying screens including the same content area (prohibition step). At this time, a group G1 is formed, which is a group of devices displaying screens including the same content area. Group G1 is a group that includes the programmable display device 1 and the remote devices 2A to 2C.

[0083] Specifically, the control device 14 prohibits operation of areas 30 and 31, which are the same content area, on the screen P1 displayed by the programmable display device 1. The control device 14 prohibits operation of areas 30B and 31B, which are the same content area, on the screen PB displayed by the remote device 2B. The control device 14 prohibits operation of areas 30C and 31C, which are the same content area, on the screen PC displayed by the remote device 2C.

[0084] When the control device 14 prohibits operation of the content area, the control device 14 may prohibit operation of the content area while operation on the screen displayed by the operation device continues. Furthermore, when the control device 14 prohibits operation of the content area, the control device 14 may prohibit operation of the content area for a second predetermined time period from the time when operation on the screen displayed by the operation device is interrupted.

[0085] As described above, the control device 14 not only prohibits the same content area of ​​the screen PB displayed by the remote device 2B connected to the programmable display device 1 in synchronous mode, but also prohibits operation of the same content area of ​​the screen PC displayed by the remote device 2C connected to the programmable display device 1 in asynchronous mode.

[0086] 5, consider a case where user A3 of remote device 2C performs a touch operation on the touch panel 21 of remote device 2C connected to the programmable display device 1 in asynchronous mode. In this case, too, the control device 14 prohibits operation of the same content area on the programmable display device 1 and remote devices 2A and 2B, which are other devices than the operation device and displaying screens including the same content area, which has the same content. In other words, the control device 14 also prohibits operation of the same content area on the remote devices 2A and 2B connected to the programmable display device 1 in synchronous mode.

[0087] The above description of reference numeral 501 in Figure 5 leads to the following configuration. Let remote devices 2A and 2B be first remote devices, and remote devices 2C and 2D be second remote devices. In the first case described above, consider a state in which the second remote device is displaying a screen having at least a portion of the same content as the display screen displayed by the display unit 10. In this state, the control device 14 prohibits the first other device from operating a same content area of ​​the screen displayed by the first other device, the same content area having the same content as the screen displayed by the first operating device.

[0088] Consider a state in which a second remote device connected to the programmable display device 1 in asynchronous mode is displaying a screen having at least a portion of the same content as screen P1 displayed on the display unit 10 of the programmable display device 1. In this state, the programmable display device 1, the first remote device, and the second remote device are all displaying screens including a same content area having the same content. When any of these devices is operated, the control device 14 prohibits the first other devices other than the first operating device from operating the same content area.

[0089] In other words, in the above state, not only the synchronous screen displayed by the first remote device connected to the programmable display device 1 in synchronous mode, but also the screen displayed by the second remote device connected to the programmable display device 1 in asynchronous mode may be subject to the prohibition of operation of the same content area. Therefore, when the second remote device is displaying a screen including the same content area, the control device 14 can prevent simultaneous operation of the same content area, which has the same content, among the programmable display device 1, the first remote device, and the second remote device.

[0090] In addition, in the synchronous mode, the programmable display device 1 and the remote devices 2A and 2B prohibit conflicting operations on synchronized areas that are synchronized with each other. Here, consider a case where the control device 14 does not prohibit operations on the same content area on the screen displayed by the first other device.

[0091] In this case, conflicting operations are not prohibited in the remote devices 2C and 2D that are connected in asynchronous mode to the programmable display device 1. Therefore, for example, if the remote device 2C is displaying a screen whose content is the same as the screen displayed by the programmable display device 1, conflicting operations may occur between the programmable display device 1 and the remote devices 2A and 2B and the remote device 2C.

[0092] Therefore, in order to prevent conflicting operations from occurring between the programmable display device 1 and the remote devices 2A and 2B and the remote device 2C, the control device 14 prohibits operations on the same content area on the screen displayed by the first other device. This makes it possible to restrict the remote devices 2C and 2D connected to the programmable display device 1 in asynchronous mode when they are displaying a screen including the same content area.

[0093] 5, consider a case where user A3 of remote device 2C performs a touch operation on touch panel 21. In this case, user A3 performs a touch operation on a predetermined area (an area defining images such as buttons) not shown in the figure included in the screen PC displayed by remote device 2C, causing remote device 2C to transmit operation request data to control device 14. The predetermined area is an area of ​​the screen PC other than the area containing the same content.

[0094] The control device 14 receives the operation request data from the remote device 2C and transmits data (drawing information) of the screen PC1 after switching to the remote device 2C. As a result, the screen displayed by the remote device 2C switches from the screen PC to the screen PC1. In this way, the control device 14 executes the process of switching from the screen PC to the screen PC1.

[0095] Screen PC1 is a screen separate from screen PC and does not include a content area whose content is the same as that of screen PA displayed by remote device 2A. Screen PC1 has area 40C. When remote device 2C is displaying screen PC1, remote device 2C is not included in group G1, and control device 14 does not prohibit remote device 2C from operating screen PC1.

[0096] That is, the control device 14 accepts input by touch operation on the predetermined area, i.e., permits operation on the predetermined area, in the remote device 2C connected to the programmable display device 1 in asynchronous mode, thereby enabling the control device 14 to switch from a state in which operation on the content area is prohibited to a state in which a different screen is displayed.

[0097] Furthermore, as shown by reference numeral 503 in Figure 5, consider a case where, in remote device 2D, user A4 of remote device 2D performs a touch operation on the touch panel 21, and the control device 14 executes a process to switch the screen displayed by remote device 2D from screen PD1 to screen PD2.

[0098] Screen PD1 is a screen that does not include a content area whose content is the same as that of screen PA displayed by remote device 2A, and does not include a content area whose content is the same as that of screen PC1 displayed by remote device 2C. Screen PD2 is a screen that does not include a content area whose content is the same as that of screen PA displayed by remote device 2A, and does include a content area whose content is the same as that of screen PC1 displayed by remote device 2C. Screen PD2 has area 40D1. Area 40D1 is an area whose content is the same as that of area 40C included in screen PC1.

[0099] Consider a situation in which the remote device being operated is remote device 2D and remote device 2D is displaying screen PD2. In this situation, of remote devices 2C and 2D displaying screens including the same content area with the same content, control device 14 prohibits remote device 2C, which is a device other than the operated device, from operating the same content area. At this time, group G2 is formed, which is a group of devices displaying screens including the same content area with the same content. Group G2 is a group that includes remote devices 2C and 2D.

[0100] Specifically, the control device 14 prohibits operation of an area 40C of the screen PC1 displayed by the remote device 2C, which is an area having the same content as that of the screen PD2 displayed by the remote device 2D. When an operation is performed on the screen PD2 displayed by the remote device 2D, the screen PC1 comes to have areas 40C and 41C.

[0101] Area 40C is an area with the same content as area 40D1 of screen PD2. Area 41C is an area that is added when an operation is performed on screen PD2 displayed by remote device 2D. The operation of the screen displayed by remote device 2D, which is an operation device included in group G2, and the operation of the screen displayed by remote device 2A, which is an operation device included in group G1, can be performed independently and simultaneously.

[0102] The following configuration can be derived from the above description of reference numeral 503 in Figure 5. Here, remote devices 2A and 2B are referred to as first remote devices, remote device 2C is referred to as second remote device, and remote device 2D is referred to as third remote device. A third case is defined as a case in which the control device 14 permits connection of the first remote device in synchronous mode, permits connection of the second remote device in asynchronous mode, and permits connection of the third remote device in asynchronous mode.

[0103] Furthermore, of the programmable display device 1 and the first remote device, the device whose screen is being operated is referred to as a third operation device, and the device other than the third operation device is referred to as a third other device. Furthermore, of the second remote device and the third remote device, the device whose screen is being operated is referred to as a fourth operation device, and the device other than the fourth operation device is referred to as a fourth other device.

[0104] In this case, in the third case, when the second remote device is displaying a screen having at least a portion of the same content as the screen displayed by the third remote device, the control device 14 executes the following process. Specifically, the control device 14 prohibits the third other device from operating a same content area of ​​the screen displayed by the third other device, the same content area having the same content as the screen displayed by the third manipulation device. Furthermore, the control device 14 prohibits the fourth other device from operating a same content area of ​​the screen displayed by the fourth manipulation device, the same content area having the same content as the screen displayed by the fourth manipulation device.

[0105] The control device 14 can prevent simultaneous operations on the same content area between the programmable display device 1 and the first remote device, and can also prevent simultaneous operations on the same content area between the second remote device and the third remote device. In other words, it is possible to form multiple groups of devices that can prevent simultaneous operations on the same content area between the programmable display device 1 and the first remote device.

[0106] The screen displayed by the first other device is a screen that defines a composite image formed by overlapping a plurality of layer images, and the content area is an area that defines some of the layer images included in the composite image.

[0107] This allows the control device 14 to prohibit the first other device other than the first operation device from operating on an area that defines some of the layer images among the multiple layer images, thereby allowing the remote device connected to the programmable display device in asynchronous mode to operate on an area other than the same content area and to display a screen other than the synchronous screen.

[0108] Furthermore, the remote device 2C is the first remote device, the remote device 2D is the second remote device, and the case where the control device 14 allows the first remote device to be connected in asynchronous mode and also allows the second remote device to be connected in asynchronous mode is referred to as the second case. Furthermore, of the first remote device and the second remote device, the device whose screen is being operated is referred to as the second operating device, and the device other than the second operating device is referred to as the second other device.

[0109] In the second case, consider a state in which the first remote device is displaying a screen having at least a portion of the same content as the screen displayed by the second remote device. In this state, the control device 14 prohibits a second other device other than the second manipulation device from operating a same content area of ​​the screen displayed by the second manipulation device, the same content area having the same content as the screen displayed by the second manipulation device.

[0110] This allows the control device 14 to prevent simultaneous operations on the same content area between a first remote device and a second remote device connected to the programmable display device 1 in asynchronous mode, where the content of both devices is the same.

[0111] Furthermore, consider a case where remote devices 2C and 2D connected to the programmable display device 1 in asynchronous mode are displaying screens with at least some of the same content, and the control device 14 does not prohibit operation of the same content area on the screen displayed by the second other device. In this case, conflicting operations may occur between the remote devices 2C and 2D. Therefore, to prevent conflicting operations from occurring between the remote devices 2C and 2D, the control device 14 prohibits operation of the same content area on the screen displayed by the second other device when the remote devices 2C and 2D are displaying screens with at least some of the same content.

[0112] In the synchronous mode, the multiple devices shown in FIG. 5 display screens including synchronized areas that are synchronized with each other, and the control device 14 automatically prohibits operations on the synchronized areas while allowing operations to be performed on each of the multiple devices. In the synchronous mode, the multiple devices also switch screens and display pop-ups during operations in tandem. Hereinafter, the multiple devices refer to the programmable display device 1 and multiple remote devices including the remote devices 2A to 2D.

[0113] In the asynchronous mode, a screen that does not include a synchronization area can be displayed among the multiple devices, and in this case, the control device 14 does not prohibit operations, and operations can be performed on each of the multiple devices. Also, in the asynchronous mode, even if each of the multiple devices displays the same screen, screen switching among the multiple devices is not linked.

[0114] (Variation 3) The control device 14 may display prohibition information indicating that operation is prohibited on the screen of a device that prohibits operation of the content area. The prohibition information is not displayed on the screen displayed by the operating device on which the screen is being operated. This allows the user of the device that prohibits operation of the content area to recognize that operation of the content area is prohibited.

[0115] (Variation 4) The control device 14 may display first information, second information, and third information on the screens displayed by multiple devices. The first information is information indicating that the programmable display device 1 and the remote device are connected. The second information is information indicating that the programmable display device 1 and the remote device are connected in synchronous mode. The third information is information that switches between and indicates the following four pieces of information (1) to (4):

[0116] (1) Information indicating a state in which no touch operation is being performed on any of the screens displayed by multiple devices connected to each other. (2) Information indicating a touch operation is being performed on any of the screens displayed by multiple remote devices connected to the programmable display device 1. (3) Information indicating a touch operation is being performed on a screen displayed by the programmable display device 1. (4) Information indicating a touch operation is being performed on a screen displayed by a device other than the device displaying the third information.

[0117] (Variation 5) When the remote HMI function for connecting a remote device to the programmable display device 1 is used, the control device 14 may display any one of the fourth information, the fifth information, and the sixth information on the display screen displayed by the display unit 10, depending on the operation status of the multiple devices. The fourth information is information that is displayed when none of the multiple devices is being operated. The fifth information is information that is displayed when the programmable display device 1 is being operated. The sixth information is information that is displayed when a remote device is being operated.

[0118] The fourth information may be information indicating a state in which operation of any of the same content areas on screens displayed by multiple devices is not prohibited. The fifth information may be information indicating a state in which operation of the same content area on screens displayed by devices (remote devices) other than the programmable display device 1 is prohibited among multiple devices that display screens including the same content area with the same content. The sixth information may be information indicating a state in which operation of the same content area on screens displayed by devices other than a certain remote device is prohibited among multiple devices that display screens including the same content area with the same content.

[0119] (Process for Permitting Operation) Fig. 6 is a flow diagram showing a process performed by the control device 14 of the programmable display device 1 shown in Fig. 1 to permit operation on a screen displayed by the remote device 2A. First, as shown in Fig. 6, the touch panel 21 of the remote device 2A accepts a touch operation input (S21). After the touch panel 21 accepts the touch operation input, the control device 24 of the remote device 2A creates operation request data (S22).

[0120] After the control device 24 creates the operation request data, it transmits the operation request data to the programmable display device 1 (S23). When the control device 14 of the programmable display device 1 receives the operation request data from the remote device 2A, it determines whether or not the operation can be performed on the screen displayed by the remote device 2A (S24).

[0121] When the device that transmitted the operation request data is a device other than the operation device among a plurality of devices that display screens including the same content area with the same content, the control device 14 prohibits operation of the same content area on the screen displayed by the device that transmitted the operation request data. Also, when the screen of none of the plurality of devices that display screens including the same content area with the same content is being operated, the control device 14 permits operation of the screen displayed by the device that transmitted the operation request data.

[0122] The control device 14 maintains the state in which operation of the screen displayed by the device that sent the operation request data is permitted from the time when operation of the screen displayed by the device is permitted until a third predetermined time has elapsed.

[0123] If the control device 14 determines in step S24 that the operation on the screen displayed by the remote device 2A is not permitted, the control device 14 prohibits the operation. On the other hand, if the control device 14 determines in step S24 that the operation on the screen displayed by the remote device 2A is permitted, the control device 14 creates operation information (S25).

[0124] The control device 14 transmits the created operation information to the remote device 2A (S26). When the control device 24 of the remote device 2A receives the operation information from the programmable display device 1, it determines the operation device whose screen is being operated (S27). Specifically, the control device 24 determines which of the multiple devices is the operation device whose screen is being operated.

[0125] The control device 24 creates an image showing the operation information (S28). The control device 24 combines the created image with the screen displayed by the display panel 20 (S29). The processes shown in PM1 and PM2 in Fig. 6 are executable on the condition that operation on the screen is permitted in step S24.

[0126] (Regarding Operation Permission and Operation Prohibition) Fig. 7 is a timing chart showing the process of the control device 14 provided in the programmable display device 1 shown in Fig. 1 permitting or prohibiting operations on the screens displayed by the remote devices 2A and 2B. In Fig. 7, graph 2A1 is a graph showing whether or not a touch operation has been performed on the touch panel 21 of the remote device 2A. Graph 2B1 is a graph showing whether or not a touch operation has been performed on the touch panel 21 of the remote device 2B.

[0127] In the graphs 2A1 and 2B1, the rising portions indicate the presence of a touch operation, and the falling portions indicate the absence of a touch operation. The graph D1 indicates that either the remote device 2A or 2B is operating the screen.

[0128] 7 , when a touch operation is performed on the touch panel 21 of the remote device 2A at time T1, the control device 24 of the remote device 2A transmits operation request data to the programmable display device 1. At time T2, the control device 14 of the programmable display device 1 determines that operation on the screen displayed by the remote device 2A is permitted, and transmits operation permission information to the remote device 2A. The operation permission information indicates that operation on the screen displayed by the remote device 2A is permitted. The control device 14 then recognizes that operation on the screen displayed by the remote device 2A is continuing.

[0129] When a touch operation is performed on the touch panel 21 of the remote device 2B at time T3, the control device 24 of the remote device 2B transmits operation request data to the programmable display device 1. At time T4, the control device 14 of the programmable display device 1 determines that an operation on the screen displayed by the remote device 2B is not permitted because an operation on the screen displayed by the remote device 2A is continuing. The control device 14 transmits operation refusal information to the remote device 2B indicating that an operation on the screen displayed by the remote device 2B is not permitted. Therefore, an operation on the same content area of ​​the screen displayed by the remote device 2B is rejected.

[0130] At time T5, the operation on the screen displayed by remote device 2A ends. With the operation on the screen displayed by remote device 2A ending, the control device 14 recognizes that the operation on the screen displayed by remote device 2A has ended at time T6. Specifically, the control device 14 recognizes that the operation on the screen displayed by remote device 2A has ended when a second predetermined time has elapsed since the touch operation on remote device 2A stopped.

[0131] When a touch operation is performed on the touch panel 21 of the remote device 2B at time T7, the control device 24 of the remote device 2B transmits operation request data to the programmable display device 1. At time T8, the programmable display device 1 determines that operation on the screen displayed by the remote device 2B is permitted, and transmits operation permission information to the remote device 2B. The operation permission information indicates that operation on the screen displayed by the remote device 2B is permitted. The control device 14 then recognizes that operation on the screen displayed by the remote device 2B is continuing.

[0132] At time T9, the operation on the screen displayed by remote device 2B is completed. In response to the completion of the operation on the screen displayed by remote device 2B, control device 14 recognizes that the operation on the screen displayed by remote device 2B has been completed at time T10.

[0133] (Determination of Operation Type) Fig. 8 is a flowchart showing the process of overlapping an image of identification information and an image of an operation on the screen by the control device 14 or 24 shown in Fig. 1. As shown in Fig. 8, the control device 14 determines whether the operation on the screen displayed by the operation device among the programmable display device 1 and the multiple remote devices is a start or an end (S41).

[0134] If the control device 14 determines in step S41 that the operation on the screen has ended, it creates an image deletion command (S42). The control device 14 transmits the image deletion command to the operation device, and the operation device deletes the image showing the operation information. The control device 14 then ends the process.

[0135] If the control device 14 determines in step S41 that the operation on the screen is an operation start, it determines the operation type of the operation on the screen (S43). If the control device 14 determines in step S43 that the operation on the screen is a panning operation, it acquires an image of the panning operation (an image indicating operation information) stored in the storage unit 12 (S44). After acquiring the image of the panning operation, the control device 14 creates an image of identification information of the operating device (an image indicating operation information) (S48).

[0136] If the control device 14 determines in step S43 that the operation on the screen is a zoom operation, it acquires an image of the zoom operation (an image showing operation information) stored in the storage unit 12 (S45). After acquiring the image of the zoom operation, the control device 14 proceeds to the processing of step S48. If the control device 14 determines in step S43 that the operation on the screen is a swipe operation, it acquires an image of the swipe operation (an image showing operation information) stored in the storage unit 12 (S46). After acquiring the image of the swipe operation, the control device 14 proceeds to the processing of step S48.

[0137] If the control device 14 determines in step S43 that the operation on the screen is a mouse operation (touch operation), it acquires an image (image showing operation information) of the mouse operation (touch operation) stored in the storage unit 12 (S47). After acquiring the image of the mouse operation (touch operation), the control device 14 proceeds to the processing of step S48.

[0138] After the process of step S48, the control device 14 causes the image of the identification information and the image of the operation acquired in any of steps S44 to S47 to overlap on the screen displayed by the device other than the operation device (S49). In this way, different images can be displayed on the screen depending on the type of operation.

[0139] After step S43, the control device 14 may transmit operation information to a remote device that is not the operation device among the multiple remote devices. In this case, in steps S44 to S47, the control device 24 of the remote device that is not the operation device may acquire an image of the operation stored in the data memory 22. In addition, in step S48, the control device 24 of the remote device that is not the operation device may create an image of the identification information and execute the process of step S49.

[0140] [Example of software implementation] The functions of the programmable display device 1 and the remote devices 2A to 2E (hereinafter referred to as "devices") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (especially the control devices 14, 24).

[0141] In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The functions described in each of the above embodiments are realized by executing the program using the control device and storage device.

[0142] The program may be non-transitory and may be recorded on one or more computer-readable recording media. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

[0143] Furthermore, some or all of the functions of the control blocks can be realized by logic circuits. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, the functions of the control blocks can also be realized by, for example, a quantum computer.

[0144] [Summary] A programmable display according to a first aspect of the present invention is a programmable display connectable to a plurality of remote devices including a first remote device and a second remote device, and includes a display unit that displays a screen, and a control device that allows each of the plurality of remote devices to connect in a synchronous mode or an asynchronous mode, wherein the synchronous mode is a mode in which the remote device displays a synchronous screen that is at least partially synchronized with the display screen displayed by the display unit, and the asynchronous mode is a mode in which the remote device is allowed to display a screen other than the synchronous screen, and the control device allows the first remote device to connect in the synchronous mode and the second remote device to connect in the asynchronous mode, and in a first case in which the control device allows the first remote device to connect in the synchronous mode and the second remote device to connect in the asynchronous mode, when the second remote device is displaying a screen the content of which is at least partially the same as the display screen, prohibits operation of a same content area of ​​the screen displayed by the first other device, the same content area having the same content as the screen displayed by the first operating device, for a first other device among the programmable display, the first remote device, and the second remote device, other than a first operating device whose screen is being operated.

[0145] Consider a state in which a second remote device connected to a programmable display device in asynchronous mode is displaying a screen having at least a portion of the same content as the display screen displayed by the display unit of the programmable display device. In this state, the programmable display device, the first remote device, and the second remote device are all displaying screens including a same content area having the same content. When one of these devices is operated, the control device prohibits the first other device other than the first operating device from operating the same content area.

[0146] In other words, in the above state, not only the synchronous screen displayed by the first remote device connected to the programmable display device in synchronous mode but also the screen displayed by the second remote device connected to the programmable display device in asynchronous mode may be subject to prohibition of operation of the same content area. Therefore, when the second remote device is displaying a screen including the same content area, the control device can prevent simultaneous operation of the same content area, which has the same content, among the programmable display device, the first remote device, and the second remote device.

[0147] A programmable display according to aspect 2 of the present invention is such that, in the above-described aspect 1, the control device allows the first remote device to be connected in the asynchronous mode, and in a second case where the control device allows the second remote device to be connected in the asynchronous mode, when the first remote device is displaying a screen having at least some of the same content as the screen displayed by the second remote device, the control device may prohibit a second other device, other than the second operating device whose screen is being operated, from operating a same content area of ​​the screen displayed by the second other device, the same content area having the same content as the screen displayed by the second operating device.

[0148] The control device can prevent simultaneous operations on the same content area between a first remote device and a second remote device connected to the programmable display in asynchronous mode.

[0149] A programmable display according to a third aspect of the present invention is related to the above-mentioned first or second aspects, and the plurality of remote devices further includes a third remote device. In a third case in which the control device allows connection of the first remote device in the synchronous mode, allows connection of the second remote device in the asynchronous mode, and allows connection of the third remote device in the asynchronous mode, when the second remote device is displaying a screen having at least some of the same content as the screen displayed by the third remote device, the control device may prohibit a third other device among the programmable display and the first remote device other than the third operation device whose screen is being operated from operating a same content area of ​​the screen displayed by the third other device, the same content area having the same content as the screen displayed by the third operation device, and may prohibit a fourth other device among the second remote device and the third remote device other than the fourth operation device whose screen is being operated from operating a same content area of ​​the screen displayed by the fourth operation device, the same content area having the same content as the screen displayed by the fourth operation device.

[0150] The control device can prevent simultaneous operations on the same content area between the programmable display device and the first remote device, and can also prevent simultaneous operations on the same content area between the second remote device and the third remote device, which means that multiple groups of devices can be formed that can prevent simultaneous operations on the same content area between the programmable display device and the first remote device.

[0151] In a programmable display according to aspect 4 of the present invention, in any of aspects 1 to 3 above, the control device may, in the first case, when the second remote device is displaying a screen having at least some of the same content as the display screen, display operation information indicating content related to operations on the screen displayed by the first operating device on the screen displayed by the first other device.

[0152] A user of a first other device other than the first operating device whose screen is being operated can recognize the content of the operation on the screen displayed by the first operating device by checking the screen of the device he or she owns.

[0153] A programmable display according to aspect 5 of the present invention is such that, in the above-mentioned aspect 4, the control device determines whether an operation on a screen displayed by the first operating device is a valid operation, and in the first case, when the second remote device is displaying a screen having at least some of the same content as the display screen, if it determines that the operation on the screen displayed by the first operating device is a valid operation, it displays the operation information on the screen displayed by the first other device, and if it determines that the operation on the screen displayed by the first operating device is an invalid operation, it does not display the operation information on the screen displayed by the first other device.

[0154] Operation information indicating the content of an operation determined to be a valid operation is displayed on a screen displayed by a first other device other than the first manipulation device. Also, operation information indicating the content of an operation determined to be an invalid operation is not displayed on a screen displayed by the first other device. Therefore, the user of the first other device other than the first manipulation device can recognize only the content of the valid operation.

[0155] A programmable display according to aspect 6 of the present invention is such that, in any of aspects 1 to 5 above, the screen displayed by the first other device is a screen that defines a composite image formed by overlapping multiple layer images, and the content area may be an area that defines some of the multiple layer images included in the composite image.

[0156] Because the content area is an area that defines some of the layer images among the plurality of layer images, the control device can prohibit a first other device other than the first operation device from operating on the area that defines some of the layer images among the plurality of layer images. Thus, it is possible to allow a remote device connected to the programmable display device in asynchronous mode to operate outside the content area and to display a screen other than the synchronous screen.

[0157] In the programmable display of aspect 7 of the present invention, in the above aspect 6, in the first case, when the second remote device is displaying a screen having at least some of the same content as the display screen, the control device may display, for the screen displayed by the first other device, layer images of the plurality of layer images excluding the layer image defined by the same content area as images displaying operation information indicating content related to operations on the screen displayed by the first operating device.

[0158] The control device sets, among the plurality of layer images, layer images other than the layer image defined by the same content area as images that display operation information indicating content related to operations on the screen displayed by the first operation device, thereby allowing the control device to easily display the operation information on the first other device other than the first operation device whose screen is being operated.

[0159] In a programmable display according to aspect 8 of the present invention, in the above-mentioned aspects 6 or 7, the control device may, in the first case, when the second remote device is displaying a screen having at least some of the same content as the display screen, cause some of the layer images among the plurality of layer images for the screen displayed by the first remote device to be images displayed in a first display format, and cause some of the layer images among the plurality of layer images for the screen displayed by the second remote device to be images displayed in a second display format different from the first display format.

[0160] A user of a remote device can recognize whether his or her device is connected to the programmable display in synchronous mode or in asynchronous mode.

[0161] A screen synchronization system according to a ninth aspect of the present invention may be configured as in any one of the first to eighth aspects, and may include a programmable display device and the plurality of remote devices.

[0162] A screen synchronization method according to aspect 10 of the present invention is a screen synchronization method for synchronizing screens using a programmable display device connectable to multiple remote devices including a first remote device and a second remote device, the method including: a display step of displaying a screen on a display unit of the programmable display device; and a connection step of permitting connection in a synchronous mode or asynchronous mode for each of the multiple remote devices, wherein the synchronous mode is a mode in which the remote device displays a synchronized screen that is at least partially synchronized with the display screen displayed by the display unit, and the asynchronous mode is a mode in which the remote device is permitted to display a screen other than the synchronized screen. When connection of the first remote device is permitted in the synchronous mode and connection of the second remote device is permitted in the asynchronous mode, and the second remote device is displaying a screen that has at least partially the same content as the display screen, the screen synchronization method further includes a prohibition step of prohibiting other devices among the programmable display device, the first remote device, and the second remote device, other than the operating device whose screen is being operated, from operating a same content area of ​​the screen displayed by the other device, the same content area having the same content as the screen displayed by the operating device.

[0163] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Configurations obtained by appropriately combining multiple technical means disclosed in the embodiments are also included in the technical scope of the present invention.

[0164] 1 Programmable display 2A to 2E Remote device 10 Display unit 14 Control device 30, 31, 30B, 31B, 30C, 31C, 40C Area (same content area) 100 Screen synchronization system P1, PC1, PD1, PD2 Screen

Claims

1. A programmable display connectable to a plurality of remote devices including a first remote device and a second remote device, comprising: a display unit that displays a screen; and a control device that permits connection in a synchronous mode or an asynchronous mode to each of the plurality of remote devices, wherein the synchronous mode is a mode in which the remote devices display a synchronous screen at least a portion of which is synchronized with a display screen displayed by the display unit, and the asynchronous mode is a mode in which the remote devices are permitted to display a screen other than the synchronous screen, and the control device, in a first case in which the connection of the first remote device is permitted in the synchronous mode and the connection of the second remote device is permitted in the asynchronous mode, prohibits operation of a same content area of ​​the screen displayed by the first other device, the same content area having the same content as the screen displayed by the first operating device, for a first other device among the programmable display, the first remote device, and the second remote device other than a first operating device whose screen is being operated.

2. The programmable display of claim 1, wherein the control device, in a second case in which the control device permits connection of the first remote device in the asynchronous mode and permits connection of the second remote device in the asynchronous mode, when the first remote device is displaying a screen the content of which is at least partially the same as the screen displayed by the second remote device, prohibits a second other device, among the first remote device and the second remote device, other than the second operating device whose screen is being operated, from operating a same content area of ​​the screen displayed by the second other device, the same content area having the same content as the screen displayed by the second operating device.

3. The programmable display according to claim 1, wherein the plurality of remote devices further includes a third remote device, and the control device, in a third case in which the control device permits connection of the first remote device in the synchronous mode, permits connection of the second remote device in the asynchronous mode, and permits connection of the third remote device in the asynchronous mode, when the second remote device is displaying a screen the contents of which are at least partially the same as the screen displayed by the third remote device, prohibits a third other device among the programmable display and the first remote device other than the third operation device whose screen is being operated from operating a same content area of ​​the screen displayed by the third other device, the same content area having the same content as the screen displayed by the third operation device, and prohibits a fourth other device among the second remote device and the third remote device other than the fourth operation device whose screen is being operated from operating a same content area of ​​the screen displayed by the fourth operation device.

4. The programmable display device of claim 1, wherein in the first case, when the second remote device is displaying a screen having at least a portion of the same content as the display screen, the control device causes operation information indicating content related to operations on the screen displayed by the first operating device to be displayed on the screen displayed by the first other device.

5. The programmable display device of claim 4, wherein the control device determines whether an operation on a screen displayed by the first operating device is a valid operation, and in the first case, when the second remote device is displaying a screen having at least a portion of the same content as the display screen, if it determines that the operation on the screen displayed by the first operating device is a valid operation, causes the operation information to be displayed on the screen displayed by the first other device, and if it determines that the operation on the screen displayed by the first operating device is an invalid operation, does not cause the operation information to be displayed on the screen displayed by the first other device.

6. A programmable display as described in claim 1, wherein the screen displayed by the first other device is a screen defining a composite image formed by overlapping a plurality of layer images, and the same content area is an area defining a portion of the layer images among the plurality of layer images included in the composite image.

7. The programmable display device described in claim 6, wherein in the first case, when the second remote device is displaying a screen having at least a portion of the same content as the display screen, the control device sets, for the screen displayed by the first other device, layer images among the plurality of layer images, excluding the layer image defined by the same content area, as images displaying operation information indicating content related to operations on the screen displayed by the first operating device.

8. The programmable display device described in claim 6, wherein, in the first case, when the second remote device is displaying a screen having at least a portion of the same content as the display screen, the control device causes some of the layer images among the plurality of layer images for the screen displayed by the first remote device to be images displayed in a first display format, and causes some of the layer images among the plurality of layer images for the screen displayed by the second remote device to be images displayed in a second display format different from the first display format.

9. A screen synchronization system comprising: a programmable display device according to any one of claims 1 to 8; and a plurality of remote devices.

10. A screen synchronization method for synchronizing screens using a programmable display connectable to a plurality of remote devices including a first remote device and a second remote device, comprising: a display step of displaying a screen on a display unit of the programmable display; and a connection step of permitting connection in a synchronous mode or an asynchronous mode for each of the plurality of remote devices, wherein the synchronous mode is a mode in which the remote devices display a synchronous screen at least a portion of which is synchronized with a display screen displayed by the display unit, and the asynchronous mode is a mode in which the remote devices are permitted to display a screen other than the synchronous screen, and the screen synchronization method further comprises a prohibition step of prohibiting, for other devices among the programmable display, the first remote device, and the second remote device, other than the operating device whose screen is being operated, from operating a same content area of ​​a screen displayed by the other device, the same content area having the same content as a screen displayed by the operating device.