Information processing device, application program, information processing method, touch panel display device, and information processing system

Abstract

One of the objectives is to enable simultaneous touch operations on multiple touch-panel display devices connected to the information processing device using the information processing device's standard functions, and to allow users operating the touch-panel display devices to check the status of the touch operations. [Solution] An information processing device having an OS equipped with a standard API, comprising: a touch data receiving unit that receives touch data from a plurality of touch panel display devices; a touch data transmitting unit that transmits touch data to the OS; and a control unit that selects one of the plurality of touch panel display devices and controls it so that the first touch data received from the one touch panel display device is transmitted to the OS, wherein the control unit supplies selection information to each of the plurality of touch panel display devices indicating whether or not each touch panel display device has been selected.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an application program, an information processing method, a display device with a touch panel, and an information processing system.

Background Art

[0002] With the development of information technology, a multi-monitor environment in which a plurality of monitors with touch panels are connected to a PC (Personal Computer) and used simultaneously for the purpose of improving work efficiency and information visibility is becoming popular. When a plurality of users touch their respective monitors with touch panels simultaneously, the PC needs to identify which monitor the touch operation is from. To solve this problem, a portable terminal that allows multiple users to perform handwritten input simultaneously has been proposed by attaching a terminal ID (identifier) to the handwritten input information on the monitor (see, for example, Patent Document 1). In addition, a touch panel device composed of a plurality of touch panels has been proposed that makes the other touch panels unable to receive information input when a touch from one touch panel is detected (see, for example, Patent Document 2).

Summary of the Invention

Problems to be Solved by the Invention

[0003] The technique disclosed in Patent Document 1 has a problem in that a dedicated controller and an application for attaching a terminal ID to handwritten input information from a plurality of users are required.

[0004] The technique disclosed in Patent Document 2 has a problem in that each user operating the touch panel cannot recognize whether input to the touch panel is permitted or not.

[0005] One embodiment of the present invention has been made in view of the above-mentioned problems, and one of its objectives is to enable processing by the standard functions of the information processing device even when multiple touch operations are performed simultaneously on multiple touch-panel display devices connected to the information processing device, and to enable the user operating the touch-panel display device to confirm the status of the touch operation. [Means for solving the problem]

[0006] An information processing device according to one embodiment of the present invention is an information processing device having an operating system equipped with a standard application programming interface, comprising: a touch data receiving unit that receives touch data from a plurality of touch panel display devices; a touch data transmitting unit that transmits the touch data to the operating system; and a control unit that selects one of the plurality of touch panel display devices and controls it so that a first touch data received from the one touch panel display device is transmitted to the operating system, wherein the control unit supplies selection information to each of the plurality of touch panel display devices indicating whether or not each touch panel display device has been selected. [Effects of the Invention]

[0007] Even when multiple touch-enabled display devices connected to the information processing device are simultaneously touch-operated, the standard functions of the information processing device can handle the operation, and each user can check the status of the touch operation on the touch-enabled display device. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 shows an example of the configuration of an information processing system to which the application program according to the embodiment is applied. [Figure 2] Figure 2 shows an example of the hardware configuration of an information processing device according to an embodiment. [Figure 3]Figure 3 is an example of a functional block diagram of an information processing device according to an embodiment. [Figure 4] Figure 4 shows an example of the hardware configuration of a touch panel display device according to an embodiment. [Figure 5] Figure 5 is an example of a functional block diagram of a touch panel-equipped display device according to an embodiment. [Figure 6] Figure 6 is an example of a control flowchart for selecting a touch-enabled device from among multiple touch-enabled devices that allows touch operation. [Figure 7] Figure 7 is an example of a control flowchart for maintaining the selection state of a touch-panel display device that allows touch operation among multiple touch-panel display devices. [Figure 8] Figure 8 shows an example of a settings screen for setting the duration for which the selected state of a touch-enabled display device that allows touch operation is maintained. [Figure 9A] Figure 9A is an example of a settings screen for setting the priority of touch-enabled display devices that are allowed to be touch-operated. [Figure 9B] Figure 9B shows another example of a settings screen for prioritizing which touch-enabled display devices are allowed to be touch-operated. [Figure 10] Figure 10 is an example of a control flowchart that switches the selection state of a touch-enabled display device that allows touch operation to a touch-enabled display device with a higher priority. [Figure 11] Figure 11 is an example of a display screen in a touch panel-equipped display device according to an embodiment, showing whether or not the touch panel-equipped display device being operated by the user has been selected by the information processing device or application program. [Figure 12] Figure 12 is a schematic diagram showing how the display screen of Figure 11 is generated by a synthesis process performed by an information processing device or application program. [Figure 13] Figure 13 is a schematic diagram showing how the display screen of Figure 11 is generated by a synthesis process using a touch panel display device. [Figure 14A]Figure 14A is an example of a flowchart for controlling the screen generation shown in Figure 13. [Figure 14B] Figure 14B is another example of the control flowchart for screen generation shown in Figure 13. [Modes for carrying out the invention]

[0009] Hereinafter, one embodiment of the present invention will be described in detail with reference to the drawings. In the following embodiment, multiple touch-panel display devices are connected to an information processing device such as a PC, and are made operable using the standard functions of the information processing device. Furthermore, the status of touch operations can be confirmed on the touch-panel display device being operated by the user. The operation of the information processing device may be realized by an application program, or by hardware, firmware, etc. In the following embodiment, an example of an information processing system in which multiple touch-panel display devices are connected to an information processing device such as a PC on which an application program is installed will be described, but the invention is not limited to this example. The application program of the following embodiment may be applied to output devices such as projectors, IWBs (Interactive White Boards: whiteboards with electronic blackboard functions that enable mutual communication), digital signage, medical devices, network home appliances, game consoles, etc., to realize simultaneous use by multiple touch-panel display devices (including portable devices, wearable devices, etc.).

[0010] In the following embodiments, a display device with a touch panel may be referred to as a "monitor with a touch panel," "touch panel monitor," "touch panel display," "touch panel screen," "touch monitor," "touch display," "touch screen," etc. An information processing device such as a PC may be referred to as a "source device" or "external device." A monitor may be referred to as a "display device," "display," "screen," or "external display device." Without distinguishing between applications and programs, an application composed of programs may be referred to as an "application program," "application," "program," etc.

[0011] <System Configuration Diagram> FIG. 1 is an example of the configuration of an information processing system to which an application program according to an embodiment is applied.

[0012] In the information processing system 1, the information processing apparatus 10 is connected to a display device 20 with a touch panel (20a and 20b) by wire or wirelessly. The information processing apparatus 10 also has a connection application 100 for connecting to the display device 20 with a touch panel, an OS (Operating System) 101, and a normal application 102 corresponding to touch operations used by the user.

[0013] When a touch operation is performed on the touch panel by the user, the display device 20 with a touch panel transmits data indicating the touch position and the like of the touch operation (hereinafter referred to as touch data) to the connection application 100 possessed by the information processing apparatus 10.

[0014] The connection application 100 performs appropriate processing on the touch data received from the display device 20 with a touch panel, and then transmits the processed touch data to the OS 101 using an API (Application Programming Interface) standardly installed in the OS 101. This appropriate processing will be described later.

[0015] The OS 101 transmits the touch data received from the connection application 100 to the normal application 102 corresponding to the touch operation in accordance with the standard specifications of the OS 101.

[0016] <Configuration of Information Processing Apparatus> Figure 2 shows an example of the hardware configuration of an information processing device according to an embodiment. The information processing device 10 is built by a computer and includes a CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, RAM (Random Access Memory) 103, HD (Hard Disk) 104, HDD (Hard Disk Drive) controller 105, display 106, external device connection interface (indicated as "I / F" in the figure) 107, network interface 108, bus line 109, keyboard 110, pointing device 111, optical media 112, optical drive 113, recording media 114, and media interface 115.

[0017] The CPU 101 controls the operation of the entire information processing device 10. The ROM 102 stores programs used to drive the CPU 101, such as the IPL (Initial Program Loader). The RAM 103 is used as the work area for the CPU 101. The HD 104 stores various data such as programs and operating systems. The HDD controller 105 controls the reading or writing of various data to the HD 104 according to the control of the CPU 101. The display 106 displays various information such as cursors, menus, windows, characters, images, or videos. The external device connection interface 107 is an interface for connecting various external devices. These external devices may be, for example, USB (Universal Serial Bus) memory, printers, or external display devices.

[0018] The network interface 108 is an interface for data communication using a communication network. The network interface 108 may also be connected to an external display device using a communication network. The bus line 109 is an address bus, data bus, etc., for electrically connecting each component such as the CPU 101 shown in Figure 2. The keyboard 110 is a type of input means equipped with multiple keys for inputting characters, numbers, and various instructions. The pointing device 111 is a type of input means for selecting and executing various instructions, selecting processing targets, moving a cursor, etc. The optical drive 113 controls the reading or writing of various data to the optical media 112, which is an example of a removable recording medium. The optical media 112 may be a CD (Compact Disc), DVD (Digital Versatile Disc), Blu-ray (registered trademark), etc. The media interface 115 controls the reading or writing of data to the recording medium 114, such as flash memory.

[0019] Figure 3 is an example of a functional block diagram of an information processing device according to an embodiment. The information processing device 10 includes a control unit 1000, a video data transmission unit 1001, a touch data reception unit 1002, a connection processing unit 1003, a video data reception unit 1004, a touch data transmission unit 1005, a storage unit 1006, and a UI (User Interface) processing unit 1007. Each of these units is a function or means realized by the CPU 101 of the information processing device 10 executing one or more programs stored in the HD 104, etc., and controlling each piece of hardware of the information processing device 10.

[0020] The control unit 1000 controls the entire information processing device 10. For example, the control unit 1000 may select one external display device from among multiple external display devices to allow touch operation. The control unit 1000 may control the system so that touch data received from the selected external display device is transmitted to the OS 101. The control unit 1000 may supply selection information to the external display device indicating whether or not to allow touch operation. If none of the multiple external display devices that allow touch operation are selected, the control unit 1000 may select the external display device that sent the touch data. Based on the settings of the storage unit 1006, the control unit 1000 may maintain the state in which the external display device is selected until a predetermined time has elapsed since receiving the touch data. Based on the settings of the storage unit 1006, the control unit 1000 may select or switch the external display device that allows touch operation. The control unit 1000 may synthesize the above selection information into the data to be transmitted to the external display device. The above selection information may be referred to as the "selection state" or simply the "state".

[0021] The video data transmission unit 1001 transmits video data to an external display device. The video data receiving unit 1004 receives video data from the external display device. The external display device is, for example, a touch panel display device 20. The data transmitted by the video data transmission unit 1001 and the data received by the video data receiving unit 1004 are not limited to video data. The data transmitted by the video data transmission unit 1001 and the data received by the video data receiving unit 1004 may be, for example, image data.

[0022] The touch data receiving unit 1002 receives touch data from an external display device. The touch data transmitting unit 1005 transmits touch data to the OS 101 using an API that is standardly included in the OS 101.

[0023] The connection processing unit 1003 performs processing for connecting to an external display device by wire or wireless connection. The storage unit 1006 stores the duration for which the external display device is selected. The storage unit 1006 also stores setting information regarding priority for determining which of the multiple external display devices should be given priority for touch operation.

[0024] The UI processing unit 1007 receives settings related to processing in the connection processing unit 1003 and the storage unit 1006 via the UI.

[0025] <Configuration of a touch panel display device> Figure 4 shows an example of the hardware configuration of a touch panel display device according to an embodiment. The touch panel display device 20 includes a CPU 200, ROM 201, RAM 202, display panel 203, touch panel 204, communication interface 205, USB interface 206 (206a and 206b), power supply 207, and battery 208. The number of USB interfaces 206 is just an example.

[0026] The CPU 200 controls the entire hardware of the touch panel display device 20. The ROM 201 stores the firmware of the touch panel display device 20. The RAM 202 is used as the work area for the CPU 200.

[0027] The display panel 203 displays various information received from an external device connected to the USB interface 206 via at least one of the CPU 200, ROM 201, and RAM 202. This external device is, for example, an information processing device 10 such as a PC. This information includes, for example, video data and image data from the external device. The display panel 203 may control the power, brightness, and contrast of the touch panel display device 20 via a user interface (UI).

[0028] When a user performs a touch operation, the touch panel 204 transmits touch data to an external device connected to the USB interface 206 or communication interface 205 via at least one of the CPU 200, ROM 201, and RAM 202. The touch panel 204 may generate and transmit touch data based on the pressure information of the touch. The touch panel 204 may generate and transmit touch data based on the coordinate information of the touch. The touch panel 204 may be a capacitive touch panel. The touch panel 204 may be an infrared touch panel.

[0029] The communication interface 205 is an interface for data communication using a communication network. The communication interface 205 has the functionality of both wired and wireless network connections. The communication interface 205 may also receive various types of information, such as video data and image data, from external devices connected wirelessly.

[0030] The USB interface 206 is an interface for connecting various external devices. The USB interface 206 supplies power from the external device to the power supply 207.

[0031] Power supply 207 provides power for the operation of the touch panel display device 20 and charges the battery 208. The battery 208 operates the touch panel display device 20 by supplying power to power supply 207 if the power supplied via the USB interface 206 is insufficient or unavailable.

[0032] Bus 250 is a bus for electrically connecting the various components, such as the CPU 200 shown in Figure 4.

[0033] Figure 5 is an example of a functional block diagram of a touch panel display device according to an embodiment. The touch panel display device 20 comprises a control unit 2000, a video data processing unit 2001, a touch data processing unit 2002, a display unit 2003, an identifier processing unit 2004, a state processing unit 2005, and a connection processing unit 2006. Each of these units is a function or means realized by the CPU 200 of the touch panel display device 20 executing one or more programs stored in ROM 201, RAM 202, etc., and controlling each hardware of the touch panel display device 20.

[0034] The control unit 2000 controls the entire touch panel display device 20. For example, the control unit 2000 may display on the display unit 2003 whether or not touch operation is permitted on the touch panel display device 20 being operated by the user.

[0035] The video data processing unit 2001 performs specific processing on the video data transmitted from the information processing unit 10. This specific processing may include, for example, the synthesis of a mark indicating whether the touch panel display device 20 being operated by the user is permitted to be touch-operated or not. The data processed by the video data processing unit 2001 is not limited to video data, but may also include, for example, image data. Based on the state received (processed) by the state processing unit 2005, the video data processing unit 2001 may synthesize a mark indicating whether the touch panel display device 20 being operated by the user is permitted to be touch-operated or not. This mark may be referred to as "selection information".

[0036] The touch data processing unit 2002 generates touch data based on pressure information, coordinate information, etc., when the touch panel 204 is touched, and transmits the touch data to the information processing unit 10.

[0037] The display unit 2003 displays video data received from the information processing device 10 on the display panel 203. The video data may be image data. The display unit 2003 may also display video data processed by the video data processing unit 2001 on the display panel 203. The display unit 2003 may also display, based on processing by the control unit 2000, whether or not the touch panel display device 20 being operated by the user is permitted to be touch operated.

[0038] The identifier processing unit 2004 receives (processes) the identifier of the touch panel display device 20 that is permitted to be touch operated from the information processing device 10. The identifier processing unit 2004 determines whether the identifier received from the information processing device 10 matches the identifier of the touch panel display device 20 that the user is operating. If the touch panel display device 20 determines that the two identifiers match, the touch panel display device 20 recognizes that the touch panel display device 20 that the user is operating is permitted to be touch operated. In other words, it recognizes that the touch panel display device 20 that the user is operating is selected by the information processing device 10.

[0039] The state processing unit 2005 receives (processes) from the information processing unit 10 whether the touch panel display device 20 being operated by the user is permitted to be touch-operated. In other words, the state processing unit 2005 receives from the information processing unit 10 whether the touch panel display device 20 being operated by the user has been selected by the information processing unit 10.

[0040] The connection processing unit 2006 performs processing for connecting to the information processing device 10 by wire or wirelessly.

[0041] <Processing flow> Next, the control processing in the information processing device 10 of this embodiment will be described. [Examples]

[0042] Figure 6 is an example of a control flowchart for selecting a touch-enabled device from among multiple touch-enabled devices that allows touch operation.

[0043] In step S600, the information processing device 10 determines whether or not it has received touch data from the touch panel display device 20. If the information processing device 10 determines that it has received the touch data, it proceeds to step S601; if it determines that it has not received the touch data, it executes step S600 again.

[0044] In step S601, the information processing device 10 determines whether or not a touch panel display device 20 has been selected to transmit the received touch data to the OS 101. If the information processing device 10 determines that a touch panel display device 20 has been selected, it proceeds to step S602; otherwise, it proceeds to step S603.

[0045] In step S602, the information processing device 10 determines whether the selected touch panel display device 20 has transmitted the received touch data. If the information processing device 10 determines that the selected touch panel display device 20 has transmitted the data, it proceeds to step S604. If the information processing device 10 determines that the selected touch panel display device 20 has not transmitted the data, it terminates the process shown in Figure 6. As a result, the information processing device 10 does not transmit the received touch data to the OS 101 and terminates this control.

[0046] In step S603, the information processing device 10 selects the touch panel display device 20 that transmitted the received touch data as the touch panel display device 20 to transmit the touch data to the OS 101. As a result, the information processing device 10 has selected the touch panel display device 20 to transmit the touch data to the OS 101.

[0047] In step S604, the information processing device 10 sends the received touch data to the OS 101 using an API that is standardly included in the OS 101.

[0048] Steps S601, S602, and S603 in the flowchart of Figure 6 are examples of appropriate processing to be performed on touch data received from the touch panel display device 20, as described in the configuration of the information processing system above.

[0049] To summarize the control processes described above, if no touch panel display device 20 is selected, the information processing device 10 selects the touch panel display device 20 that has sent touch data. If a touch panel display device 20 is selected, the information processing device 10 sends only the touch data transmitted from the selected touch panel display device 20 to the OS 101, and does not send touch data transmitted from any other touch panel display device 20 to the OS 101.

[0050] Through the control processing described above, even when multiple users use multiple touch-panel display devices 20 simultaneously, users can perform touch operations and handwriting input without causing malfunctions in the information processing device 10.

[0051] ≪Example 1-1≫ Figure 7 is an example of a control flowchart for maintaining the selection state of a touch-panel display device that allows touch operation among multiple touch-panel display devices.

[0052] In step S700, the information processing device 10 determines whether or not it has selected a touch panel display device 20 to send the received touch data to the OS 101. If the information processing device 10 determines that it has selected a touch panel display device 20, it proceeds to step S701. If it determines that it has not selected a touch panel display device 20, it executes step S700 again.

[0053] In step S701, the information processing device 10 determines whether a certain amount of time has elapsed since the last touch data received in the time domain from the selected touch panel display device 20. If the information processing device 10 determines that a certain amount of time has elapsed since the last touch data, it proceeds to step S702. If it determines that a certain amount of time has not elapsed since the last touch data, it executes step S701 again. Note that "certain amount of time" and "predetermined time" may be used interchangeably.

[0054] In step S702, the information processing device 10 deselects the selected touch panel display device 20. As a result, the information processing device 10 is left in a state where no touch panel display device 20 is selected. In other words, the information processing device 10 is left in a state where touch operation is permitted for all touch panel display devices 20 connected to the information processing device 10.

[0055] To summarize the above control processes, the information processing device 10 maintains the selected state until a certain amount of time has elapsed since the last touch data was received from the selected touch panel display device 20. If a certain amount of time has elapsed since the last touch data was received from the selected touch panel display device 20, the information processing device 10 cancels the selected state and returns to a state where none of the touch panel display devices 20 are selected.

[0056] Through the above control processing, even when multiple users use multiple touch-panel display devices 20 simultaneously, users can perform touch operations and handwriting input without causing malfunctions in the information processing device 10.

[0057] Figure 8 shows an example of a settings screen for setting the duration for which the selected state of a touch-panel display device that allows touch operation is maintained.

[0058] On the settings screen 10000 of the information processing device 10, the user sets the time for which the selected touch panel display device 20 will remain selected.

[0059] For example, when multiple users frequently perform touch operations during brainstorming sessions, the touch-enabled display device 20, which maintains a selected state, also needs to be switched frequently. Therefore, it is desirable to maintain the selected state of the touch-enabled display device 20 for approximately one second.

[0060] For example, if only the presenter performs touch operations during a presentation, there is no need to switch the selected touch panel display device 20. For example, if multiple users perform touch operations infrequently during a presentation, it is sufficient to switch the selected touch panel display device 20 infrequently. Therefore, it is desirable to maintain the selected state of the touch panel display device 20 for about 3 to 5 seconds. This prevents the state in which touch operations are permitted from shifting to a different touch panel display device 20 while a user is performing handwriting input on a touch panel display device 20 that is permitted for touch operations.

[0061] Through the above process, even when multiple users use multiple touch-panel display devices 20 simultaneously, users can perform touch operations and handwriting input without causing malfunctions in the information processing device 10. Furthermore, it prevents the selected state of the touch-panel display device 20 from being immediately deselected.

[0062] Examples 1-2 Figures 9A and 9B are both examples of setting screens for configuring the priority of touch-enabled display devices that are allowed to be touch-operated.

[0063] ≪Example 1-2-1≫ As shown in Figure 9A, the user sets the priority order for allowing touch operations on multiple touch-panel display devices 20 in the settings screen 10001 of the information processing device 10. The user may set different priority orders among the names of touch-panel display devices in the settings screen 10001, for example by clicking the arrow next to the name of the touch-panel display device.

[0064] The user may configure the settings screen 10001 to prioritize allowing touch operation on touch-enabled display devices 20 with lower priority numbers corresponding to the names of the touch-enabled display devices. Alternatively, the user may configure the settings screen 10001 to prioritize allowing touch operation on touch-enabled display devices 20 with higher priority numbers corresponding to the names of the touch-enabled display devices.

[0065] In the settings screen 10001, the touch-panel display device 20 displayed as the name of the touch-panel display device is the touch-panel display device 20 registered in the information processing device 10. Registration in the information processing device 10 may be performed based on the connection record from the touch-panel display device 20 to the information processing device 10. The connection record from the touch-panel display device 20 to the information processing device 10 may be based on the number of connections, connection time, etc., between the information processing device 10 and the touch-panel display device 20. Registration in the information processing device 10 may also be performed based on setting information entered by the user in the information processing device 10. The setting information entered by the user may be the unique name of the touch-panel display device 20 (MAC (Media Access Control) address, serial number, etc.).

[0066] With the above settings, the user can determine the priority order for granting touch operation permissions to multiple touch-panel display devices 20 without duplication.

[0067] ≪Example 1-2-2≫ As shown in Figure 9B, the user sets the priority order for granting touch operation permissions to multiple touch-panel display devices 20 on the settings screen 10002 of the information processing device 10. The difference from Figure 9A is that the priority order set by the user can be the same.

[0068] The user may configure the settings screen 10002 to prioritize touch operation on touch-enabled display devices 20 with lower priority numbers corresponding to their names, for example. The user may also configure the settings screen 10002 to prioritize touch operation on touch-enabled display devices 20 with higher priority numbers corresponding to their names, for example. If there are multiple touch-enabled display devices 20 with the same priority number corresponding to their names, for example, on the settings screen 10002, these multiple touch-enabled display devices 20 do not need to be configured to prioritize touch operation.

[0069] In the settings screen 10002, the touch panel display device 20 displayed as the name of the touch panel display device is the touch panel display device 20 registered in the information processing device 10. Registration in the information processing device 10 may be performed based on the connection history from the touch panel display device 20 to the information processing device 10. The connection history from the touch panel display device 20 to the information processing device 10 may be the same as in Example 1-2-1.

[0070] With the above settings, the user can flexibly determine the priority for granting permission for touch operations on multiple touch-panel display devices 20.

[0071] Figure 10 is an example of a control flowchart that switches the selection state of a touch-enabled display device that allows touch operation to a touch-enabled display device with a higher priority.

[0072] In step S1000, the information processing device 10 determines whether or not it has received touch data from the touch panel display device 20. If the information processing device 10 determines that it has received the touch data, it proceeds to step S1001. If it determines that it has not received the touch data, it executes step S1000 again.

[0073] In step S1001, the information processing device 10 determines whether or not a touch panel display device 20 has been selected to transmit the received touch data to the OS 101. If the information processing device 10 determines that a touch panel display device 20 has been selected, it proceeds to step S1002; otherwise, it proceeds to step S1003.

[0074] In step S1002, the information processing device 10 determines whether the selected touch panel display device 20 has transmitted the received touch data. If the information processing device 10 determines that the selected touch panel display device 20 has transmitted the data, it proceeds to step S1007. If the information processing device 10 determines that the selected touch panel display device 20 has not transmitted the data, it proceeds to step S1004.

[0075] In step S1003, the information processing device 10 selects the touch panel display device 20 that transmitted the received touch data as the touch panel display device 20 to transmit the touch data to the OS 101. As a result, the information processing device 10 has selected the touch panel display device 20 to transmit the touch data to the OS 101.

[0076] In step S1004, the information processing device 10 determines whether the priority for granting touch operation to the touch panel display device 20 that sent the received touch data is higher than the priority for granting touch operation to the selected touch panel display device 20. If the priority for granting touch operation to the touch panel display device 20 that sent the received touch data is higher than the priority for granting touch operation to the selected touch panel display device 20, the information processing device 10 proceeds to step S1005.

[0077] In step S1005, the information processing device 10 deselects the selected touch panel display device 20. As a result, the information processing device 10 is left in a state where no touch panel display device 20 is selected. In other words, the information processing device 10 is left in a state where touch operation is permitted for all touch panel display devices 20 connected to the information processing device 10.

[0078] In step S1006, similar to S1003, the information processing device 10 selects the touch panel display device 20 that transmitted the received touch data as the touch panel display device 20 to transmit the touch data to the OS 101. Here, "the touch panel display device 20 that transmitted the received touch data" means "the touch panel display device 20 with a high priority for granting permission for touch operations." As a result, the information processing device 10 has selected the touch panel display device 20 to transmit the touch data to the OS 101.

[0079] In step S1007, the information processing device 10 sends the received touch data to the OS 101 using an API that is standardly installed in the OS 101, and then terminates the process.

[0080] In step S1004, if the priority for granting touch operation to the touch panel display device 20 that sent the received touch data is lower than the priority for granting touch operation to the selected touch panel display device 20, or if these priorities are the same, the process shown in Figure 10 is terminated. As a result, the information processing device 10 does not switch the touch panel display device 20 to which touch operation is permitted.

[0081] Steps S1001, S1002, S1003, S1004, S1005, and S1006 in the flowchart of Figure 10 are examples of appropriate processing to be performed on touch data received from the touch panel display device 20, as described in the configuration of the information processing system above.

[0082] To summarize the above processes, even if a touch-enabled display device 20 that allows touch operation is selected, if the touch data received by the information processing device 10 is transmitted from a touch-enabled display device 20 with a higher priority than the selected touch-enabled display device 20, the information processing device 10 switches the touch-enabled display device 20 that allows touch operation to the higher-priority touch-enabled display device 20, thereby transmitting the touch data received by the information processing device 10 to the OS 101. If the touch data received by the information processing device 10 is transmitted from a touch-enabled display device 20 with a lower priority than the selected touch-enabled display device 20, the information processing device 10 does not transmit the touch data received to the OS 101. If the touch data received by the information processing device 10 is transmitted from a touch-enabled display device 20 with the same priority as the selected touch-enabled display device 20, the information processing device 10 does not transmit the touch data received to the OS 101.

[0083] Through the above processing, if a priority order for granting permission for touch operations on multiple touch-panel display devices 20 is set, the information processing device 10 can appropriately transmit touch data to the OS 101 based on that priority order. [Examples]

[0084] Figure 11 is an example of a display screen in a touch panel-equipped display device according to an embodiment, showing whether or not the touch panel-equipped display device 20 being operated by the user has been selected by the application program.

[0085] Figure 11(A) shows an example of the display panel of the touch panel display device 20 when the touch panel display device 20 being operated by the user is selected. A mark indicating that touch operation is permitted is displayed on the display panel 203 of the touch panel display device 20 being operated by the user.

[0086] Figure 11(B) shows an example of the display panel of the touch panel display device 20 when the touch panel display device 20 being operated by the user is not selected. A mark indicating that touch operation is not permitted is displayed on the display panel 203 of the touch panel display device 20 being operated by the user.

[0087] The mark indicating the status of touch operation permission to be displayed on the display panel 203 may be displayed on the display panel 203 at all times, as shown in Figures 11(A) and 11(B). The mark indicating the status of touch operation permission to be displayed on the display panel 203 may also be displayed on the display panel 203 by blinking at relatively short intervals, such as milliseconds.

[0088] By the method described above, the user can easily determine whether or not the touch-enabled display device 20 being operated by the user is permitted to be touch-enabled, without having to touch the touch-enabled display device 20 itself.

[0089] ≪Example 2-1≫ Figure 12 is a schematic diagram showing how the display screen of Figure 11 is generated by a synthesis process performed by an information processing device or application program. As described below, the images displayed on the multiple touch panel display devices 20 are the data shown in Figure 12(C).

[0090] Figure 12(A) shows an example of original data transmitted from the information processing device 10. In this example, the transmitted data is image data.

[0091] Figure 12(B) shows an example of data generated by the information processing device 10. In this example, the generated data is image data indicating that the touch panel display device 20 being operated by the user, as shown in Figure 11(A), is selected. The generated data may also be image data indicating that the touch panel display device 20 being operated by the user, as shown in Figure 11(B), is not selected.

[0092] Figure 12(C) shows an example of data transmitted from the information processing device 10 to the touch panel display device 20. In this example, the transmitted data is image data synthesized by the information processing device 10 from the data in Figures 12(A) and 12(B). By transmitting this image data to the touch panel display device 20, the information processing device 10 displays a mark on the display panel 203 of the touch panel display device 20, along with the original data transmitted from the information processing device 10, indicating that touch operation is permitted. The information processing device 10 may also transmit image data synthesized by the information processing device 10 from data different from the data in Figures 12(A) and 12(B) to the touch panel display device 20, thereby displaying a mark on the display panel 203 of the touch panel display device 20, along with the original data transmitted from the information processing device 10, indicating that touch operation is not permitted.

[0093] By the above method, the information processing device 10 can display a mark corresponding to the selected state regarding permission for touch operation for each touch panel display device, even when multiple touch panel display devices 20 are connected to the information processing device 10, by switching and combining a mark indicating whether or not the touch panel display device 20 is permitted to be touched with the data transmitted from the information processing device 10. Furthermore, the user can easily determine whether or not the touch panel display device 20 being operated is permitted to be touched without having to touch the touch panel display device 20 itself.

[0094] ≪Example 2-2≫ Figure 13 is a schematic diagram showing how the display screen of Figure 11 is generated by a synthesis process using a touch panel display device. As explained below, the images displayed on the multiple touch panel display devices 20 are the data shown in Figure 13(C).

[0095] Figure 13(A) shows an example of original data received by the touch panel display device 20. In this example, the received data is image data. Unlike Figure 12, the image data transmitted from the information processing device 10 to the touch panel display device 20 is transmitted without any processing.

[0096] Figure 13(B) shows an example of data generated by the touch panel display device 20. In this example, the generated data is image data indicating that the touch panel display device 20 being operated by the user is selected, as shown in Figure 11(A). The generated data may also be image data indicating that the touch panel display device 20 being operated by the user is not selected, as shown in Figure 11(B).

[0097] Figure 13(C) shows an example of data displayed on the touch panel display device 20. In this example, the displayed data is image data synthesized by the touch panel display device 20 from the data in Figures 13(A) and 13(B). By synthesizing the image data in Figures 13(A) and 13(B), the touch panel display device 20 displays a mark on the display panel 203 of the touch panel display device 20 indicating that touch operation is permitted, along with the original data received by the touch panel display device 20. The touch panel display device 20 may also synthesize data different from the data in Figures 13(A) and 13(B) to display a mark on the display panel 203 of the touch panel display device 20 indicating that touch operation is not permitted, along with the original data received by the touch panel display device 20.

[0098] By the above method, the touch panel display device 20 can display a mark corresponding to the selected state regarding permission for touch operation for each touch panel display device 20, even when multiple touch panel display devices 20 are connected to the information processing device 10, by switching and combining a mark indicating whether or not the touch panel display device 20 is permitted to perform touch operations with the data received by the touch panel display device 20. Furthermore, the user can easily determine whether or not the touch panel display device 20 being operated is permitted to perform touch operations without having to touch the touch panel display device 20 itself.

[0099] ≪Example 2-2-1≫ Figure 14A is an example of a flowchart for controlling the screen generation shown in Figure 13.

[0100] In step S1400, the multiple touch panel display devices 20 determine whether they have received an identifier from the information processing device 10 indicating which touch panel display device 20 is permitted to be touch-operated. This identifier may be a value based on the unique name of the touch panel display device 20. If the touch panel display device 20 and the information processing device 10 are wirelessly connected, this identifier may be a value based on the SSID (Service Set Identifier).

[0101] The identifier may be transmitted each time the selection state regarding permission for touch operation is changed in the information processing device 10. The identifier may be transmitted to only one of the multiple touch panel display devices 20, or to two or more.

[0102] In step S1401, the multiple touch panel display devices 20 determine whether the received identifier matches the identifier of the touch panel display device 20 being operated by the user. If they match, the process proceeds to step S1402; otherwise, the process proceeds to step S1403.

[0103] In step S1402, the multiple touch panel display devices 20 display a mark indicating that touch operation is permitted.

[0104] In step S1403, the multiple touch panel display devices 20 display a mark indicating that touch operation is not permitted.

[0105] Through the control process described above, the information processing device 10 only needs to send the same identifier to multiple touch panel display devices 20, thus reducing the processing load on the information processing device 10.

[0106] ≪Example 2-2-2≫ Figure 14B is another example of the control flowchart for screen generation shown in Figure 13.

[0107] In step S1410, the multiple touch panel display devices 20 determine whether they have received a status from the information processing device 10 indicating whether or not touch operation of the touch panel display devices 20 is permitted. This status may be transmitted each time the selection status regarding permission for touch operation is changed in the information processing device 10.

[0108] In step S1411, the multiple touch panel display devices 20 determine whether the received status allows touch operation. If the determination is that touch operation is permitted, the process proceeds to step S1412; otherwise, the process proceeds to step S1413.

[0109] In step S1412, the multiple touch panel display devices 20 display a mark indicating that touch operation is permitted.

[0110] In step S1413, the multiple touch panel display devices 20 display a mark indicating that touch operation is not permitted.

[0111] As a result of the above control processing, multiple touch panel display devices 20 no longer need to perform the process of determining an identifier that indicates a touch panel display device 20 for which touch operation is permitted, thereby reducing the processing load on the touch panel display devices 20.

[0112] Thus, according to one embodiment of the present invention, even when multiple touch-enabled display devices 20 connected to the information processing device are touch-enabled simultaneously, the information processing device 10 can process the data using its standard functions, and each user can check the status of the touch-enabled display device 20.

[0113] Although the present invention has been described above based on one embodiment, the present invention is not limited to the requirements shown in the above embodiment. These points can be modified as long as they do not impair the spirit of the present invention, and can be appropriately determined according to the application. The embodiments described above can be combined with each other.

[0114] The functions in each embodiment described above can be realized by one or more processing circuits. Here, the processing circuits include processors programmed to execute each function by software, such as processors implemented by electronic circuits, and devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules designed to execute each of the functions described above.

[0115] The apparatus described in the above embodiments represents only one of several computing environments for carrying out one embodiment disclosed herein. In one embodiment, the information processing device 10 includes a plurality of computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including a network or shared memory, and perform the processing disclosed herein. Similarly, the touch panel display device 20 may include a plurality of computing devices configured to communicate with the information processing device 10.

[0116] Examples of the present invention are as follows: <1> In an information processing device having an operating system equipped with a standard application programming interface, A touch data receiving unit that receives touch data from multiple touch panel display devices, A touch data transmission unit that transmits the touch data to the operating system, The system includes a control unit that selects one of the plurality of touch-panel display devices and controls it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, The information processing apparatus is characterized in that the control unit supplies selection information to each of the plurality of touch panel-equipped display devices indicating whether or not each touch panel-equipped display device is selected. <2> When the control unit receives the first touch data from the first touch panel display device while none of the plurality of touch panel display devices are selected, it selects the first touch panel display device. <1> The information processing device described above. <3> The control unit maintains the selected state of the first touch panel display device until a predetermined time has elapsed since receiving the first touch data from the first touch panel display device. <2> The information processing device described above. <4> The system further includes a storage unit that stores setting information regarding the priority order of touch panel display devices to be selected from among the plurality of touch panel display devices, When the control unit receives two or more touch data simultaneously from the multiple touch panel display devices, it selects one of the touch panel display devices based on the setting information. <1> from <3> An information processing device as described in any one of the items. <5> The system further includes a storage unit that stores setting information regarding the priority order of touch panel displays to be selected from the aforementioned plurality of touch panel displays, When the control unit is selected and receives second touch data from a second touch panel display device which has a higher priority than the first touch panel display device, it selects the second touch panel display device. <2> or <3> The information processing device described above. <6> The system further includes a video data transmission unit that transmits video data to the aforementioned plurality of touch panel-equipped display devices, The control unit generates composite data by combining the selection information with the video data to be transmitted to the plurality of touch panel display devices, and supplies the composite data to the plurality of touch panel display devices. <1> from <5> An information processing device as described in any one of the items. <7> An application program installed on an information processing device having an operating system equipped with a standard application programming interface, Processing to receive touch data from multiple touch panel display devices, A process of transmitting the touch data to the operating system, A process of selecting one of the plurality of touch-panel display devices and controlling it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, An application program that causes the information processing device to perform the following process: supplying each of the plurality of touch panel-equipped display devices with selection information indicating whether or not each touch panel-equipped display device is selected. <8> An information processing method executed by an information processing device having an operating system equipped with a standard application programming interface, The steps include receiving touch data from multiple touch panel display devices, The steps include: transmitting the touch data to the operating system; The steps include selecting one of the plurality of touch-panel display devices and controlling it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, An information processing method performed by an information processing device, comprising the step of supplying each of the plurality of touch panel-equipped display devices with selection information indicating whether or not each touch panel-equipped display device is selected. <9> A display device with a touch panel connected to an information processing device, A touch data processing unit that generates touch data based on touch operation and transmits the touch data to the information processing device, A state processing unit receives selection information from the information processing unit indicating whether or not the touch panel display device has been selected by the information processing unit, and processes the selection information. A touch panel display device having a control unit that causes the selection information to be displayed on the touch panel display device. <10> The system further includes a video data processing unit that combines the touch data and the selection information to generate composite data. The control unit causes the composite data to be displayed on the touch panel display device. <9> A touch panel display device as described above. <11> An information processing system comprising an information processing device and a plurality of touch panel display devices connected to the information processing device, The aforementioned information processing device is An information processing device having an operating system equipped with a standard application programming interface, A touch data receiving unit that receives touch data from the plurality of touch panel-equipped display devices, A touch data transmission unit that transmits the touch data to the operating system, The system includes a control unit that selects one of the plurality of touch-panel display devices and controls it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, The control unit is characterized by supplying each of the plurality of touch panel-equipped display devices with selection information indicating whether or not each touch panel-equipped display device is selected. The aforementioned plurality of touch panel-equipped display devices are A touch data processing unit that generates the touch data based on a touch operation and transmits the touch data to the information processing device, A state processing unit receives the selection information from the information processing device and processes the selection information, An information processing system characterized by having a control unit that causes the selection information to be displayed on each of the touch panel-equipped display devices. [Explanation of Symbols]

[0117] 1. Information Processing System 10 Information Processing Devices 20 Touchscreen Display Devices 100 connected applications 101 OS 203 Display Panel 1001 Video data transmission unit 1002 Touch data receiving unit 1004 Video data receiving unit 1005 Touch data transmission unit 1006 Storage section 2001 Video Data Processing Unit 2002 Touch Data Processing Unit 2003 Display section 2004 Identifier Processing Unit 2005 Status Processing Unit [Prior art documents] [Patent Documents]

[0118] [Patent Document 1] Patent No. 6161544 [Patent Document 2] Japanese Patent Publication No. 2018-005681

Claims

1. In an information processing device having an operating system equipped with a standard application programming interface, A touch data receiving unit that receives touch data from multiple touch panel display devices, A touch data transmission unit that transmits the touch data to the operating system, The system includes a control unit that selects one of the plurality of touch-panel display devices and controls it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, The information processing apparatus is characterized in that the control unit supplies selection information to each of the plurality of touch panel-equipped display devices indicating whether or not each touch panel-equipped display device is selected.

2. The information processing apparatus according to claim 1, wherein the control unit selects the first touch display device when it receives the first touch data from the first touch display device while none of the plurality of touch display devices is selected.

3. The information processing apparatus according to claim 2, wherein the control unit maintains the selected state in which the first touch panel display device is selected until a predetermined time has elapsed since receiving the first touch data from the first touch panel display device.

4. The system further includes a storage unit that stores setting information regarding the priority order of touch panel display devices to be selected from among the plurality of touch panel display devices, The information processing apparatus according to claim 1, wherein the control unit, when it receives two or more touch data simultaneously from the plurality of touch panel display devices, selects one of the touch panel display devices based on the setting information.

5. The system further includes a storage unit that stores setting information regarding the priority order of touch panel displays to be selected from the aforementioned plurality of touch panel displays, The information processing apparatus according to claim 2, wherein the control unit, while the first touch panel display device is selected, selects the second touch panel display device when it receives second touch data from a second touch panel display device having a higher priority than the first touch panel display device.

6. The system further includes a video data transmission unit that transmits video data to the aforementioned plurality of touch panel-equipped display devices, The information processing apparatus according to claim 1, wherein the control unit generates composite data by combining the selection information with the video data to be transmitted to the plurality of touch panel display devices, and supplies the composite data to the plurality of touch panel display devices.

7. An application program installed on an information processing device having an operating system equipped with a standard application programming interface, Processing to receive touch data from multiple touch panel display devices, A process of transmitting the touch data to the operating system, A process to select one of the plurality of touch-panel display devices and control it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, An application program that causes the information processing device to perform the following process: supplying each of the plurality of touch panel-equipped display devices with selection information indicating whether or not each touch panel-equipped display device is selected.

8. An information processing method executed by an information processing device having an operating system equipped with a standard application programming interface, The steps include receiving touch data from multiple touch panel display devices, The steps include: transmitting the touch data to the operating system; The steps include selecting one of the plurality of touch-panel display devices and controlling it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, An information processing method performed by an information processing device, comprising the step of supplying each of the plurality of touch panel-equipped display devices with selection information indicating whether or not each touch panel-equipped display device is selected.

9. A display device with a touch panel connected to an information processing device, A touch data processing unit that generates touch data based on touch operation and transmits the touch data to the information processing device, A state processing unit receives selection information from the information processing unit indicating whether or not the touch panel display device has been selected by the information processing unit, and processes the selection information. A touch panel display device having a control unit that causes the selection information to be displayed on the touch panel display device.

10. The system further includes a video data processing unit that combines the touch data and the selection information to generate composite data. The touch panel display device according to claim 9, wherein the control unit causes the touch panel display device to display the composite data.

11. An information processing system comprising an information processing device and a plurality of touch panel display devices connected to the information processing device, The aforementioned information processing device is The information processing device having an operating system equipped with a standard application programming interface, A touch data receiving unit that receives touch data from the plurality of touch panel-equipped display devices, A touch data transmission unit that transmits the touch data to the operating system, The system includes a control unit that selects one of the plurality of touch-panel display devices and controls it so that the first touch data received from the one touch-panel display device is transmitted to the operating system, The control unit is characterized by supplying each of the plurality of touch panel-equipped display devices with selection information indicating whether or not each touch panel-equipped display device is selected. The aforementioned plurality of touch panel-equipped display devices are A touch data processing unit that generates the touch data based on a touch operation and transmits the touch data to the information processing device, A state processing unit receives the selection information from the information processing device and processes the selection information, An information processing system characterized by having a control unit that causes the selection information to be displayed on each of the touch panel-equipped display devices.

Images