Display system, control method, recording medium, and display device
By establishing a communication connection between multiple display devices, sending and receiving input information, the problem of difficulty in smooth switching between different input devices in the prior art is solved, and efficient input switching of the display system is realized.
Patent Information
- Application Number
- CN201980102358.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-11-27
- Publication Date
- 2025-07-01
- Estimated Expiration
- 2039-11-27
AI Technical Summary
In the case where multiple display devices are connected in a cascade, it is difficult for the prior art to smoothly switch between inputs of different input devices.
By establishing a communication connection between the first display device and the second display device, the second control unit sends the second information it receives to the first control unit, so that the first control unit can grasp the latest second information in real time, thereby achieving smooth switching of inputs.
In the case where multiple display devices are connected in a cascade manner, input received from the first display device and input received from the second display device can be smoothly switched.
Smart Images

Figure CN114730208B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a display system, a display method, and a computer program. Background Art
[0002] In recent years, KVM switches (K: keyboard, V: video, M: mouse) have been disclosed, which are connected to a plurality of computers, display devices, and input devices, and cascade-connect a plurality of KVM switches that switch the operated computer according to the input of the input device (for example, Patent Document 1). In this patent document, only one KVM switch is connected to the input devices (mouse and keyboard).
[0003] Prior Art Documents
[0004] Patent Documents
[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-85690 Summary of the Invention
[0006] (Problems to be Solved by the Invention)
[0007] On the other hand, when each of a plurality of display devices includes an input device and a computer switching mechanism, and the plurality of display devices are cascade-connected, it is necessary to be able to smoothly switch between the input from one input device and the input from another input device.
[0008] The present invention has been made in view of such circumstances, and an object thereof is to provide a display system that can smoothly switch inputs from different input devices when each of a plurality of display devices includes an input device.
[0009] (Technical Means for Solving the Problems)
[0010] According to the present invention, there is provided a display system including a first display device and a second display device. The first display device includes a first display unit, a first control unit, and a first input device. The second display device includes a second display unit, a second control unit, and a second input device. The first display unit displays a first image output from at least one first computer. The second display unit displays a second image output from at least one second computer. The first control unit receives an input of first information output from the first input device that operates the first and second computers. The second control unit receives an input of second information output from the second input device that operates the second computer. The second control unit also sends the second information received by the second control unit to the first control unit.
[0011] With such a structure, the second information received by the second control unit is sent to the first control unit, and the first control unit can grasp the latest second information. As a result, the input received from the first display device and the input received from the second display device can be smoothly switched.
[0012] Hereinafter, various embodiments of the present invention will be exemplified. The embodiments shown below can be combined with each other. Also, each feature independently constitutes an invention.
[0013] Preferably, the first information is information specifying a position in the first and second display units, and the second information is information specifying a position in the second display unit.
[0014] Preferably, the first information is key data, and the second information is information specifying a position in the second display unit.
[0015] Preferably, the second control unit receives the input of the second information by a touch operation on the second display unit.
[0016] Preferably, at least one of the first display device and the second display device is connected to a plurality of computers, and the display unit provided in the display device connected to the plurality of computers performs split display in which the image output by the plurality of connected computers is divided into a plurality of regions, and it is possible to operate the computer corresponding to the input operation target region in the plurality of regions.
[0017] Preferably, the second display device is connected to a plurality of the second computers, the second display unit performs split display in which the image output by the second computers is divided into a plurality of regions, and the second control unit sends the configuration information about the plurality of regions to the first control unit.
[0018] According to another aspect of the present invention, there is provided a control method for a display system, the display system including a first display device and a second display device, the first display device including a first display unit, a first control unit, and a first input device, the second display device including a second display unit, a second control unit, and a second input device, the control method including: a step of displaying a first image output by at least one first computer on the first display unit; a step of displaying a second image output by at least one second computer on the second display unit; a step of causing the first control unit to receive an input of first information output by the first input device that operates the first and second computers; a step of causing the second control unit to receive an input of second information output by the second input device that operates the second computer; a step of causing the second control unit to send the second information received by the second control unit to the first control unit.
[0019] According to another aspect of the present invention, there is provided a computer program for causing a display system to function. The display system includes a first display device and a second display device. The first display device includes a first display unit, a first control unit, and a first input device. The second display device includes a second display unit, a second control unit, and a second input device. The computer program causes the first display unit to display a first image output by at least one first computer, causes the second display unit to display a second image output by at least one second computer, causes the first control unit to receive an input of first information output by the first input device for operating the first and second computers, causes the second control unit to receive an input of second information output by the second input device for operating the second computer, and causes the second control unit to send the second information received by the second control unit to the first control unit.
[0020] According to another aspect of the present invention, there is provided a display device including a display unit, a control unit, and an input device. The display unit displays an image output by at least one computer. The control unit can communicate with a second display device including a second display unit and a second input device, receive an input of first information output by the input device for operating the computer, and receive second information output by the second input device from the second display device. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 FIG. is a diagram showing the hardware configuration of the display system 1.
[0022] Figure 2 FIG. is a block diagram showing the functional configuration of the display system 1.
[0023] Figure 3 FIG. is a diagram for explaining a coordinate management method of the first display unit 16 and the second display unit 26 in the first main control unit 13.
[0024] Figure 4 FIG. is a diagram for explaining the operation of the display system 1 when a part of the first display device 10 is operated by the operating device 2.
[0025] Figure 5 FIG. is a diagram for explaining the operation of the display system 1 when the touch panel of the first display unit 16 is operated for a part of the first display device 10.
[0026] Figure 6 FIG. is a diagram for explaining the operation of the display system 1 when a part of the second display device 20 is operated by the operating device 2.
[0027] Figure 7This describes the operation of the display system 1 when the touch panel of the second display unit 26 is operated in a partial area of the second display device 20.
[0028] Figure 8 This is a diagram showing the hardware configuration of the display system 1 when a plurality of display devices are connected in cascade.
[0029] Figure 9 This is a diagram showing the hardware configuration of the display system 1 when a plurality of display devices are connected in parallel. Detailed implementation
[0030] <1. Hardware configuration of the display system 1>
[0031] Refer to Figure 1 , and describe the hardware configuration of the display system 1. As Figure 1 shown, the display system 1 includes a first display device 10, a second display device 20, and a plurality of PCs (Personal Computers) 3a to 3h that are computers. The first display device 10 and the second display device 20 are configured to be connected to each other through a control signal cable 5 and be able to communicate.
[0032] The first display device 10 and the second display device 20 are connected to the plurality of PCs 3a to 3h through an image signal cable 4 and a control signal cable 5. Specifically, the first display device 10 is connected to the PCs 3a to 3d that are the first computers, and the second display device 20 is connected to the PCs 3e to 3h that are the second computers. It should be noted that the image signal cable 4 and the control signal cable 5 can also be combined into one cable.
[0033] The first display unit 16 included in the first display device 10 is configured to be divisible into a plurality of areas D1 to D4. The images output from the PCs 3a to 3d are displayed as the first images in the areas D1 to D4 of the first display unit 16. And, the second display unit 26 included in the second display device 20 is configured to be divisible into a plurality of areas D5 to D8. The images output from the PCs 3e to 3h are displayed as the second images in the areas D5 to D8 of the second display unit 26. It should be noted that the images in this embodiment refer to static images or dynamic images.
[0034] An operating device 2 for operating the first and second computers is connected to the first display device 10. For example, the operating device 2 is a pointing device or a key data output device. More specifically, the pointing device is a mouse, and the key data output device is a hardware or software keyboard. In the present embodiment, a keyboard 2a and a mouse 2b as the operating device 2 are connected to the first display device 10. By performing a typing operation using the keyboard 2a and a cursor control operation using the mouse 2b, the user can operate the PCs 3a to 3d connected to the first display device 10 and the PCs 3e to 3h connected to the second display device 20.
[0035] The first display unit 16 included in the first display device 10 and the second display unit 26 included in the second display device 20 have the function of a touch screen display. The user can operate the PCs 3a to 3d connected to the first display device 10 by touching the first display unit 16. Also, the user can operate the PCs 3e to 3h connected to the second display device 20 by touching the second display unit 26.
[0036] <2. Functional Structure of Display System 1>
[0037] (2.1. First Display Device 10)
[0038] Refer to Figure 2 to describe the functional structure of the display system 1. As Figure 2 shown, the first display device 10 includes a first control unit 11 and a first display unit 16. The first control unit 11 includes an input receiving unit 12, a first main control unit 13, a touch panel control unit 14, and a communication unit 15.
[0039] The input receiving unit 12 receives the input of the first information output from the operating device 2 as the first input device and the touch panel control unit 14. The first main control unit 13 reads a program stored in a storage unit (not shown) to perform various arithmetic processes, and is constituted by, for example, a CPU or the like. When the input information received from the input receiving unit 12 is the movement information of the cursor in the first display unit 16 or the second display unit 26 according to the mouse 2b, the first main control unit 13 moves the cursor on the first display unit 16 or the second display unit 26 based on the movement amount.
[0040] By performing a cursor operation using the mouse 2b on the first display unit 16, the user can input, as the first information, the movement amount as the information specifying the position in the first display unit 16 to the input receiving unit 12. Also, by performing a cursor operation using the mouse 2b on the second display unit 26, the user can input, as the first information, the movement amount as the information specifying the position in the second display unit 26 to the input receiving unit 12.
[0041] The touch panel control unit 14 is formed of, for example, an electrode film having a conductive layer, detects a touch operation of a user on the first display unit 16, and conveys coordinate information indicating information on a position in the first display unit 16 as first information to the input receiving unit 12. The communication unit 15 performs communication of various signals between the first display device 10 and the PCs 3a to 3d.
[0042] The first display unit 16 is configured to display input image data as an image, and is formed of, for example, a liquid crystal display, an organic EL display, a touch screen display, electronic paper, or other displays.
[0043] (2.2. Second display device 20)
[0044] The second display device 20 includes a second control unit 21 and a second display unit 26. The second control unit 21 includes an input receiving unit 22, a second main control unit 23, a touch panel control unit 24 as a second input device, and a communication unit 25. Except that the input receiving unit 22 receives an input of second information that is output from the touch panel control unit 24 and indicates information on a position in the second display unit 26, the structure of the second display device 20 is the same as that of the first display device 10, and thus will not be described repeatedly. Information indicating a position in the second display unit 26 is, for example, coordinate information in the second display unit 26.
[0045] In addition, the first main control unit 13 of the first display device 10 and the second main control unit 23 of the second display device 20 are configured to be capable of two-way communication via a control signal cable 5. For example, it is configured to be capable of communicating via USB (Universal Serial Bus) communication, RS232 (Recommended Standard 232) communication, or UART (Universal Asynchronous Receiver Transmitter) communication, etc.
[0046] Specifically, the first main control unit 13 sends input information from the keyboard 2a, input information from the mouse 2b, and information on the PCs 3e to 3h connected to the second display device 20 to the second main control unit 23. On the other hand, the second main control unit 23 sends information on the configuration of a plurality of regions in the second display unit 26 and information on a touch operation on the second display unit 26 to the first main control unit 13. Information on the configuration of a plurality of regions in the second display unit 26 is, for example, layout information of the plurality of regions. Specifically, it is information indicating the positions of a plurality of regions D5 to D8 in the second display unit 26. Sending of information on a touch operation on the second display unit 26 will be described in detail later.
[0047] Each of the above-described components can be implemented by software or by hardware. When implemented by software, various functions can be realized by the CPU executing a program. The program can be stored in the built-in storage unit or in a computer-readable non-transitory recording medium. Also, by reading out the program stored in the external storage unit, so-called cloud computing can be realized. When implemented by hardware, it can be realized by various circuits such as ASIC, FPGA, or DRP.
[0048] (2.3. Management of Position Information in the First Display Unit 16 and the Second Display Unit 26)
[0049] The first main control unit 13 converts the information specifying the positions in the first display unit 16 and the second display unit 26 into coordinate information and performs centralized management. Specifically, as Figure 3 shown, a coordinate system is set in such a way that the first display unit 16 and the second display unit 26 are arranged. Figure 3 In the example above, the first display unit 16 and the second display unit 26 are arranged vertically, but they can also be arranged horizontally.
[0050] The first main control unit 13 centrally manages the position of the cursor operated by the mouse 2b and the input target of the keyboard. Thus, it becomes easier to move the cursor between the first display unit 16 and the second display unit and to manage the input target of the keyboard. On the other hand, the information on the respective touch positions for each touch screen display is controlled by the respective main control units.
[0051] <3. Operation of the Display System 1>
[0052] Refer to Figures 4 to 7 to describe the operation of the display system 1 in this embodiment. It should be noted that in Figures 4 to 7 , in the first display unit 16 or the second display unit 26, the areas targeted by various operations (i.e., typing operations using the keyboard 2a, cursor operations using the mouse 2b, or touch operations using the touch panel) are indicated by diagonal lines.
[0053] As Figure 4 shown, when the operation machine 2 is used to operate the area D1 of the first display device 10, the PC 3a corresponding to the input operation target area D1 becomes the operation target. At this time, the input content from the operation machine 2 is conveyed to the input receiving unit 12, the first main control unit 13, and the communication unit 15 in the order of the arrows Y11~Y14 and is sent to the PC 3a corresponding to the area D1.
[0054] For example, when operating the operation keyboard 2a as the operation machine 2, the key data is conveyed from the operation machine 2 to the input receiving unit 12 (arrow Y11). Also, the key data is conveyed from the first main control unit 13 to the PC 3a (arrows Y13, Y14).
[0055] Also, when operating the mouse 2b of the operating machine 2, the amount of movement is transmitted from the operating machine 2 to the input receiving unit 12 (arrow Y11). Further, the coordinate information indicating the cursor position calculated based on this amount of movement is transmitted from the first main control unit 13 to the PC 3a (arrows Y13, Y14). As an example, if the cursor on the area D1 is moved to the area D2, the target PC for operation switches from the PC 3a to the PC 3b. And if the user moves the cursor on the area D2 to the area D5, the target PC for operation switches from the PC 3b to the PC 3e.
[0056] As Figure 5 shown, when operating the touch panel of the first display unit 16 for the area D1 of the first display device 10, the PC 3a corresponding to the target area D1 of the input operation becomes the target for operation. At this time, the input content from the first display unit 16 is transmitted to the touch panel control unit 14, the input receiving unit 12, the first main control unit 13, and the communication unit 15 in the order of arrows Y21 to Y25, and is sent to the PC 3a corresponding to the area D1.
[0057] As Figure 6 shown, when operating the area D5 of the second display device 20 using the operating machine 2, the PC 3e corresponding to the target area D5 of the input operation becomes the target for operation. At this time, the input content from the operating machine 2 is transmitted to the input receiving unit 12, the first main control unit 13, the second main control unit 23, and the communication unit 25 in the order of arrows Y31 to Y35, and is sent to the PC 3e corresponding to the area D5.
[0058] As Figure 7 shown, when operating the touch panel of the second display unit 26 for the area D5 of the second display device 20, the PC 3e corresponding to the target area D5 of the input operation becomes the target for operation. At this time, the input content from the second display unit 26 is transmitted to the touch panel control unit 24, the input receiving unit 22, the second main control unit 23, and the communication unit 25 in the order of arrows Y41 to Y45, and is sent to the PC 3e corresponding to the area D5.
[0059] Here, the second main control unit 23 also sends the second information received by the input receiving unit 22 to the first main control unit 13 (arrow Y46). Thereby, the first main control unit 13 can grasp in real time the touch position (equivalent to the second information) in the area D5 being operated.
[0060] Therefore, when the mouse 2b of the input device is operated while a touch operation is performed on the area D5 of the second display device 20, the display can be made such that the cursor position indicates the nearest touch position. Also, when the keyboard 2a of the input device is operated while a touch operation is performed on the area D5 of the second display device 20, the operation of the keyboard 2a is effective in the area corresponding to the nearest touch position. Thus, it is possible to smoothly switch inputs from different input devices.
[0061] As described above, the display system 1 includes the first display device 10 and the second display device 20. The first display device 10 includes a first display unit 16, a first control unit 11, and a first input device including the operation device 2 and the touch panel control unit 14. The first display unit 16 displays the first image output from the plurality of PCs 3a to 3d. The first control unit 11 receives the input of the first information output from the first input device that operates on the plurality of PCs 3a to 3h.
[0062] The second display device 20 includes a second display unit 26, a second control unit 21, and a second input device including the touch panel control unit 24. The second display unit 26 displays the second image output from the plurality of PCs 3e to 3h. The second control unit 21 receives the input of the second information output from the second input device that operates on the plurality of PCs 3e to 3h. The second control unit 21 also sends the second information received by the second control unit 21 to the first control unit 11.
[0063] With such a configuration, when each of the plurality of display devices includes an input device, it is possible to smoothly switch inputs from different input devices.
[0064] <4. Other Embodiments>
[0065] The scope of application of the technical idea of the present application is not limited to the above-described embodiments. For example, in the above-described embodiments, a plurality of PCs are connected to the first display device 10 and the second display device 20, but this is not limited to this example, and the first display device 10 and the second display device 20 may each be connected to only one PC.
[0066] Also, the display system 1 may include three or more display devices. In this case, as Figure 8 shown, the plurality of display devices may be cascade-connected, and as Figure 9 shown, a plurality of display devices may be connected in parallel to the first display device 10 having the operation device 2.
[0067] Further, as the operation machine 2, the first display device 10 may also be equipped with only the keyboard 2a. At this time, normal key data can be input by the keyboard 2a, and at the same time, a predetermined shortcut key can be operated, so that the operation target PC can be switched. With such a structure, even when the mouse 2b is not provided, the first input device can input information specifying the positions in the first and second display units, and the technical idea of the present application can be applied.
[0068] Further, the first display device 10 may not be provided with the touch panel control unit 14, but may have a structure in which only the operation machine 2 is provided as the first input device.
[0069] Further, the second display device 20 may not be provided with the touch panel control unit 14, but may have a structure in which an identification device (such as a line-of-sight identification device) using an imaging device such as a camera or a voice input device is provided as the second input device.
[0070] Further, in the above-described embodiment, the operation machine 2 is connected only to the first display device, but is not limited to this method, and the operation machine 2 may also be connected to the second display device.
[0071] In addition, the present invention can also be implemented as a computer-readable non-transitory recording medium storing the above program.
[0072] Various embodiments of the present invention have been described, but these are only for illustration and do not limit the scope of the present invention. These embodiments can be variously omitted, replaced, and changed without departing from the gist of the present invention. These embodiments or their changes are included in the scope or gist of the invention, and are included in the invention described in the claims and the scope equivalent thereto.
[0073] (Reference Signs)
[0074] 1: Display system, 2: Operation machine (first input device), 2a: Keyboard, 2b: Mouse, 4: Image signal cable, 5: Control signal cable, 10: First display device, 11: First control unit, 12: Input receiving unit, 13: First main control unit, 14: Touch panel control unit (first input device), 15: Communication unit, 16: First display unit, 20: Second display device, 21: Second control unit, 22: Input receiving unit, 23: Second main control unit, 24: Touch panel control unit (second input device), 25: Communication unit, 26: Second display unit.
Claims
1. A display system includes a first display device and a second display device. The first display device includes a first display unit, a first control unit, and a first input device. The second display device includes a second display unit, a second control unit, and a second input device. The first display unit displays a first image output by at least one first computer. The second display unit displays a second image output by at least one second computer. The first control unit receives an input of first information output by the first input device that operates the first computer and the second computer, and the first information is information specifying a position in the first display unit or the second display unit. The second control unit receives an input of second information output by the second input device that operates the second computer, and the second information is information specifying a position in the second display unit. The second control unit further sends the second information received by the second control unit to the first control unit. The first control unit centrally manages information specifying positions in the first display unit and the second display unit based on the first information and the second information. When the first information is output from the first input device, the first computer or the second computer based on the first information becomes the operation target of the display system. On the other hand, when the second information is output from the second input device, the second computer based on the second information becomes the operation target of the display system.
2. The display system according to claim 1, wherein the first information is key data.
3. The display system according to claim 1 or 2, wherein the second control unit receives an input of the second information by a touch operation on the second display unit.
4. The display system according to claim 1 or 2, wherein at least one of the first display device and the second display device is connected to a plurality of computers, the display unit of the display device connected to the plurality of computers performs a split display in which the images output by the connected plurality of computers are correspondingly divided into a plurality of regions, and it is possible to operate the computer corresponding to the input operation target region in the plurality of regions.
5. The display system according to claim 1 or 2, wherein the second display device is connected to a plurality of the second computers, the second display unit performs a split display in which the images output by the second computers are correspondingly divided into a plurality of regions, and the second control unit sends the configuration information about the plurality of regions to the first control unit.
6. A control method for a display system, wherein the display system includes a first display device and a second display device, the first display device includes a first display unit, a first control unit, and a first input device, the second display device includes a second display unit, a second control unit, and a second input device, and the control method includes: a step of displaying a first image output by at least one first computer on the first display unit; The step of displaying a second image output by at least one second computer on the second display unit; The step of causing the first control unit to receive an input of first information output by the first input device that operates the first computer and the second computer; The step of causing the second control unit to receive an input of second information output by the second input device that operates the second computer; The step of causing the second control unit to send the second information received by the second control unit to the first control unit; The step of causing the first control unit to centrally manage information designating positions in the first display unit and the second display unit based on the first information and the second information; The first information is information designating a position in the first display unit or the second display unit, and the second information is information designating a position in the second display unit; The display system is configured such that, when the first information is output from the first input device, the first computer or the second computer based on the first information becomes the operation target of the display system. On the other hand, when the second information is output from the second input device, the second computer based on the second information becomes the operation target of the display system.
7. A recording medium, wherein, The recording medium stores a computer program that causes a display system to function; The display system includes a first display device and a second display device; The first display device includes a first display unit, a first control unit, and a first input device; The second display device includes a second display unit, a second control unit, and a second input device; The computer program, Causes the first display unit to display a first image output by at least one first computer; Causes the second display unit to display a second image output by at least one second computer; Causes the first control unit to receive an input of first information output by the first input device that operates the first computer and the second computer, the first information being information designating a position in the first display unit or the second display unit; Causes the second control unit to receive an input of second information output by the second input device that operates the second computer, the second information being information designating a position in the second display unit; Causes the second control unit to send the second information received by the second control unit to the first control unit; Causes the first control unit to centrally manage information designating positions in the first display unit and the second display unit based on the first information and the second information; The display system is configured such that, when the first information is output from the first input device, the first computer or the second computer based on the first information becomes the operation target of the display system. On the other hand, when the second information is output from the second input device, the second computer based on the second information becomes the operation target of the display system.
8. A display device, including a display unit, a control unit, and an input device; The display unit displays an image output by at least one first computer. The control unit is capable of communicating with a second display device including a second display unit that displays a second image output by at least one second computer and a second input device that operates the second computer, receives an input of first information output by the input device that operates the first computer and the second computer, the first information being information specifying a position in the display unit or the second display unit, receives second information output by the second input device from the second display device, the second information being information specifying a position in the second display unit, collectively manages information specifying positions in the display unit and the second display unit based on the first information and the second information, when the first information is output from the input device, the first computer or the second computer based on the first information becomes an operation target, and on the other hand, when the second information is output from the second input device, the second computer based on the second information becomes an operation target.
Citation Information
Patent Citations
KVM switch
JP2016085690A
Electronic device and method for processing audio data
US20160321029A1
Touch display device
US20190250759A1