System, display control method and program

Abstract

To cause a user to efficiently grasp contents inputted by handwriting.SOLUTION: A display device 10 which displays a shared area 700 (an example of a handwritten input area) capable of being inputted in handwriting acquires handwritten input data inputted into the shared area 700 capable of being inputted in handwriting, and causes a display screen 100 to display at least a part of a first area of the shared area 700. Moreover, the display device 10 causes the display screen 100 to display an overhead screen area indicating a second area including the handwritten input data inputted to the shared area 700.SELECTED DRAWING: Figure 22

Description

[Technical field]

[0001] The present disclosure relates to S The present invention relates to a display control system, a display control method, and a program. [Background technology]

[0002] Display devices that allow multiple users to input handwriting are used in conferences and the like in companies, educational institutions, government agencies, etc. Also, in remote conferences and the like between different locations, a method is known in which a display screen displayed at each location is shared and handwriting input is performed on the same screen from each location.

[0003] Furthermore, methods are being considered for improving user operability such as input and viewing on a display screen when a remote conference is held between different locations. For example, Patent Document 1 discloses a method for displaying a first display area in which a shared document is displayed and a second display area in which a thumbnail image of the shared document is displayed on a remote conference screen. Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional method, when only a part of the handwriting input area is displayed, there is a problem that the contents input outside the displayed area cannot be understood. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the invention according to claim 1 is A system in which a plurality of display devices are configured to be able to communicate with each other, the system comprising: a shared area shared by the plurality of display devices, the shared area being capable of displaying a different area for each of the plurality of display devices; At least some A first region, which is A display control means for displaying the an acquiring means for acquiring first handwritten input data inputted to the shared area via the display screen and second handwritten input data inputted to the shared area in a second display device different from the first display device among the plurality of display devices; and a display device controlled to display all of the first handwritten input data and the second handwritten input data in the shared area. Bird's-eye view screen area and displaying the first display area superimposed on the display screen. an overhead screen area display means; a display area acquisition means for acquiring information of a third area displayed on a display screen of the second display device, out of the shared area; Equipped with When a third area of ​​the shared area displayed on the display screen of the second display device is included in the bird's-eye view screen area, the bird's-eye view screen area includes base area information that identifiably displays the third area, the system It is.

[0006] According to the present invention, it is possible to provide an effect that a user can efficiently understand the contents of handwritten input. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of an overall configuration of a display system. [Diagram 2] FIG. 1 is a diagram for explaining an image of how an electronic whiteboard is used. [Diagram 3] FIG. 1 is a schematic diagram showing an example of a configuration of an electronic whiteboard. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of an electronic whiteboard. [Diagram 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a PC. [Figure 6] FIG. 2 is a diagram illustrating an example of a hardware configuration of a communication management device. [Figure 7] 1 is a schematic diagram for explaining the relationship between a shared area shared by a plurality of display devices and a display screen displayed on the display device. [Figure 8] FIG. 2 is a diagram illustrating an example of a functional configuration of a display system. [Figure 9] FIG. 13 is a conceptual diagram illustrating an example of a user information management table. [Figure 10] FIG. 13 is a conceptual diagram illustrating an example of an event information management table. [Figure 11] FIG. 13 is a diagram illustrating an example of a metadata file. [Figure 12] 1 is a diagram showing an example of a handwritten input data file. [Figure 13] 13 is a conceptual diagram showing an example of an overhead screen information management table. FIG. [Figure 14] FIG. 11 is a sequence diagram showing an example of a screen display process at the start of an event. [Figure 15] FIG. 2 is a diagram illustrating an example of a shared area. [Figure 16] FIG. 11 is a sequence diagram showing an example of a sharing process of handwritten input data. [Figure 17] 13A to 13C are diagrams illustrating an example of a handwriting input process in the display device. [Figure 18]FIG. 2 is a diagram for explaining an example of a display area displayed on a display device. [Figure 19] FIG. 11 is a sequence diagram showing an example of a display process of an overhead screen. [Figure 20] FIG. 4 is a diagram showing an example of a display screen. [Figure 21] 11 is a diagram for explaining an example of an overhead screen area included in a shared area. FIG. [Figure 22] FIG. 13 is a diagram showing an example of an overhead screen. [Figure 23] 13 is a sequence diagram showing an example of an update process of an overhead screen area. FIG. [Figure 24] 11 is a diagram for explaining an example of a method for calculating an overhead screen area. FIG. [Diagram 25] FIG. 13 is a diagram showing an example of an updated overhead screen area. [Figure 26] 13 is a flowchart showing an example of a process for changing a display area using an overhead screen. [Figure 27] FIG. 11 is a diagram for explaining an example of a method for specifying a display area. [Figure 28] FIG. 11 is a diagram for explaining an example of a method for specifying a display area. [Figure 29] FIG. 13 is a diagram showing an example of a display screen in which a display area has been changed. [Diagram 30] 11 is a diagram for explaining an example of handwritten input data inputted into a shared area; FIG. [Diagram 31] FIG. 2 is a diagram showing an example of an overhead screen area. [Diagram 32] 11 is a sequence diagram showing an example of a process for changing the display size of an overhead screen. FIG. [Diagram 33] 13 is a flowchart showing an example of a process for changing the display size of an overhead screen. [Diagram 34] 13 is a diagram for explaining an example of a shared area when a large-sized overhead screen is set. FIG. [Diagram 35] FIG. 13 is a diagram showing an example of a large-sized overhead screen. [Diagram 36] 13 is a diagram illustrating an example of a shared area when a medium-sized overhead screen is set. FIG. [Figure 37] FIG. 13 is a diagram showing an example of a medium-sized overhead screen. [Figure 38] 13 is a diagram illustrating an example of a shared area when a small-sized overhead screen is set. FIG. [Figure 39] FIG. 13 is a diagram showing an example of a small-sized overhead screen. [Diagram 40] 13 is a sequence diagram showing an example of a display process of base region information on an overhead screen. FIG. [Diagram 41] 11 is a diagram for explaining an example of a method for calculating a display area displayed on a display device included in a shared area. FIG. [Diagram 42] FIG. 13 is a diagram illustrating an example of an overhead screen on which base region information is displayed. [Diagram 43] FIG. 13 is a diagram illustrating an example of a functional configuration of a display system according to a modified example of the embodiment. [Diagram 44] 13 is a sequence diagram showing an example of a display process of an overhead screen according to a modified example of an embodiment. FIG. [Diagram 45] 13 is a sequence diagram showing an example of an update process of an overhead screen area according to a modified example of the embodiment. FIG. [Diagram 46] 13 is a sequence diagram showing an example of a process for changing the display size of an overhead screen according to a modified example of an embodiment. FIG. [Figure 47] 13 is a sequence diagram showing an example of a display process of display area information on an overhead screen according to a modified example of an embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are given the same reference numerals, and duplicated description will be omitted.

[0009] ●Embodiment● System Configuration First, an outline of the configuration of a display system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the overall configuration of a display system. The display system 1 shown in Fig. 1 is a system in which data that can be displayed by each of a plurality of display devices 10 can be shared among each other.

[0010] As shown in Fig. 1, the display system 1 includes display devices 10A, 10B, and 10C located at a plurality of bases (base A, base B), and a communication management device 50. The display devices 10A, 10B, and 10C and the communication management device 50 constituting the display system 1 can communicate with each other via a communication network 5. The communication network 5 is constructed by the Internet, a mobile communication network, a LAN (Local Area Network), and the like. Note that the communication network 5 may include not only wired communication but also networks using wireless communication such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution).

[0011] The display devices 10A, 10B, and 10C are computers equipped with handwriting input functions, communication functions, and display functions. The display device 10A is, for example, an electronic whiteboard installed at site A, the display device 10B is a portable notebook PC (Personal Computer) at site B, and the display device 10C is a portable tablet PC at site C. The display devices 10A, 10B, and 10C perform remote communication while sharing objects input by handwriting. Users A, B, and C can hold events such as remote conferences while viewing display screens on which display contents are shared at each site. The event is not limited to a remote conference, and may be a remote lesson, a remote medical examination, a meeting, a consultation, or a simple conversation.

[0012] The display devices 10A, 10B, and 10C communicate screen data such as handwritten input data. The handwritten input data is data necessary to display (reproduce) a display screen including objects handwritten by the user A, the user B, and the user C on the display devices 10A, 10B, and 10C, respectively. The handwritten input data includes coordinate data, line width data, line color data, vector data, data indicating the pen pressure when the stroke was drawn, and the like.

[0013] The display devices 10A, 10B, and 10C transmit and receive handwritten input data for displaying a shared object, thereby allowing users of the display system 1 to share the same object. An object is an image showing a line or the like written by a user through handwritten input with an electronic pen or the like. An object image showing an object is displayed by handwritten input data showing a point specifying the coordinates on the display.

[0014] The display device 10 is not limited to an electronic whiteboard or a PC, but may be any device in which a software application that executes a handwriting input function, a communication function, and a display function is installed. The PC may be, for example, a smartphone, a wearable terminal or a smart watch, a car navigation terminal, a game machine, a telepresence robot, or a medical device.

[0015] 1 shows an example constructed by display devices 10 (10A, 10B, 10C) located at three bases (base A, base B, base C), but the display system 1 may be configured to include multiple display devices 10 at one base. The number of bases constituting the display system 1 may be two bases or four or more bases with a display device 10 located at each base, or may be only one base when multiple display devices 10 are located at one base. Hereinafter, the display devices 10A, 10B, 10C are collectively referred to as "display device 10."

[0016] The communication management device 50 is a server computer that centrally manages login authentication from the display devices 10A, 10B, and 10C, the communication status of the display devices 10A, 10B, and 10C, and shared screen data, etc. The communication management device 50 also relays shared screen data between the multiple display devices 10A, 10B, and 10C.

[0017] The communication management device 50 may be configured by one server computer or may be configured by multiple server computers. Also, the communication management device 50 will be described as a server computer existing in a cloud environment, but it may be a server that operates on a display device 10 such as an electronic whiteboard, or may be a server that exists in an on-premise environment.

[0018] ○Image of electronic whiteboard use○ Here, an image of use of an electronic whiteboard, which is an example of the display device 10, will be described with reference to FIG. 2. FIG. 2 is a diagram for explaining an image of use of the electronic whiteboard. As shown in FIG. 2, the electronic whiteboard, which is an example of the display device 10, is composed of a leg 251 having a plurality of casters on the lower side, a support 252 on the upper side of the leg 251, a main body 253 of the electronic whiteboard on the upper side of the support 252, and a display 280 on the front side of the main body 253. The main body 253 has a built-in CPU 201, which will be described later, and the like. A user can input (draw) an object such as a character on the display 280 using an electronic pen 290. The display 280 is an example of a display unit.

[0019] FIG. 3 is a schematic diagram showing an example of the configuration of an electronic whiteboard. LEDs, which are light-emitting elements, and phototransistors, which are light-receiving elements, are arranged in a main body 253 of the electronic whiteboard. As shown in FIG. 3, the electronic whiteboard has, for example, a plurality of LEDs arranged in one horizontal row and one vertical row on the lower side and the right side of the display 280, and a plurality of phototransistors arranged in one horizontal row and one vertical row on the upper side and the left side of the display 280. The LEDs and phototransistors in one row are all arranged at equal intervals, and each LED and each phototransistor are arranged facing each other in the vertical and horizontal directions. As a result, the electronic whiteboard has two sets of light-receiving and light-emitting element groups, a light-receiving and light-emitting element group consisting of LEDs and phototransistors arranged facing each other in the vertical direction, and a light-receiving and light-emitting element group consisting of LEDs and phototransistors arranged facing each other in the horizontal direction. For example, when the phototransistor cannot detect light emitted from the LED, that is, the position where the light is blocked, the electronic whiteboard determines that the position is touched (handwritten input).

[0020] Note that FIG. 3 shows an example of an arrangement in which the LEDs and phototransistors are equally spaced, with 20 LEDs and phototransistors arranged horizontally (LV1 to LV20, PV1 to PV20) and 15 LEDs and phototransistors arranged vertically (LH1 to LH15, PH1 to PH15). However, the numbers of LEDs and phototransistors can vary depending on the size of display 280.

[0021] ●Hardware configuration Next, the hardware configuration of the device or terminal constituting the display system according to the embodiment will be described with reference to Figures 4 to 6. Note that components may be added or deleted from the hardware configurations shown in Figures 4 to 6 as necessary.

[0022] ○Hardware configuration of electronic whiteboard○ First, the hardware configuration of an electronic whiteboard, which is an example of the display device 10, will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the hardware configuration of an electronic whiteboard. Each hardware component of the electronic whiteboard, which is an example of the display device 10, is indicated by a reference number in the 200s. As shown in Fig. 4, the electronic whiteboard includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an SSD (Solid State Drive) 204, a network I / F (Interface) 205, and an external device connection I / F 206.

[0023] Of these, the CPU 201 controls the overall operation of the electronic whiteboard. The ROM 202 stores the CPU 201 and programs used to drive the CPU 201, such as an IPL (Initial Program Loader). The RAM 203 is used as a work area for the CPU 201. The SSD 204 stores various data, such as programs for the electronic whiteboard. The network I / F 205 controls communication with the communication network 5. The external device connection I / F 206 controls communication with external devices, such as a USB (Universal Serial Bus) memory 230, a PC 270, a microphone 240, a speaker 250, or a camera 260.

[0024] The electronic whiteboard also includes a capture device 211, a GPU (Graphics Processing Unit) 212, a display controller 213, a contact sensor 214, a sensor controller 215, an electronic pen controller 216, a short-range communication circuit 219, an antenna 219a of the short-range communication circuit 219, a power switch 222, and selection switches 223.

[0025] Among these, the capture device 211 acquires image data displayed on a display 280, which is an example of a display unit, via a display controller 213, and stores the image data in a RAM 203 or the like. The GPU 212 is a semiconductor chip (processor) that specializes in graphics. The display controller 213 controls and manages screen display in order to output an output image from the capture device 211 or the GPU 212 to a display 280 or the like. The contact sensor 214 detects that an electronic pen 290, a user's hand H, or the like has contacted the display 280. The sensor controller 215 controls the processing of the contact sensor 214. The contact sensor 214 inputs and detects coordinates by an infrared blocking method. The method of inputting and detecting the coordinates is a method in which two light receiving and emitting devices installed at both ends of the upper side of the display 280 emit a plurality of infrared rays in parallel to the display 280, and receive light that is reflected by a reflecting member installed around the display 280 and returns along the same optical path as the optical path of the light emitted by the light receiving element. The contact sensor 214 outputs the ID of the infrared light radiated by the two light receiving and emitting devices that is blocked by the object to the sensor controller 215, and the sensor controller 215 specifies the coordinate position that is the contact position of the object. The electronic pen controller 216 determines whether the pen tip or the pen tail touches the display 280 by communicating with the electronic pen 290. The short-range communication circuit 219 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The power switch 222 is a switch for switching the power of the electronic whiteboard ON / OFF. The selection switches 223 are, for example, a group of switches for adjusting the brightness and color of the display 280.

[0026] The electronic whiteboard further includes a bus line 210. The bus line 210 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 201 shown in FIG.

[0027] The contact sensor 214 is not limited to an infrared blocking type, and may use various detection means such as a capacitive touch panel that identifies the contact position by detecting a change in capacitance, a resistive film touch panel that identifies the contact position by a voltage change between two opposing resistive films, or an electromagnetic induction touch panel that identifies the contact position by detecting electromagnetic induction caused by a contacting object touching the display unit. The electronic pen controller 216 may determine whether or not a part of the electronic pen 290 that is held by the user or other parts of the electronic pen have been touched, in addition to the tip and bottom of the electronic pen 290.

[0028] ○PC hardware configuration○ Next, the hardware configuration of a PC, which is an example of the display device 10, will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the hardware configuration of a PC. Each hardware configuration of the PC, which is an example of the display device 10, is indicated by a reference number in the 300 series. As shown in Fig. 5, the PC includes a CPU 301, a ROM 302, a RAM 303, a HD (Hard Disk) 304, a HDD (Hard Disk Drive) controller 305, a display 306, an external device connection I / F 307, a network I / F 308, a bus line 310, a keyboard 311, a pointing device 312, an audio input / output I / F 313, a microphone 314, a speaker 315, a camera 316, a DVD-RW (Digital Versatile Disk Rewritable) drive 317, and a media I / F 319.

[0029] The CPU 301 controls the operation of the entire PC. The CPU 301 is a calculation device that realizes each function of the PC by reading out programs or data stored in the ROM 302 or the HD 304, etc., onto the RAM 303 and executing processing. The ROM 302 is a non-volatile memory that stores programs used to drive the CPU 301, such as an IPL. The RAM 303 is a volatile memory that is used as a work area for the CPU 301. The HD 304 stores various data such as programs. The HDD controller 305 controls the reading or writing of various data from the HD 304 according to the control of the CPU 301. The display 306 displays various information such as a cursor, a menu, a window, characters, or an image. The display 306 may be a touch panel display equipped with an input means. The display 306 is an example of a display unit. The external device connection I / F 307 is an interface for connecting various external devices. In this case, the external device is, for example, a USB memory or a printer. The network I / F 308 is an interface for data communication using the communication network 5. The bus line 310 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 301 shown in FIG.

[0030] The keyboard 311 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, and the like. The pointing device 312 is a type of input means for selecting or executing various instructions, selecting a processing target, or moving a cursor. The input means may be not only the keyboard 311 and the pointing device 312, but also a touch panel or a voice input device, and the like. The sound input / output I / F 313 is a circuit that processes input and output of sound signals between the microphone 314 and the speaker 315 under the control of the CPU 301. The microphone 314 is a type of built-in sound collecting means that inputs sound. The speaker 315 is a type of built-in output means that outputs sound signals. The camera 316 is a type of built-in imaging means that captures an object and obtains image data. The microphone 314, the speaker 315, and the camera 316 may be external devices, not built-in to the PC. The DVD-RW drive 317 controls reading and writing of various data from the DVD-RW 318, which is an example of a removable recording medium. The removable recording medium is not limited to DVD-RW, but may be DVD-R or Blu-ray (registered trademark) Disc, etc. Media I / F 319 controls reading and writing (storing) data from and to a recording medium 321 such as a flash memory.

[0031] ○Hardware configuration of communication management device○ Next, the hardware configuration of the communication management device will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the hardware configuration of the communication management device. Each hardware component of the communication management device 50 is indicated by a reference number in the 500 range. The communication management device 50 is constructed by a computer, and as shown in Fig. 6, includes a CPU 501, a ROM 502, a RAM 503, a HD 504, a HDD controller 505, a display 506, an external device connection I / F 508, a network I / F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW drive 514, and a media I / F 516.

[0032] The CPU 501 controls the overall operation of the communication management device 50. The CPU 501 is a calculation device that realizes each function of the communication management device 50 by reading programs or data stored in the ROM 502 or HD 504, etc., onto the RAM 503 and executing processing. The ROM 502 is a non-volatile memory that stores programs used to drive the CPU 501, such as an IPL. The RAM 503 is a volatile memory used as a work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading or writing of various data from the HD 504 according to the control of the CPU 501. The display 506 displays various information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB memory. The network I / F 509 is an interface for data communication using the communication network 5. The bus line 510 is an address bus or a data bus for electrically connecting the components such as the CPU 501 shown in FIG.

[0033] Moreover, the keyboard 511 is a type of input means having a plurality of keys for inputting characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting or executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading or writing of various data from a DVD-RW 513 as an example of a removable recording medium. Note that the removable recording medium is not limited to a DVD-RW, and may be a DVD-R or a Blu-ray Disc, etc. The media I / F 516 controls reading or writing (storing) of data from a recording medium 515 such as a flash memory.

[0034] Each of the above programs may be recorded in a computer-readable recording medium as an installable or executable file and distributed. Examples of the recording medium include a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), a Blu-ray Disc, an SD card, and a USB memory. The recording medium may be provided domestically or internationally as a program product. For example, the display device 10 realizes the display control method according to the present invention by executing the program according to the present invention.

[0035] Overview Next, a description will be given of a shared area shared among the display devices 10A, 10B, and 10C, and the relationship between the display screens displayed on the display devices 10A, 10B, and 10C, with reference to Fig. 7. Fig. 7 is a schematic diagram for explaining the relationship between a shared area shared among a plurality of display devices and the display screens displayed on the display devices.

[0036] In Fig. 7, display devices 10A, 10B, and 10C share objects drawn on their respective display units as a shared area to hold events such as remote conferences. The shared area is a handwriting input area that can be shared by multiple users and allows handwriting input. The shared area is also called a whiteboard, a shared canvas, a handwriting input area, a drawing area, a writing area, or the like. The shared area is shared in a state that can be displayed on the display screen by mutually transmitting and receiving handwriting input data for displaying objects drawn on display devices 10A, 10B, and 10C.

[0037] Moreover, the shared area is an expandable area with no limit to the area where handwriting input is possible. The shared area includes, for example, a so-called infinite canvas or finite canvas. That is, the shared area is an area larger than the area that can be displayed on the display screen of the display device 10. Therefore, as shown in FIG. 7, the display devices 10A, 10B, and 10C display at least a part of the shared area on the display screen. The display devices 10A, 10B, and 10C display a part of the shared area instead of the entire shared area, which makes it easier for the user to input handwriting and makes it easier for the user to understand the contents of the object that has been input by handwriting. Furthermore, the display devices 10A, 10B, and 10C can display different areas of the shared area, so that the user can view a desired area during the execution of an event.

[0038] Here, when a handwriting input area is shared among a plurality of locations, there are cases where a user wants to know the operation contents of other locations. In this case, as shown in FIG. 7, since the area displayed on the display device is a part of the shared area shared with other display devices, when another user performs an operation such as writing outside the display area, the user cannot quickly know that the operation has been performed. In addition, in order to check the operation contents of other users performed outside the display area, the user must perform an operation to move the display area by enlarging or reducing the display area or scrolling, and therefore the user cannot efficiently understand the input operation of the user in the handwriting input area and the contents handwritten by other users.

[0039] Therefore, the display system 1 superimposes an overhead screen area including handwritten input data (objects) outside the display area displayed on the display device 10 on the display screen of the display device 10. As a result, when performing handwritten input by displaying only a part of the handwritten input area, the display system 1 allows the user to grasp the specific handwritten input contents through the overhead screen area even if an operation is performed by another location outside the display area. Furthermore, when performing handwritten input by displaying only a part of the handwritten input area, the display system 1 allows the user to efficiently grasp the input operation on the handwritten input area and the contents handwritten input by other users.

[0040] ●Function configuration Next, the functional configuration of the display system according to the embodiment will be described with reference to Fig. 8 to Fig. 13. Fig. 8 is a diagram showing an example of the functional configuration of the display system. Fig. 8 shows devices or terminals shown in Fig. 1 that are related to the processing or operation described below.

[0041] ○Functional configuration of the display device○ First, the functional configuration of the display devices 10A, 10B, and 10C will be described with reference to FIG. 8. The display devices 10A, 10B, and 10C have the same functions, and therefore the functions of the display device 10 will be described here. The display device 10 has a transmitting / receiving unit 11, a receiving unit 12, a display control unit 13, a determining unit 14, a shared area generating unit 15, a screen data creating unit 16, an image processing unit 17, an overhead screen area generating unit 18, an overhead screen area display unit 19, a display position calculating unit 21, an external device communication unit 22, and a storage / reading unit 29. Each of these units is a function or means realized by operating any of the components shown in FIG. 4 or FIG. 5 according to an instruction from the CPU 201 according to a program loaded from the SSD 204 onto the RAM 203, or an instruction from the CPU 301 according to a program loaded from the HD 304 onto the RAM 303. The display device 10 also has a storage unit 1000 constructed by the ROM 202, the SSD 204, or the USB memory 230 shown in FIG. 4, or the ROM 302, the HD 304, or the recording medium 321 shown in FIG.

[0042] The transmission / reception unit 11 is mainly realized by the processing of the CPU 201 for the network I / F 205 or the processing of the CPU 301 for the network I / F 308, and transmits and receives various data or information to and from other devices or terminals via the communication network 5. The transmission / reception unit 11, for example, functions as an acquisition unit and acquires handwritten input data transmitted from other display devices 10.

[0043] The reception unit 12 is realized mainly by the processing of the CPU 201 on the contact sensor 214 and the electronic pen controller 216, or the processing of the CPU 301 on the pointing device 312 or the touch panel 309, and receives various inputs from the user.

[0044] The display control unit 13 is mainly realized by the processing of the CPU 201 for the display controller 213 or the processing of the CPU 301, and causes the display 280 or the display 306 to display drawn images, or causes the display 280 or the display 306 to display various screen data by accessing the communication management device 50 using a Web browser or the like. Specifically, the display control unit 13 starts and executes various applications that run on the OS (Operating System), thereby causing the display 280 or the display 306 to display various screens that are drawn by the API (Application Programming Interface) provided by the OS.

[0045] The determination unit 14 is realized by the processing of the CPU 201 or CPU 301, and performs various determinations. The shared area generation unit 15 is mainly realized by the processing of the CPU 201 or CPU 301, and generates a shared area that can be shared with other display devices 10 and displayed.

[0046] The screen data creation unit 16 is mainly realized by the processing of the CPU 201 or CPU 301, and creates screen data constituting a shared area. For example, the screen data creation unit 16 functions as an acquisition unit, and creates and acquires handwritten input data based on strokes (handwritten input) of the electronic pen 190 or the like accepted by the acceptance unit 12. For example, the screen data creation unit 16 performs a process of converting an object obtained by a user's handwritten input on a display into coordinate data. In addition, the screen data creation unit 16 creates metadata related to the display history of the display screen. Here, the metadata and handwritten input data created by the screen data creation unit 16 are an example of history data indicating the execution history of executed events.

[0047] The image processing unit 17 is mainly realized by the processing of the CPU 201 or CPU 301, and is a function that performs main processing of the handwriting input and display functions. The image processing unit 17 generates an object image that is an image of an object input by handwriting, for example, based on the handwriting input data created by the screen data creation unit 16. Also, the image processing unit 17 generates an object image for displaying an object of the same content on the display of its own device, for example, based on the handwriting input data indicating an object input to the display device 10 of another site received by the transmission / reception unit 11.

[0048] The overhead screen area generating unit 18 is mainly realized by the processing of the CPU 201 or CPU 301, and generates an overhead screen area showing an overall image of the shared area 700 generated during an event. Here, the overhead screen area is, for example, an area with a wider range than the display area displayed on the display screen in the shared area 700. The overhead screen area is generated according to handwritten input data (objects) input into the shared area 700. The overhead screen area is, for example, an area including all handwritten input data (objects) input into the shared area 700.

[0049] The overhead screen area display unit 19 is mainly realized by the processing of the CPU 201 or the processing of the CPU 301 for the display controller 213, and displays on the display screen the overhead screen area generated by the overhead screen area generation unit 18. For example, the overhead screen area display unit 19 displays a reduced image obtained by reducing the image of the generated overhead screen area at a predetermined reduction ratio in a superimposed manner on the display screen.

[0050] The display position calculation unit 21 is mainly realized by the processing of the CPU 201 or the CPU 301, and calculates a position on the shared area corresponding to a selected position on the overhead screen area.

[0051] The external device communication unit 22 is realized by processing of the CPU 201 on the external device connection I / F 206, or processing of the CPU 301 on the external device connection I / F 307, and accepts input of various data or information from external devices connected to the display device 10.

[0052] The storage / reading unit 29 is realized mainly by the processing of the CPU 201 or CPU 301 , and stores various data (or information) in the storage unit 1000 and reads various data (or information) from the storage unit 1000 .

[0053] ○Functional configuration of the communication management device○ Next, the functional configuration of the communication management device 50 will be described with reference to Fig. 8. The communication management device 50 has a transmission / reception unit 51, an authentication unit 52, an event information generation unit 53, a shared area generation unit 54, an event information management unit 55, an overhead screen information generation unit 56, an overhead screen information management unit 57, a shared area duplication unit 58, and a storage / readout unit 59. Each of these units is a function or means realized by operating any of the components shown in Fig. 6 by an instruction from the CPU 501 according to the program for the communication management device expanded from the HD 504 onto the RAM 503. The communication management device 50 also has a storage unit 5000 constructed by the ROM 502, HD 504, or recording medium 515 shown in Fig. 6.

[0054] The transmission / reception unit 51 is realized mainly by the processing of the CPU 501 for the network I / F 509, and transmits and receives various data or information to and from other devices or terminals via the communication network 5.

[0055] The authentication unit 52 is realized by the processing of the CPU 501, and performs authentication processing for users who participate in an event using the display device .

[0056] Event information generating unit 53 is realized mainly by processing of CPU 501, and generates event information regarding events executed by a user.

[0057] The shared area generating unit 54 is realized mainly by the processing of the CPU 501, and generates a shared area that can be shared among a plurality of display devices 10 and displayed.

[0058] Event information management unit 55 is realized mainly by the processing of CPU 501 , and manages the event information generated by event information generation unit 53 .

[0059] The overhead screen information generating unit 56 is mainly realized by the processing of the CPU 501, and generates overhead screen information for specifying an overhead screen area to be displayed on the display device 10. The overhead screen information managing unit 57 is mainly realized by the processing of the CPU 501, and manages the overhead screen information generated by the overhead screen information generating unit 56.

[0060] Shared area duplication unit 58 is mainly realized by the processing of CPU 501, and duplicates a shared area generated in an event. Shared area duplication unit 58 duplicates a shared area including handwritten input data (object), for example, and generates shared area duplication data that is data separate from the screen data for configuring the shared area.

[0061] The storage / reading unit 59 is realized mainly by the processing of the CPU 501 , and stores various data (or information) in the storage unit 5000 and reads various data (or information) from the storage unit 5000 .

[0062] User information management table Fig. 9 is a conceptual diagram showing an example of a user information management table. The user information management table manages user information for identifying users who will participate in an event. A user information management DB 5001 configured by the user information management table shown in Fig. 9 is constructed in the storage unit 5000. This user information management table manages user information associated with a user ID, a user name, and a password for identifying a user, as well as an email address which is an example of destination information indicating the destination of the user.

[0063] Event information management table Fig. 10 is a conceptual diagram showing an example of an event information management table. The event information management table manages event information related to events carried out by users. An event information management DB 5002 configured by the event information management table shown in Fig. 10 is constructed in the storage unit 5000. This event information management table manages event information in which an event ID and event name for identifying an event, the event date and time, participating users who will participate in the event, and storage locations of various event files generated by the event are associated with each other.

[0064] Among these, the event opening date and time is indicated by, for example, the date and time when the event file was last updated. The opening date and time may be the date and time when the event was first held, or may be configured to store the start date and time and the end date and time of the event, respectively. The participating users indicate the user names of the users who participated in the event. Furthermore, the file storage location indicates information on the storage destination where various event files are stored. The file storage location may be a data path inside the communication management device 50, or may be a URL (Uniform Resource Locator) or URI (Uniform Resource Identifier) ​​outside the communication management device 50. The event files stored in the file storage location include, for example, the metadata file 500, the handwritten input data file 550, and the shared area data of the event generated by the shared area generation unit 54, etc.

[0065] Metadata file FIG. 11 is a diagram showing an example of a metadata file. The metadata file 500 shown in FIG. 11 is an event file generated in an executed event. The metadata file 500 shows, as metadata, the operation history of the display screen, such as moving, enlarging or reducing the display area for each user. The metadata file 500 shown in FIG. 11 includes the event name (Name), the start time (Start) and end time (End) of the event, and the operation history (OperationLog) for each user. The operation history includes, as the display area (ViewArea) for each user, area information indicating the coordinate position (X, Y) and size (Width, Height) of the display area, and display history data indicating the display time (Time).

[0066] The example shown in FIG. 11 indicates that an event named "Theme A Regular 1" was held from "2021 / 01 / 15 13:00 to 15:00". In addition, it is indicated that the participant "userA" first displayed an area with a width of 100 pixels and a height of 80 pixels with (X,Y)=(10,310) in the shared area as the upper left point for 100 seconds, and then moved to the area of ​​(X,Y)=(100,210). The area last displayed by "userA" is the area of ​​(X,Y)=(130,1300). In addition, the area last displayed by "userB" is the area of ​​(X,Y)=(105,1200), and the area last displayed by "userC" is the area of ​​(X,Y)=(130,1300). The metadata file 500 stores such an operation history for each user. Note that, although the metadata file 500 shown in FIG. 11 is an example in a data format of Json (JavaScript Object Notation), the data format of the metadata file 500 is not limited to this.

[0067] Handwritten input data file FIG. 12 is a diagram showing an example of a handwritten input data file. The handwritten input data file 550 shown in FIG. 12 is an event file generated in an executed event. The handwritten input data file 550 shows the operation history of handwritten input objects such as strokes or stamps as object data. The handwritten input data file 550 shown in FIG. 12 includes the background color (BackgroundColor) of the shared area and object data (Objects) showing the input history of handwritten input objects. The object data includes the type of object (Type), data details (Data) showing the contents of the object, the name of the user (User) who input the object, and the input date and time (Data). The type of object is, for example, a stroke (Stroke) or a stamp (Stamp). In addition, the data details information includes data of the stroke coordinate position locus (Point), line thickness (Thin), and line color (Color) when the object type is a stroke, and further includes data of the stamp coordinate position (Point), size (Size), and image file (Image) when the object type is a stamp.

[0068] In the example shown in FIG. 12, a black stroke with a thickness of 5 pixels from (X,Y)=(10,10) to (X,Y)=(30,30) is input by "userA" on "2021 / 01 / 15 13:32" in a shared area with a white background color (BackgroundColor). In addition, it is also shown that "userB" then input an image file "Circle.jpg" with a size of 20 pixels x 20 pixels with (X,Y)=(100,200) at the top left on "2021 / 01 / 15 13:40". The handwriting input data file 550 stores such object data for each input object. Note that the handwriting input data file 550 shown in FIG. 12 shows an example of a data format in Json format, but the data format of the handwriting input data file 550 is not limited to this. In addition, the format of the object is not limited to strokes or stamps, but may include text in which the strokes have been processed using an Optical Character Reader (OCR) to convert them into symbols such as letters or numbers, system-generated characters such as dates or times, predetermined shapes such as triangles, stars or circles, or lines such as arrows, line segments or Bezier curves.

[0069] The metadata file 500 and the handwritten input data file 550 may be stored in the storage unit 1000 of the display device 10 participating in the event, together with the communication management device 50. In this case, the display device 10 stores metadata indicating the operation history of the user using the display device 10 and history data including the handwritten input data in the storage unit 1000. In addition, in the case of a display device 10 having a server function, the storage unit 1000 may store metadata including the operation history of all users participating in the event and handwritten input data.

[0070] ○Overhead screen information management table Fig. 13 is a conceptual diagram showing an example of an overhead screen information management table. The overhead screen information management table manages overhead screen information for identifying an overhead screen area to be displayed on the display device 10 participating in the event. The storage unit 5000 has an overhead screen information management DB 5003 configured by the overhead screen information management table shown in Fig. 13. This overhead screen information management table manages overhead screen information associated with area data indicating the position (range) of the overhead screen area in the shared area, the display size of the overhead screen to be displayed on the display screen, and display user information indicating the user displaying the overhead screen, for each event ID for identifying an event.

[0071] Among these, the area data indicates the range (width Dx, height Dy) of the overhead screen area on the shared area by coordinate information. In addition, when the display size of the overhead screen is fixed, information of "fixed" is given, and when the display size is variable, information of the corresponding display size (e.g., "large" or "small") is given. Furthermore, the display user is given information (user ID or user name) that identifies the user who uses the display device 10 that displays the overhead screen on the display screen.

[0072] Processing or operation of the embodiment ○Processing at the start of an event○ Next, the process or operation of the display system according to the embodiment will be described with reference to Fig. 14 to Fig. 42. First, the display screen displayed on the display device 10 at the start of an event will be described with reference to Fig. 14 and Fig. 15. Fig. 14 is a sequence diagram showing an example of a screen display process at the start of an event.

[0073] First, user A operates a predetermined input means of the display device 10A, causing the reception unit 12A of the display device 10A to receive input of a user ID and password (step S11). Next, the transmission / reception unit 11A transmits login request information to the communication management device 50 (step S12). This login request information includes the user ID and password received in step S11. As a result, the transmission / reception unit 51 of the communication management device 50 receives the login request information transmitted from the display device 10A.

[0074] Next, the authentication unit 52 of the communication management device 50 performs user authentication using the user ID and password received in step S12 (step S13). Specifically, the storage / reading unit 59 searches the user information management DB 5001 (see FIG. 8) for a pair of a user ID and a password that corresponds to the pair of the user ID and password received in step S12. If there is a corresponding pair, the authentication unit 52 determines that the requesting user A is a valid user. If there is no corresponding pair, the authentication unit 52 determines that the requesting user A is an illegal (illegitimate) user. If it is not legitimate, the transmission / reception unit 51 notifies the display device 10A that it is not legitimate, but here we will continue to explain the case where it is legitimate.

[0075] Next, the shared area generation unit 54 generates a new shared area which is a handwriting input area that can be shared and displayed among a plurality of display devices (step S14). Next, the event information management unit 55 generates event information related to the event to be started (step S15). Here, the generated event information is information indicating an event ID for identifying the event, the event name, the start time of the event, and the storage location of an event file generated for the event. The event information management unit 55 stores the generated event information in the event information management DB 5002 (see FIG. 9) via the storage / readout unit 59.

[0076] Next, the transmitting / receiving unit 51 transmits the shared area data generated in step S14 and the event information generated in step S15 to the display device 10A (step S16). As a result, the transmitting / receiving unit 11A of the display device 10A receives the shared area data and the event information transmitted from the communication management device 50.

[0077] Then, the display control unit 13A of the display device 10A displays the shared area 700 configured by the shared area data received in step S16 on the display unit (for example, the display 280 or the display 306) (step S17). FIG. 15 is a diagram showing an example of a shared area. The shared area 700 shown in FIG. 15 is a handwriting input screen that is shared and displayed with other display devices 10 during an event. The shared area 700 is in a state in which a plurality of objects have been input by users participating in the event performing handwriting input on the display screen. As shown in FIG. 15, the shared area 700 has an area that is sufficiently larger than the display area of ​​the display screen of the display device 10, so that at least a part of the shared area 700 is displayed as a display area on the display screen of the display device 10. A user participating in an event displays a desired area of ​​the shared area 700 during an event and performs handwriting input of an object.

[0078] Here, the coordinates of the display area are expressed in display coordinates with the pixel position at the upper left corner of the display screen of display device 10A as the origin, with the right direction being the positive direction of the X axis and the downward direction being the positive direction of the Y axis. That is, the display coordinates are (the number of pixels in the X axis direction from the pixel at the origin position, and the number of pixels in the Y axis direction from the pixel at the origin position). Moreover, the coordinates of the shared area 700 are expressed in display coordinates with the pixel position at the upper left corner of the display area that is first displayed on display device 10A in an event as the origin, with the right direction being the positive direction of the X axis, the left direction being the negative direction of the X axis, the downward direction being the positive direction of the Y axis, and the upward direction being the negative direction of the Y axis.

[0079] Furthermore, similar to the process by the display device 10A, when the user B operates a predetermined input means of the display device 10B, the reception unit 12B of the display device 10B receives input of user information including a user ID and a password (step S18). Next, the transmission / reception unit 11B transmits login request information to the communication management device 50 (step S19). This login request information includes the user ID and password received in step S18. As a result, the transmission / reception unit 51 of the communication management device 50 receives the login request information transmitted from the display device 10A.

[0080] Next, the authentication unit 52 of the communication management device 50 performs user authentication using the user ID and password received in step S19, similar to the process of step S13 (step S20). Next, when the authentication unit 52 has completed authentication of user B, the event information management unit 55 reads the event information generated in step S15 from the event information management DB 5002 via the storage / read unit 59 (step S21).

[0081] Next, the transmitting / receiving unit 51 transmits the shared area data generated in step S14 and the event information read out in step S21 to the display device 10B (step S22). As a result, the transmitting / receiving unit 11B of the display device 10B receives the shared area data and the event information transmitted from the communication management device 50. Then, similar to the processing of the display device 10A in step S17, the display control unit 13B of the display device 10B causes the display unit (e.g., the display 280 or the display 306) to display the shared area 700 configured by the received shared area data (step S23).

[0082] Furthermore, similar to the processes performed by the display devices 10A and 10B, the user C operates a predetermined input means of the display device 10C, causing the reception unit 12C of the display device 10C to receive input of user information including a user ID and a password (step S24). Next, the transmission / reception unit 11C transmits login request information to the communication management device 50 (step S25). This login request information includes the user ID and password received in step S24. As a result, the transmission / reception unit 51 of the communication management device 50 receives the login request information transmitted from the display device 10C.

[0083] Next, the authentication unit 52 of the communication management device 50 performs user authentication using the user ID and password received in step S25, similar to the processes in steps S13 and S20 (step S26). Next, when the authentication unit 52 has completed authentication of user C, the event information management unit 55 reads the event information generated in step S15 from the event information management DB 5002 via the storage / read unit 59 (step S27).

[0084] Next, the transmitting / receiving unit 51 transmits the shared area data generated in step S14 and the event information read out in step S27 to the display device 10C (step S28). As a result, the transmitting / receiving unit 11C of the display device 10C receives the shared area data and the event information transmitted from the communication management device 50. Then, similar to the processing of the display device 10A in step S17 and the processing of the display device 10B in step S23, the display control unit 13C of the display device 10C causes the display unit (e.g., the display 280 or the display 306) to display the shared area 700 configured by the received shared area data (step S29).

[0085] In this manner, the display system 1 can display the shared area 700 forming the handwriting input screen in a shared manner among a plurality of display devices 10 participating in the event.

[0086] ○Sharing of handwritten input data○ Next, a sharing process of handwritten input data input by a user to a display screen (handwritten input screen) will be described with reference to Figs. 16 to 18. Fig. 16 is a sequence diagram showing an example of a sharing process of handwritten input data. Fig. 17 is a diagram for explaining an example of handwritten input processing in a display device. Note that Figs. 16 and 17 explain an example in which handwritten input data input to the display device 10A is shared by the display devices 10B and 10C, but similar processing is performed when handwritten input data input to the display device 10B or the display device 10C is shared by another display device 10.

[0087] First, as shown in FIG. 17(A), a part of the shared area 700 is displayed on the display screen of the display device 10A as a display area. For example, when the user A performs a scroll operation on the display screen, the display control unit 13A changes the display area displayed on the display screen as shown in FIG. 17(B) (step S31). Next, for example, when the user A touches and moves the electronic pen 290 or the hand H on the display unit, the reception unit 12A receives handwritten input such as a stroke (trajectory) of the movement (step S32). The screen data creation unit 16A creates handwritten input data (for example, coordinate data (x, y)) for displaying an object on the two-dimensional display unit based on the input stroke or the like (step S33). Then, the display control unit 13A displays an object image as shown in FIG. 17(C) on the display screen (step S34).

[0088] Next, the transmitting / receiving unit 11A of the display device 10A transmits the handwritten input data created in step S33 to the communication management device 50 (step S35). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the handwritten input data transmitted from the display device 10A. The event information management unit 55 of the communication management device 50 updates the handwritten input data file 550 stored in the storage unit 5000 based on the handwritten input data received in step S35 (step S36). In this case, the event information management unit 55 stores the handwritten input data received by the transmitting / receiving unit 51 in the event file of the event being executed in the order of occurrence (sequence order), as shown in FIG.

[0089] Next, the transmission / reception unit 51 transmits the handwritten input data received in step S35 to the display device 10B (step S37). As a result, the transmission / reception unit 11B of the display device 10B receives the handwritten input data transmitted from the display device 10A. Similarly, the transmission / reception unit 51 transmits the handwritten input data received in step S35 to the display device 10C (step S38). As a result, the transmission / reception unit 11C of the display device 10C receives the handwritten input data transmitted from the display device 10A.

[0090] In this way, the display system 1 can share handwritten input data entered on a display device 10 (e.g., display device 10A) with other display devices (e.g., display devices 10B, 10C), thereby enabling a shared area 700 containing handwritten input data entered at the event to be shared among multiple display devices 10 participating in the event.

[0091] Here, the display area displayed on each display device will be described with reference to FIG. 18. FIG. 18 is a diagram for explaining an example of a display area displayed on a display device. As shown in FIG. 18, the display devices 10A, 10B, and 10C can display different areas included in the shared area 700 as display areas on their respective display screens. Based on the shared handwritten input data, each display device 10 generates and displays an object image at a coordinate position corresponding to the display area to be displayed on the display screen of the shared area 700. Here, the display area to be displayed on the display screen, which is at least a part of the shared area 700, is an example of a first area.

[0092] ○ Bird's-eye view display processing ○ Next, a process of displaying an overhead screen showing an overall image of the shared area 700 generated in an event on the display screen of the display device 10 will be described with reference to Figs. 19 to 22. Although Figs. 19 to 22 describe the process in the display device 10A, similar processes are also performed in the display devices 10B and 10c. Fig. 19 is a sequence diagram showing an example of the display process of the overhead screen. The display size of the overhead screen may be fixed or variable, and Fig. 19 describes an example in which the display size of the overhead screen is fixed.

[0093] Fig. 20 is a diagram showing an example of a display screen displayed on the display device 10A. The display screen 100A of the display device 10A shown in Fig. 20 displays a part of a shared area 700 shared with another display device 10, and includes a display switching button 110 for switching between displaying and not displaying an overhead screen. Here, the overhead screen is a screen that displays the shared area 700 including an area not displayed on the display screen, and displays an area including all handwritten input data (objects) inputted into the shared area 700. The display screen 100A shown in Fig. 20 is in a state where the overhead screen is not displayed (non-display state). The display switching button 110 is an example of a switching means.

[0094] The reception unit 12A of the display device 10A receives the selection of the display switch button 110 by an input operation by the user A on the display screen 100A (step S51). Next, the transmission / reception unit 11A transmits an overhead screen display request indicating a request to display an overhead screen to the communication management device 50 (step S52). This overhead screen display request includes the event ID of the event being executed on the display device 10A. As a result, the transmission / reception unit 51 of the communication management device 50 receives the overhead screen display request transmitted from the display device 10A.

[0095] Next, the event information management unit 55 of the communication management device 50 reads out the handwritten input data file 550 of the event corresponding to the received event ID stored in the storage unit 5000 via the storage / readout unit 59 (step S53). Next, the overhead screen information generation unit 56 generates overhead screen information based on the handwritten input data file 550 read out in step S53 (step S54). The overhead screen information generation unit 56 generates area data indicating the position on the shared area 700 of the overhead screen area to be displayed on the overhead screen, for example, as the overhead screen information. FIG. 21 is a diagram for explaining an example of an overhead screen area included in the shared area. As shown in FIG. 21, the overhead screen area is a rectangular area including all objects handwritten and input in the shared area 700. The size of the overhead screen area is expressed, for example, by a width Dx1 and a height Dy1. Here, the overhead screen area is an example of the second area.

[0096] The overhead screen information management unit 57 stores the overhead screen information generated in step S54 in the overhead screen information management DB 5003 (see FIG. 13) via the storage / readout unit 59 (step S55). In this case, the overhead screen information management unit 57 stores, for example, the position (Dx1, Dy1) of the overhead screen area included in the overhead screen information generated in step S54 on the shared area 700 as area data in association with the event ID of the event being executed. Next, the transmission / reception unit 51 transmits the overhead screen information generated in step S54 to the display device 10A (step S56). As a result, the transmission / reception unit 11A of the display device 10A receives the overhead screen information transmitted from the communication management device 50.

[0097] The overhead screen area generating unit 18A of the display device 10A generates an overhead screen area to be displayed on the display screen 100A based on the overhead screen information received in step S56 (step S57). The overhead screen area generating unit 18A generates an image of an area on the shared area 700 corresponding to the area data (Dx1, Dy1) indicated in the received overhead screen information as an overhead screen area. Then, the overhead screen area display unit 19A displays the overhead screen 400 indicating the overhead screen area generated in step S57 on the display screen 100A (step S58).

[0098] FIG. 22 is a diagram showing an example of an overhead screen displayed on the display screen 100A. The overhead screen 400 shown in FIG. 22 is displayed superimposed on the display screen 100A on which a part of the display area of ​​the shared area 700 is displayed. The overhead screen 400 displays an image of the overhead screen area generated in step S57 in a reduced form. As described above, the overhead screen 400 displays an area including all handwritten input data (objects) inputted to the shared area 700 in a reduced form. If the display size of the overhead screen 400 is width Dx2 and height Dy2, the overhead screen area generating unit 18A calculates the ratios (Dx2 / Dx1, Dy2 / Dy1) of the overhead screen 400 and the overhead screen display area for the width and height, respectively. The overhead screen area generating unit 18A reduces the image of the overhead screen area by taking the smaller value as the reduction ratio. Then, the overhead screen area display unit 19A displays the image of the reduced overhead screen area on the overhead screen 400.

[0099] 19, an example in which the display switching button 110 is used to switch between displaying and not displaying the overhead screen has been described, but the display device 10A may be configured to automatically display the overhead screen when handwritten input is made in the shared area 700 outside the display area displayed on the display screen 100A. The overhead screen area does not have to be an area that includes all handwritten input data in the entire shared area 700, but may be an area that includes all handwritten input data within a predetermined range of the shared area 700, or may be an area that includes only handwritten input data input by a specific user.

[0100] In this way, in a state where a part of the shared area 700 is displayed on the display screen 100A, the display device 10A displays the overhead screen 400 indicating the overhead screen area, which is an area including the handwritten input data (objects) existing outside the display area, on the display screen 100A, thereby enabling the user A to efficiently grasp the contents handwritten input in the ongoing event. Note that, although an example in which the overhead screen 400 is superimposed and displayed on the display screen 100A of the display device 10A has been described, for example, when the user A holds an event using multiple displays, the overhead screen 400 may be configured to be displayed on an external device having a display function connected to the display device 10A.

[0101] ○ Updating the bird's-eye view screen area Next, the process of updating the overhead screen area displayed on the display screen will be described with reference to Fig. 23 to Fig. 25. Fig. 23 is a sequence diagram showing an example of the process of updating the overhead screen area. Note that the process of steps S71 to S78 shown in Fig. 23 is similar to the process of steps S31 to S38 shown in Fig. 16, and therefore the description will be omitted. Also, Fig. 23 to Fig. 25 will be described as the process in the display device 10A, but the same process is also performed in the display devices 10B and 10c.

[0102] The overhead screen information management unit 57 of the communication management device 50 judges whether or not the object input to the display device 10A is outside the overhead screen area based on the handwritten input data received in step S75. If the input object is outside the overhead screen area, the overhead screen information management unit 57 changes the overhead screen information stored in the overhead screen information management DB 5003 (see FIG. 13) (step S79). FIG. 24 is a diagram for explaining an example of a method for calculating the overhead screen area. Compared to the state of FIG. 21, the shared area 700 has a larger area including handwritten input data due to new handwritten input by the user A who uses the display device 10A. Therefore, the overhead screen information management unit 57 changes the size of the overhead screen area based on the coordinate position of the newly input handwritten input data. For example, the overhead screen information management unit 57 changes the coordinates of the area data (Dx1, Dy1) indicating the position of the overhead screen area on the shared area 700 so that the newly input object is included in the overhead screen area. Note that, if the input object is within the range of the overhead screen area, the overhead screen information management unit 57 does not perform the processes in and after step S79.

[0103] Then, the transmitting / receiving unit 51 transmits the overhead screen information changed in step S79 to the display device 10A (step S80). As a result, the transmitting / receiving unit 11A of the display device 10A receives the overhead screen information transmitted from the communication management device 50. Note that the communication management device 50 similarly transmits the overhead screen information transmitted to the display device 10A to other display devices 10 in a state where the overhead screen is displayed (display state).

[0104] The overhead screen area generating unit 18A of the display device 10A updates the overhead screen area displayed on the display screen 100A based on the overhead screen information received in step S80 (step S81). The overhead screen area generating unit 18A updates the area on the shared area 700 corresponding to the area data (Dx1, Dy1) shown in the received overhead screen information as the overhead screen area. Then, the overhead screen area display unit 19A displays the overhead screen 400 showing the image of the updated overhead screen area on the display screen 100A. FIG. 25 is a diagram showing an example of the updated overhead screen area. The overhead screen 400 shown in FIG. 25 displays a reduced image of the overhead screen area updated in step S81. Here, the display area displayed on the display screen 100A is an example of a first area, and the overhead screen area displayed on the overhead screen 400 is an example of a second area.

[0105] In this way, when handwritten input is made outside the overhead screen area while the overhead screen 400 is being displayed, the display device 10A can automatically change the overhead screen area displayed on the overhead screen 400 so that the input handwritten input data (object) is displayed. This allows user A to quickly grasp that another user has made handwritten input outside the overhead screen area, for example, and to confirm the contents of the handwritten input data (object) input by the other user.

[0106] ○ Updating the display area using an overhead view Next, a process of changing the display area displayed on the display screen using an overhead screen will be described with reference to Fig. 26 to Fig. 29. Fig. 26 is a flow chart showing an example of a process of changing the display area using an overhead screen. Although Fig. 26 to Fig. 29 will be described as a process in the display device 10A, the same process is also performed in the display devices 10B and 10c.

[0107] First, when user A touches (selects) the overhead screen 400, the reception unit 12A of the display device 10A receives the selection of an arbitrary position on the overhead screen area shown on the overhead screen 400 displayed on the display screen 100A (step S101). Next, the display position calculation unit 21A calculates the display coordinates on the overhead screen area of ​​the position selected in step S101 (step S102). Specifically, as shown in FIG. 27, when user A touches (selects) the position of object S1 on the overhead screen 400, the selected position is represented by coordinates (Fx1, Fy1). If the coordinates of the upper left corner of the overhead screen 400 are (Fx2, Fy2), the selected position is represented by display coordinates (Fx1-Fx2, Fy1-Fy2) on the overhead screen 400.

[0108] Next, the display position calculation unit 21A calculates the position of the selected position on the shared area (step S103). Specifically, as shown in Fig. 28, since the upper left corner of the overhead screen 400 corresponds to the position of the upper left corner of the overhead screen display area, the display position calculation unit 21A calculates the position (Dx3, Dy3) of the object S1 by returning the reduction ratio when displayed on the overhead screen 400 to the same size.

[0109] Then, the display control unit 13A changes the display area to be displayed on the display screen 100A based on the calculation result of the display position calculation unit 21A (step S104). Fig. 29 is a diagram showing an example of a display screen in which the display area has been changed. The display screen 100A shown in Fig. 29 displays a display area centered on the object S1 on the overhead view screen 400 selected in step S101.

[0110] In this way, the display device 10A can automatically display, on the display screen 100A, an area corresponding to the position on the overhead screen 400 selected by the user A as the display area, thereby allowing the user A to efficiently switch the display area and allowing the event to proceed smoothly.

[0111] ○Changing the display size of the bird's-eye view screen Next, a process for changing the display size of the overhead screen will be described with reference to Figs. 30 to 39. Although Figs. 30 to 39 will be described as a process for the overhead screen displayed on the display device 10A, similar processes are also performed on the display devices 10B and 10c. In the above description, an example in which the display size of the overhead screen is fixed has been described, but Figs. 30 to 39 will be described as an example in which the display size of the overhead screen is variable. Fig. 30 is a diagram for explaining an example of handwritten input data inputted into a shared area. As shown in Fig. 30, when handwritten input data (objects) are present in a wide range of the shared area 700, the area of ​​the overhead screen area becomes large. In this case, when a reduced image of the overhead screen area is displayed on the overhead screen, each object becomes small and difficult to see.

[0112] Fig. 31 is a diagram showing an example of an overhead screen corresponding to the shared area shown in Fig. 30. As shown in Fig. 31, the overhead screen 400 has a wide area including the object input to the shared area 700, so the displayed overhead screen area is also wide. Therefore, it is difficult for user A viewing the display screen 100A to understand the contents of the writing even when looking at the overhead screen 400. Therefore, when objects are present over a wide range of the shared area 700, the display system 1 changes the display size of the overhead screen according to the area of ​​the overhead screen area so that the object in the overhead screen does not become too small.

[0113] Fig. 32 is a sequence diagram showing an example of a process for changing the display size of the overhead screen. Note that the processes in steps S131 to S137 shown in Fig. 32 are similar to the processes in steps S32 to S38 shown in Fig. 16, and therefore will not be described.

[0114] In step S138, the communication management device 50 executes processing for changing the display size of the overhead screen. The processing of step S138 will now be described in detail with reference to Fig. 33. Fig. 33 is a flowchart showing an example of processing for changing the display size of the overhead screen.

[0115] First, the overhead screen information management unit 57 judges whether the area of ​​the overhead screen area is equal to or larger than a threshold Tl (threshold Tl≦area of ​​the overhead screen area) based on the overhead screen information stored in the overhead screen information management DB 5003 (step S151). The threshold Tl is a value indicating a predetermined threshold for the area of ​​the overhead screen area, and is a threshold for switching the display size of the overhead screen. As shown in Fig. 34, the overhead screen information management unit 57 judges whether the area (Dx1 x Dy1) of the overhead screen area including all objects input to the handwriting input screen, which is the shared area 700, is equal to or larger than a threshold Tl.

[0116] When the overhead screen information management unit 57 determines that the area of ​​the overhead screen region is equal to or larger than the threshold value Tl (YES in step S151), the process proceeds to step S153. Then, the overhead screen information management unit 57 sets the display size of the overhead screen to "large" (step S153). The overhead screen information management unit 57 stores the set display size ("large" size) as the display size of the overhead screen information stored in the overhead screen information management DB 5003 (see FIG. 13) via the storage / readout unit 59.

[0117] Fig. 35 is a diagram showing an example of a large-sized bird's-eye view screen. Bird's-eye view screen 410 shown in Fig. 35 is a bird's-eye view screen displayed when the display size of the bird's-eye view screen is set to "large". Since the bird's-eye view screen area displayed on bird's-eye view screen 410 includes objects over a wide range of shared area 700, the objects are displayed in an image reduced to a size corresponding to the "large"-sized bird's-eye view screen 410 so that user A can easily view each object.

[0118] On the other hand, when the overhead screen information management unit 57 determines that the area of ​​the overhead screen area is smaller than the threshold Tl (NO in step S151), it shifts the process to step S152. Based on the overhead screen information stored in the overhead screen information management DB 5003, the overhead screen information management unit 57 determines whether the area of ​​the overhead screen area is equal to or larger than the threshold Ts and smaller than the threshold Tl (threshold Ts≦area of ​​the overhead screen area<threshold Tl) (step S152). The threshold Ts is a value indicating a predetermined threshold for the area of ​​the overhead screen area, and is a value smaller than the threshold Tl. As shown in FIG. 36, the overhead screen information management unit 57 determines whether the area (Dx1×Dy1) of the overhead screen area including all objects input to the handwriting input screen, which is the shared area 700, is equal to or larger than the threshold Ts and smaller than Tl.

[0119] When the overhead screen information management unit 57 determines that the area of ​​the overhead screen region is equal to or larger than the threshold value Ts and smaller than Tl (YES in step S152), the process proceeds to step S154. Then, the overhead screen information management unit 57 sets the display size of the overhead screen to "medium" (step S154). The overhead screen information management unit 57 stores the set display size ("medium" size) as the display size of the overhead screen information stored in the overhead screen information management DB 5003 via the storage / readout unit 59.

[0120] Fig. 37 is a diagram showing an example of a medium-sized bird's-eye view screen. Bird's-eye view screen 420 shown in Fig. 37 is a bird's-eye view screen displayed when the display size of the bird's-eye view screen is set to "medium" size. The bird's-eye view screen area displayed on bird's-eye view screen 420 has a narrower area including objects and a smaller area than the bird's-eye view screen areas shown in Figs. 34 and 35. Therefore, the bird's-eye view screen 420 displays an image of the bird's-eye view screen area with a reduction ratio corresponding to the "medium" size, which is larger than the reduction ratio of the image of the bird's-eye view screen area displayed on the bird's-eye view screen 410.

[0121] On the other hand, when the overhead screen information management unit 57 determines that the area of ​​the overhead screen region is smaller than the threshold value Ts (NO in step S152), it shifts the process to step S155. Then, the overhead screen information management unit 57 sets the display size of the overhead screen to "small" (step S155). As shown in FIG. 38, the overhead screen information management unit 57 determines whether the area (Dx1×Dy1) of the overhead screen region including all objects inputted to the handwriting input screen, which is the shared area 700, is less than the threshold value Ts, and sets the display size to "small". The overhead screen information management unit 57 stores the set display size ("small" size) as the display size of the overhead screen information stored in the overhead screen information management DB 5003 via the storage / readout unit 59.

[0122] FIG. 39 is a diagram showing an example of a small-sized bird's-eye view screen. The bird's-eye view screen 430 shown in FIG. 39 is a bird's-eye view screen displayed when the display size of the bird's-eye view screen is set to "small". The bird's-eye view screen area displayed on the bird's-eye view screen 430 has a narrower area including objects and a smaller area than the bird's-eye view screen areas corresponding to the above-mentioned "large" and "medium" sizes of bird's-eye view screens. Therefore, the bird's-eye view screen 430 displays an image of the bird's-eye view screen area with a reduction ratio corresponding to the "small" size, which is larger than the reduction ratio of the image of the bird's-eye view screen area displayed on the bird's-eye view screen 410 and the bird's-eye view screen 420.

[0123] In this way, the communication management device 50 switches the display size of the overhead screen on the display screen 100A displaying the overhead screen area between three patterns, "large", "medium", and "small", depending on the area of ​​the overhead screen area determined by the range of the handwritten input data (objects) included in the shared area 700. Note that the display size of the overhead screen is not limited to three patterns, "large", "medium", and "small", and may be configured to be switchable between only two patterns or four or more patterns.

[0124] 32, the transmitting / receiving unit 51 of the communication management device 50 transmits to the display device 10A the overhead screen information for which the display size has been set in the processing of step S138 (step S139). As a result, the transmitting / receiving unit 11A of the display device 10A receives the overhead screen information transmitted from the communication management device 50. Note that the communication management device 50 similarly transmits the overhead screen information transmitted to the display device 10A to other display devices 10 in a state in which the overhead screen is displayed (display state).

[0125] The overhead screen area generating unit 18A of the display device 10A updates the overhead screen area displayed on the display screen 100A based on the overhead screen information received in step S139 (step S140). Then, the overhead screen area display unit 19A displays an overhead screen corresponding to the display size of the updated overhead screen area on the display screen 100A, as shown in FIG. 35, FIG. 37, or FIG. 39.

[0126] In this way, display device 10A can display an overhead screen with a display size according to the area of ​​the overhead screen region so that the object in the overhead screen does not become too small, even if handwritten input data (objects) are included in a wide range of shared area 700. This allows user A to easily understand the contents of the input object by viewing the overhead screen, which has a variable display size, even if the object is input in a wide range of shared area 700.

[0127] ○ Display processing of base area information on the bird's-eye view screen Next, a process of displaying the display areas displayed on the display screens of the display devices participating in the event on the overhead screen will be described with reference to Fig. 40 to Fig. 42. Fig. 40 is a sequence diagram showing an example of a display process of base area information on the overhead screen. Note that Fig. 40 to Fig. 42 will be described as a process of the overhead screen displayed on the display device 10A, but the same process is also performed on the display devices 10B and 10c.

[0128] First, the display control unit 13B of the display device 10B changes the display area of ​​the display screen 100B on which a part of the shared area 700 is displayed (step S151), similar to the example shown in the above-mentioned FIGS. 17(A) and (B). Then, the transmitting / receiving unit 11B transmits display area information indicating the display area displayed on the display screen 100B to the communication management device 50 (step S152). This display area information includes coordinate data for specifying the display area displayed on the display screen (e.g., display screen 100B) of the display device 10B and a user ID for identifying a user (e.g., user B) who uses the display device 10B. As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the display area information transmitted from the display device 10B.

[0129] Similarly, the display control unit 13C of the display device 10C changes the display area of ​​the display screen 100C on which a part of the shared area 700 is displayed, as in the example shown in FIGS. 17(A) and (B) described above (step S153). Then, the transmitting / receiving unit 11C transmits display area information indicating the display area displayed on the display screen 100C to the communication management device 50 (step S154). This display area information includes coordinate data for specifying the display area displayed on the display screen (e.g., display screen 100C) of the display device 10C and a user ID for identifying a user (e.g., user C) who uses the display device 10C. As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the display area information transmitted from the display device 10C. Note that the display area information transmitted and received in steps S152 and S154 may include user name information for identifying a user together with or instead of the user ID.

[0130] Next, the shared area duplication unit 58 of the communication management device 50 generates a duplicate of the shared area shared in the ongoing event based on the metadata file 500 and the handwritten input data file 550 stored in the storage unit 5000 (step S155). Next, the shared area duplication unit 58 adds, to the duplicated shared area, the location display information indicating the display area displayed on the display device 10 of each location based on the display area information received in steps S152 and S154 (step S156). This location display information includes information indicating the position of the display area displayed on the display device 10 of each location in the shared area 700 and information identifying the user who is displaying the display area. The information indicating the position of the display area in the shared area 700 and the information identifying the user who is displaying the display area correspond to the coordinate data and the user ID (or user name) included in the display area information received in steps S152 and S154, respectively.

[0131] FIG. 41 is a diagram for explaining an example of a method for calculating a display area displayed on a display device included in a shared area. As shown in FIG. 41, for example, the display devices 10A, 10B, and 10C participating in an event may each display a different area included in the shared area 700. In this case, the display area displayed on the display screen 100A of the display device 10A does not include the display area displayed on the display devices 10B and 10C of the other bases. If the user A using the display device 10A can grasp which area in the shared area 700 is displayed by the user at the other base, for example, the user A can determine whether it is okay to continue the explanation or whether an instruction to prompt the user to move the display area is necessary, and the event can proceed smoothly. Therefore, the display system 1 is capable of displaying base display information indicating the display area displayed on the display screen of each base on the overhead screen.

[0132] As shown in FIG. 41, the display area of ​​each base is expressed by the coordinates of the upper left corner and the lower right corner of each display area on the shared area 700. For example, the display area of ​​the display device 10B is expressed by B1 (x1, y1), which is the coordinate of the upper left corner of the display area, and B2 (x2, y2), which is the coordinate of the lower right corner. The display area of ​​the display device 10C is expressed by C1 (x1, y1), which is the coordinate of the upper left corner of the display area, and C2 (x2, y2), which is the coordinate of the lower right corner. The shared area duplication unit 58 specifies the position of the display area of ​​each base on the overhead screen based on the coordinate data for specifying the display area included in the received display area information. Then, the shared area duplication unit 58 adds base display information indicating the display area of ​​each base to the specified position of the display area of ​​each base to the duplicated shared area duplication data.

[0133] The transmitting / receiving unit 51 of the communication management device 50 transmits to the display device 10A the overhead screen information stored in the overhead screen information management DB 5003 and the shared area copy data generated in steps S155 and S156 (step S157). As a result, the transmitting / receiving unit 11A of the display device 10A receives the overhead screen information and the shared area copy data transmitted from the communication management device 50.

[0134] The overhead screen area generating unit 18A of the display device 10A generates an overhead screen area using the received shared area copy data based on the overhead screen information received in step S157 (step S158). Then, the overhead screen area display unit 19A displays an overhead screen 470 showing the overhead screen area generated in step S158 on the display screen 100A (step S159). FIG. 42 is a diagram showing an example of an overhead screen on which base area information is displayed. The overhead screen 470 shows the display area displayed by each display device 10 participating in the event. The overhead screen 470 includes, as base display information, area information 471 (471A, 471B, 471C) showing the display area at each base, and a user display image 475 (475A, 475B, 475C) specifying the user using the display device 10 at each base. In the area information 471, the display area of ​​each base is represented by a dotted line, but the method of representing the area information 471 is not limited to this, and the display area of ​​each base may be represented by a line (frame) of a different color, etc. The user display image 475 is an image representing the user name of the user who uses the display device 10 on which the display area corresponding to the area information 471 is displayed. Here, the display area of ​​the other display device 10 shown by the area information 471 is an example of a third area.

[0135] Also, for example, when there is a base displaying a display area that is not included in the overhead screen area displayed on the overhead screen 470, a configuration may be adopted in which only the user display image 475 is displayed at the screen end in the direction in which the corresponding display area exists. In this case, for example, by viewing the overhead screen 470 on which only the user display image 475 is displayed, the user A can understand that the corresponding user is displaying another area in which nothing has been handwritten.

[0136] In this way, display device 10A displays on overhead screen 470 an overhead screen area including information on display areas displayed at other locations, allowing user A to know which areas in shared area 700 are being displayed by other users, thereby enabling the event to proceed smoothly. Also, by checking overhead screen 470, user A can know whether users at each location are paying attention to the explanation points, for example, thereby improving the quality of the event.

[0137] Modifications of the embodiment Next, a modified example of the display system according to the embodiment will be described with reference to Fig. 43 to Fig. 47. The same configurations and functions as those of the above embodiment are given the same reference numerals, and the description thereof will be omitted. The display system 1a according to the modified example is an example in which the display device 10 generates and manages the overhead screen to be displayed on the display device 10.

[0138] FIG. 43 is a diagram showing an example of a functional configuration of a display system according to a modification of the embodiment. The display device 10 according to the modification shown in FIG. 43 includes an overhead screen information generating unit 23, an overhead screen information managing unit 24, and a shared area copying unit 25 in addition to the configuration of the display device 10 shown in FIG. 8. The overhead screen information generating unit 23, the overhead screen information managing unit 24, and the shared area copying unit 25 have the same configuration as the overhead screen information generating unit 56, the overhead screen information managing unit 57, and the shared area copying unit 58, respectively. In addition, the display device 10 according to the modification has an overhead screen information management DB 1001 constructed in the storage unit 1000. The overhead screen information management DB 1001 is configured by the overhead screen information management table shown in FIG. 13. In this way, the display system 1a according to the modification 1 generates and manages overhead screen information for identifying the overhead screen area on the display device 10. In addition, the function of generating and managing the overhead screen information in the modified example may be provided in all display devices 10, or may be provided only in the display device 10 used by the user who will be the host of the event to be held.

[0139] ○ Bird's-eye view display processing ○ FIG. 44 is a sequence diagram showing an example of a display process of an overhead screen according to a modified example of the embodiment. First, the reception unit 12A of the display device 10A receives the selection of the display switching button 110 shown in FIG. 20 by the input operation of the user A on the display screen 100A (step S201). Next, the overhead screen information generation unit 23A generates overhead screen information based on the handwritten input data of the ongoing event stored in the storage unit 1000 (step S202). As shown in FIG. 21, the overhead screen information generation unit 23A generates area data indicating the position on the shared area 700 of the overhead screen area to be displayed on the overhead screen as the overhead screen information. The overhead screen information management unit 24A stores the overhead screen information generated in step S202 in the overhead screen information management DB 1001A via the storage / readout unit 29A (step S203).

[0140] Next, the overhead screen area generating unit 18A generates an overhead screen area to be displayed on the display screen 100A based on the overhead screen information generated in step S202 (step S204). The overhead screen area generating unit 18A generates an image of an area on the shared area 700 corresponding to the area data (Dx1, Dy1) indicated in the generated overhead screen information as an overhead screen area. Then, the overhead screen area display unit 19A displays the overhead screen 400 indicating the overhead screen area generated in step S204 on the display screen 100A as shown in FIG. 22 (step S205).

[0141] Next, the transmitting / receiving unit 11A transmits the overhead screen information generated in step S202 to the communication management device 50 (step S206). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the overhead screen information transmitted from the display device 10A. Then, the overhead screen information management unit 57 of the communication management device 50 stores the overhead screen information received in step S206 in the overhead screen information management DB 5003 via the storage / readout unit 59 (step S207).

[0142] ○ Updating the bird's-eye view screen area Fig. 45 is a sequence diagram showing an example of an update process of an overhead screen area according to a modification of the embodiment. Note that the processes of steps S231 to S238 shown in Fig. 45 are similar to the processes of steps S71 to S78 shown in Fig. 23, and therefore the description thereof will be omitted.

[0143] The overhead screen information management unit 24A of the display device 10A judges whether or not the object input to the display device 10A is outside the overhead screen area based on the handwritten input data created in step S233. If the input object is outside the overhead screen area, the overhead screen information management unit 24A changes the overhead screen information stored in the overhead screen information management DB 1001 as shown in FIG. 24 (step S239).

[0144] Next, the overhead screen area generating unit 18A updates the overhead screen area displayed on the display screen 100A based on the overhead screen information changed in step S239 (step S240). The overhead screen area generating unit 18A updates the area on the shared area 700 corresponding to the area data (Dx1, Dy1) shown in the changed overhead screen information as the overhead screen area. Then, the overhead screen area display unit 19A displays the overhead screen 400 showing the image of the updated overhead screen area on the display screen 100A as shown in FIG.

[0145] Next, the transmitting / receiving unit 11A transmits the overhead screen information changed in step S239 to the communication management device 50 (step S241). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the overhead screen information transmitted from the display device 10A. Then, the overhead screen information management unit 57 of the communication management device 50 changes the overhead screen information stored in the overhead screen information management DB 5003 to the overhead screen information received in step S241 (step S242).

[0146] ○Changing the display size of the bird's-eye view screen Fig. 46 is a sequence diagram showing an example of a process for changing the display size of an overhead screen according to a modified example of the embodiment. Note that the processes in steps S251 to S257 shown in Fig. 46 are similar to the processes in steps S131 to S137 shown in Fig. 32, and therefore will not be described.

[0147] In step S238, the overhead screen information management unit 24A of the display device 10A performs a process shown in Fig. 33 to change the display size of the overhead screen. Next, the overhead screen area generation unit 18A updates the overhead screen area displayed on the display screen 100A based on the overhead screen information whose display size has been changed by the process of step S238 (step S259). Then, the overhead screen area display unit 19A displays the overhead screen corresponding to the display size of the updated overhead screen area on the display screen 100A, as shown in Fig. 35, Fig. 37, or Fig. 39.

[0148] Next, the transmitting / receiving unit 11A transmits the overhead screen information whose display size has been changed by the processing of step S238 to the communication management device 50 (step S260). As a result, the transmitting / receiving unit 51 of the communication management device 50 receives the overhead screen information transmitted from the display device 10A. Then, the overhead screen information management unit 57 of the communication management device 50 changes the overhead screen information stored in the overhead screen information management DB 5003 to the overhead screen information received in step S260 (step S261).

[0149] ○ Display processing of base area information on the bird's-eye view screen FIG. 47 is a sequence diagram showing an example of a display process of display area information for an overhead view screen according to a modified example of the embodiment. First, the display control unit 13B of the display device 10B changes the display area of ​​the display screen 100B on which a part of the shared area 700 is displayed (step S271) in the same manner as the process of step S151 of FIG. 40. Then, the transmitting / receiving unit 11B transmits display area information indicating the display area displayed on the display screen 100B to the communication management device 50 (step S272). This display area information includes coordinate data for specifying the display area displayed on the display screen (for example, the display screen 100B) of the display device 10B and a user ID for identifying a user (for example, user B) who uses the display device 10B. Then, the transmitting / receiving unit 51 of the communication management device 50 transmits (transfers) the display area information transmitted from the display device 10B to the display device 10A (step S273). As a result, the transmitting / receiving unit 11A of the display device 10A receives the display area information transmitted from the display device 10B.

[0150] Similarly, the display control unit 13C of the display device 10C changes the display area of ​​the display screen 100C on which a part of the shared area 700 is displayed, similar to the process of step S153 in FIG. 30 (step S274). Then, the transmitting / receiving unit 11C transmits display area information indicating the display area displayed on the display screen 100C to the communication management device 50 (step S275). This display area information includes coordinate data for specifying the display area displayed on the display screen (for example, the display screen 100C) of the display device 10C and a user ID for identifying a user (for example, user C) who uses the display device 10C. Then, the transmitting / receiving unit 51 of the communication management device 50 transmits (transfers) the display area information transmitted from the display device 10C to the display device 10A (step S276). As a result, the transmitting / receiving unit 11A of the display device 10A receives the display area information transmitted from the display device 10C. Note that the display area information transmitted and received in steps S272 and S275 may include information on a user name for identifying a user together with or instead of the user ID.

[0151] Next, the shared area duplication unit 25A of the display device 10A generates a duplicate of the shared area shared in the ongoing event based on the metadata and handwritten input data of the ongoing event stored in the storage unit 1000 (step S277). Next, the shared area duplication unit 25A adds, to the duplicated shared area, the site display information indicating the display area displayed on the display device 10 of each site based on the display area information received in steps S273 and S276, as shown in FIG. 41 (step S278). This site display information includes information indicating the position of the display area displayed on the display device 10 of each site in the shared area 700 and information identifying the user who is displaying the display area. The information indicating the position of the display area in the shared area 700 and the information identifying the user who is displaying the display area correspond to the coordinate data and the user ID included in the display area information received in steps S273 and S276, respectively.

[0152] Next, the overhead screen area generating unit 18A generates an overhead screen area using the shared area copy data generated in steps S277 and S278 based on the overhead screen information stored in the overhead screen information management DB 1001 (step S279). Then, the overhead screen area display unit 19A displays an overhead screen 470 showing the overhead screen area generated in step S279 on the display screen 100A as shown in FIG. 42 (step S280).

[0153] In this way, the display system 1a according to the modified example can execute various processes related to the overhead screen area displayed on the display device 10, even when the display device 10 generates and manages overhead screen information for identifying the overhead screen area.

[0154] Effect of the embodiment As described above, the display system 1, 1a, in a state where a part of the shared area 700 is displayed on the display screen 100, displays an overhead screen area, which is an area including handwritten input data (objects) existing outside the display area, superimposed on the display screen 100. This allows the display system 1, 1a to allow the user to efficiently grasp the contents handwritten input in the ongoing event.

[0155] Furthermore, when handwritten input is made outside the overhead screen area, the display system 1, 1a automatically changes the overhead screen area so that the input handwritten input data (object) is displayed. This allows the display system 1, 1a to allow the user to quickly understand that handwritten input has been made outside the overhead screen area, and to allow the user to confirm the contents of the handwritten input data (object) input by another user.

[0156] Furthermore, the display system 1, 1a displays an overhead screen area including information on display areas displayed at other locations on the overhead screen 470. This allows the display system 1, 1a to allow the user to know which area in the shared area 700 is being displayed by other users, thereby allowing the event to proceed smoothly.

[0157] ●Summary● As described above, the display device according to one embodiment of the present invention acquires handwritten input data input into the shared area 700 (one example of a handwritten input area) where handwritten input is possible, and displays at least a part of the shared area 700 on the display screen 100. Furthermore, the display device 10 displays, on the display screen 100, an overhead screen area including the handwritten input data input into the shared area 700. This allows the display device 10 to allow the user to efficiently understand the handwritten input content.

[0158] Furthermore, the display device according to an embodiment of the present invention displays, on the display screen 100, a first area that is at least a part of the shared area 700 (one example of a handwriting input area) in which handwriting input is possible, and displays, on the display screen 100 on which the first area is displayed, an overhead screen area that shows a second area in the shared area 700 that includes handwriting input data that has been input outside the first area. This allows the display device 10 to allow the user to efficiently understand the contents that have been handwritten.

[0159] Furthermore, when handwritten input data input outside the second area is acquired, the display device according to the embodiment of the present invention displays the overhead screen area changed to include the acquired handwritten input data. This allows the display device 10 to quickly let the user know that another user has made a handwritten input outside the overhead screen area, for example, and to check the contents of the handwritten input data input by the other user.

[0160] Furthermore, the display device according to an embodiment of the present invention changes the display size of the overhead screen area in accordance with the range of the shared area 700 (one example of a handwriting input area) into which the handwritten input data has been input. As a result, even if the handwritten input data is included in a wide range of the shared area 700, the display device 10 displays an overhead screen area with a variable display size, thereby allowing the user to easily grasp the contents of the handwritten input data entered.

[0161] Furthermore, the display device according to an embodiment of the present invention displays an overhead screen area including base area information indicating a third area displayed on the display screen of another display device 10 within the shared area 700 (an example of a handwriting input area). The display device also displays, as the base area information, an overhead screen area including a user display image 475 that identifies a user using another display device 10 on which the third area is displayed. This allows the display device 10 to allow the user to know which area in the shared area 700 is being displayed by the other users, thereby allowing the event to proceed smoothly.

[0162] ●Additional Information● Each function of the above-described embodiment can be realized by one or more processing circuits. Here, the "processing circuit" in the present embodiment includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), a SOC (System on a chip), a GPU (Graphics Processing Unit), and a conventional circuit module designed to execute each function described above.

[0163] In addition, the various tables in the above-described embodiment may be generated by the learning effect of machine learning, and the data of each associated item may be classified by machine learning, making it unnecessary to use tables. Here, machine learning is a technology for making a computer acquire human-like learning capabilities, and refers to a technology in which a computer autonomously generates an algorithm required for judgment such as data identification from learning data previously acquired, and applies this to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods, and any learning method for machine learning may be used.

[0164] So far, a display device, a display system, a display control method, and a program according to one embodiment of the present invention have been described. However, the present invention is not limited to the above-described embodiment, and other embodiments may be added, modified, or deleted, etc., within the scope that can be conceived by a person skilled in the art. In any aspect, as long as the function and effect of the present invention are achieved, it is included in the scope of the present invention. [Explanation of symbols]

[0165] 1,1a Display System 5. Communication Network 10(10A,10B,10C) Display device 11 Transmitting and receiving unit (an example of an acquiring means) 12 Reception 13 Display control unit (an example of a display control means) 16 Screen data creation unit (an example of an acquisition means) 17 Image processing section 18 Overhead screen area generation unit 19. Bird's-eye view screen area display unit (an example of a bird's-eye view screen area display means) 21 Display position calculation section 23 Overhead screen information generation section 24 Overview screen information management department 25 Shared area replication section 50 Communication management device 51 Transmitter / receiver 56 Overview screen information generation section 57 Overview screen information management department 58 Shared area replication section 100(100A,100B,100C) display screen 400,410,420,430,470 Overview screen 471 Area information 475 User Display Images 700 Shared area (Example of handwritten input area) [Prior art documents] [Patent documents]

[0166] [Patent Document 1] JP 2014-195183 A

Claims

1. A system in which a plurality of display devices are configured to be able to communicate with each other, a display control means for displaying, on a display screen of a first display device among the plurality of display devices, a first area which is at least a part of a shared area shared by the plurality of display devices, and which is capable of displaying a different area of ​​the shared area for each of the plurality of display devices; an acquiring means for acquiring first handwritten input data inputted to the shared area via the display screen and second handwritten input data inputted to the shared area in a second display device different from the first display device among the plurality of display devices; an overhead screen area display means for displaying an overhead screen area, which is controlled so as to display all of the first handwritten input data and the second handwritten input data, in the shared area in a manner superimposed on a first display area displayed on the display screen; a display area acquisition means for acquiring information on a third area displayed on a display screen of the second display device, out of the shared area; Equipped with When a third area of ​​the shared area displayed on the display screen of the second display device is included in the bird's-eye view screen area, the bird's-eye view screen area includes base area information that identifiably displays the third area. A system characterized by:

2. The display control means displays a switching means for switching between displaying and not displaying the overhead screen area on the display screen, The system according to claim 1 , wherein the overhead screen area display means displays the overhead screen area when a selection is accepted for the displayed switching means.

3. The display control means displaying, on the display screen, a first area into which the first handwritten input data has been input; displaying, on the display screen, a second area into which the second handwritten input data has been input; The system described in claim 1 or 2, wherein the overhead screen area display means displays the overhead screen area indicating a second area of ​​the second area, which is outside the first area and corresponds to another part of the shared area, and into which the second handwritten input data is input via a display screen provided on another display device, on the display screen of the first display device on which the first area is displayed.

4. The system according to claim 3 , wherein the overhead screen area display means displays the overhead screen area when the second handwritten input data input outside the first area is acquired.

5. The system described in claim 3 or 4, wherein the overhead screen area display means, when handwritten input data entered outside the second area is acquired, displays the overhead screen area modified to include the acquired handwritten input data.

6. 6. The system according to claim 1, wherein the overhead screen area display means changes a display size of the overhead screen area in accordance with a range of the shared area into which each piece of handwritten input data is input.

7. The system according to claim 1 , wherein the base area information includes a user display image that identifies a user who uses the other display device on which the third area is displayed.

8. The shared area is a shared canvas. A system according to any one of claims 1 to 7.

9. A display control method executable on a plurality of display devices configured to be able to communicate with each other, comprising: a display control step of displaying, on a display screen of a first display device among the plurality of display devices, a first area which is at least a part of a shared area shared by the plurality of display devices, and in which a different area of ​​the shared area can be displayed on each of the plurality of display devices; an acquiring step of acquiring first handwritten input data inputted to the shared area via the display screen and second handwritten input data inputted to the shared area in a second display device different from the first display device among the plurality of display devices; an overhead screen area display step of displaying an overhead screen area, which is controlled to display all of the first handwritten input data and the second handwritten input data, in the shared area in a manner superimposed on a first display area displayed on the display screen; a display area acquisition step of acquiring information of a third area displayed on a display screen of the second display device, out of the shared area; Run When a third area of ​​the shared area displayed on the display screen of the second display device is included in the bird's-eye view screen area, the bird's-eye view screen area includes base area information that identifiably displays the third area. A display control method comprising:

10. A method for controlling a plurality of display devices configured to be able to communicate with each other, a display control step of displaying, on a display screen of a first display device among the plurality of display devices, a first area which is at least a part of a shared area shared by the plurality of display devices, and in which a different area of ​​the shared area can be displayed on each of the plurality of display devices; an acquiring step of acquiring first handwritten input data inputted to the shared area via the display screen and second handwritten input data inputted to the shared area in a second display device different from the first display device among the plurality of display devices; an overhead screen area display step of displaying an overhead screen area, which is controlled to display all of the first handwritten input data and the second handwritten input data, in the shared area in a manner superimposed on a first display area displayed on the display screen; a display area acquisition means for acquiring information on a third area displayed on a display screen of the second display device, out of the shared area; Run When a third area of ​​the shared area displayed on the display screen of the second display device is included in the bird's-eye view screen area, the bird's-eye view screen area includes base area information that identifiably displays the third area. A program characterized by:

Images