COMMUNICATION SYSTEM, COMMUNICATION TERMINAL, SCREEN SHARING METHOD, AND PROGRAM

The communication system facilitates the sharing of multiple screens between communication terminals by using a reception and display control mechanism, addressing the limitations of conventional systems in screen sharing based on attention ranking, thereby improving collaboration through synchronized screen display.

JP7581721B2Active Publication Date: 2024-11-13RICOH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2020155740
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-09-16
Publication Date
2024-11-13
Estimated Expiration
2040-09-16

AI Technical Summary

Technical Problem

Conventional conference systems are limited in their ability to share multiple screens selected and displayed on a certain communication terminal with other terminals, as the content to be shared is determined by the ranking of the degree of attention, preventing flexible screen sharing.

Method used

A communication system that includes a first and second communication terminal, allowing for the selection and display of multiple screens on one terminal to be shared with others, using a reception unit, display control section, and operation screen display section to manage and display these screens based on display history and arrangement information.

Benefits of technology

Enables the sharing of multiple screens selected and displayed on one communication terminal with other terminals, ensuring synchronized and coordinated screen display across multiple devices, enhancing collaboration and understanding among users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007581721000001
    Figure 0007581721000001
  • Figure 0007581721000002
    Figure 0007581721000002
  • Figure 0007581721000003
    Figure 0007581721000003
Patent Text Reader

Abstract

To provide a communication system, a communication terminal, a screen sharing method, and a program which, in a communication system for sharing a screen among a plurality of communication terminals, allow a plurality of screens selected for display by a communication terminal to be shared with other communication terminals.SOLUTION: The present invention is directed to a communication system 100 having a first communication terminal and a second communication terminal sharing its screen with the first communication terminal. A reception unit of the first communication terminal receives selection of a plurality of screens displayed on a display unit of the first communication terminal. A display control unit of the second communication terminal displays, on a display unit of the second communication terminal, the plurality of screens received by the reception unit based on information of the plurality of screens received by the reception unit and arrangement information based on the number of screens of the plurality of screens received by the reception unit.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a communication system, a communication terminal, a screen sharing method, and a program. [Background technology]

[0002] A conference system in which a conference is held among a plurality of communication terminals via a communication network such as the Internet has become widespread. In such a conference system, a display screen is shared among the plurality of communication terminals, and stroke data for reproducing a stroke image drawn by a user with an electronic pen, hand, or the like is transmitted and received among the communication terminals, thereby sharing the stroke image.

[0003] In addition, among such conference systems, there is known a conference system that calculates the attention level of conference data based on the display state of the conference data of each communication terminal participating in the conference, and creates a screen to be displayed on a communication terminal that joins midway in accordance with the attention level ranking (see, for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] In such a conference system, there is a demand for sharing a plurality of screens selected and displayed on a certain communication terminal with other communication terminals.

[0005] However, in conventional conferencing systems such as that shown in Patent Document 1, the content displayed on the shared screen is determined according to the attention ranking of the conference data, which creates a problem in that multiple screens selected and displayed on one communication terminal cannot be shared with other communication terminals.

[0006] One embodiment of the present invention has been made in consideration of the above-mentioned problems, and in a communication system in which screens are shared among multiple communication terminals, it enables multiple screens selected and displayed on a communication terminal to be shared with other communication terminals. [Means for solving the problem]

[0007] In order to solve the above problem, a communication system according to an embodiment of the present invention is a communication system including a first communication terminal and a second communication terminal that shares a screen with the first communication terminal, the first communication terminal having a reception unit that receives a selection of a plurality of screens to be displayed on a display unit of the first communication terminal, and the second communication terminal having a display control unit that displays the plurality of screens received by the reception unit on the display unit of the second communication terminal, using information regarding the plurality of screens received by the reception unit and arrangement information based on the number of screens of the plurality of screens received by the reception unit. death , The first communication terminal further has an operation screen display unit that displays a proposed screen that displays a selectable combination of multiple screens to be displayed on the display unit of the first communication terminal based on a display history of screens displayed by the first communication terminal. Effect of the Invention

[0008] According to one embodiment of the present invention, in a communication system in which screens are shared among a plurality of communication terminals, a plurality of screens selected and displayed on a certain communication terminal can be shared with other communication terminals. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a schematic diagram illustrating an example of a communication route in a communication system according to an embodiment. [Diagram 2] FIG. 1 is a diagram illustrating an example of a system configuration of a communication system according to an embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of an electronic whiteboard according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to an embodiment. [Diagram 5] FIG. 1 is a diagram illustrating an example of a functional configuration of a communication system according to an embodiment. [Figure 6] FIG. 13 is a diagram illustrating an example of an authentication management table according to an embodiment. [Figure 7] FIG. 13 is a diagram illustrating an example of a terminal management table according to an embodiment. [Figure 8]FIG. 13 is a diagram illustrating an example of a destination list management table according to an embodiment. [Figure 9] FIG. 13 is a diagram illustrating an example of a session management table according to an embodiment. [Figure 10] FIG. 13 is a diagram illustrating an example of a relay device management table according to an embodiment. [Figure 11] FIG. 13 is a diagram illustrating an example of a shared data management table according to an embodiment. [Figure 12] FIG. 11 is a diagram for explaining screen information according to an embodiment. [Figure 13] FIG. 11 is a sequence diagram illustrating an example of a preparatory process according to an embodiment. [Figure 14] FIG. 11 is a sequence diagram illustrating an example of a session start process according to an embodiment. [Figure 15] FIG. 11 is a sequence diagram illustrating an example of a stroke image sharing process according to an embodiment. [Figure 16] FIG. 4 is a sequence diagram showing an example of a sharing process for a plurality of screens according to the first embodiment. [Figure 17] FIG. 4 is a diagram showing an example of a page list screen according to the first embodiment. [Figure 18] FIG. 4 is a diagram showing an example of arrangement information according to the first embodiment. [Figure 19] FIG. 1 is a diagram (1) showing an example of a display screen of an interactive whiteboard according to a first embodiment. [Figure 20] FIG. 2 is a diagram showing an example of a display screen of the interactive whiteboard according to the first embodiment; [Figure 21] FIG. 11 is a diagram (1) showing an example of a sharing process for a plurality of screens according to the second embodiment. [Figure 22] FIG. 13 is a diagram showing an example of a sharing process for a plurality of screens according to the second embodiment; [Figure 23] FIG. 13 is a diagram showing an example of a selection screen for selecting a plurality of screens to be displayed according to the third embodiment. [Figure 24] 13 is a flowchart showing an example of a process of an electronic whiteboard according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0011] [Outline of the communication system] First, an overview of a communication system 100 for conducting a video conference while drawing on multiple electronic whiteboards 1a and 1b will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing an example of a communication route in this embodiment. Note that a "video conference" may also be called a "television conference" or a "remote conference", etc.

[0012] Note that a "video conference", a "television conference", and a "remote conference" are examples of a session in which a stroke image is shared among a plurality of communication terminals. For example, the session in which a stroke image is shared may be a session other than a conference, such as a remote lesson, a remote medical treatment, a meeting, or a simple conversation.

[0013] The communication system 100 is constructed by, for example, a plurality of electronic whiteboards 1a and 1b, a relay device 3, a communication management device 5, an image storage device 7, and the like.

[0014] The electronic whiteboards (communication terminals) 1a and 1b are communication terminals that perform mutual communication of content data such as site image data and sound data for video conferences, background image data, and stroke data of stroke images, and are also called IWBs (Interactive White Boards).

[0015] The communication system 100 may have three or more electronic whiteboards, not limited to two electronic whiteboards 1a and 1b. In the following description, the term "electronic whiteboard 1" will be used to refer to any one of the electronic whiteboards included in the communication system 100.

[0016] The electronic whiteboard 1 is an example of a communication terminal according to the present embodiment. The communication terminal may be another communication terminal having a communication function, a drawing function, a display function, etc. For example, the communication terminal may be an information terminal such as a PC (Personal Computer), a tablet terminal, or a smartphone in which an application program corresponding to the communication system 100 is installed.

[0017] The stroke data is data necessary to reproduce (reproduce) a stroke image, and includes coordinate data, line width data, line color data, vector data, etc. In addition, the electronic whiteboards 1a and 1b transmit and receive base image data and sound data, which are video data for video conferencing, and reproduce the video and sound of the other party, enabling video calls.

[0018] Furthermore, the electronic whiteboards 1a and 1b can transmit and receive image data of a shared document image, allowing users of the communication system 100 to share the same document image. The document image is an image displayed on the display of the electronic whiteboard 1, and can include, for example, meeting documents, background images displayed on the display, and images of a captured screen when the display screen is captured.

[0019] Moreover, the electronic whiteboards 1a and 1b transmit and receive stroke data of a shared stroke image, so that participants using the communication system can share the same stroke image. A stroke image is an image showing lines drawn by a user using handwritten strokes with an electronic pen or the like. A stroke image is displayed by stroke data showing points that specify coordinates on a display.

[0020] 1, an electronic whiteboard equipped with a video conference function is shown as an example of the electronic whiteboards 1a and 1b. Note that the image of the video data may be a moving image or a still image.

[0021] In the following description, the electronic whiteboard 1 that requests the start of a video conference is called the "start terminal," and the electronic whiteboard 1 that is the destination (relay destination) of the request is called the "destination terminal." For example, in FIG. 1, when electronic whiteboard 1a requests electronic whiteboard 1b to start a video conference, electronic whiteboard 1a is the start terminal, and electronic whiteboard 1b is the destination terminal. Note that each of electronic whiteboards 1a and 1b may be used not only for communication between multiple offices or between different rooms in the same office, but also for communication within the same room, or communication between outdoors and indoors, or outdoors and outdoors.

[0022] The relay device 3 is configured by a computer, and performs a process of relaying content data for communication between the plurality of electronic whiteboards 1a and 1b.

[0023] The communication management device 5 is configured by a computer, and manages, for example, communication (session) between the electronic whiteboard 1a and the electronic whiteboard 1b. For example, the communication management device 5 centrally manages the authentication of logins from the electronic whiteboards 1a and 1b, the management of the communication status of the electronic whiteboards 1a and 1b, the management of destination lists, and the communication status of the relay device 3. The communication management device 5 also relays shared stroke data between the multiple electronic whiteboards 1a and 1b.

[0024] The image storage device 7 is configured by a computer, and stores image data of the shared document image uploaded from the electronic whiteboard 1a and downloads it to the electronic whiteboard 1b. The reverse is also performed. That is, the image storage device 7 stores image data uploaded from the electronic whiteboard 1b and downloads it to the electronic whiteboard 1a.

[0025] In addition, the relay device 3, the communication management device 5, and the image storage device 7 may be constructed by a single computer, or may be constructed by multiple computers in which each section (function or means) is divided and arbitrarily assigned.

[0026] In addition, in the communication system 100, a management information session sei (hereinafter referred to as "session sei") for transmitting and receiving various management information is established between the electronic whiteboards 1a and 1b via the communication management device 5. In addition, four sessions for transmitting and receiving four types of data, for example, high-resolution image data, medium-resolution image data, low-resolution image data, and sound data, are established between the electronic whiteboards 1a and 1b via the relay device 3. In FIG. 1, these four sessions are collectively shown as an image and sound data session sed (hereinafter simply referred to as "session"). Note that the number of sessions does not necessarily have to be four, and the number of sessions may be less or more than four. In addition, a session may be established directly between the start terminal and the destination terminal without the relay device 3.

[0027] Furthermore, in the communication system 100, stroke data can be transmitted and received between the electronic whiteboards 1a and 1b using the session sei.

[0028] Here, the image resolution of the image data handled in this embodiment will be described. Low-resolution image data is, for example, 160 pixels wide and 120 pixels high, and serves as a base image. Medium-resolution image data is, for example, 320 pixels wide and 240 pixels high. High-resolution image data is, for example, 640 pixels wide and 480 pixels high. Among these, when passing through a narrowband path, low-quality image data consisting only of low-resolution image data serving as a base image is relayed. When the band is relatively wide, low-resolution image data serving as a base image and medium-quality image data consisting of medium-resolution image data are relayed. Also, when the band is very wide, high-quality image data consisting of low-resolution image data serving as a base image, medium-resolution image data, and high-resolution image data are relayed. Since the amount of sound data is smaller than that of video data, it is relayed even through a narrowband path.

[0029] <System configuration> FIG. 2 is a diagram illustrating an example of a system configuration of a communication system according to an embodiment.

[0030] In FIG. 2, electronic whiteboard 1a is installed at location A, and electronic whiteboard 1b is installed at location B. For example, location A is an office in Tokyo, Japan, and location B is an office in Osaka, Japan. At location A, user A1 uses electronic whiteboard 1a, and at location B, users B1 and B2 use electronic whiteboard 1b. Electronic whiteboard 1a is an example of a first communication terminal, and electronic whiteboard 1b is an example of a second communication terminal.

[0031] The electronic whiteboards 1a and 1b, the relay device 3, the communication management device 5, and the image storage device 7 can transmit and receive data to and from each other via a communication network 200 such as the Internet or a LAN (Local Area Network). The communication network 200 may include a wireless communication portion. In Fig. 2, the electronic whiteboards 1a and 1b are electronic whiteboards capable of transmitting and receiving site image data for video conferences and conference video data including audio data.

[0032] <Hardware configuration> Next, the hardware configuration of each device according to this embodiment will be described.

[0033] (Hardware configuration of electronic whiteboard) Fig. 3 is a diagram showing an example of a hardware configuration of an electronic whiteboard according to an embodiment. As shown in Fig. 3, the electronic whiteboard 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an SSD (Solid State Drive) 104, a network I / F (Interface) 105, and an external device connection I / F 106.

[0034] Of these, the CPU 101 is a calculation device that controls the overall operation of the electronic whiteboard 1. The ROM 102 is a non-volatile memory that stores, for example, the CPU 101 and programs used to start the CPU 101, such as an IPL (Initial Program Loader). The RAM 103 is a volatile memory that is used, for example, as a work area for the CPU 101. The SSD 104 is a large-capacity storage device that stores, for example, various data such as programs for the electronic whiteboard 1.

[0035] The network I / F 105 is a communication interface for connecting the electronic whiteboard 1 to the communication network 200 and performing communication. The external device connection I / F 106 is an interface for connecting various external devices. In this case, the external devices include, for example, a USB (Universal Serial Bus) memory 130, a microphone 140, a speaker 150, a camera 160, and a PC (Personal Computer) 170.

[0036] The electronic whiteboard 1 also includes a capture device 111, a GPU (Graphics Processing Unit) 112, a display controller 113, a contact sensor 114, a sensor controller 115, an electronic pen controller 116, a short-range communication circuit 119, an antenna 119a of the short-range communication circuit 119, a power switch 122, and selection switches 123.

[0037] Of these, the capture device 111 captures (acquires) a display screen or the like displayed on a display or the like of the external PC 170 as a still image or a moving image. The GPU 112 is a semiconductor chip (processor) that specializes in graphics. The display controller 113 controls and manages the screen display in order to output an output image from the GPU 112 to a display 180 or the like. The contact sensor 114 detects that the electronic pen 190, the user's hand H, or the like has come into contact with the display 180. The sensor controller 115 controls the processing of the contact sensor 114.

[0038] The contact sensor 114 performs input of coordinates and detection of coordinates by, for example, an infrared blocking method. The method of inputting coordinates and detecting coordinates is such that two light receiving / emitting devices installed at both ends of the upper side of the display 180 emit a plurality of infrared rays parallel to the display 180, and receive the light reflected by a reflecting member provided around the display 180 and returning on the same optical path as the optical path of the light emitted by the light receiving element. The contact sensor 114 outputs the ID of the infrared rays emitted by the two light receiving / emitting devices that are blocked by an object to the sensor controller 115, and the sensor controller 115 specifies the coordinate position that is the contact position of the object. The electronic pen controller 116 communicates with the electronic pen 190 to determine whether the pen tip or the pen tail touches the display 180. The short-distance communication circuit 119 is a communication circuit for performing short-distance wireless communication.

[0039] The power switch 122 is a switch for switching on / off the power of the electronic whiteboard 1. The selection switches 123 are a group of switches for adjusting the brightness and color of the display 180, for example.

[0040] Furthermore, the electronic whiteboard 1 includes a bus line 110. The bus line 110 includes an address bus, a data bus, various control signals, and the like for electrically connecting the components such as the CPU 101 shown in FIG.

[0041] The contact sensor 114 is not limited to an infrared blocking type, and may be a capacitive touch panel that identifies the contact position by detecting a change in capacitance, or a resistive film touch panel that identifies the contact position by a voltage change between two opposing resistive films. The contact sensor 114 may also be an electromagnetic induction type touch panel that identifies the contact position by detecting electromagnetic induction caused by a contact object touching the display unit. Furthermore, the electronic pen controller 116 may determine the presence or absence of a touch not only on the tip and end of the electronic pen 190, but also on the part of the electronic pen 190 that the user holds and other parts of the electronic pen.

[0042] (Hardware configuration of management device, relay device, image storage device, PC, etc.) The communication management device 5, the relay device 3, the image storage device 7, and the PC 170, etc., have, for example, the hardware configuration of a computer 400 as shown in Fig. 4. Alternatively, the communication management device 5, the relay device 3, and the image storage device 7 may be realized by a plurality of computers 400.

[0043] 4 is a diagram showing an example of a hardware configuration of a computer according to an embodiment. The computer 400 includes, for example, a CPU 401, a ROM 402, a RAM 403, a hard disk (HD) 404, a hard disk drive (HDD) controller 405, a display 406, an external device connection I / F 407, a network I / F 408, a keyboard 409, a pointing device 410, a digital versatile disk rewritable (DVD-RW) drive 412, a media I / F 414, and a bus line 415.

[0044] Of these, the CPU 401 is an arithmetic unit that controls the overall operation of the computer 400. The ROM 402 is a non-volatile memory that stores programs used to drive the CPU 401, such as an IPL. The RAM 403 is a volatile memory that is used, for example, as a work area for the CPU 401. The HD 404 is a large-capacity storage device that stores programs such as an OS (Operating System) and applications, and various data. The HDD controller 405 controls the reading and writing of various data from and to the HD 404 under the control of the CPU 401.

[0045] The display 406 displays various information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 407 is an interface for connecting various external devices. The network I / F 408 is a communication interface for performing data communication using a communication network. The keyboard 409 is a type of input means having a plurality of keys for inputting, for example, characters, numbers, various instructions, etc. The pointing device 410 is a type of input means for selecting and executing various instructions, selecting a processing target, moving the cursor, etc.

[0046] The DVD-RW drive 412 controls reading and writing (storing) of data from and to the DVD-RW 411. The DVD-RW drive 412 may also control reading and writing (storing) of data from and to a disk other than the DVD-RW 411. The media I / F 414 controls reading and writing (storing) of data from and to a medium 413 such as a flash memory. The bus line 415 includes an address bus, a data bus, various control signals, and the like for electrically connecting each component such as the CPU 401 shown in FIG. 4.

[0047] <Functional configuration> Next, a functional configuration of the communication system 100 according to the present embodiment will be described. Fig. 5 is a diagram showing an example of the functional configuration of the communication system according to an embodiment. In Fig. 5, the electronic whiteboard 1b has the same functional configuration as the electronic whiteboard 1a.

[0048] <Functional configuration of the electronic whiteboard> Each electronic whiteboard 1, for example, realizes a communication unit 11, a reception unit 12, a video / audio processing unit 13, a display control unit 14, an image processing unit 15, an information transmission unit 16, an operation screen display unit 17, a short-range communication unit 18, and a storage / readout processing unit 19 by executing a predetermined program in a CPU 101 in Fig. 3. Also, the electronic whiteboard 1 has a storage unit 1000 realized by, for example, the RAM 103, the SSD 104, etc. in Fig. 3. At least a part of the above functional configurations may be realized by hardware.

[0049] The communication unit 11 transmits and receives various data and information to and from other terminals, devices, or systems via the communication network 200. The communication unit 11 also serves as an initiation unit, and performs a login process to the communication management device 5, etc., and a process to start communication with other communication terminals.

[0050] The reception unit 12 receives various input operations from a user using the electronic pen 190 or the like. For example, the reception unit 12 receives a drawing operation of a stroke image, various setting operations, selection operations, and the like. The reception unit 12 according to this embodiment also has a function of receiving the selection of a plurality of screens to be displayed on a display unit such as the display 180. Specific processing contents of the reception unit 12 will be described later.

[0051] The video / audio processor 13 performs main processing of the video conference function. For example, the video / audio processor 13 performs digital processing such as encoding video data and audio data based on the output signal of the microphone 140 and the output signal of the camera 160. The video / audio processor 13 also generates video signals and audio signals based on the video data and audio data received by the communication unit 11. The video / audio processor 13 also performs processing such as combining video data with different resolutions.

[0052] The display control unit 14 outputs a video signal (image signal) to a display unit such as the display 180 to control display of the display screen. The display control unit 14 according to the present embodiment also has a function of displaying the multiple screens on the display unit such as the display 180 using information on the multiple screens selected on another electronic whiteboard 1 and layout information based on the number of the multiple screens. The specific processing contents of the display control unit 14 will be described later.

[0053] The image processing unit 15 performs main processing of the electronic whiteboard function. For example, the image processing unit 15 performs processing to create a stroke image and stroke data based on strokes of the electronic pen 190 or the like received by the reception unit 12, processing to create a stroke image based on stroke data received by the communication unit 11, etc. The image processing unit 15 also performs processing to generate an image signal based on image data of a document image received by the communication unit 11, etc.

[0054] The information transmitting unit 16 transmits the stroke data created by the image processing unit 15 to the communication management device 5. The information transmitting unit 16 according to the present embodiment also has a function of transmitting operation information including information on the multiple screens accepted by the accepting unit 12 to another electronic whiteboard 1 communicating with the electronic whiteboard 1 via the communication management device 5.

[0055] The information transmitting unit 16 may transmit the operation information to another electronic whiteboard 1 without going through the communication management device 5. The information transmitting unit 16 may transmit the operation information to the communication management device 5, and the communication management device 5 may have a function of transmitting the operation information to another electronic whiteboard 1. In short, the communication system 100 may be one in which the operation information transmitted by the information transmitting unit 16 of an electronic whiteboard 1 is transmitted to another electronic whiteboard 1 that is communicating with the electronic whiteboard. The specific processing of the information transmitting unit 16 will be described later.

[0056] The operation screen display unit 17 displays an operation screen such as a page list screen 1700 or a selection screen 2300, which will be described later, on a display unit such as the display 180.

[0057] The short-range communication unit 18 obtains and provides data between each terminal having a short-range communication unit through short-range wireless communication.

[0058] The storage / read processing unit 19 performs processing such as storing various data in the storage unit 1000 and reading out various data stored in the storage unit 1000 .

[0059] For example, video data and audio data received during communication with another terminal are overwritten and stored every time they are received in the storage unit 1000. Of these, images are displayed on the display 180 using the video data before being overwritten, and audio is output from the speaker 150 using the audio data before being overwritten.

[0060] The storage unit 1000 according to this embodiment also stores information such as operation information 1001 and arrangement information 1002, which will be described later.

[0061] <Functional configuration of the communication management device> 4 executes a predetermined program, the communication management device 5 realizes a communication unit 51, an authentication unit 52, a terminal management unit 53, a session management unit 54, a relay device management unit 55, a shared data management unit 56, and a storage / read processing unit 57. Each of the above functional configurations may be realized by a program executed by a plurality of computers 400. Furthermore, at least a part of each of the above functional configurations may be realized by hardware.

[0062] 4, and a storage unit 5000 implemented by the HDD controller 405, etc. The storage unit 5000 stores, for example, an authentication management DB (Database) 5001, a terminal management DB 5002, a destination list management DB 5003, a session management DB 5004, a relay device management DB 5005, and a shared data management DB 5006.

[0063] (Authentication Management Table) Fig. 6 is a diagram showing an example of an authentication management table according to an embodiment. For example, an authentication management DB 5001 configured by an authentication management table 600 as shown in Fig. 6 is stored in the storage unit 5000. In this authentication management table 600, the terminal IDs of multiple electronic whiteboards 1 managed by the communication management device 5 are associated with passwords corresponding to each terminal ID and managed. For example, the authentication management table 600 shown in Fig. 6 indicates that the password corresponding to the terminal ID "01aa" of the electronic whiteboard 1a is "aaaa".

[0064] The terminal ID is identification information for identifying the electronic whiteboard (communication terminal) 1, and is an example of identification information for the communication management device 5 to manage communication terminals such as the electronic whiteboard 1. For example, the communication management device 5 may manage the electronic whiteboard 1 using a user ID for identifying a user, a contract ID for identifying a contractor, a communication ID for identifying a communication source, or the like, instead of the terminal ID.

[0065] Moreover, the password is an example of authentication information for authenticating a communication terminal such as the interactive whiteboard 1. The authentication information may be authentication information other than a password, such as an access token or an electronic certificate.

[0066] (Terminal Management Table) Fig. 7 is a diagram showing an example of a terminal management table according to an embodiment. For example, a terminal management DB 5002 configured by a terminal management table 700 as shown in Fig. 7 is stored in the storage unit 5000. In this terminal management table 700, for each terminal ID for identifying each electronic whiteboard 1, the destination name when each electronic whiteboard 1 is the destination, the operation status of each electronic whiteboard 1, the reception date and time when login request information described later is received by the communication management device 5, the IP address of each electronic whiteboard 1, etc. are associated and managed.

[0067] 7, the terminal management table 700 indicates that the electronic whiteboard 1a with the terminal ID "01aa" has the terminal name "Japan Tokyo Office AA Terminal" and the operating status "Online (communication available)". The electronic whiteboard 1a with the terminal ID "01aa" also indicates that the date and time when the login request information was received by the communication management device 5 was "April 10, 20xx, 13:40" and the IP address was "1.2.1.3". The terminal ID, destination name, and terminal IP address are stored, for example, when each electronic whiteboard 1 pre-registers to receive services provided by the communication management device 5.

[0068] (Destination list management table) FIG. 8 is a diagram showing an example of a destination list management table according to an embodiment. The storage unit 5000 stores a destination list management DB 5003 configured by a destination list management table 800 as shown in FIG. 8, for example. In this destination list management table 800, the terminal IDs of all destination terminals registered as candidates of the destination electronic whiteboard 1 (destination terminal) are associated with the terminal ID of the electronic whiteboard 1 (start terminal) requesting the start of communication and are managed. For example, the destination list management table 800 shown in FIG. 8 shows that the destination terminal candidates that can request the start of communication from the start terminal (electronic whiteboard 1a) with the terminal ID "01aa" include the electronic whiteboard 1b with the terminal ID "01ba". The destination terminal candidates are updated by being added or deleted in response to an addition or deletion request from any start terminal to the communication management device 5.

[0069] (Session management table) FIG. 9 is a diagram showing an example of a session management table according to an embodiment. The storage unit 5000 stores a session management DB 5004 configured by a session management table 900 as shown in FIG. 9. In this session management table 900, for each session ID, which is identification information for identifying a session (communication), the device ID of the relay device 3 to be used, the terminal ID of the starting terminal, the terminal ID of the destination terminal, and the like are managed in association with each other. In addition, in the session management table 900, for example, information such as a reception delay time (ms) when video data is received at the destination terminal and a reception date and time when delay information indicating this delay time is received from the destination terminal are further managed in association with each other. For example, in the session management table 900 shown in FIG. 9, in a session with a session ID "se01", a relay device 3 with a relay device ID "111a" relays communication between a start terminal with a terminal ID "01aa" and a destination terminal with a terminal ID "01ba". It also indicates that in the session with session ID "se01", the delay time of the video data at the time of "13:41 on April 10, 20xx" is 200 (ms).

[0070] (Relay device management table) FIG. 10 is a diagram showing an example of a relay device management table according to an embodiment. The storage unit 5000 stores a relay device management DB 5005 configured by a relay device management table 1010 as shown in FIG. 10. In this relay device management table 1010, the operation state of each relay device 3, the reception date and time of the state information indicating the operation state, the IP address of the relay device 3, and the maximum data transmission rate (Mbps) are associated and managed for each relay device ID that identifies a plurality of relay devices 3. For example, in the relay device management table 1010 shown in FIG. 10, it is shown that the operation state of the relay device 3 with the relay device ID "111a" is "online" and the date and time when the state information was received by the communication management device 5 is "12:00 on April 10, 20xx". In addition, it is shown that the IP address of the relay device 3 with the relay device ID "111a" is "1.2.1.2" and the maximum data transmission rate of the relay device 3 is 100Mbps.

[0071] (Shared data management table) Fig. 11 is a diagram showing an example of a shared data management table according to an embodiment. In the storage unit 5000, for example, a shared data management DB 5006 configured by a shared data management table 1100 as shown in Fig. 11 is constructed. In this shared data management table 1100, various data related to multiple screens shared between the electronic whiteboards 1 are stored for each session ID for identifying a session (communication) for mutual communication between each electronic whiteboard (communication terminal) 1 and the relay device 3.

[0072] The data stored in the shared data management table 1100 includes, for example, an ID for identifying each data, a sequence number indicating the order in which each data was generated, a body that is information indicating the content of the data, and a parent that is information for identifying the parent data. For example, in Fig. 11, the shared data management table 1100 stores information indicating the pages generated in the session (children) and information indicating the currently displayed page (current page) in association with the session ID "se01".

[0073] Moreover, the shared data management table 1100 stores display screen information for displaying one or more display screens displayed by the electronic whiteboard 1.

[0074] (Display screen information) FIG. 12 is a diagram for explaining display screen information according to an embodiment. For example, as shown in display screen information 1200 in FIG. 12, the display screen displayed on the electronic whiteboard 1 has a hierarchical structure including "meeting," "pages (pages 1-4)," "strokes (strokes 1-5)," and the like. "Strokes" correspond to stroke data according to this embodiment, and are managed for each "page." Furthermore, "page" refers to a state in which image data related to one page of a screen (display screen) displayed on the display 180 is stored. Furthermore, "meeting" refers to information on a meeting (session) being held by the electronic whiteboard 1. The electronic whiteboard 1 allows pages to be switched, and a "page" corresponds to each page of the electronic whiteboard 1. For example, page 1 includes a page ID (id=pag01) for identifying page 1, information (parent=se01) for specifying the "meeting" being held on the electronic whiteboard 1, a gid "g01" for identifying the page (page data), image data 1, etc.

[0075] (Functional configuration of the communication management device) Returning now to FIG. 5, the functional configuration of the communication management device 5 will be described.

[0076] The communication unit 51 transmits and receives various data (or information) to and from other terminals, devices, or systems via the communication network 200. For example, the communication unit 51 has a function of receiving operation information including information on multiple screens transmitted from the electronic whiteboard 1a, and transferring (transmitting) the received operation information to another electronic whiteboard 1b that is communicating with the electronic whiteboard 1a (participating in the same conference). Similarly, the communication unit 51 can receive operation information including information on multiple shared screens transmitted from the electronic whiteboard 1b, and transfer the received operation information to another electronic whiteboard 1a that is communicating with the electronic whiteboard 1b (participating in the same conference).

[0077] The operation information transmitted by the electronic whiteboard 1 includes at least information on the "current page" indicating the screen currently being displayed by the electronic whiteboard 1, from the shared data management table 1100 as shown in FIG.

[0078] The authentication unit 52 authenticates the login request received via the communication unit 51. For example, when a combination of a terminal ID and a password included in the login request received from the electronic whiteboard 1 is stored in the authentication management table 600 as shown in FIG.

[0079] The terminal management unit 53 manages the terminal management DB 5002, and updates information such as the operating state, reception date and time, and terminal IP address in the terminal management table 700 shown in FIG.

[0080] The terminal manager 53 also manages a destination list management table 800, and provides destination list information including the terminal IDs of destination terminals in the destination list management table 800 as shown in FIG. 8 in response to a request from the electronic whiteboard 1, for example.

[0081] The session management unit 54 manages sessions (communications, conferences, etc.) held in the communication system 100. For example, the session management unit 54 generates a session ID for identifying a session in response to start request information requesting the start of communication from the electronic whiteboard 1. In addition, the session management unit 54 stores and manages various information related to the session in a session management table 900 as shown in FIG. 9 in association with the session ID.

[0082] The relay device management unit 55 manages the relay device management DB 5005 and selects a relay device 3 to be used for relaying a session, for example, by using a relay device management table 1010 as shown in Fig. 10. For example, the relay device management unit 55 may select a relay device 3 near the starting terminal based on the IP address of each relay device 3 stored in the relay device management table 1010 and the IP address of the starting terminal. Alternatively, the relay device management unit 55 may select a relay device 3 based on the maximum data transmission speed of each relay device 3 stored in the relay device management table 1010.

[0083] In this embodiment, the method of selecting the relay device 3 to be used for relaying a session may be any method. Also, the communication system 100 may have one relay device 3, and the same relay device 3 may be used for each session.

[0084] The shared data management unit 56 manages, for example, a shared data management table 1100 as shown in FIG. The stroke data transmitted from the electronic whiteboard 1 in the session sei is stored and managed in the shared data management table 1100 in association with the session ID.

[0085] The storage / read processing unit 57 performs processing such as storing various data in the storage unit 5000 and reading out various data stored in the storage unit 5000.

[0086] <Functional configuration of the image storage device> The image storage device 7 realizes a communication unit 71, a storage / readout processing unit 72, etc., by executing a predetermined program in the CPU 401 in Fig. 4. The image storage device 7 also has a storage unit 7000 realized by, for example, the RAM 403, the HD 404, the HDD controller 405, etc. in Fig. 4.

[0087] The communication unit 71 transmits and receives various data, information, and the like to and from other terminals, devices, or systems via the communication network 200. The storage / readout processing unit 72 performs processing to store various data in the storage unit 7000 and to read out various data stored in the storage unit 7000.

[0088] With the above configuration, the image storage device 7 stores, for example, image data uploaded from the electronic whiteboard 1 in a specified URL (Uniform Resource Locator), and provides the image data stored in the specified URL in response to a request from the electronic whiteboard 1.

[0089] <Functional configuration of relay device> The relay device 3 realizes a communication unit (transfer unit) 31, a determination unit 32, a storage / readout processing unit 33, etc., by executing a predetermined program in a CPU 401 in Fig. 4. The relay device 3 also has a storage unit 3000 realized by, for example, a RAM 403, a HD 404, a HDD controller 405, etc. in Fig. 4.

[0090] The communication unit (transfer unit) 31 transmits and receives various data, information, and the like to and from other terminals, devices, or systems via the communication network 200. The communication unit 31 also serves as a transfer unit, and transfers, for example, video data and audio data received from the electronic whiteboard 1 to other electronic whiteboards 1 participating in the same session as the electronic whiteboard 1. The judgment unit 32 makes various judgments, such as judging the delay state of data, and the like.

[0091] The storage / read processing unit 33 performs processing such as storing various data in the storage unit 3000 and reading out various data stored in the storage unit 3000.

[0092] 5 is an example, and various modifications and applications are possible. For example, each functional configuration included in the communication management device 5 may be realized by a plurality of computers 400. Furthermore, at least a part of each functional configuration included in the communication management device 5 may be possessed by the electronic whiteboard (communication terminal) 1. Similarly, at least a part of each functional configuration included in the electronic whiteboard 1 may be possessed by the communication management device 5.

[0093] The function of the image saving device 7 may be realized by a storage server or the like outside (or inside) the communication system 100. Furthermore, at least a part of the functional configurations of the image saving device 7 and the relay device 3 may be included in the communication management device 5. Furthermore, the electronic whiteboard 1 is an example of a communication terminal, and the communication terminal may be an information terminal or the like that executes an application corresponding to the communication system 100.

[0094] [Processing flow] Next, the process flow of the communication management method and the screen sharing method according to this embodiment will be described.

[0095] <Preparatory processing> 13 is a sequence diagram showing an example of a preparatory process according to an embodiment. This process shows an example of a preparatory process executed before the interactive whiteboard 1 participates in a session (communication) such as a remote conference in the communication system 100.

[0096] First, when the power switch 122 of the interactive whiteboard 1a is turned on, the reception unit 12 receives the power-on command (step S22).

[0097] Next, the communication unit 11 transmits login request information requesting login to the communication management device 5 via the communication network 200 (step S23). This login request information includes, for example, the terminal ID and password of the electronic whiteboard 1a.

[0098] Next, the authentication unit 52 of the communication management device 5 searches an authentication management table 600 as shown in Fig. 6 using the terminal ID and password included in the login request information received via the communication unit 51 as search keys. Furthermore, if the combination of the terminal ID and password included in the login request information is managed in the authentication management table 600, the authentication unit 52 permits login to the electronic whiteboard 1a (step S24). Here, if the combination of the terminal ID and password included in the login request information is managed in the authentication management table 600, the processing from step S25 onwards is executed.

[0099] When the login of the electronic whiteboard 1a is permitted, the terminal management unit 53 updates the information corresponding to the terminal ID "01aa" of the electronic whiteboard 1a in the terminal management table 700 as shown in FIG. 7. For example, the terminal management unit 53 changes the information of "operation status" corresponding to the terminal ID "01aa" to "online (communication possible)" and updates the information of "received date and time" to the date and time when the login request information was received (step S25). The IP address information of the terminal in the terminal management table 700 is not registered in advance, and the IP address transmitted from the electronic whiteboard 1a in the above step S23 may be used. By this process, for example, as shown in FIG. 7, the terminal ID "01aa" is associated with the operation status "online (communication possible)", the received date and time "20xx.4.10.13:40", the IP address "1.2.1.3", and the like in the terminal management table 700 and managed.

[0100] Next, the session management unit 54 adds a new record in which the terminal ID "01aa" of the electronic whiteboard 1a received in step S23 is set as the "terminal ID of the starting terminal" to the session management table 900 as shown in Fig. 9 and manages the new record (step S26). Then, the communication unit 51 of the communication management device 5 transmits authentication result information indicating the authentication result obtained by the processing of step 24 to the electronic whiteboard 1a that made the login request via the communication network 200 (step S27).

[0101] When the communication unit 11 of the electronic whiteboard 1a receives the authentication result information indicating that the login is permitted, it transmits destination list request information indicating a request for a destination list to the communication management device 5 via the communication network 200 (step S28). As a result, the communication unit 51 of the communication management device 5 receives the destination list request information.

[0102] Next, the terminal management unit 53 searches the destination list management table 800 as shown in Fig. 8 using the terminal ID "01aa" of the electronic whiteboard 1a as a search key, and reads out the terminal IDs of destination candidates that can communicate with the electronic whiteboard 1a. The terminal management unit 53 also reads out the destination names corresponding to the terminal IDs of the destination candidates from the terminal management table 700 as shown in Fig. 7 (step S29). As a result, the terminal IDs of the destination candidates corresponding to the terminal ID "01aa" of the electronic whiteboard 1a and the destination names corresponding to these are extracted.

[0103] Next, the communication unit 51 of the communication management device 5 reads, for example, data of the destination list frame and data of the icon indicating the operating state stored in the memory unit 5000 via the memory / readout processing unit 57 (step S30). The communication unit 51 of the communication management device 5 also transmits "destination list information (destination list frame, icon, terminal ID, destination name)" including the read destination list frame and icon, and the terminal ID and destination name extracted in step S29 to the electronic whiteboard 1a (step S31). As a result, in the electronic whiteboard 1a, the communication unit 11 receives the destination list information, and the memory / readout processing unit 19 stores the received destination list information in the memory unit 1000 (step S32).

[0104] In this manner, in this embodiment, the destination list information of all terminals is centrally managed by the communication management device 5, rather than each electronic whiteboard 1 managing the destination list information. Therefore, even when a new electronic whiteboard 1 is registered in the communication management device 5, when a new model of communication terminal is registered in place of an electronic whiteboard 1 already included, when the appearance of the destination list frame is changed, etc., it is possible to eliminate the need to change the destination list information on each electronic whiteboard 1 side.

[0105] 7 using the terminal IDs of the destination candidates extracted in step S29 as a search key, and reads out the corresponding operating status for each of the destination candidate terminal IDs. As a result, the terminal management unit 53 acquires the operating status of each electronic whiteboard 1 corresponding to the destination candidate terminal ID (step S33).

[0106] Next, the communication unit 51 of the communication management device 5 transmits "terminal status information" including the terminal ID used as the search key in step S33 and the operating status of each corresponding destination terminal to the electronic whiteboard 1a via the communication network 200 (step S34).

[0107] Next, the storage / readout processing unit 19 of the electronic whiteboard 1a sequentially stores the terminal status information received from the communication management device 5 in the storage unit 1000 (step S35). Thus, by receiving the above-mentioned electronic whiteboard 1 status information, the electronic whiteboard 1a can obtain the current operating status of the electronic whiteboards 1b, 1c, etc., which are potential destinations that can communicate with the electronic whiteboard 1a.

[0108] Next, the display control unit 14 of the electronic whiteboard 1a creates a destination list that reflects the status of the terminal as a destination candidate, based on the destination list information and the terminal status information stored in the storage unit 1000. In addition, the display control unit 14 uses the created destination list to display a destination list screen on the display 180 of the electronic whiteboard 1a (step S36).

[0109] Meanwhile, the terminal management unit 53 of the communication management device 5 extracts the terminal IDs of other terminals that have registered the electronic whiteboard 1a as a destination candidate by searching the destination list management table 800 as shown in FIG. 8 based on the terminal ID "01aa" of the electronic whiteboard 1a (step S37).

[0110] Next, the terminal management unit 53 of the communication management device 5 searches the terminal management table 700 as shown in FIG. 7 based on the terminal ID "01aa" of the electronic whiteboard 1a, and acquires the operation status of the electronic whiteboard 1a (step S38).

[0111] Then, the communication unit 51 transmits "terminal status information" including the terminal ID and the operating status of the electronic whiteboard 1a to the electronic whiteboard 1 of the terminal ID whose operating status is "online" in the terminal management table 700 among the terminal IDs extracted in step S37 (step S39). When transmitting the terminal status information to each electronic whiteboard 1, the communication unit 51 refers to the IP address of each electronic whiteboard 1 managed in the terminal management table 700 based on each terminal ID. This makes it possible to transmit the terminal ID "01aa" of the electronic whiteboard 1a and the operating status "online" to each electronic whiteboard 1 that can communicate with the electronic whiteboard 1a as a destination candidate. This makes it possible to display the status of the electronic whiteboard 1a on each electronic whiteboard 1 that is a destination candidate (step S40).

[0112] <Session start processing> 14 is a sequence diagram showing an example of a session start process according to an embodiment. This process shows an example of a session start process executed in the communication system 100 when, for example, the electronic whiteboard 1a requests the electronic whiteboard 1b to start a session (communication).

[0113] In step S1401, when the electronic whiteboard 1a, which is the start terminal, accepts the destination selection by the user A1, the processes from step S1402 onward are executed. Here, it is assumed that the electronic whiteboard 1b is selected as the destination terminal by the user A1.

[0114] In step S1402, when the electronic whiteboard 1a accepts the destination selection by the user A1, the communication unit 11 of the electronic whiteboard 1a transmits start request information requesting the start of a session to the communication management device 5. This start request information includes, for example, the terminal ID "01aa" of the electronic whiteboard 1a which is the start terminal, the terminal ID "01ba" of the electronic whiteboard 1b which is the destination terminal, and the IP address of the electronic whiteboard 1a which is the start terminal. As a result, the communication unit 51 of the communication management device 5 receives the start request information and also receives the IP address of the start terminal (electronic whiteboard 1a) which is the sender.

[0115] In step S1403, the terminal management unit 53 of the communication management device 5 updates the terminal management DB 5002 based on the terminal ID of the starting terminal and the terminal ID of the destination terminal included in the start request information. For example, based on the terminal ID "01aa" of the starting terminal and the terminal ID "01ba" of the destination terminal included in the start request information, the terminal management unit 53 updates the "operating status" corresponding to the terminal IDs "01aa" and "01ba" in the terminal management table 700 to "online (communicating)". Note that in this state, the electronic whiteboard 1a, which is the starting terminal, and the electronic whiteboard 1b, which is the destination terminal, are not participating in the session, but are managed as being in a communicating state.

[0116] In step S1404, the session management unit 54 of the communication management device 5 generates a session ID for identifying a session held between the electronic whiteboard 1a and the electronic whiteboard 1b. Here, it is assumed that the session management unit 54 generates the session ID "se01".

[0117] In step S1405, the session management unit 54 stores and manages the generated session ID, the terminal ID "01aa" of the initiating terminal, the terminal ID "01ba" of the destination terminal, etc. in association with each other in a session management table 900 as shown in FIG.

[0118] In step S1406, the relay device management unit 55 of the communication management device 5 selects a relay device 3 that will relay the session between the starting terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b). For example, the relay device management unit 55 selects a relay device 3 having an IP address close to the IP address of the starting terminal (electronic whiteboard 1a) in the terminal management table 700 from among the device IDs of relay devices 3 whose operating status is "online" in the relay device management table 1010. Here, it is assumed that the relay device 3 with the device ID "111a" is selected.

[0119] In steps S1407a and S1407b, the session management unit 54 of the communication management device 5 transmits relay device selection information to the start terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) via the communication unit 51. This relay device selection information includes, for example, the IP address of the relay device 3 selected in step S1406, the session ID generated in step S1404, and the IP address of the communication management device 5.

[0120] In steps S1408a and S1408b, when the communication units 11 of the start terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) receive the relay device selection information, they transmit reception completion information indicating that the relay device selection information has been received to the communication management device 5. This reception completion information includes, for example, the session ID "se01" and the like that was included in the relay device selection information.

[0121] In steps S1409a and S1409b, the communication units 11 of the initiating terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) establish a session with the relay device 3 using the device ID and session ID of the relay device 3 included in the relay device selection information. As a result, the electronic whiteboard 1a and the electronic whiteboard 1b participate in the session with the same session ID "se01" and can mutually transmit and receive video data such as conference video, audio data, and the like via the relay device 3.

[0122] By the above process, a conference video or the like can be transmitted and received between user A1 of the electronic whiteboard 1a and user B of the electronic whiteboard 1b.

[0123] <Sharing of stroke images> In the communication system 100, a user A1 of the electronic whiteboard 1a and users B1 and B2 of the electronic whiteboard 1b who are participating in a conference (session) can display stroke images drawn with an electronic pen 190 or the like on each electronic whiteboard 1 as shared images on the other electronic whiteboards 1. Here, an example of a process for sharing stroke images between the electronic whiteboards 1a and 1b participating in the same session will be described.

[0124] Fig. 15 is a sequence diagram showing an example of a stroke image sharing process according to an embodiment. At the start of the process shown in Fig. 15, the electronic whiteboard 1a and the electronic whiteboard 1b are assumed to participate in the same session, for example, by the session start process shown in Fig. 14. Also, the electronic whiteboard 1a and the electronic whiteboard 1b are assumed to share a document image via the image storage device 7 as necessary, and to display the document image on the display 180.

[0125] In step S1501, the user A1 draws (moves) the electronic pen 190 or the hand H on the display 180 of the electronic whiteboard 1a, and the reception unit 12 receives an input of the drawn stroke (trajectory).

[0126] In step 1502, the image processing unit 15 of the electronic whiteboard 1a creates stroke data for displaying a stroke image corresponding to the stroke accepted by the accepting unit 12. As described above, this stroke data includes, for example, coordinate data, line width data, line color data, vector data, and the like for reproducing the stroke image.

[0127] In step S1503, the display control unit 14 of the electronic whiteboard 1a displays a stroke image on a display unit such as the display 180 based on the stroke data created by the image processing unit 15. As a result, the stroke image drawn by the user A1 on the display 180 with the electronic pen 190 or the like is displayed on the display 180 of the electronic whiteboard 1a.

[0128] In step S1504, the information transmission unit 16 of the electronic whiteboard 1a transmits stroke data for reproducing the stroke image drawn by the user A1 to the communication management device 5, for example, in the session sei, via the communication unit 11. As a result, the communication unit 51 of the communication management device 5 receives the stroke data transmitted from the electronic whiteboard 1a.

[0129] In step S1505, the shared data management unit 56 of the communication management device 5 registers the stroke data received from the electronic whiteboard 1a in, for example, a shared data management table 1100 as shown in FIG.

[0130] In step S1506, the communication unit 11 (or the shared data management unit 56) of the communication management device 5 transfers the stroke data received from the electronic whiteboard 1a to the electronic whiteboard 1b participating in the same session as the electronic whiteboard 1a, for example, in parallel with the process of step S1505. As a result, the communication unit 11 of the electronic whiteboard 1b receives the stroke data transmitted by the electronic whiteboard 1a.

[0131] In step S1507, the image processing unit 15 of the electronic whiteboard 1b creates a stroke image based on the stroke data received by the communication unit 11.

[0132] In step S1508, the display control unit 14 of the electronic whiteboard 1b causes a display unit such as the display 180 to display the stroke image created by the image processing unit 15, that is, the stroke image drawn by the user A in step S1501.

[0133] When the user B1 or B2 draws on the electronic whiteboard 1b with the electronic pen 190 or the like, a stroke image can be displayed on the electronic whiteboard 1a in the same manner.

[0134] In this manner, in the communication system 100, stroke images can be shared between the electronic whiteboard 1a and the electronic whiteboard 1b participating in the same session.

[0135] <Multiple screen sharing process> Through the above processes, the communication system 100 can store and manage information on a plurality of images (pages) shared by a plurality of electronic whiteboards 1a, 1b participating in a conference (session) in, for example, a shared data management table 1100 as shown in Fig. 11. As a result, for example, when another electronic whiteboard 1c newly participates in a conference in which the electronic whiteboards 1a, 1b are participating, the electronic whiteboard 1c can display the same shared screen as the electronic whiteboards 1a, 1b based on the information stored in the shared data management table 1100.

[0136] However, the conventional technology has a problem that, for example, multiple screens (pages) selected and displayed on the electronic whiteboard 1a cannot be shared with other electronic whiteboards 1b. Therefore, for example, when a user A1 of the electronic whiteboard 1a wants to proceed with a discussion while comparing multiple screens, he or she may have to ask users B1 and B2 of the electronic whiteboard 1b to display multiple screens.

[0137] Here, a screen sharing method for sharing a plurality of screens displayed by an electronic whiteboard 1a with another electronic whiteboard 1b (displaying them on another electronic whiteboard 1b) in the communication system 100 will be described.

[0138] [First embodiment] Fig. 16 is a sequence diagram showing an example of a sharing process of a plurality of screens according to the first embodiment. At the start of the process shown in Fig. 16, the electronic whiteboard 1a and the electronic whiteboard 1b are participating in the same conference (session), and data and information of a plurality of screens (pages) are already stored in the shared data management table 1100 shown in Fig. 11, for example.

[0139] In addition, when the electronic whiteboards 1a and 1b are participating in a conference with session ID "se01", for example, information 1101 of multiple screens corresponding to the session ID "se01" in the shared data management table 1100 is stored in the memory unit 1000 as operation information 1001.

[0140] In step S1601, the interactive whiteboard 1a displays, for example, a page list screen 1700 as shown in FIG. 17 on a display unit such as the display 180 in response to a display operation of the page list screen by the user A1.

[0141] 17 is a diagram showing an example of a page list screen according to the first embodiment. A plurality of pages (screens) 1701 that can be displayed on the electronic whiteboard 1a are displayed in a selectable manner on the page list screen 1700. For example, the operation screen display unit 17 of the electronic whiteboard 1a displays this page list screen 1700 on a display unit such as the display 180 by referring to operation information 1001 stored in the storage unit 1000. Note that the operation information 1001 stored in the storage unit 1000 includes, for example, information 1101 of a plurality of screens corresponding to the session ID "se01" of the conference in which the electronic whiteboard 1a is participating, as shown in FIG.

[0142] Now, returning to FIG. 16, the explanation of the sequence diagram will be continued.

[0143] In step S1602, the reception unit 12 of the electronic whiteboard 1a receives the selection of multiple pages to be displayed by the user A1. For example, the user A1 can select multiple screens to be displayed by selecting a check box 1702 provided on each page 1701 of the page list screen 1700 and selecting the “Display” button 1703, etc.

[0144] In step S1603, the display control unit 14 of the interactive whiteboard 1a uses the operation information 1001 and the layout information 1002 stored in the storage unit 1000 to display the selected screens on a display unit such as the display 180.

[0145] In addition, the arrangement information 1002 stored in the storage unit 1000 of the electronic whiteboards 1a and 1b stores in advance arrangement information (layout) corresponding to the number of multiple screens, for example, as shown in FIGS. 18(A) to (C).

[0146] FIG. 18 is a diagram showing an image of the arrangement information according to the first embodiment. FIG. 18(A) shows an image of an example of the arrangement information when the number of multiple screens to be displayed is "2". In the example of FIG. 18(A), an example of the arrangement information is shown in which the first selected screen (e.g., "page 1") is arranged on the left side, and the second selected screen (e.g., "page 2") is arranged on the right side. Similarly, FIG. 18(B) shows an example of the arrangement information when the number of multiple screens to be displayed is "3", and FIG. 18(C) shows an example of the layout when the number of multiple screens to be displayed is "4".

[0147] 18(A) to 18(C) are merely examples. For example, the position, size, etc. of each screen in each piece of layout information may be other positions and sizes. Also, layout information 1002 stored in storage unit 1000 may include layout information in the case where the number of multiple screens to be displayed is five or more.

[0148] For example, when page 1 and page 2 are selected from the page list screen 1700 as shown in Fig. 14, the display control unit 14 of the electronic whiteboard 1a acquires layout information corresponding to the number of multiple screens to be displayed, "2," as shown in Fig. 18(A). In addition, the display control unit 14 of the electronic whiteboard 1a acquires information for displaying page 1 and page 2 from the operation information 1001 stored in the storage unit 1000, and displays page 1 and page 2 on a display unit such as the display 180 in the layout as shown in Fig. 18(A).

[0149] In step S1604, the information transmission unit 16 of the electronic whiteboard 1a transmits operation information including information about the selected pages to the electronic whiteboard 1b via the communication management device 5. As a result, the communication unit 51 of the communication management device 5 receives the operation information transmitted from the electronic whiteboard 1a.

[0150] This operation information includes information indicating multiple screens currently displayed on the electronic whiteboard 1a (for example, "current page: pag01, pag02"). This information is also stored in the operation information 1001 stored in the storage unit 1000 of the electronic whiteboard 1a with a sequence number.

[0151] In step S1605, the shared data management unit 56 of the communication management device 5 registers the operation information received from the electronic whiteboard 1a in, for example, a shared data management table 1100 as shown in FIG.

[0152] In step S1606, the communication unit 11 of the communication management device 5 transfers the operation information received from the electronic whiteboard 1a to the electronic whiteboard 1b participating in the same session as the electronic whiteboard 1a, for example, in parallel with the processing of step S1605. As a result, the communication unit 11 of the electronic whiteboard 1b receives the operation information transmitted by the electronic whiteboard 1a via the communication management device 5. The received operation information is also stored in the operation information 1001 stored in the memory unit 1000 of the electronic whiteboard 1b.

[0153] In step S1607, the display control unit 14 of the electronic whiteboard 1b uses information regarding the multiple screens contained in the received operation information and layout information based on the number of the multiple screens to display the multiple screens on a display unit such as the display 180 of the electronic whiteboard 1b.

[0154] For example, the display control unit 14 of the electronic whiteboard 1b acquires arrangement information indicating a layout as shown in FIG. 18(A) corresponding to the number of multiple screens to be displayed (for example, "2") from the arrangement information 1002 stored in the storage unit 1000 of the electronic whiteboard 1b. Furthermore, the display control unit 14 of the electronic whiteboard 1b acquires information for displaying page 1 and page 2 selected on the electronic whiteboard 1a from the operation information 1001 stored in the storage unit 1000 of the electronic whiteboard 1b based on information regarding the multiple screens included in the received operation information. Furthermore, the display control unit 14 of the electronic whiteboard 1b causes a display unit such as the display 180 of the electronic whiteboard 1b to display page 1 and page 2 in a layout as shown in FIG. 18(A), for example.

[0155] By the above process, for example, as shown in Fig. 19, multiple screens (page 1, page 2) are displayed in the same layout on the display 180 of the electronic whiteboard 1a and the display 180 of the electronic whiteboard 1b. Even when multiple screens are shared in this manner, for example, a stroke image written on page 1 displayed on the electronic whiteboard 1a is displayed on page 1 displayed on the electronic whiteboard 1b.

[0156] In addition, the multiple screens that the electronic whiteboard 1a shares with another electronic whiteboard 1b may include, for example, an external input screen 2001 that receives input from an external device (e.g., PC 170, etc.) connected to the external device connection I / F 106 of the electronic whiteboard 1, as shown in FIG. 20.

[0157] For example, the electronic whiteboard 1a can share the external input screen 2001 with the electronic whiteboard 1b by transmitting the external input screen 2001 input from the PC 170 to the electronic whiteboard 1b via the relay device 3. Also, the electronic whiteboard 1a can share a plurality of screens including the external input screen 2001 with the electronic whiteboard 1b as shown in FIG. 20 by selecting the external input screen 2001 on a page list screen 1700 as shown in FIG. 17, for example.

[0158] Thus, according to the first embodiment, in a communication system 100 in which screens are shared between multiple communication terminals (electronic whiteboards 1a, 1b), multiple screens selected and displayed on a certain communication terminal (electronic whiteboard 1a) can be shared with another communication terminal (electronic whiteboard 1b).

[0159] In this embodiment and the following embodiments, the "information about multiple screens" refers to information about multiple screens that an operator causes to be displayed on a communication terminal. This information includes, for example, information about multiple screens or pages that are simultaneously displayed on one screen of a communication terminal, or multiple screens or pages that are shared with other communication terminals participating in a conference, selected by a user through screen operations on the communication terminal.

[0160] Moreover, "layout information based on a number of screens" refers to information on the layout of screens that a user displays on a communication terminal. This information includes, for example, one or more pieces of information on the size, position, and layout of a screen to be displayed on the communication terminal, or one or more pieces of information on the size, position, and layout of a screen to be shared with other communication terminals participating in the conference.

[0161] This allows the multiple screens on the electronic whiteboard 1a and the electronic whiteboard 1b to look the same, so users B1 and B2 using the electronic whiteboard 1b can easily understand which page user A1 using the electronic whiteboard 1a is explaining.

[0162] The sharing process of multiple screens shown in FIG. 16 is an example, and various modifications and applications are possible. For example, in the above description, the information transmission unit 16 of the electronic whiteboard 1a transmits operation information including information on multiple screens selected by the reception unit 12 to the electronic whiteboard 1b via the communication management device 5. However, this is not limited to this, and the destination to which the information transmission unit 16 of the electronic whiteboard 1 transmits the operation information may be the communication management device 5. In this case, the shared data management unit 56 of the communication management device 5 has a function of storing the operation information received from the electronic whiteboard 1a in the shared data management DB 5006, as well as a function of transmitting the operation information to the electronic whiteboard 1b. In this case, the shared data management unit 56 of the communication management device 5 becomes an "information transmission unit" that transmits operation information including information on multiple screens selected by the reception unit 12 of the electronic whiteboard 1a to the electronic whiteboard 1b.

[0163] [Second embodiment] As described above, the electronic whiteboard 1a has a function of conducting a video conference with the electronic whiteboard 1b by transmitting and receiving site image data and sound data for the video conference. The screen displayed in this video conference differs for each electronic whiteboard 1. For example, the video conference screen displayed by the electronic whiteboard 1a mainly displays images (e.g., video images) of users B1 and B2 captured by the camera 160 of the electronic whiteboard 1b.

[0164] A user A1 of the electronic whiteboard 1a can select multiple screens, including this video conference screen 2101, from a page list screen such as that shown in FIG. 17, and display them on the display 180 of the electronic whiteboard 1a, as shown in FIG. 21.

[0165] However, in many cases, the video conference screen 2101 of the electronic whiteboard 1a is unnecessary for the electronic whiteboard 1b, because the electronic whiteboard 1b mainly displays an image of the user A1 captured by the camera 160 of the electronic whiteboard 1a as a video conference screen.

[0166] To address such problems, the electronic whiteboard 1 of the second embodiment has a function to exclude the screen of a specific application, such as a video conferencing application (hereinafter referred to as an app), from multiple screens shared with other electronic whiteboards 1.

[0167] (Multiple screen sharing process 1) 21 is a diagram (1) showing an example of a sharing process of a plurality of screens according to the second embodiment. Note that the basic flow of the process is similar to that of the first embodiment, so the following description will focus on the differences from the first embodiment.

[0168] In [1] of FIG. 21, the display control unit 14 of the electronic whiteboard 1a causes the display 180 to display, for example, a plurality of screens selected on a page list screen 1700 as shown in FIG.

[0169] At this time, if the screen 2101 of a specific application is included in the multiple screens that the display control unit 14 of the electronic whiteboard 1a causes to be displayed on the display 180, the display control unit 14 prepares a dummy page and gives it a special PageType attribute such as "ExApp". This dummy page cannot have child elements such as strokes, and is deleted when the split display of the multiple screens is completed. In addition, when displaying the selected multiple screens, the display control unit 14 of the electronic whiteboard 1a secures an area for displaying the dummy screen, and displays the screen (window) of the specific application within that area.

[0170] In [2] of Figure 21, when the screen 2101 of a specified application is included among the multiple screens displayed by the electronic whiteboard 1a, the information transmission unit 16 of the electronic whiteboard 1a transmits operation information excluding the screen 2101 of the specified application to the other electronic whiteboard 1b via the communication management device 5.

[0171] For example, when the multiple screens displayed on the electronic whiteboard 1a include a screen having the PageType attribute "ExApp" ("current page: pag01, pag02, pag03, ExApp", etc.), the information transmission unit 16 of the electronic whiteboard 1a excludes the screen having the PageType attribute "ExApp" from the operation information to be transmitted.

[0172] 21[3], the communication unit 51 of the communication management device 5 transfers the operation information received from the electronic whiteboard 1a, excluding the screen 2101 of a specific application (for example, "current page: pag01, pag02, pag03"), to another electronic whiteboard 1b participating in the same conference as the electronic whiteboard 1a. Note that in the above description, the electronic whiteboard 1a deletes the PageType attribute "ExApp" from the operation information before transmitting it, but the communication management device 5 may delete the PageType attribute "ExApp" from the operation information received from the electronic whiteboard 1a before transmitting it.

[0173] As a result, in [4] of Figure 21, the display control unit 14 of the electronic whiteboard 1b can display multiple screens selected on the electronic whiteboard 1a, excluding the screen 2101 of a specified app, on the display 180 of the electronic whiteboard 1b.

[0174] (Multiple screen sharing process 2) The screen of a specific application such as a video conference, which is described in Fig. 21, is an example of a screen that is predetermined not to be shared. The predetermined screen that is predetermined not to be shared may be, for example, a memo screen 2201 that is temporarily displayed locally.

[0175] 22 is a diagram (2) showing an example of a sharing process of a plurality of screens according to the second embodiment. Note that the basic flow of the process is similar to that of the first embodiment, so the following description will focus on the differences from the first embodiment.

[0176] In [1] of FIG. 22, the display control unit 14 of the electronic whiteboard 1a causes the display 180 to display, for example, a plurality of screens selected on a page list screen 1700 as shown in FIG.

[0177] At this time, if the memo screen 2201 is included in the multiple screens that the display control unit 14 of the electronic whiteboard 1a causes to be displayed on the display 180, the display control unit 14 gives the memo screen 2201 a special PageType attribute such as "Memo".

[0178] In [2] of Figure 22, when a memo screen 2201 is included in the multiple screens displayed by the electronic whiteboard 1a, the information transmission unit 16 of the electronic whiteboard 1a transmits operation information excluding the memo screen 2201 to the other electronic whiteboard 1b via the communication management device 5.

[0179] For example, when the multiple screens displayed on the electronic whiteboard 1a include a screen with the PageType attribute "Memo" ("current page: pag01, pag02, pag03, Memo", etc.), the information transmission unit 16 of the electronic whiteboard 1a excludes the screen with the PageType attribute "Memo" from the operation information to be transmitted.

[0180] 22[3], the communication unit 51 of the communication management device 5 transfers the operation information (e.g., "current page: pag01, pag02, pag03") received from the electronic whiteboard 1a, excluding the memo screen 2201, to another electronic whiteboard 1b participating in the same conference as the electronic whiteboard 1a. Note that in the above explanation, the electronic whiteboard 1a deletes the PageType attribute "Memo" from the operation information before sending it, but the communication management device 5 may delete the PageType attribute "Memo" from the operation information received from the electronic whiteboard 1a before sending it.

[0181] As a result, in [4] of Figure 22, the display control unit 14 of the electronic whiteboard 1b can display multiple screens selected on the electronic whiteboard 1a, excluding the memo screen 2201, on a display unit such as the display 180 of the electronic whiteboard 1b.

[0182] Thus, according to the second embodiment, when the multiple screens displayed by the electronic whiteboard 1a include a screen that is not to be shared as predetermined, the electronic whiteboards 1a and 1b can share the multiple screens excluding the screen that is not to be shared.

[0183] [Third embodiment] Fig. 23 is a diagram showing an example of a selection screen for multiple screens to be displayed according to the third embodiment. Instead of the page list screen 1700 shown in Fig. 17, the electronic whiteboard 1a may display a selection screen 2300 for selecting multiple screens to be displayed as shown in Fig. 23, for example, and accept the selection of multiple screens to be displayed by the electronic whiteboard 1a.

[0184] In the example of FIG. 23, a selection screen 2300 displays a list 2301 of selectable screens, as well as a suggestion screen 2302 that suggests display patterns for a plurality of screens.

[0185] On this proposal screen 2302, the operation screen display unit 17 of the interactive whiteboard 1a displays one or more display patterns or the like determined by, for example, the following methods A to F or the like.

[0186] (Method A) The operation screen display unit 17 of the electronic whiteboard 1a may display, for example, a display pattern that displays the "currently displayed screen" and the "most recently displayed screen" on the proposed screen 2302. The most recently displayed screen can be identified from the display history such as the "current page" of the operation information 1001 stored in the storage unit 1000.

[0187] Furthermore, operation screen display unit 17 may display, on proposed screen 2302, a display pattern that displays the most recent three screens or the most recent four screens, going back to the screen that is still before that.

[0188] (Method B) The operation screen display unit 17 of the electronic whiteboard 1a may tally up the number of times each screen has been displayed, and display on the proposed screen 2302 a display pattern that displays a predetermined number of screens in descending order of the number of times each screen has been displayed.

[0189] (Method C) The operation screen display unit 17 of the electronic whiteboard 1a may tally up the display time for each screen, and display on the proposal screen 2302 a display pattern in which a predetermined number of screens are displayed in order from the screen with the longest display time.

[0190] (Method D) The operation screen display unit 17 of the electronic whiteboard 1a may display a display pattern in which a predetermined number of screens are displayed in order from the screen with the most writing (for example, the screen with the most strokes of the stroke image) on the proposed screen 2302. For example, as shown in Fig. 12, stroke data is associated with each page (screen), so the display control unit 14 can identify the screen with the most writing from the number of stroke data associated with each page, etc.

[0191] (Method E) The operation information 1001 stored in the storage unit 1000 also includes, for example, modification information in which a background image is added to each screen (page). The operation screen display unit 17 of the electronic whiteboard 1a may display, on the proposed screen 2302, a display pattern in which a predetermined number of screens are displayed in order from the screen with the most recent modification information.

[0192] (Method F) For example, the external input image input from the PC 170 of the user A1 often contains materials that are central to the agenda. Therefore, the operation screen display unit 17 of the electronic whiteboard 1a may display on the proposal screen 2302 a display pattern that displays the external input image and one or more images selected by any one of the methods A to E.

[0193] The operation screen display unit 17 of the interactive whiteboard 1a may determine the display pattern to be displayed on the proposal screen 2302 by combining the above methods A to F.

[0194] For example, a user A1 of the electronic whiteboard 1a can easily select a plurality of screens to be displayed on the electronic whiteboard 1a by using a selection screen 2300 as shown in Fig. 23. The third embodiment can be implemented in combination with the first and second embodiments.

[0195] <Processing flow> Fig. 24 is a flowchart showing an example of the process of the electronic whiteboard according to the third embodiment. It is assumed that the electronic whiteboard 1a and the electronic whiteboard 1b are participating in the same conference (session) at the start of the process shown in Figs. 24(A) and (B).

[0196] (Processing of electronic whiteboard 1a) FIG. 24A shows an example of a process executed by the electronic whiteboard 1a according to the third embodiment.

[0197] In step S2401, when the interactive whiteboard 1a receives a display operation for a selection screen 2300 as shown in FIG. 23, for example, the interactive whiteboard 1a executes the processes in and after step S2402.

[0198] In step S2402, the display control unit 14 of the electronic whiteboard 1a determines whether or not there is a screen of a predetermined application such as a video conference application. For example, when the predetermined application is being executed, the display control unit 14 determines that there is a screen of the predetermined application.

[0199] If the screen of the predetermined application is present, the display control unit 14 of the electronic whiteboard 1a acquires the window (screen) of the predetermined application in step S2403. On the other hand, if the screen of the predetermined application is not present, the display control unit 14 of the electronic whiteboard 1a shifts the process to step S2404 without executing the process of step S2403.

[0200] In step S2404, the operation screen display unit 17 of the electronic whiteboard 1a creates one or more display patterns to be displayed on the proposal screen 2302 of the selection screen 2300 as shown in Fig. 23. For example, the display control unit 14 of the electronic whiteboard 1a creates the display patterns by the above-mentioned methods A to F or a combination thereof.

[0201] In step S2405, the operation screen display unit 17 of the electronic whiteboard 1a displays, on a display unit such as the display 180, a selection screen 2300 including a proposal screen 2302 that selectably displays one or more created display patterns, as shown in FIG. 23. The reception unit 12 of the electronic whiteboard 1a receives a selection operation on the selection screen 2300 by the user A1.

[0202] In step S2406, the display control unit 14 of the electronic whiteboard 1a causes a display screen displaying the multiple screens selected by the user A1 to be displayed on a display unit such as the display 180 of the electronic whiteboard 1a. For example, when one display pattern is selected from the proposal screen 2302 on the selection screen 2300 as shown in Fig. 23, the display control unit 14 of the electronic whiteboard 1a displays the multiple screens on the display 180 of the electronic whiteboard 1a in the selected display pattern.

[0203] In step S2407, the information transmission unit 16 of the electronic whiteboard 1a judges whether or not a predetermined screen not to be shared is included in the multiple screens displayed by the display control unit 14. If an image not to be shared is not included, the information transmission unit 16 shifts the process to step S2408. On the other hand, if an image not to be shared is included, the information transmission unit 16 shifts the process to step S2409.

[0204] In step S2408, the information transmitting unit 16 of the interactive whiteboard 1a creates operation information including information related to the selected screens, and transmits the operation information to the interactive whiteboard 1b via the communication management device 5.

[0205] On the other hand, when the process proceeds to step S2409, the information transmission unit 16 of the electronic whiteboard 1a creates operation information excluding images that are not to be shared from the selected multiple screens, and transmits the operation information to the electronic whiteboard 1b via the communication management device 5.

[0206] (Processing of electronic whiteboard 1b) FIG. 24B shows an example of a process executed by the electronic whiteboard 1b according to the third embodiment.

[0207] In step S2411, when the communication unit 11 of the electronic whiteboard 1b receives the operation information transmitted by the electronic whiteboard 1a via, for example, the communication management device 5, the processes in and after step S2412 are executed.

[0208] In step S2412, the display control unit 14 of the electronic whiteboard 1b acquires layout information corresponding to the number of screens included in the operation information, for example, from the layout information 1002 prestored in the storage unit 1000 of the electronic whiteboard 1b. For example, when the operation information includes information on four screens, the display control unit 14 of the electronic whiteboard 1b acquires the layout information of FIG. 18(C) corresponding to the four screens from among the multiple pieces of layout information as shown in FIG. 18(A) to (C).

[0209] In step S2413, the display control unit 14 of the electronic whiteboard 1b creates a display screen in which the multiple screens are arranged according to the acquired arrangement information based on information regarding the multiple screens included in the operation information, and displays the display screen on a display unit such as the display 180 of the electronic whiteboard 1b.

[0210] In the above explanation, the electronic whiteboard 1a is described as transmitting operation information to the electronic whiteboard 1b via the communication management device 5, but the electronic whiteboard 1a may also transmit operation information to the electronic whiteboard 1b without going through the communication management device 5.

[0211] In addition, the multiple screens shared by the electronic whiteboards 1a and 1b may be selected on the electronic whiteboard 1b side. In this case, the electronic whiteboard 1b executes the process of FIG. 24(A), and the electronic whiteboard 1a executes the process of FIG. 24(B).

[0212] As described above, according to each embodiment of the present invention, in a communication system 100 in which screens are shared among multiple communication terminals (electronic whiteboard 1), multiple screens selected and displayed on one communication terminal (electronic whiteboard 1a) can be shared with other communication terminals (electronic whiteboard 1b).

[0213] <Supplementary Information> Each function of each embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0214] In addition, in each of the above embodiments, the communication terminal has been described as being the electronic whiteboard 1, but the communication terminal may be, for example, an information terminal having a communication function, such as a PC, a smartphone, or a tablet terminal that executes an application corresponding to the communication system 100. In addition, the communication terminal may be various electronic devices having a communication function and a display function, such as a projector, a video conference device, a digital signage, a medical device, or a car navigation device, that are corresponding to the communication system 100.

[0215] The above-mentioned program for the communication terminal may be distributed by recording it on a computer-readable recording medium as a file in an installable or executable format. The program for the communication terminal may be downloaded from a server (cloud or on-premise) and installed on the communication terminal, instead of being recorded on a recording medium.

[0216] Furthermore, the communication management device 5 is not limited to the computer 400 shown in FIG. 4, but may be realized by electronic devices such as a mobile phone, a smartphone, a tablet terminal, a wearable terminal, a PDA (Personal Data Assistant), and an image forming device. [Explanation of symbols]

[0217] 1a Electronic whiteboard (first communication terminal) 1b Electronic whiteboard (second communication terminal) 5 Communication management device 12 Reception 14 Display control section 16 Information transmission section 17 Operation screen display section 51 Communications Department 56 Shared Data Management Department 100 Communication Systems 180 Display (Display unit) 2001 External input screen [Prior art documents] [Patent documents]

[0218] [Patent Document 1] JP 2012-129626 A

Claims

1. A communication system including a first communication terminal and a second communication terminal that shares a screen with the first communication terminal, The first communication terminal comprises: a reception unit that receives a selection of a plurality of screens to be displayed on a display unit of the first communication terminal; The second communication terminal comprises: a display control unit that displays the plurality of screens received by the reception unit on a display unit of the second communication terminal using information regarding the plurality of screens received by the reception unit and layout information based on the number of screens of the plurality of screens received by the reception unit, A communication system, wherein the first communication terminal further has an operation screen display unit that displays a proposal screen that displays a selectable combination of multiple screens to be displayed on the display unit of the first communication terminal based on a display history of screens displayed by the first communication terminal.

2. The first communication terminal comprises: The communication system according to claim 1 , further comprising an information transmitting unit that transmits information about the plurality of screens received by the receiving unit to the second communication terminal.

3. The communication system according to claim 1 , wherein the plurality of screens include one or more shared screens for sharing stroke images drawn by users of the first communication terminal and the second communication terminal.

4. The communication system according to claim 1 , wherein the plurality of screens include an external input screen that shares an external input image input from an external device to the first communication terminal or the second communication terminal.

5. When the plurality of screens selected by the reception unit include a screen that is not to be shared as determined in advance, The communication system according to claim 2 , wherein the information transmission unit transmits information about the plurality of screens to the second communication terminal, excluding a screen that is not to be shared.

6. The communication system further includes a communication management device that manages communication between the first communication terminal and the second communication terminal, the information transmission unit transmits information about the plurality of screens selected by the reception unit of the first communication terminal to the second communication terminal via the communication management device; The communication management device includes: a communication unit that receives information related to the plurality of screens transmitted by the first communication terminal and transfers the received information related to the plurality of screens to one or more of the second communication terminals that communicate with the first communication terminal; a shared data management unit that manages information relating to the plurality of screens received from the first communication terminal in association with identification information that identifies the communication; 6. A communication system according to claim 2 or 5, comprising:

7. A communication terminal that communicates with another communication terminal, a reception unit that receives a selection of a plurality of screens to be displayed on a display unit of the communication terminal; a display control unit that displays, on a display unit, the multiple screens received by the reception unit of the other communication terminal, using information regarding the multiple screens received by the reception unit of the other communication terminal and layout information based on the number of screens of the multiple screens received by the reception unit of the other communication terminal; having The communication terminal further includes an operation screen display unit that displays a proposal screen that displays a selectable combination of a plurality of screens to be displayed on the display unit of the communication terminal based on a display history of the screens displayed by the communication terminal.

8. A screen sharing method in a communication system including a first communication terminal and a second communication terminal that shares a screen with the first communication terminal, comprising: an accepting unit of the first communication terminal executes a process of accepting a selection of a plurality of screens to be displayed on a display unit of the first communication terminal; a display control unit of the second communication terminal executes a process of displaying the plurality of screens received by the reception unit on a display unit of the second communication terminal, using information related to the plurality of screens received by the reception unit and arrangement information based on the number of screens of the plurality of screens received by the reception unit; A screen sharing method, in which an operation screen display unit of the first communication terminal further executes a process of displaying a proposal screen that displays a selectable combination of multiple screens to be displayed on the display unit of the first communication terminal based on a display history of screens displayed by the first communication terminal.

9. A communication system including a first communication terminal and a second communication terminal that shares a screen with the first communication terminal, The first communication terminal, a reception unit that receives a selection of a plurality of screens to be displayed on the first communication terminal; The second communication terminal, a display control unit that causes the second communication terminal to display the plurality of screens received by the reception unit on a display unit of the second communication terminal, using information regarding the plurality of screens received by the reception unit and layout information based on the number of screens of the plurality of screens received by the reception unit; A program that causes the first communication terminal to further function as an operation screen display unit that displays a proposal screen that displays a selectable combination of multiple screens to be displayed on the display unit of the first communication terminal based on a display history of screens displayed by the first communication terminal.

Citation Information

Patent Citations

  • Laser machining head

    JP1997085481A

  • Multi-point communication conference device and its control method, and multi-point communication conference system

    JP2012129626A

  • Transmission terminal, data transmission method and program

    JP2016036143A

  • Information processing device and control method thereof, information processing system, and computer program

    JP2017033291A

  • Information processing system, information processing device, and control method and program thereof

    JP2017220131A