COMMUNICATION SYSTEM, COMMUNICATION METHOD, AND PROGRAM
The communication system dynamically adjusts the display order of shared images by locking editing and transmitting order information, addressing the limitations of conventional systems in image arrangement flexibility.
Patent Information
- Application Number
- JP2020132639
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-08-04
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-08-04
AI Technical Summary
Conventional communication systems fail to dynamically adjust the display order of shared images, as coordinate-based definitions do not account for foreground or background positioning, limiting the flexibility in image arrangement.
A communication system with a first and second communication terminal, a communication management device, and a display control unit that allows users to change the display order of shared images by locking editing and transmitting display order information between terminals.
Enables dynamic adjustment of the display order of shared images across multiple terminals, ensuring consistent image arrangement and preventing operational conflicts during editing.
Smart Images

Figure 0007593002000001 
Figure 0007593002000002 
Figure 0007593002000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a communication system 、 The present invention relates to a communication method and a program. [Background technology]
[0002] 2. Description of the Related Art Conference systems that enable a conference to be held among a plurality of communication terminals via a communication network such as the Internet have become widespread.
[0003] In addition, in such a conference system, a technology is known for sharing stroke images by transmitting and receiving stroke data for reproducing a stroke image drawn by a user with an electronic pen, hand, or the like between communication terminals (for example, see Patent Document 1). Summary of the Invention [Problem to be solved by the invention]
[0004] For example, in a conventional communication terminal as shown in Patent Document 1, the arrangement of multiple images such as stroke images is defined by X and Y coordinates on a two-dimensional plane, and when sharing multiple images with another communication terminal, for example, content data defined by the X and Y coordinates is transmitted.
[0005] However, content data defined by X and Y coordinates alone cannot indicate whether each image is in the foreground or background, which creates a problem in that, for example, it is not possible to change the display order of multiple shared images.
[0006] One embodiment of the present invention has been made in consideration of the above-mentioned problems, and makes it possible to change the display order of multiple shared images in a communication system in which multiple images are shared among multiple communication terminals. [Means for solving the problem]
[0007] In order to solve the above problems, a communication system according to an embodiment of the present invention includes a first communication terminal, a second communication terminal that shares a plurality of images with the first communication terminal, and a communication management device that manages communication between the first communication terminal and the second communication terminal, The first communication terminal, a reception unit that receives a change in a display order indicating whether each image of the plurality of images is located in the foreground or the background of a page, the change being received by the reception unit; The communication management device includes: The first communication terminal and the second communication terminal display a page displayed on the first communication terminal. and an information transmission unit that requests an edit lock, wherein the communication management device, in response to the edit lock request, causes the first communication terminal and the second communication terminal to update the page displayed by the second communication terminal. Restricted shared image management section and the second communication terminal receives the a display control unit that changes the display order of the plurality of images displayed on the display unit of the second communication terminal according to the information regarding the display order; and after requesting the communication management device to lock the editing, the information transmission unit transmits information relating to the display order to the second communication terminal. Effect of the Invention
[0008] According to one embodiment of the present invention, in a communication system in which a plurality of images are shared among a plurality of communication terminals, it becomes possible to change the display order of the plurality of shared images. [Brief description of the drawings]
[0009] [Figure 1] FIG. 2 is a schematic diagram illustrating an example of a communication route in a communication system according to an embodiment. [Diagram 2] FIG. 1 is a diagram for explaining an image of how an electronic whiteboard is used according to an embodiment; [Diagram 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of an electronic whiteboard according to an embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to an embodiment. [Diagram 5] FIG. 1 is a diagram illustrating an example of a system configuration of a communication system according to an embodiment. [Figure 6] FIG. 1 is a diagram illustrating an example of a functional configuration of a communication system according to an embodiment. [Figure 7]FIG. 13 is a diagram illustrating an example of an authentication management table according to an embodiment. [Figure 8] FIG. 13 is a diagram illustrating an example of a terminal management table according to an embodiment. [Figure 9] FIG. 13 is a diagram illustrating an example of a destination list management table according to an embodiment. [Figure 10] FIG. 13 is a diagram illustrating an example of a session management table according to an embodiment. [Figure 11] FIG. 13 is a diagram illustrating an example of a relay device management table according to an embodiment. [Figure 12] FIG. 11 is a sequence diagram illustrating an example of a preparatory process according to an embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a screen of a destination list displayed on an electronic whiteboard according to an embodiment. [Figure 14] FIG. 11 is a sequence diagram illustrating an example of a session start process according to an embodiment. [Figure 15] FIG. 11 is a sequence diagram (1) showing an example of a sharing process of a background image and a stroke image according to an embodiment. [Figure 16] FIG. 11 is a sequence diagram (2) illustrating an example of a sharing process of a background image and a stroke image according to an embodiment. [Figure 17] FIG. 2 is a diagram illustrating an example of a display screen of an electronic whiteboard according to an embodiment. [Figure 18] FIG. 2 is a diagram showing an example of shared information according to the first embodiment; [Figure 19] FIG. 4 is a sequence diagram showing an example of a process of changing a display order according to the first embodiment. [Figure 20] FIG. 11 is a diagram showing an example of a change operation of the display order of stroke images according to the first embodiment. [Figure 21] FIG. 11 is a diagram showing an example of shared information according to the second embodiment. [Figure 22] FIG. 11 is a sequence diagram showing an example of a process of changing a display order according to the second embodiment. [Figure 23] 13 is a flowchart illustrating an example of a display order update process according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
[0011] [Outline of the communication system] First, an overview of a communication system 100 for conducting a video conference while drawing on multiple electronic whiteboards 1a and 1b will be described with reference to Fig. 1. Fig. 1 is a schematic diagram showing an example of a communication route in this embodiment. Note that a "video conference" may also be called a "television conference," a "remote conference," a "conference," or the like.
[0012] Note that a conference such as a "video conference", a "television conference", or a "remote conference" is an example of a session (communication) in which stroke images are shared among multiple communication terminals. For example, the session may be a session other than a conference, such as a remote lesson, a remote medical examination, a meeting, or a simple conversation.
[0013] The communication system 100 is constructed by, for example, a plurality of electronic whiteboards 1a and 1b, a relay device 3, a communication management device 5, an image storage device 7, and the like.
[0014] The electronic whiteboards (communication terminals) 1a and 1b are terminal devices that perform mutual communication of content data such as video data and audio data for calls, image data for sharing, and stroke data, and are also called IWBs (Interactive White Boards).
[0015] The communication system 100 may have three or more electronic whiteboards, not limited to two electronic whiteboards 1a and 1b. In the following description, the term "electronic whiteboard 1" will be used to refer to any one of the electronic whiteboards included in the communication system 100.
[0016] The electronic whiteboard 1 is an example of a communication terminal according to the present embodiment. The communication terminal may be another communication terminal having a communication function, a drawing function, a display function, etc. For example, the communication terminal may be an information terminal such as a PC (Personal Computer), a tablet terminal, or a smartphone in which an application program corresponding to the communication system 100 is installed.
[0017] The stroke data is data used to reproduce (reproduce) a stroke image, and includes, for example, coordinate data, line width data, line color data, vector data, etc. In addition, the electronic whiteboards 1a and 1b transmit and receive video data and audio data for a call, and reproduce the video and audio of the other party, enabling a video call.
[0018] The electronic whiteboards 1a and 1b transmit and receive image data of a shared document image, allowing users of the communication system 100 to share the same document image. The document image is an image displayed on the display of the electronic whiteboard 1, and may include, for example, meeting documents, background images displayed on the display, and images of a captured screen when the display screen is captured.
[0019] Moreover, the electronic whiteboards 1a and 1b transmit and receive stroke data of a shared stroke image, so that participants using the communication system can share the same stroke image. A stroke image is an image showing lines drawn by a user using handwritten strokes with an electronic pen or the like. A stroke image is displayed by stroke data showing points that specify coordinates on a display.
[0020] 1, an electronic whiteboard equipped with a video conference function is shown as an example of the electronic whiteboards 1a and 1b. Note that the image of the video data may be a moving image or a still image.
[0021] In the following description, the electronic whiteboard 1 that requests the start of a video conference may be referred to as the "start terminal," and the electronic whiteboard 1 that is the destination (relay destination) of the request may be referred to as the "destination terminal." For example, in FIG. 1, when electronic whiteboard 1a requests electronic whiteboard 1b to start a video conference, electronic whiteboard 1a is the start terminal, and electronic whiteboard 1b is the destination terminal. Note that each of electronic whiteboards 1a and 1b may be used not only for communication between multiple offices or between different rooms in the same office, but also for communication within the same room, or communication between outdoors and indoors, or outdoors and outdoors.
[0022] The relay device 3 is configured by a computer, and performs a process of relaying content data for communication between the plurality of electronic whiteboards 1a and 1b.
[0023] The communication management device 5 is configured by a computer, and manages, for example, communication (session) between the electronic whiteboard 1a and the electronic whiteboard 1b. For example, the communication management device 5 centrally manages the authentication of logins from the electronic whiteboards 1a and 1b, the management of the communication status of the electronic whiteboards 1a and 1b, the management of destination lists, and the communication status of the relay device 3. The communication management device 5 also relays shared stroke data between the multiple electronic whiteboards 1a and 1b.
[0024] The image storage device 7 is configured by a computer, and stores image data of the shared document image uploaded from the electronic whiteboard 1a and downloads it to the electronic whiteboard 1b. The reverse is also performed. That is, the image storage device 7 stores image data uploaded from the electronic whiteboard 1b and downloads it to the electronic whiteboard 1a.
[0025] In addition, the relay device 3, the communication management device 5, and the image storage device 7 may be constructed by a single computer, or may be constructed by multiple computers in which each section (function or means) is divided and arbitrarily assigned.
[0026] In addition, in the communication system 100, a management information session sei (hereinafter referred to as "session sei") for transmitting and receiving various management information is established between the electronic whiteboards 1a and 1b via the communication management device 5. In addition, four sessions for transmitting and receiving four types of data, for example, high-resolution image data, medium-resolution image data, low-resolution image data, and sound data, are established between the electronic whiteboards 1a and 1b via the relay device 3. In FIG. 1, these four sessions are collectively shown as an image and sound data session sed (hereinafter simply referred to as "session"). Note that the number of sessions does not necessarily have to be four, and the number of sessions may be less or more than four. In addition, a session may be established directly between the start terminal and the destination terminal without the relay device 3.
[0027] Furthermore, in the communication system 100, stroke data can be transmitted and received between the electronic whiteboards 1a and 1b using the session sei.
[0028] Here, the image resolution of the image data handled in this embodiment will be described. Low-resolution image data is, for example, 160 pixels wide and 120 pixels high, and serves as a base image. Medium-resolution image data is, for example, 320 pixels wide and 240 pixels high. High-resolution image data is, for example, 640 pixels wide and 480 pixels high. Among these, when passing through a narrowband path, low-quality image data consisting only of low-resolution image data serving as a base image is relayed. When the band is relatively wide, low-resolution image data serving as a base image and medium-quality image data consisting of medium-resolution image data are relayed. Also, when the band is very wide, high-quality image data consisting of low-resolution image data serving as a base image, medium-resolution image data, and high-resolution image data are relayed. Since the amount of sound data is smaller than that of video data, it is relayed even through a narrowband path.
[0029] <Image of using the electronic whiteboard> Fig. 2 is a diagram for explaining an image of use of an electronic whiteboard according to an embodiment. As shown in Fig. 2, the electronic whiteboard 1 has a leg 151 with a plurality of casters provided on the lower side, a support 152 provided on the upper side of the leg 151, a main body 130 of the electronic whiteboard 1 provided on the upper side of the support 152, and a display 160 provided on the front side of the main body 130. The main body 130 has a built-in CPU 101, which will be described later, and the like. A user can input (draw) a stroke image such as a character on the display 160 using an electronic pen 140 or the like.
[0030] [Hardware configuration] Next, the hardware configuration of each device according to this embodiment will be described.
[0031] <Hardware configuration of the electronic whiteboard> Fig. 3 is a diagram showing an example of a hardware configuration of an electronic whiteboard according to an embodiment. As shown in Fig. 3, the electronic whiteboard 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an SSD (Solid State Drive) 104, a network I / F (Interface) 105, and an external device connection I / F 106.
[0032] Of these, the CPU 101 is a calculation device that controls the overall operation of the electronic whiteboard 1. The ROM 102 is a non-volatile memory that stores the CPU 101 and programs used to start up the CPU 101, such as an IPL (Initial Program Loader). The RAM 103 is a volatile memory that is used as a work area for the CPU 101. The SSD 104 is a large-capacity storage device that stores various data such as programs for the electronic whiteboard 1.
[0033] The network I / F 105 is a communication interface for connecting the electronic whiteboard 1 to a communication network and performing communication. The external device connection I / F 106 is an interface for connecting various external devices. In this case, the external devices include, for example, a USB (Universal Serial Bus) memory 131, external devices (a microphone 132, a speaker 133, a camera 134), and the like.
[0034] The electronic whiteboard 1 also includes a capture device 111, a GPU (Graphics Processing Unit) 112, a display controller 113, a contact sensor 114, a sensor controller 115, an electronic pen controller 116, a short-range communication circuit 119, an antenna 119a of the short-range communication circuit 119, a power switch 117, and selection switches 118.
[0035] Of these, the capture device 111 captures (acquires) a display screen or the like displayed on a display or the like of an external PC (Personal Computer) 150 as a still image or a moving image. The GPU 112 is a semiconductor chip (processor) that specializes in graphics. The display controller 113 controls and manages the screen display in order to output an output image from the GPU 112 to a display 160 or the like. The contact sensor 114 detects that the electronic pen 140, the user's hand H, or the like has come into contact with the display 160. The sensor controller 115 controls the processing of the contact sensor 114.
[0036] The contact sensor 114 performs input of coordinates and detection of coordinates by, for example, an infrared blocking method. The method of inputting coordinates and detecting coordinates is such that two light receiving / emitting devices installed at both ends of the upper side of the display 160 emit a plurality of infrared rays parallel to the display 160, and receive the light reflected by a reflecting member provided around the display 160 and returning on the same optical path as the optical path of the light emitted by the light receiving element. The contact sensor 114 outputs the ID of the infrared rays emitted by the two light receiving / emitting devices that are blocked by an object to the sensor controller 115, and the sensor controller 115 specifies the coordinate position that is the contact position of the object. The electronic pen controller 116 communicates with the electronic pen 140 to determine whether the pen tip or the pen tail touches the display 160. The near field communication circuit 119 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark).
[0037] The power switch 117 is a switch for switching on / off the power of the electronic whiteboard 1. The selection switches 118 are a group of switches for adjusting the brightness and color of the display 160, for example.
[0038] Furthermore, the electronic whiteboard 1 includes a bus line 120. The bus line 120 includes an address bus, a data bus, various control signals, and the like for electrically connecting the various components such as the CPU 101 shown in FIG.
[0039] The contact sensor 114 is not limited to an infrared blocking type, and may be a capacitive touch panel that identifies the contact position by detecting a change in capacitance, or a resistive film type touch panel that identifies the contact position by a voltage change between two opposing resistive films. The contact sensor 114 may also be an electromagnetic induction type touch panel that identifies the contact position by detecting electromagnetic induction caused by a contact object touching the display unit. Furthermore, the electronic pen controller 116 may determine the presence or absence of a touch not only on the tip and end of the electronic pen 140, but also on the part of the electronic pen 140 that the user holds and other parts of the electronic pen.
[0040] <Hardware configuration of management device, relay device, image storage device, PC, etc.> The communication management device 5, the relay device 3, the image storage device 7, and the PC 170, etc., have, for example, the hardware configuration of a computer 400 as shown in Fig. 4. Alternatively, the communication management device 5, the relay device 3, and the image storage device 7 may be realized by a plurality of computers 400.
[0041] 4 is a diagram showing an example of a hardware configuration of a computer according to an embodiment. The computer 400 includes, for example, a CPU 401, a ROM 402, a RAM 403, a hard disk (HD) 404, a hard disk drive (HDD) controller 405, a display 406, an external device connection I / F 407, a network I / F 408, a keyboard 409, a pointing device 410, a digital versatile disk rewritable (DVD-RW) drive 412, a media I / F 414, and a bus line 415.
[0042] Of these, the CPU 401 is an arithmetic unit that controls the overall operation of the computer 400. The ROM 402 is a non-volatile memory that stores programs used to drive the CPU 401, such as an IPL. The RAM 403 is a volatile memory that is used, for example, as a work area for the CPU 401. The HD 404 is a large-capacity storage device that stores programs such as an OS (Operating System) and applications, and various data. The HDD controller 405 controls the reading and writing of various data from and to the HD 404 under the control of the CPU 401.
[0043] The display 406 displays various information such as a cursor, a menu, a window, characters, or an image. The external device connection I / F 407 is an interface for connecting various external devices. The network I / F 408 is a communication interface for performing data communication using a communication network. The keyboard 409 is a type of input means having a plurality of keys for inputting, for example, characters, numbers, various instructions, etc. The pointing device 410 is a type of input means for selecting and executing various instructions, selecting a processing target, moving the cursor, etc.
[0044] The DVD-RW drive 412 controls reading and writing (storing) of data from and to the DVD-RW 411. The DVD-RW drive 412 may also control reading and writing (storing) of data from and to a disk other than the DVD-RW 411. The media I / F 414 controls reading and writing (storing) of data from and to a medium 413 such as a flash memory. The bus line 415 includes an address bus, a data bus, various control signals, and the like for electrically connecting each component such as the CPU 401 shown in FIG. 4.
[0045] [Overall configuration of communication system] Next, a description will be given of the overall configuration of the communication system 100. Fig. 5 is a diagram showing an example of the system configuration of a communication system according to an embodiment.
[0046] In FIG. 5, electronic whiteboard 1a is installed at location A, and electronic whiteboard 1b is installed at location B. For example, location A is an office in Tokyo, Japan, and location B is an office in Osaka, Japan. At location A, user A uses electronic whiteboard 1a, and at location B, user B and user C use electronic whiteboard 1b. Electronic whiteboard 1a is an example of a first communication terminal, and electronic whiteboard 1b is an example of a second communication terminal.
[0047] Moreover, the electronic whiteboards 1a and 1b, the relay device 3, the communication management device 5, and the image storage device 7 can transmit and receive data to and from each other via a communication network 500 such as the Internet or a LAN (Local Area Network). The communication network 500 may include a wireless communication portion. In Fig. 5, the electronic whiteboards 1a and 1b are assumed to be electronic whiteboards capable of transmitting and receiving conference videos.
[0048] <Functional configuration> Next, a functional configuration of the communication system 100 according to the present embodiment will be described. Fig. 6 is a diagram showing an example of the functional configuration of the communication system according to one embodiment.
[0049] <Functional configuration of the electronic whiteboard> First, the functional configuration of the electronic whiteboards 1a and 1b will be described with reference to Fig. 6. Since the electronic whiteboards 1a and 1b have the same functions, the functions of the electronic whiteboard 1 will be described here.
[0050] Each electronic whiteboard 1, for example, realizes a transmission / reception unit 11, a reception unit 12, a video / audio processing unit 13, a display control unit 14, an image processing unit 15, an information transmission unit 16, a short-range communication unit 17, and a storage / readout processing unit 18 by executing a predetermined program in a CPU 101 in Fig. 3. Also, the electronic whiteboard 1 has a storage unit 1000 realized by, for example, a RAM 103, an SSD 104, etc. in Fig. 3. At least a part of the above functional configurations may be realized by hardware.
[0051] The transmitting / receiving unit 11 transmits and receives various data and information to and from other terminals, devices, or systems via the communication network 500. The transmitting / receiving unit 11 also serves as an initiating unit, and performs a login process to the communication management device 5, etc., and a process of initiating communication with other communication terminals.
[0052] The reception unit 12 executes a reception process for receiving various input operations from a user using the electronic pen 140 or the like. For example, the reception unit 12 receives a drawing operation of a stroke image, various setting operations, a selection operation, and the like. In addition, the reception unit 12 according to the present embodiment receives an operation for changing the display order of a plurality of images (e.g., stroke images, etc.) displayed on a display unit such as the display 160.
[0053] The video / audio processor 13 performs main processing of the video conference function. For example, the video / audio processor 13 performs digital processing such as encoding video data and audio data based on the output signal of the microphone 132 and the output signal of the camera 134. The video / audio processor 13 also generates video signals and audio signals based on the video data and audio data received by the transmission / reception unit 11. The video / audio processor 13 also performs processing such as combining video data with different resolutions.
[0054] The display control unit 14 outputs a video signal (image signal) to a display unit such as the display 160 to perform control for displaying a display screen. The display control unit 14 according to the present embodiment also executes a display control process for changing the display order of a plurality of images displayed on a display unit such as the display 160 of the electronic whiteboard 1 according to information on the display order of a plurality of images transmitted by another electronic whiteboard 1 with which the display control unit 14 is communicating.
[0055] The image processing unit 15 performs main processing of the electronic whiteboard function. For example, the image processing unit 15 performs processing to create a stroke image and stroke data based on strokes of the electronic pen 190 or the like received by the reception unit 12, processing to create a stroke image based on stroke data received by the transmission / reception unit 11, etc. The image processing unit 15 also performs processing to generate an image signal based on image data of a document image received by the transmission / reception unit 11, etc.
[0056] The information transmitting unit 16 executes an information transmitting process of transmitting the stroke data created by the image processing unit 15 to another electronic whiteboard 1 in communication with the electronic whiteboard 1 via the communication management device 5. The information transmitting unit 16 according to the present embodiment also executes a process of transmitting information on the display order of the multiple images changed by the reception unit 12 to the other electronic whiteboard 1 in communication with the electronic whiteboard 1 via the communication management device 5. Note that the information transmitting unit 16 may transmit the stroke data, information on the display order of the multiple images, etc. to the other electronic whiteboard 1 in communication without going through the communication management device 5.
[0057] The short-range communication unit 17 obtains and provides data between each terminal having a short-range communication unit through short-range wireless communication.
[0058] The storage / read processing unit 18 performs processing such as storing various data in the storage unit 1000 and reading out various data stored in the storage unit 1000 .
[0059] For example, video data and audio data received during communication with another terminal are overwritten and stored every time they are received in the storage unit 1000. Of these, images are displayed on the display 160 using the video data before being overwritten, and audio is output from the speaker 150 using the audio data before being overwritten.
[0060] Moreover, the storage unit 1000 according to this embodiment stores shared information 1001, which is information relating to a plurality of images shared with other interactive whiteboards 1, and the like.
[0061] <Functional configuration of the communication management device> 4 executes a predetermined program, the communication management device 5 realizes a transmission / reception unit 51, an authentication unit 52, a terminal management unit 53, a session management unit 54, a relay device management unit 55, a shared information management unit 56, a generation unit 57, and a storage / read processing unit 58. Each of the above functional configurations may be realized by a program executed by a plurality of computers 400. Furthermore, at least a part of each of the above functional configurations may be realized by hardware.
[0062] 4, and a storage unit 5000 implemented by the HDD controller 405, etc. The storage unit 5000 stores, for example, an authentication management DB (Database) 5001, a terminal management DB 5002, a destination list management DB 5003, a session management DB 5004, a relay device management DB 5005, and shared information 5006.
[0063] (Authentication Management Table) Fig. 7 is a diagram showing an example of an authentication management table according to an embodiment. For example, an authentication management DB 5001 configured by an authentication management table 700 as shown in Fig. 7 is stored in the storage unit 5000. In this authentication management table 700, the terminal IDs of multiple electronic whiteboards 1 managed by the communication management device 5 are associated with passwords corresponding to each terminal ID and managed. For example, the authentication management table 700 shown in Fig. 7 indicates that the password corresponding to the terminal ID "01aa" of the electronic whiteboard 1a is "aaaa".
[0064] The terminal ID is identification information for identifying the electronic whiteboard (communication terminal) 1, and is an example of identification information for the communication management device 5 to manage communication terminals such as the electronic whiteboard 1. For example, the communication management device 5 may manage the electronic whiteboard 1 using a user ID for identifying a user, a contract ID for identifying a contractor, a communication ID for identifying a communication source, or the like, instead of the terminal ID.
[0065] Moreover, the password is an example of authentication information for authenticating a communication terminal such as the interactive whiteboard 1. The authentication information may be authentication information other than a password, such as an access token or an electronic certificate.
[0066] (Terminal Management Table) Fig. 8 is a diagram showing an example of a terminal management table according to an embodiment. For example, a terminal management DB 5002 configured by a terminal management table 800 as shown in Fig. 8 is stored in the storage unit 5000. In this terminal management table 800, for each terminal ID for identifying each electronic whiteboard 1, the destination name when each electronic whiteboard 1 is the destination, the operation status of each electronic whiteboard 1, the reception date and time when login request information described later is received by the communication management device 5, the IP address of each electronic whiteboard 1, etc. are associated and managed.
[0067] 8, the terminal management table 800 indicates that the electronic whiteboard 1a with the terminal ID "01aa" has the terminal name "Japan Tokyo Office AA Terminal" and the operating status "Online (communication available)". The electronic whiteboard 1a with the terminal ID "01aa" also indicates that the date and time when the login request information was received by the communication management device 5 was "April 10, 20xx, 13:40" and the IP address was "1.2.1.3". The terminal ID, destination name, and terminal IP address are stored, for example, when each electronic whiteboard 1 pre-registers to receive services provided by the communication management device 5.
[0068] (Destination list management table) FIG. 9 is a diagram showing an example of a destination list management table according to an embodiment. The storage unit 5000 stores a destination list management DB 5003 configured by a destination list management table 900 as shown in FIG. 9. In this destination list management table 900, the terminal IDs of all destination terminals registered as candidates of the destination electronic whiteboard 1 (destination terminal) are associated with the terminal ID of the electronic whiteboard 1 (start terminal) requesting the start of communication and are managed. For example, the destination list management table 900 shown in FIG. 9 shows that the destination terminal candidates that can request the start of communication from the start terminal (electronic whiteboard 1a) with the terminal ID "01aa" include the electronic whiteboard 1b with the terminal ID "01ba". The destination terminal candidates are updated by being added or deleted in response to an addition or deletion request from any start terminal to the communication management device 5.
[0069] (Session management table) FIG. 10 is a diagram showing an example of a session management table according to an embodiment. The storage unit 5000 stores a session management DB 5004 configured by a session management table 1010 as shown in FIG. 10, for example. In this session management table 1010, the device ID of the relay device 3 to be used, the terminal ID of the starting terminal, the terminal ID of the destination terminal, and the like are associated and managed for each session ID, which is identification information for identifying a session (communication). In addition, in the session management table 1010, for example, information such as a reception delay time (ms) when video data is received at the destination terminal and a reception date and time when the delay information indicating this delay time is received from the destination terminal are further associated and managed. For example, in the session management table 1010 shown in FIG. 10, in a session with a session ID "se01", a relay device 3 with a relay device ID "111a" relays communication between a start terminal with a terminal ID "01aa" and a destination terminal with a terminal ID "01ba". It also indicates that in the session with session ID "se01", the delay time of the video data at the time of "13:41 on April 10, 20xx" is 200 (ms).
[0070] (Relay device management table) FIG. 11 is a diagram showing an example of a relay device management table according to an embodiment. The storage unit 5000 stores a relay device management DB 5005 configured by a relay device management table 1100 as shown in FIG. 11, for example. In this relay device management table 1100, the operation state of each relay device 3, the reception date and time of receiving the status information indicating the operation state, the IP address of the relay device 3, and the maximum data transmission rate (Mbps) are associated and managed for each relay device ID that identifies a plurality of relay devices 3. For example, in the relay device management table 1100 shown in FIG. 11, it is shown that the operation state of the relay device 3 with the relay device ID "111a" is "online" and the date and time when the status information was received by the communication management device 5 is "12:00 on April 10, 20xx". In addition, it is shown that the IP address of the relay device 3 with the relay device ID "111a" is "1.2.1.2" and the maximum data transmission rate of the relay device 3 is 100Mbps.
[0071] (Functional configuration of the communication management device) Returning now to FIG. 6, the functional configuration of the communication management device 5 will be described.
[0072] The transmitting / receiving unit 51 transmits and receives various data (or information) to and from other terminals, devices, or systems via the communication network 500. For example, the transmitting / receiving unit 51 transfers (transmits) data of a plurality of images (e.g., stroke data), information on the display order of a plurality of images, and the like, transmitted by the electronic whiteboard 1a to another electronic whiteboard 1b in communication with the electronic whiteboard 1b.
[0073] The authentication unit 52 authenticates the login request received via the transmission / reception unit 51. For example, when a combination of a terminal ID and a password included in the login request received from the electronic whiteboard 1 is stored in the authentication management table 700 as shown in FIG.
[0074] The terminal management unit 53 manages the terminal management DB 5002, and updates information such as the operating state, reception date and time, and terminal IP address in the terminal management table 800 shown in FIG.
[0075] The terminal manager 53 also manages a destination list management table 900, and provides destination list information including the terminal IDs of destination terminals in the destination list management table 900 as shown in FIG. 9 in response to a request from the electronic whiteboard 1, for example.
[0076] The session management unit 54 manages sessions (communications, conferences, etc.) held in the communication system 100. For example, the session management unit 54 generates a session ID for identifying a session in response to start request information requesting the start of communication from the electronic whiteboard 1. In addition, the session management unit 54 stores and manages various information related to the session in a session management table 1010 as shown in FIG. 10 in association with the session ID.
[0077] The relay device management unit 55 manages the relay device management DB 5005 and selects a relay device 3 to be used for relaying a session, for example, by using a relay device management table 1100 as shown in Fig. 11. For example, the relay device management unit 55 may select a relay device 3 near the starting terminal based on the IP address of each relay device 3 stored in the relay device management table 1100 and the IP address of the starting terminal. Alternatively, the relay device management unit 55 may select a relay device 3 based on the maximum data transmission speed of each relay device 3 stored in the relay device management table 1100.
[0078] In this embodiment, the method of selecting the relay device 3 to be used for relaying a session may be any method. Also, the communication system 100 may have one relay device 3, and the same relay device 3 may be used for each session.
[0079] The shared information management unit 56 stores and manages information on multiple images shared by multiple electronic whiteboards 1 participating in a session (communication, conference, etc.), information indicating the display order of the multiple images, etc., in shared information 5006, in association with a session ID that identifies the session.
[0080] The generating unit 57 generates a URL or the like indicating a storage location of image data of a document image in response to a request from a communication terminal such as the electronic whiteboard 1.
[0081] The storage / read processing unit 58 performs processing such as storing various data in the storage unit 5000 and reading out various data stored in the storage unit 5000.
[0082] <Functional configuration of the image storage device> The image storage device 7 realizes a transmission / reception unit 71, a storage / readout processing unit 72, etc., by executing a predetermined program in the CPU 401 in Fig. 4. The image storage device 7 also has a storage unit 7000 realized by, for example, the RAM 403, HD 404, HDD controller 405, etc. in Fig. 4.
[0083] The transmitting / receiving unit 71 transmits and receives various data, information, and the like to and from other terminals, devices, or systems via the communication network 500. The storage / reading processing unit 72 performs processing to store various data in the storage unit 7000 and to read out various data stored in the storage unit 7000.
[0084] With the above configuration, the image storage device 7 stores, for example, image data uploaded from the electronic whiteboard 1 in a specified URL (Uniform Resource Locator), and provides the image data stored in the specified URL in response to a request from the electronic whiteboard 1.
[0085] <Functional configuration of relay device> The relay device 3 realizes a transmission / reception unit (transfer unit) 31, a determination unit 32, a storage / readout processing unit 33, etc., by executing a predetermined program in a CPU 401 in Fig. 4. The relay device 3 also has a storage unit 3000 realized by, for example, a RAM 403, a HD 404, a HDD controller 405, etc. in Fig. 4.
[0086] The transmitting / receiving unit (transfer unit) 31 transmits and receives various data, information, and the like to and from other terminals, devices, or systems via the communication network 500. The transmitting / receiving unit 31 also serves as a transfer unit, and transfers, for example, video data and audio data received from the electronic whiteboard 1 to other electronic whiteboards 1 participating in the same session as the electronic whiteboard 1. The determining unit 32 performs various determinations, such as determining the state of data delays, and the like.
[0087] The storage / read processing unit 33 performs processing such as storing various data in the storage unit 3000 and reading out various data stored in the storage unit 3000.
[0088] 6 is an example, and various modifications and applications are possible. For example, each functional configuration included in the communication management device 5 may be realized by multiple computers 400. Furthermore, at least a part of each functional configuration included in the communication management device 5 may be possessed by the electronic whiteboard (communication terminal) 1. Similarly, at least a part of each functional configuration included in the electronic whiteboard 1 may be possessed by the communication management device 5.
[0089] The function of the image saving device 7 may be realized by a storage server or the like outside (or inside) the communication system 100. Furthermore, at least a part of the functional configurations of the image saving device 7 and the relay device 3 may be included in the communication management device 5. Furthermore, the electronic whiteboard 1 is an example of a communication terminal, and the communication terminal may be an information terminal or the like that executes an application corresponding to the communication system 100.
[0090] [Processing flow] Next, the process flow of the communication method according to this embodiment will be described.
[0091] <Preparatory processing> 12 is a sequence diagram showing an example of a preparatory process according to an embodiment. This process shows an example of a preparatory process executed before the interactive whiteboard 1 participates in a session (communication, conference, etc.) in the communication system 100.
[0092] First, when the power switch 122 of the interactive whiteboard 1a is turned on, the reception unit 12a receives the power-on command (step S22).
[0093] Next, the transmitting / receiving unit 11a transmits login request information requesting login to the communication management device 5 via the communication network 500 (step S23). This login request information includes, for example, the terminal ID and password of the electronic whiteboard 1a.
[0094] Next, the authentication unit 52 of the communication management device 5 searches the authentication management table 700 as shown in Fig. 7 using the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys. Furthermore, if the combination of the terminal ID and password included in the login request information is managed in the authentication management table 700, the authentication unit 52 permits login to the electronic whiteboard 1a (step S24). Here, if the combination of the terminal ID and password included in the login request information is managed in the authentication management table 700, the processing from step S25 onwards is executed.
[0095] When the login of the electronic whiteboard 1a is permitted, the terminal management unit 53 updates the information corresponding to the terminal ID "01aa" of the electronic whiteboard 1a in the terminal management table 800 as shown in FIG. 8. For example, the terminal management unit 53 changes the information of "operation status" corresponding to the terminal ID "01aa" to "online (communication possible)" and updates the information of "received date and time" to the date and time when the login request information was received (step S25). The IP address information of the terminal in the terminal management table 800 is not registered in advance, and the IP address transmitted from the electronic whiteboard 1a in the above step S23 may be used. By this process, for example, as shown in FIG. 8, the terminal ID "01aa" is associated with the operation status "online (communication possible)", the received date and time "20xx.4.10.13:40", the IP address "1.2.1.3", and the like in the terminal management table 800 and managed.
[0096] Next, the session management unit 54 adds a new record in which the terminal ID "01aa" of the electronic whiteboard 1a received in step S23 is set as the "terminal ID of the starting terminal" to the session management table 1010 as shown in Fig. 10 and manages the new record (step S26). Then, the transmitting / receiving unit 51 of the communication management device 5 transmits authentication result information indicating the authentication result obtained by the processing of step 24 to the electronic whiteboard 1a that made the login request via the communication network 500 (step S27).
[0097] When the transmitting / receiving unit 11a of the electronic whiteboard 1a receives the authentication result information indicating that the login is permitted, the transmitting / receiving unit 11a transmits destination list request information indicating a request for a destination list to the communication management device 5 via the communication network 500 (step S28). As a result, the transmitting / receiving unit 51 of the communication management device 5 receives the destination list request information.
[0098] Next, the terminal management unit 53 searches the destination list management table 900 as shown in Fig. 9 using the terminal ID "01aa" of the electronic whiteboard 1a as a search key, and reads out the terminal IDs of destination candidates that can communicate with the electronic whiteboard 1a. The terminal management unit 53 also reads out the destination names corresponding to the terminal IDs of the destination candidates from the terminal management table 800 as shown in Fig. 8 (step S29). As a result, the terminal IDs of the destination candidates corresponding to the terminal ID "01aa" of the electronic whiteboard 1a and the destination names corresponding to these are extracted.
[0099] Next, the transmitting / receiving unit 51 of the communication management device 5 reads, for example, data of the destination list frame and data of the icon indicating the operating state stored in the memory unit 5000 via the memory / read processing unit 58 (step S30). The transmitting / receiving unit 51 of the communication management device 5 also transmits "destination list information (destination list frame, icon, terminal ID, destination name)" including the read destination list frame and icon, and the terminal ID and destination name extracted in step S29, to the electronic whiteboard 1a (step S31). As a result, in the electronic whiteboard 1a, the transmitting / receiving unit 11a receives the destination list information, and the memory / read processing unit 18a stores the received destination list information in the memory unit 1000a (step S32).
[0100] In this manner, in this embodiment, the destination list information of all terminals is centrally managed by the communication management device 5, rather than each electronic whiteboard 1 managing the destination list information. Therefore, even when a new electronic whiteboard 1 is registered in the communication management device 5, when a new model of communication terminal is registered in place of an electronic whiteboard 1 already included, when the appearance of the destination list frame is changed, etc., it is possible to eliminate the need to change the destination list information on each electronic whiteboard 1 side.
[0101] 8 using the terminal IDs of the destination candidates extracted in step S29 as a search key, and reads out the corresponding operating status for each of the destination candidate terminal IDs. As a result, the terminal management unit 53 acquires the operating status of each electronic whiteboard 1 corresponding to the destination candidate terminal ID (step S33).
[0102] Next, the transmitter / receiver unit 51 of the communication management device 5 transmits "terminal status information" including the terminal ID used as the search key in step S33 and the operating status of each corresponding destination terminal to the electronic whiteboard 1a via the communication network 500 (step S34).
[0103] Next, the storage / readout processing unit 18a of the electronic whiteboard 1a sequentially stores the terminal status information received from the communication management device 5 in the storage unit 1000 (step S35). Thus, by receiving the status information of each of the electronic whiteboards 1, the electronic whiteboard 1a can obtain the current operating status of the electronic whiteboards 1b, 1c, etc., which are potential destinations that can communicate with the electronic whiteboard 1a.
[0104] Next, the display control unit 14a of the electronic whiteboard 1a creates a destination list 1300, for example, as shown in FIG. 13, which reflects the status of the terminals as destination candidates, based on the destination list information stored in the storage unit 1000a and the terminal status information. The display control unit 14a also displays the created destination list 1300 on a display unit such as the display 160 of the electronic whiteboard 1a (step S36). In this destination list 1300, an icon indicating the operating status, a terminal ID, and a destination name are displayed for each destination candidate. In the example of FIG. 13, the icons indicating the operating status of each communication terminal are displayed as "offline" and "online (communication available)" from the top.
[0105] Meanwhile, the terminal management unit 53 of the communication management device 5 extracts the terminal IDs of other terminals that have registered the electronic whiteboard 1a as a destination candidate by searching the destination list management table 900 as shown in FIG. 8 based on the terminal ID "01aa" of the electronic whiteboard 1a (step S37).
[0106] Next, the terminal management unit 53 of the communication management device 5 searches the terminal management table 800 as shown in FIG. 7 based on the terminal ID "01aa" of the electronic whiteboard 1a, and acquires the operation status of the electronic whiteboard 1a (step S38).
[0107] Then, the transmitting / receiving unit 51 transmits "terminal status information" including the terminal ID and the operating status of the electronic whiteboard 1a to the electronic whiteboard 1 of the terminal ID whose operating status is "online" in the terminal management table 800 among the terminal IDs extracted in step S37 (step S39). When transmitting the terminal status information to each electronic whiteboard 1, the transmitting / receiving unit 51 refers to the IP address of each electronic whiteboard 1 managed in the terminal management table 800 based on each terminal ID. This makes it possible to transmit the terminal ID "01aa" of the electronic whiteboard 1a and the operating status "online" to each electronic whiteboard 1 that can communicate with the electronic whiteboard 1a as a destination candidate. This makes it possible to display the status of the electronic whiteboard 1a on each electronic whiteboard 1 that is a destination candidate (step S40).
[0108] <Session start processing> 14 is a sequence diagram showing an example of a session start process according to an embodiment. This process shows an example of a session start process executed in the communication system 100 when, for example, the electronic whiteboard 1a requests the electronic whiteboard 1b to start a session (communication).
[0109] In step S1401, when the electronic whiteboard 1a, which is the start terminal, accepts the destination selection by the user A, the processes from step S1402 onwards are executed. Here, it is assumed that the electronic whiteboard 1b is selected as the destination terminal by the user A.
[0110] In step S1402, when the electronic whiteboard 1a accepts the destination selection by user A, the transmitting / receiving unit 11a of the electronic whiteboard 1a transmits start request information requesting the start of a session to the communication management device 5. This start request information includes, for example, the terminal ID "01aa" of the electronic whiteboard 1a which is the start terminal, the terminal ID "01ba" of the electronic whiteboard 1b which is the destination terminal, and the IP address of the electronic whiteboard 1a which is the start terminal. As a result, the transmitting / receiving unit 51 of the communication management device 5 receives the start request information and also receives the IP address of the start terminal (electronic whiteboard 1a) which is the sender.
[0111] In step S1403, the terminal management unit 53 of the communication management device 5 updates the terminal management DB 5002 based on the terminal ID of the starting terminal and the terminal ID of the destination terminal included in the start request information. For example, based on the terminal ID "01aa" of the starting terminal and the terminal ID "01ba" of the destination terminal included in the start request information, the terminal management unit 53 updates the "operating status" corresponding to the terminal IDs "01aa" and "01ba" in the terminal management table 800 to "online (communicating)". Note that in this state, the electronic whiteboard 1a, which is the starting terminal, and the electronic whiteboard 1b, which is the destination terminal, are not participating in the session, but are managed as being in a communicating state.
[0112] In step S1404, the session management unit 54 of the communication management device 5 generates a session ID for identifying a session held between the electronic whiteboard 1a and the electronic whiteboard 1b. Here, it is assumed that the session management unit 54 generates the session ID "se01".
[0113] In step S1405, the session management unit 54 stores and manages the generated session ID, the terminal ID "01aa" of the initiating terminal, the terminal ID "01ba" of the destination terminal, etc. in a session management table 1010 as shown in FIG. 10 in association with each other.
[0114] In step S1406, the relay device management unit 55 of the communication management device 5 selects a relay device 3 that will relay the session between the starting terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b). For example, the relay device management unit 55 selects a relay device 3 having an IP address close to the IP address of the starting terminal (electronic whiteboard 1a) in the terminal management table 800 from among the device IDs of relay devices 3 whose operating status is "online" in the relay device management table 1100. Here, it is assumed that the relay device 3 with the device ID "111a" is selected.
[0115] In steps S1407a and S1407b, the session management unit 54 of the communication management device 5 transmits relay device selection information to the start terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) via the transmission / reception unit 51. This relay device selection information includes, for example, the IP address of the relay device 3 selected in step S1406, the session ID generated in step S1404, and the IP address of the communication management device 5.
[0116] In steps S1408a and S1408b, when the transmitter / receiver 11 of the initiating terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) receive the relay device selection information, they transmit reception completion information indicating that the relay device selection information has been received to the communication management device 5. This reception completion information includes, for example, the session ID "se01" and the like that was included in the relay device selection information.
[0117] In steps S1409a and S1409b, the transmitting / receiving units 11 of the initiating terminal (electronic whiteboard 1a) and the destination terminal (electronic whiteboard 1b) establish a session with the relay device 3 using the device ID and session ID of the relay device 3 included in the relay device selection information. As a result, the electronic whiteboard 1a and the electronic whiteboard 1b participate in the session with the same session ID "se01" and can transmit and receive video data such as conference video, audio data, and the like to each other via the relay device 3.
[0118] By the above process, it becomes possible to transmit and receive conference video and the like between user A of the electronic whiteboard 1a and user B of the electronic whiteboard 1b.
[0119] <Communication processing of document images and stroke images> Next, a communication process of the document image displayed on the electronic whiteboard 1 and the input stroke image will be described with reference to FIGS.
[0120] 15 and 16 are sequence diagrams showing an example of a sharing process of a document image and a stroke image according to an embodiment. Here, an example of a process in which a document image and a stroke image are shared between the electronic whiteboards 1a and 1b and the document image displayed on the electronic whiteboard 1a and the input stroke image are displayed on the electronic whiteboard 1b will be described.
[0121] At the start of the process shown in Fig. 15, the electronic whiteboard 1a and the electronic whiteboard 1b are assumed to be participating in the same session (communication, conference, etc.) by, for example, the process shown in Fig. 14. Also, it is assumed that, for example, a display screen 1710 as shown in Fig. 17(A) is displayed on the display 160 of the electronic whiteboard 1a.
[0122] 17A, a conference video 1711 of site B transmitted from the electronic whiteboard 1b, a document image 1712, a "share" button 1713, and the like are displayed on a display screen 1710. In this state, when a user A of the electronic whiteboard 1a presses the "share" button 1713, the reception unit 12a of the electronic whiteboard 1a receives a sharing operation of the document image (step S1501), the process from step S1502 onward is executed.
[0123] In step S1502, the reception unit 12a of the electronic whiteboard 1a transmits, via the transmission / reception unit 11a, to the communication management device 5, an acquisition request for requesting acquisition of a uniform resource locator (URL) indicating the storage location of the image data of the document image. As a result, the transmission / reception unit 51 of the communication management device 5 receives the acquisition request for the URL of the image data from the electronic whiteboard 1a. Note that the URL is an example of storage location information, and may be, for example, a uniform resource identifier (URI), etc.
[0124] In step S1503, the generating unit 57 of the communication management device 5 generates an image data URL indicating the storage location of the image data of the document image in response to the request to obtain the URL of the image data received from the electronic whiteboard 1a. In addition, in step S1504, the generating unit 57 transmits the generated URL of the image data to the electronic whiteboard 1a that is the request source via the transmitting / receiving unit 51. As a result, the transmitting / receiving unit 11 of the electronic whiteboard 1a receives the URL of the image data.
[0125] In step S1505, the transmitting / receiving unit 11a of the electronic whiteboard 1a transmits a notification of the start of uploading image data of the document image to the communication management device 5. As a result, in step S1506, the transmitting / receiving unit 51 of the communication management device 5 transfers (transmits) the notification of the start of uploading image data of the document image received from the electronic whiteboard 1a to the other electronic whiteboard 1b that is communicating with the electronic whiteboard 1a. As a result, the transmitting / receiving unit 11b of the electronic whiteboard 1b receives the start notification.
[0126] In step S1507, the display control unit 14b of the electronic whiteboard 1b displays, for example, a display screen 1720 as shown in Fig. 17(B) on the display 160 of the electronic whiteboard 1b. Note that the display screen 1720 originally displays a conference video 1721 of the site A transmitted from the electronic whiteboard 1a, a "share" button 1722, and the like. In addition, an hourglass icon 1723 is displayed on this display screen 1720 to visually indicate the time lapse of the download of the image data of the material image in response to the start notification received in step S1506.
[0127] The passage of time can be indicated by a still hourglass or an animated hourglass with moving sand. The hourglass icon 1723 is an example of schedule information indicating that image data is scheduled to be downloaded. Other examples of schedule information may be icons other than an hourglass (for example, a clock icon), characters (and / or "symbols") instead of icons, or a combination of icons and characters (and / or "symbols"). Schedule information may also be a notification by sound. In this case, sound is output from speaker 133 or the like by video / audio processing unit 13b, not by display control unit 14b.
[0128] The electronic whiteboard 1a may perform the process of step S1502 after the process of step S1505. The communication management device 5 may transmit the URL of the image data in step S1504 after receiving the notification of the start of uploading the image data in step S1505.
[0129] In step S1508, the transmitting / receiving unit 11a of the electronic whiteboard 1a uploads image data of the material image to the URL related to the image storage device 7 received in step S1504. As a result, the transmitting / receiving unit 71 of the image storage device 7 receives the image data of the material image.
[0130] In step S1509, the storage / read processing unit 72 of the image storage device 7 stores the image data of the received document image in a storage area of the storage unit 7000 that corresponds to the URL.
[0131] In step S1510, when the receiving unit 12a of the electronic whiteboard 1a receives an input of a stroke image drawn by the user A on the display 160 of the electronic whiteboard 1a using the electronic pen 180 or hand H, the processes in and after step S1511 are executed.
[0132] In step S1511, the image processing unit 15a of the electronic whiteboard 1a creates stroke data (e.g., coordinate data, line width data, line color data, vector data, etc.) representing the input stroke image. The display control unit 14 of the electronic whiteboard 1a also displays the stroke image on a display unit such as the display 160 of the electronic whiteboard 1a. As a result, for example, as shown in FIG. 17(C), the drawn stroke image 1731 is added to a display screen 1710 displayed on a display unit such as the display 160 of the electronic whiteboard 1a.
[0133] In step S1512, the information transmission unit 16a of the electronic whiteboard 1a uses the transmission / reception unit 11a to transmit the stroke data created in step S1511 to the other electronic whiteboard 1b with which the electronic whiteboard 1a is communicating via the communication management device 5. As a result, the transmission / reception unit 51 of the communication management device 5 receives the stroke data transmitted by the electronic whiteboard 1a.
[0134] In step S1513, the shared information management unit 56 of the communication management device 5 stores the stroke data received from the electronic whiteboard 1a in the shared information 5006 of the memory unit 5000 via the storage / read processing unit 58, in association with the session ID "se01."
[0135] In step S1514, the transmitting / receiving unit 51 of the communication management device 5 transfers (transmits) the stroke data received from the electronic whiteboard 1a to another electronic whiteboard 1b in communication with the electronic whiteboard 1a, for example, in parallel with the process of step S1513. As a result, the transmitting / receiving unit 11b of the electronic whiteboard 1b receives the stroke data transmitted by the electronic whiteboard 1a.
[0136] In this manner, in the communication system 100 according to the present embodiment, the electronic whiteboard 1 can transmit stroke data via the communication management device 5 to another electronic whiteboard 1 that is in communication with the electronic whiteboard 1 in question.
[0137] In step S1515, the image processor 15b of the electronic whiteboard 1b creates a stroke image based on the stroke data received from the electronic whiteboard 1a. The display controller 14b of the electronic whiteboard 1b displays the created stroke image on a display unit such as the display 160 of the electronic whiteboard 1b. As a result, for example, as shown in FIG. 17D, a stroke image 1741 similar to the stroke image 1731 displayed by the electronic whiteboard 1a is displayed on the display unit such as the display 160 of the electronic whiteboard 1b.
[0138] 16, the transmitting / receiving unit 71 of the image storage device 7 transmits a completion notification indicating that the upload of the image data of the document image has been completed to the electronic whiteboard 1a in parallel with the processing of steps 1510 to S1515 of Fig. 15. As a result, the transmitting / receiving unit 11a of the electronic whiteboard 1a receives the completion notification from the image storage device 7.
[0139] In steps S1602 and S1603, the transmitting / receiving unit 11a of the electronic whiteboard 1a transmits a completion notification indicating that uploading of the image data of the document image has been completed to the other electronic whiteboard 1b with which the electronic whiteboard 1a is communicating, via the communication management device 5. This completion notification includes, for example, the URL of the image data received in step S1504. At this time, the transmitting / receiving unit 51 of the communication management device 5 receives the completion notification transmitted by the electronic whiteboard 1a, and transfers the completion notification to the other electronic whiteboard 1b with which the electronic whiteboard 1a is communicating. As a result, the transmitting / receiving unit 11b of the electronic whiteboard 1b receives the completion notification transmitted by the electronic whiteboard 1a.
[0140] In step S1604, the transmitting / receiving unit 11b of the electronic whiteboard 1b transmits request information indicating a request for downloading image data of the document image to the URL related to the image storage device 7 received in step S1603. As a result, the transmitting / receiving unit 71 of the image storage device 7 receives the request information from the electronic whiteboard 1b.
[0141] In step S1605, the storage / read processing unit 72 of the image storage device 7 reads image data of the requested document image from the storage unit 7000 based on the received URL. In addition, in step S1606, the transmission / reception unit 71 of the image storage device transmits image data of the requested document image to the requesting electronic whiteboard 1b. This causes the transmission / reception unit 11b of the electronic whiteboard 1b to download (receive) the image data.
[0142] In step S1607, the display control unit 14b of the electronic whiteboard 1b displays the downloaded image data on the display screen 1720 displayed on a display unit such as the display 160 of the electronic whiteboard 1b. In addition, the display control unit 14b of the electronic whiteboard 1b makes the hourglass icon 1723 that had been displayed up until that point invisible.
[0143] <Display order change process> The electronic whiteboard 1 defines a plurality of images, such as stroke images, by X and Y coordinates on a two-dimensional plane on a display unit, such as the display 160. For example, when sharing a stroke image with another electronic whiteboard 1, stroke data including the X and Y coordinates is transmitted.
[0144] However, because the X and Y coordinates alone cannot indicate whether each image is in the foreground or background, there is a problem that, for example, the display order of multiple shared images cannot be changed. For example, assume that shared images are displayed in the order of image A, image B, and image C on a display unit such as display 160 of electronic whiteboard 1a. In this case, with conventional technology, it is difficult to move image A, which is displayed in the background, to the foreground and display the images in the order of image B, image C, and image A.
[0145] In order to solve such a problem, the electronic whiteboard 1 according to the present embodiment has a function of transmitting and receiving information regarding the display order of multiple images shared with other electronic whiteboards 1. As a result, in the communication system 100 according to the present embodiment, for example, when the display order of multiple images shared by the electronic whiteboards 1a and 1b is changed on the electronic whiteboard 1a, the display order of the multiple images on the electronic whiteboard 1b is also changed to the same display order as on the electronic whiteboard 1a. Note that the foreground refers to the side closest to the user of the electronic whiteboard 1 when the user faces the electronic whiteboard. Also, the background refers to the side furthest from the user of the electronic whiteboard 1 when the user faces the electronic whiteboard.
[0146] [First embodiment] (Shared Information) Fig. 18 is a diagram showing an image of shared information according to the first embodiment. In the communication system 100 according to the first embodiment, information on a plurality of images shared between the electronic whiteboard 1a and the electronic whiteboard 1b is managed, for example, as shared information 1800 in a format as shown in Fig. 18.
[0147] For example, the shared information management unit 56 of the communication management device 5 stores and manages shared information in a format as shown in FIG. 18 for each conference (session) in the shared information 5006 of the storage unit 5000, etc.
[0148] Furthermore, each of the electronic whiteboards 1a and 1b participating in the conference stores and manages shared information in a format as shown in FIG. 18 in the shared information 1001 or the like in the storage unit 1000 of the own device.
[0149] In the example of FIG. 18, the shared information 1800 has a hierarchical structure of "conference," "pages (pages 1 to 3)," and "strokes (strokes 1 to 5)."
[0150] A "stroke" corresponds to stroke data according to this embodiment, and is managed for each "page," for example, as shown in Fig. 18. For example, stroke 1 includes a stroke ID (id=aaaaa) that identifies stroke 1, information that specifies parent page 1 (parent=gewaa), and Gid "g001" that identifies drawing data. Stroke 1 may also include drawing data that corresponds to Gid "g001," for example.
[0151] For example, when an operation such as movement is performed on the stroke image represented by stroke 1, the stroke ID (id=aaaaa) remains the same, but the Gid "g001" that identifies drawing data 1 and the drawing data corresponding to Gid "g001" are updated. Note that the drawing data is data for reproducing stroke 1, and includes, for example, coordinate data, line width data, line color data, vector data, etc.
[0152] The electronic whiteboard 1 can switch pages, and a "page" corresponds to each page including the display page displayed on the electronic whiteboard 1. For example, page 1 includes information such as a page ID (id=gewaa) that identifies page 1, and information for specifying the parent "conference" (parent=abcdefg). Furthermore, page 1 may include, for example, data of document images to be displayed on page 1.
[0153] In the first embodiment, this "page" includes information on "orderList" that indicates the display order of multiple images (e.g., stroke images, etc.) displayed on each page. For example, "orderList=aaaaa, bbbbb, ccccc" included in page 1 in Fig. 18 indicates that strokes 1 to 3 are to be drawn in the order of stroke 1, stroke 2, and stroke 3.
[0154] Therefore, for example, if you want to draw stroke 1, which is drawn in the backmost position, in the foreground, you can change the information in "orderList" to "orderList=bbbbb, ccccc, aaaaa."
[0155] A "conference" corresponds to a session (communication, conference, etc.) managed by the communication system 100, and is managed by, for example, a session ID (id=abcdefg) that identifies the session.
[0156] For example, the image processor 15 of the electronic whiteboard 1 can reproduce a plurality of stroke images drawn on a page 1 using strokes 1 to 3.
[0157] <Processing flow> Fig. 19 is a sequence diagram showing an example of a display order change process according to the first embodiment. At the start of the process shown in Fig. 19, the electronic whiteboards 1a and 1b are assumed to be participating in the same conference (session) by, for example, the session start process shown in Fig. 14. Also, it is assumed that two stroke images, a stroke image 2011 and a stroke image 2012, are displayed in this order on the display unit such as the display 160 of the electronic whiteboards 1a and 1b, as shown in Fig. 20(A).
[0158] In step S1901, the reception unit 12 of the electronic whiteboard 1a receives an operation by the user A to change the display order of the stroke images.
[0159] For example, it is assumed that the display order of the stroke image 2012 is to be changed among the stroke image 2011 and the stroke image 2012 displayed on the display screen 2000 as shown in FIG. 20(A). In this case, the user A selects the stroke image 2012 to be changed with the electronic pen 140, the hand H, or the like, and performs a predetermined operation such as, for example, long pressing. As a result, for example, as shown in FIG. 20(B), a menu 2021 for changing the display order of the stroke image 2012 to be changed is displayed on the display screen 2000. The user A can move the stroke image 2012 to the back of the stroke image 2011 by selecting, for example, "Arrange in back" 2022 from the menu 2021, as shown in FIG. 20(C).
[0160] As a result, for example, the information of "orderList" included in the "page" of the shared information 1800 as shown in Fig. 18 is updated. For example, it is assumed that the display screen 2000 in Fig. 20(A) corresponds to "page 2" 1801 of the shared information 1800 in Fig. 18, the stroke image 2011 corresponds to "stroke 4" 1802, and the stroke image 2012 corresponds to "stroke 5" 1803.
[0161] From this state, when the stroke image 2012 is moved behind the stroke image 2011 as shown in FIG. 20C, the orderList={ddddd, eeeee} of "Page 2" 1801 is updated to orderList={eeeee, ddddd}.
[0162] In step S1902, the information transmission unit 16a of the electronic whiteboard 1a requests the communication management device 5 to lock the editing of the page (e.g., page 2) displayed by the electronic whiteboards 1a and 1b. This is because, for example, when updating information on page 2, if an update of a stroke image is received from the other electronic whiteboard 1b, an operation conflict occurs with the other electronic whiteboard 1b.
[0163] In step S1903, the shared information management unit 56 of the communication management device 5, in response to a request from the electronic whiteboard 1a, restricts the updating of page 2 by the other electronic whiteboard 1b. As a result, the shared information management unit 56 of the communication management device 5, for example, rejects the updating of page 2, the updating of stroke images, etc. from the electronic whiteboard 1b.
[0164] In step S1904, the information transmission unit 16a of the electronic whiteboard 1a transmits the update information of page 2 to the other electronic whiteboard 1b with which the electronic whiteboard 1a is communicating via the communication management device 5. The update information of this page 2 includes, for example, the updated orderList (for example, orderList={eeeee, ddddd}).
[0165] In step S1905, the shared information management unit 56 of the communication management device 5 updates the shared information of page 2 based on the update information of page 2 received from the electronic whiteboard 1a. For example, the shared information management unit 56 changes the orderList included in "page 2" 1801 of the shared information 1800 as shown in Fig. 18 to the updated orderList (for example, orderList = {eeeee, ddddd}).
[0166] In step S1906, the transmitting / receiving unit 51 of the communication management device 5 transfers (transmits) the update information of page 2 received from the electronic whiteboard 1a to the other electronic whiteboard 1b in communication with the electronic whiteboard 1a, for example, in parallel with the process of step S1905.
[0167] In step S1907, the display control unit 14b of the electronic whiteboard 1b updates the display of the multiple images displayed on the display unit such as the display 160 of the electronic whiteboard 1b using the received update information for page 2 (an example of information on the display order of the multiple images). For example, the display control unit 14b of the electronic whiteboard 1b changes the display order of "Stroke 4" 1802 and "Stroke 5" 1803 displayed on the display unit in accordance with the updated orderList included in the update information for page 2. As a result, the display unit of the electronic whiteboard 1b also displays, for example, a display screen 2000 as shown in FIG. 20(C), in the same manner as the display unit of the electronic whiteboard 1a.
[0168] In step S1908, the information transmission unit 16a of the electronic whiteboard 1a requests the communication management device 5 to release the editing lock of page 2. In response to this, in step S1909, the shared information management unit 56 of the communication management device 5 releases the editing lock of page 2.
[0169] By the above process, in the communication system 100 in which a plurality of images are shared among a plurality of communication terminals (electronic whiteboards 1), it becomes possible to change the display order of a plurality of shared images (for example, stroke images).
[0170] [Second embodiment] According to the first embodiment, when the display order of a plurality of images (e.g., stroke images) displayed on the display unit of the electronic whiteboard 1a is changed, the display order of a plurality of images displayed on the display unit of the electronic whiteboard 1b is also changed in the same manner.
[0171] However, in this method, for example, when the display order of multiple images is changed on the electronic whiteboard 1a, the page information must be changed. Also, in this method, if another user edits a stroke image while the page information is being updated, an operation conflict occurs, so that it is necessary to lock the page edit, for example, as shown in step S1902 in FIG.
[0172] In the second embodiment, an example will be described in which information (orderList) indicating the display order of a plurality of images is managed separately from page information.
[0173] (Shared Information) Fig. 21 is a diagram showing an image of shared information according to the second embodiment. In the communication system 100 according to the second embodiment, information on a plurality of images shared between the electronic whiteboard 1a and the electronic whiteboard 1b is managed, for example, as shared information 2100 in a format as shown in Fig. 21.
[0174] For example, the shared information management unit 56 of the communication management device 5 stores and manages shared information in a format as shown in FIG. 21 for each conference (session) in the shared information 5006 of the storage unit 5000, for example.
[0175] Furthermore, each of the electronic whiteboards 1a and 1b participating in the conference stores and manages shared information in a format as shown in FIG. 21 in the shared information 1001 or the like in the storage unit 1000 of its own device.
[0176] In the first embodiment, the information on "orderList" indicating the display order of multiple images was included in the "page", but in the second embodiment, the information on "orderList" is managed as a "content order" (content order 1-2) separately from the "page". As a result, in the second embodiment, for example, when only the display order of multiple images displayed on the display unit of the electronic whiteboard 1a is changed, only the information on the "content order" can be changed without changing the information on the "page".
[0177] <Processing flow> Fig. 22 is a sequence diagram showing an example of a display order change process according to the second embodiment. At the start of the process shown in Fig. 22, the electronic whiteboards 1a and 1b are assumed to be participating in the same session (conference, communication, etc.) by, for example, the session start process shown in Fig. 14. Also, it is assumed that two stroke images, a stroke image 2011 and a stroke image 2012, are displayed in this order on the display unit such as the display 160 of the electronic whiteboards 1a and 1b, as shown in Fig. 20(A).
[0178] In step S2201, the accepting unit 12a of the electronic whiteboard 1a accepts an operation by the user A to change the display order of the stroke images, in the same manner as in the first embodiment.
[0179] In step S2202, the information transmitter 16a of the electronic whiteboard 1a transmits update information of the display order to the other communicating electronic whiteboard 1b via the communication management device 5. For example, the information transmitter 16a of the electronic whiteboard 1a transmits "Content Order 2" 2101 in Fig. 21 to the other communicating electronic whiteboard 1b. This update information of the display order includes the updated orderList (for example, orderList={eeeee, ddddd}).
[0180] In step S2203, the shared information management unit 56 of the communication management device 5 updates the shared information 5006 stored in the storage unit 5000 based on the update information of the display order received from the electronic whiteboard 1a. For example, the shared information management unit 56 updates the orderList included in the "content order 2" 2101 of the shared information 2100 as shown in Fig. 21 to the updated orderList (for example, orderList = {eeeee, ddddd}).
[0181] In step S2204, the transmitting / receiving unit 51 of the communication management device 5 transfers (transmits) the update information on the display order received from the electronic whiteboard 1a to the other electronic whiteboard 1b in communication with the electronic whiteboard 1a, for example, in parallel with the process of step S2203.
[0182] In step S2205, the display control unit 14b of the electronic whiteboard 1b changes the display order of the multiple images displayed on the display unit such as the display 160 of the electronic whiteboard 1b according to the received update information on the display order (another example of information on the display order of the multiple images). For example, the display control unit 14b of the electronic whiteboard 1b changes the display order of "Stroke 4" 1802 and "Stroke 5" 1803 displayed on the display unit according to the updated orderList included in the update information on the display order. As a result, the display unit of the electronic whiteboard 1b also displays the multiple shared images in the same order as the display unit of the electronic whiteboard 1a.
[0183] In this way, in the second embodiment, when changing the display order of multiple images shared by electronic whiteboards 1a and 1b, no change is made to the page information, so that the display order of multiple images can be changed without performing a lock process that prohibits editing under "page."
[0184] <Display order update process> Fig. 23 is a flowchart showing an example of a display order update process according to an embodiment. This process shows an example of a process of updating the display order of a plurality of images executed by the display control unit 14 of the electronic whiteboard 1b in step S2205 in Fig. 22. Note that this process can also be applied to the process in step S1907 in Fig. 19, for example.
[0185] In step S2301, when the electronic whiteboard 1b receives information about the display order of the multiple images shared with the electronic whiteboard 1a, the processing of step S2302 and subsequent steps is executed. Note that the information about the display order of the multiple images includes, for example, update information about the display order including "orderList" (second embodiment), or page information including "orderList" (first embodiment), etc.
[0186] In step S2302, the display control unit 14b of the electronic whiteboard 1b determines whether the images that overlap with other images among the multiple images shared with the electronic whiteboard 1a are only stroke images. If the overlapping images are not only stroke images, the display control unit 14b of the electronic whiteboard 1b shifts the process to step S2303. On the other hand, if the overlapping images are only stroke images, the display control unit 14b of the electronic whiteboard 1b shifts the process to step S2304.
[0187] In step S2303, the display control unit 14b of the electronic whiteboard 1b updates the display order of the images shared with the electronic whiteboard 1a according to the information on the display order of the images. For example, the display control unit 14b of the electronic whiteboard 1b redraws the images shared with the electronic whiteboard 1a in the display order indicated by "orderList."
[0188] On the other hand, when the process proceeds to step S2304, the display control unit 14b of the electronic whiteboard 1b determines whether the overlapping stroke images are the same color. If the overlapping stroke images are not the same color, the display control unit 14b of the electronic whiteboard 1b proceeds to step S2303. On the other hand, if the overlapping stroke images are the same color, the display control unit 14b of the electronic whiteboard 1b proceeds to step S2305.
[0189] When the process proceeds to step S2305, the display control unit 14b of the electronic whiteboard 1b stops the process of updating the display order of the multiple images shared with the electronic whiteboard 1a. In this way, when the overlapping images are only stroke images and have the same color, the display control unit 14 of the electronic whiteboard 1b may determine that it is not necessary to change the display order of the multiple images because changing the display order does not change the appearance.
[0190] There is a problem that the processing load is high if all images are redrawn according to the page information and the display order update information. However, by using the above process, redrawing is performed only when redrawing is necessary, so the processing load of the electronic whiteboard 1b can be reduced.
[0191] The above process is an example, and the display control unit 14 of the electronic whiteboard 1b may determine whether or not it is necessary to change the display order of the multiple images, and if it is not necessary, may cancel the change of the display order of the multiple images. Also, the process of FIG. 23 is optional and not essential.
[0192] As described above, according to each embodiment of the present invention, in the communication system 100 in which a plurality of images are shared among a plurality of communication terminals (electronic whiteboards 1a, 1b), it becomes possible to change the display order of the plurality of shared images.
[0193] <Supplementary Information> Each function of each embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.
[0194] In addition, in each of the above embodiments, the communication terminal has been described as being the electronic whiteboard 1, but the communication terminal may be, for example, an information terminal having a communication function, such as a PC, a smartphone, or a tablet terminal that executes an application corresponding to the communication system 100. In addition, the communication terminal may be various electronic devices having a communication function and a display function, such as a projector, a video conference device, a digital signage, a medical device, or a car navigation device, that are corresponding to the communication system 100.
[0195] The programs of the electronic whiteboard 1 and the communication management device 5 may be distributed, for example, as files in an installable or executable format, recorded on a computer-readable recording medium. The programs of the electronic whiteboard 1 and the communication management device 5 may be downloaded from a server (cloud or on-premise) and installed on a communication terminal, instead of being recorded on a recording medium.
[0196] Furthermore, the communication management device 5 is not limited to the computer 400 shown in FIG. 4, but may be realized by electronic devices such as a mobile phone, a smartphone, a tablet terminal, a wearable terminal, a PDA (Personal Data Assistant), and an image forming device. [Explanation of symbols]
[0197] 1a Electronic whiteboard (first communication terminal) 1b Electronic whiteboard (second communication terminal) 5 Communication management device 12 Reception 14 Display control section 16 Information transmission section 51 Transmitting / receiving unit (another example of an information transmitting unit) 100 Communication Systems 160 Display (Display unit) 1000 storage section 5000 storage section 2011, 2012 Stroke Images [Prior art documents] [Patent documents]
[0198] [Patent Document 1] JP 2018-93361 A
Claims
1. A communication system including a first communication terminal, a second communication terminal that shares a plurality of images with the first communication terminal, and a communication management device that manages communication between the first communication terminal and the second communication terminal, The first communication terminal comprises: a reception unit that receives a change in a display order indicating whether each of the plurality of images is located in the foreground or the background of a page, the display unit of the first communication terminal; an information transmission unit that, when the reception unit receives the change in the display order, requests the communication management device to lock editing by the second communication terminal of the page displayed by the first communication terminal and the second communication terminal; having the communication management device has a shared information management unit that limits updating of a page displayed by the first communication terminal and the second communication terminal by the second communication terminal in response to the request for locking editing; the second communication terminal has a display control unit that changes the display order of the plurality of images displayed on a display unit of the second communication terminal in accordance with information on the display order transmitted by the first communication terminal; A communication system, wherein the information transmission unit transmits information relating to the display order to the second communication terminal after requesting the communication management device to lock the editing.
2. the communication management device has a transmitting / receiving unit that transfers information on the display order transmitted by the first communication terminal to the second communication terminal; The communication system according to claim 1 , wherein the information transmitting unit transmits the information relating to the display order to the second communication terminal via the communication management device.
3. The communication system according to claim 1 , wherein the plurality of images include a stroke image drawn by a user of the first communication terminal or the second communication terminal.
4. The communication management device has a memory unit that stores information of one or more pages including a display page displayed on a display unit of the first communication terminal, 4. The communication system according to claim 1, wherein the information sending unit sends information about the display page including information indicating the display order to the second communication terminal when the receiving unit receives a change to the display order of the plurality of images.
5. The communication management device has a memory unit that stores information about the plurality of images and information indicating the display order of the plurality of images for each page displayed on the display unit of the first communication terminal, The communication system according to any one of claims 1 to 3, wherein when the reception unit receives a change in the display order of the plurality of images, the information transmission unit transmits information indicating the display order of the plurality of images corresponding to a display page displayed on the display unit of the first communication terminal to the second communication terminal.
6. The communication system according to claim 3 , wherein the display control unit cancels the change in the display order of the plurality of images when it determines, based on the information on the stroke image and the information on the display order, that it is unnecessary to change the display order of the plurality of images.
7. The communication system according to claim 3 , wherein the display control unit cancels the change in the display order of the plurality of images when overlapping images among the plurality of images are only stroke images and have the same color.
8. A communication system including a first communication terminal, a second communication terminal that shares a plurality of images with the first communication terminal, and a communication management device that manages communication between the first communication terminal and the second communication terminal, the first communication terminal accepts a change in a display order indicating whether each of the plurality of images to be displayed on a display unit of the first communication terminal is located in the foreground or the background of a page; when the first communication terminal accepts the change in the display order, a request is made to the communication management device to lock editing by the second communication terminal of the page being displayed by the first communication terminal and the second communication terminal; the communication management device, in response to the request for locking the editing, restricts updating of the page displayed by the first communication terminal and the second communication terminal by the second communication terminal; After the first communication terminal requests the editing lock, the first communication terminal transmits information about the display order to the second communication terminal; the second communication terminal changes the display order of the plurality of images displayed on a display unit of the second communication terminal in accordance with information on the display order transmitted by the first communication terminal; Communication methods.
9. A communication system including a first communication terminal, a second communication terminal that shares a plurality of images with the first communication terminal, and a communication management device that manages communication between the first communication terminal and the second communication terminal, A process in which the first communication terminal receives a change in a display order indicating whether each image of the plurality of images is located in the foreground or the background of a page, the display order being displayed on a display unit of the first communication terminal; a process of requesting, when the first communication terminal accepts the change in the display order, the communication management device to lock editing by the second communication terminal of the page being displayed by the first communication terminal and the second communication terminal; a process in which the communication management device, in response to the request for locking the editing, restricts updating of the page displayed by the first communication terminal and the second communication terminal by the second communication terminal; a process of transmitting information regarding the display order to the second communication terminal after the first communication terminal requests the editing lock; A process in which the second communication terminal changes the display order of the plurality of images displayed on a display unit of the second communication terminal in accordance with information on the display order transmitted by the first communication terminal; A program to execute.
Citation Information
Patent Citations
System and information processing device
JP2015060305A
Electronic device and display method
JP2016162051A
Communication terminal, communication system, output method, and program
JP2018050285A
Communication terminal, communication system, video output method, and program
JP2018093361A
Data sharing system, information processing apparatus, program, and data sharing method
JP2019114123A
