Information input system, information input device, information input method, and program
The information input system addresses the issue of user recognition in remote conferences by enabling user selection, storage, and display of usernames on remote terminals, improving visibility and clarity in electronic whiteboard interactions.
Patent Information
- Application Number
- JP2023039873
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-03-14
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2043-03-14
AI Technical Summary
Conventional remote conference systems fail to recognize and display the user who inputs information via an electronic whiteboard, leading to ambiguity about who performed the input.
An information input system comprising an information input device and a terminal device that can communicate with a conference management device, enabling user recognition and display of usernames on remote terminals through participant selection, storage, and information transmission.
Users participating in a remote conference via an electronic whiteboard are recognized, and their usernames are displayed on remote terminals, enhancing clarity and participation visibility.
Smart Images

Figure 0007948044000001 
Figure 0007948044000002 
Figure 0007948044000003
Abstract
Description
TECHNICAL FIELD
[0001] The present invention relates to an information input system, an information input device, an information input method, and a program. BACKGROUND ART
[0002] In a remote conference service that connects a plurality of sites, by using an information input device such as an electronic whiteboard, conference participants can share the same material, and perform information input by writing edits, comments and the like on the material using a hand or a dedicated electronic pen. Patent Document 1 discloses a technology that recognizes participants of a remote conference using an IC card or facial recognition, and notifies the participants of connection information for the remote conference service. SUMMARY OF THE INVENTION PROBLEMS TO BE SOLVED BY THE INVENTION
[0003] However, in the conventional technology, it was not possible to recognize a user who participates in a remote conference via an information input device such as an electronic whiteboard. Accordingly, since the user name of the user who input information to the information input device cannot be displayed on the screen, a participant at a different site from the user who input information to the information input device cannot grasp who performed the information input.
[0004] In view of the above problems, an embodiment of the present invention aims to recognize a user participating in a remote conference via an information input device such as an electronic whiteboard, and display the user name of the user who input information to the information input device on the screen of a terminal device located at a remote site. MEANS FOR SOLVING THE PROBLEMS
[0005] To solve the above-mentioned problems, the present invention provides an information input system comprising an information input device and a terminal device that can communicate with a conference management device, wherein the information input device comprises: a participant user reception unit that receives an operation to select a participant user to participate in the conference via the information input device from among users scheduled to participate in the conference; a participant user storage unit that stores information about the participant user in a storage unit; a display control unit that displays an input user selection screen on the screen of the information input device for selecting an input user to input information to the information input device from among the participant users; an input user reception unit that receives an operation to select the input user on the input user selection screen; an input user storage unit that stores information about the input user in a storage unit; and an input information transmission unit that transmits input information entered by the input user and user information including the username of the input user to the conference management device, wherein the terminal device comprises: a terminal display control unit that displays the input information and the username of the input user on the screen of the terminal device to indicate that the input information was entered by the input user, based on the input information and user information received from the conference management device. [Effects of the Invention]
[0006] According to an embodiment of the present invention, in a remote conference, users participating in the conference via an information input device such as an electronic whiteboard can be recognized, and the usernames of the users who entered information into the information input device can be displayed on the screen of a terminal device located at a remote site. [Brief explanation of the drawing]
[0007] [Figure 1] This figure shows an example of a schematic diagram of an information input system according to an embodiment of the present invention. [Figure 2] This figure shows an example of the hardware configuration of an information input device according to an embodiment of the present invention. [Figure 3] This figure shows an example of the hardware configuration of a conference management device and a terminal device according to an embodiment of the present invention. [Figure 4]This figure shows an example of a configuration diagram of a functional block in an information input system according to an embodiment of the present invention. [Figure 5] This figure shows an example of a sequence relating to meeting participation processing according to an embodiment of the present invention. [Figure 6] This figure shows an example of meeting information according to an embodiment of the present invention. [Figure 7] This figure shows an example of a meeting selection screen according to an embodiment of the present invention. [Figure 8] This figure shows an example of a display screen for meeting information according to an embodiment of the present invention. [Figure 9] This figure shows an example of a participant selection screen according to an embodiment of the present invention. [Figure 10] This figure shows an example of a sequence of steps related to the display process of the username of a user who inputs information according to an embodiment of the present invention. [Figure 11] This figure shows an example of an input user selection screen according to an embodiment of the present invention. [Figure 12] This figure shows an example of a screen that displays the username of a user who has entered information according to an embodiment of the present invention. [Figure 13] This figure shows an example of a sequence for adding / removing participating users according to an embodiment of the present invention. [Figure 14] This figure shows an example of a flowchart relating to the process for determining changes in information input by a user according to an embodiment of the present invention. [Figure 15] This figure shows an example of a screen that displays the modified username of the input user according to an embodiment of the present invention. [Modes for carrying out the invention]
[0008] Hereinafter, embodiments of the information input system, information input device, information input method, and program according to the present invention will be described in detail with reference to the attached drawings.
[0009] [First Embodiment] <System Overview> Figure 1 shows an example of a schematic diagram of an information input system according to an embodiment of the present invention. The information input system 1 includes, for example, an information input device 2 connected to a communication network 3 such as the Internet, a conference management device 4, and a terminal device 5.
[0010] Information input device 2 is, for example, a device called an electronic blackboard or interactive whiteboard (IWB). Information input device 2 accepts an operation by a user participating in the meeting via information input device 2 to select an input user to input information into information input device 2. Information input device 2 also transmits the input information entered by the input user and user information including the input user's username to the meeting management device 4. Here, information input to information input device 2 is performed, for example, by writing information on the screen of information input device 2 using the user's hand or a dedicated electronic pen.
[0011] Terminal device 5 receives input information entered into the information input device 2 by users participating in the meeting via the information input device 2, as well as user information including the username of the user who entered the input information, from the meeting management device 4. Furthermore, based on the input information and user information received from the meeting management device 4, terminal device 5 displays the input information and the username of the user who entered the input information on the screen to indicate that the input information was entered by the user who entered it.
[0012] The conference management device 4 manages remote conferences conducted between the information input device 2 and the terminal device 5 using conference information, including the date and time of the conference and information about the participants. The conference management device 4 also receives input information entered by the user into the information input device 2, as well as user information about the user who entered the input information, and transmits it to the terminal device 5.
[0013] With the above configuration, the information input system 1 can recognize users participating in a meeting via an information input device such as an electronic whiteboard, and display the usernames of users who have entered information into the information input device on the screen of a terminal device located at a remote site.
[0014] Note that the system configuration of the information input system 1 shown in Figure 1 is an example. For example, the number of the information input devices 2, terminal devices 5, and conference management devices 4 may be any arbitrary number. In addition, the communication network 3 may include a connection segment by wireless communication such as mobile communication or a wireless LAN. Furthermore, the processing or means related to remote conference management performed by the conference management device 4 may be implemented by cloud computing.
[0015] <Hardware Configuration Example (Information Input Device 2)> Figure 2 is a diagram illustrating an example of the hardware configuration of the information input device 2 according to the embodiment of the present invention. As shown in Figure 2, the information input device 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an SSD (Solid State Drive) 204, a network I / F 205, and an external device connection I / F (Interface) 206.
[0016] Among these components, the CPU 201 controls the overall operation of the entire information input device 2. The ROM 202 stores programs used for driving the CPU 201, such as the CPU 201 itself and an IPL (Initial Program Loader). The RAM 203 is used as a work area for the CPU 201. The SSD 204 stores various data such as programs for display devices. The network I / F 205 controls communication with the communication network 3. The external device connection I / F 206 is an interface for connecting various external devices. The external devices in this case are, for example, a USB (Universal Serial Bus) memory 230 and external devices (a microphone 240, a speaker 250, and a camera 260).
[0017] Furthermore, the information input device 2 includes a capture device 211, a GPU 212, a display controller 213, a contact sensor 214, a sensor controller 215, an electronic pen controller 216, a short-range communication circuit 219, and an antenna 219a for the short-range communication circuit 219, a power switch 222, and selection switches 223.
[0018] Of these, the capture device 211 displays video information as a still image or video on the display of an external PC (Personal Computer) 270. The GPU (Graphics Processing Unit) 212 is a semiconductor chip specializing in graphics. The display controller 213 controls and manages screen display in order to output the output image from the GPU 212 to the display 280, etc. The contact sensor 214 detects when an electronic pen 290 or the user's hand H, etc., touches the display 280. The sensor controller 215 controls the processing of the contact sensor 214. The contact sensor 214 performs coordinate input and coordinate detection using an infrared blocking method. This method of coordinate input and coordinate detection involves two light-emitting and receiving devices installed at both ends of the upper side of the display 280 emitting multiple infrared rays parallel to the display 280, and receiving the light that is reflected by reflective materials provided around the display 280 and returns along the same optical path as the light emitted by the light-receiving element. The contact sensor 214 outputs the infrared ID emitted by two light-receiving devices that are blocked by an object to the sensor controller 215, which then identifies the coordinate position of the object's contact. The electronic pen controller 216 communicates with the electronic pen 290 to determine whether the pen tip or the pen end has touched the display 280. The near-field communication circuit 219 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The power switch 222 is a switch for turning the power of the information input device 2 ON / OFF. The selection switches 223 are a group of switches for adjusting, for example, the brightness and color of the display 280.
[0019] Furthermore, the information input device 2 is equipped with a bus line 210. The bus line 210 is an address bus, data bus, etc., for electrically connecting each component, such as the CPU 201 shown in Figure 2.
[0020] Furthermore, the contact sensor 214 is not limited to the infrared blocking method. Various detection means may be used, such as a capacitive touch panel that identifies the contact position by detecting changes in capacitance, a resistive touch panel that identifies the contact position by voltage changes between two opposing resistive films, or an electromagnetic induction touch panel that identifies the contact position by detecting electromagnetic induction caused by contact between an object and the display. In addition, the electronic pen controller 216 may be configured to determine whether or not there is touch not only at the tip and end of the electronic pen 290, but also at the part of the electronic pen 290 held by the user or other parts of the electronic pen.
[0021] <Example Hardware Configuration (Conference Management Device 4 and Terminal Device 5)> Figure 3 shows an example of the hardware configuration of a conference management device 4 and a terminal device 5 according to an embodiment of the present invention. As shown in Figure 3, the conference management device 4 and the terminal device 5 are built using a computer and include a CPU 501, ROM 502, RAM 503, HD (Hard Disk) 504, HDD (Hard Disk Drive) controller 505, display 506, external device connection I / F (Interface) 508, network I / F 509, bus line 510, keyboard 511, pointing device 512, DVD-RW (Digital Versatile Disk Rewritable) drive 514, and media I / F 516.
[0022] Of these, the CPU 501 controls the operation of the entire conference management device 4 and terminal device 5. The ROM 502 stores programs used to drive the CPU 501, such as IPL. The RAM 503 is used as the work area for the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls the reading or writing of various data to the HD 504 according to the control of the CPU 501. The display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. External devices in this case include, for example, USB (Universal Serial Bus) memory and printers. The network I / F 509 is an interface for data communication using the communication network 3. The bus line 510 is an address bus, data bus, etc., for electrically connecting each component such as the CPU 501 shown in Figure 3.
[0023] The keyboard 511 is a type of input means equipped with multiple keys used for inputting characters, numbers, or various instructions. The pointing device 512 is a type of input means used for selecting and executing various instructions, selecting processing targets, moving the cursor, etc. The DVD-RW drive 514 controls the reading or writing of various data to the DVD-RW 513, which is an example of a removable recording medium. Note that the DVD-RW drive 514 is not limited to DVD-RW, but may also be DVD-R, etc. The media I / F 516 controls the reading or writing (storage) of data to the recording medium 515, such as flash memory.
[0024] <About the features> Figure 4 is a diagram showing an example of the configuration of a functional block in an information input system 1 according to an embodiment of the present invention. The information input device 2 includes a communication unit 10, a participating user reception unit 11, a participating user storage unit 12, an input user reception unit 13, an input user storage unit 14, an input information transmission unit 15, a participating user setting unit 16, an input user setting unit 17, an input time detection unit 18, an input user determination unit 19, a display control unit 20, and an operation reception unit 21. Each of these units is a function or means realized by the CPU 201 executing instructions included in one or more programs installed in the information input device 2. The storage unit 22 can be realized by a storage device such as an SSD 204 in the information input device 2.
[0025] The communication unit 10 is a communication function of the information input device 2, and it sends and receives information with the conference management device 4 and the like via the communication network 3. For example, the communication unit 10 sends a request to update conference information (conference information update request), which includes information about participating users who will be joining the conference, to the communication unit 35 of the conference management device 4.
[0026] The participant registration unit 11 accepts user operations to select participants for the meeting and to confirm the selection of participants.
[0027] The participant user storage unit 12 stores information about the participants (such as user ID and username) in the storage unit 22 of the information input device 2.
[0028] The input user reception unit 13 accepts the operation of the user operating the information input device 2 to select a user (input user) from among the participants in the meeting to input information into the information input device 2.
[0029] The input user storage unit 14 stores information (such as user ID and username) about the user (input user) who inputs information to the information input device 2 in the storage unit 22 of the information input device 2.
[0030] The input information transmission unit 15 transmits the input information entered by the user (input user) who inputs information into the information input device 2, along with user information including the input user's username, to the communication unit 35 of the conference management device 4.
[0031] The participant setting unit 16 sets whether or not each user scheduled to participate in the meeting can be selected as a participant (i.e., whether or not their username can be displayed on the participant selection screen).
[0032] The input user setting unit 17 sets whether or not each user scheduled to participate in the meeting can be selected as an input user to input information into the information input device 2 (i.e., whether or not their username can be displayed on the input user selection screen).
[0033] The input time detection unit 18 detects the start time and end time of information input performed to the information input device 2.
[0034] The input user determination unit 19 calculates the time difference between the end time of one information input and the start time of the next information input (referred to as the information input interval), and determines, based on the calculated information input interval, whether the user inputting information to the information input device 2 has changed to another user. For example, if the information input interval is longer than or equal to a predetermined time, the input user determination unit 19 determines that the user has changed to another user.
[0035] The display control unit 20 displays the meeting selection screen, the participant user selection screen, and the input user selection screen, etc., on the screen (display 280) of the information input device 2.
[0036] The operation reception unit 21 receives operations by the user, such as inputting information into the information input device 2 using their hand or an electronic pen, and operations such as selecting a participant user to join the meeting or an input user to input information into the information input device 2.
[0037] The memory unit 22 stores information about the meeting (meeting information), including information about participating users (such as user IDs and usernames) and information about users (such as user IDs and usernames) who input information into the information input device 2 (input users).
[0038] The terminal device 5 includes a communication unit 30, a terminal display control unit 31, an operation reception unit 32, and a control unit 33. Each of these units is a function or means realized by the CPU 501 executing instructions contained in one or more programs installed in the information processing device that constitutes the terminal device 5. The storage unit 34 can be realized by a storage device such as the HD 504 of the terminal device 5.
[0039] The communication unit 30 is a communication function of the terminal device 5, and it transmits and receives information with the conference management device 4 and the like via the communication network 3. For example, the communication unit 30 receives input information that has been input to the information input device 2 from the communication unit 35 of the conference management device 4.
[0040] The terminal display control unit 31 displays the input information received by the information input device 2 from the communication unit 35 of the conference management device 4 on the screen (display 506) of the terminal device 5.
[0041] The operation reception unit 32 receives user inputs such as text input and button presses via the keyboard or pointing device of the terminal device 5.
[0042] The control unit 33 updates the list of participating users stored in the storage unit 34 of the terminal device 5 based on a meeting information update request received by the communication unit 30 from the communication unit 35 of the meeting management device 4.
[0043] The memory unit 34 stores in its storage device the list of participating users that the communication unit 30 received from the communication unit 35 of the conference management device 4.
[0044] The terminal device 5 may also have functions for configuring meeting settings on the information input device 2, such as a participant user reception unit 11, a participant user storage unit 12, an input user reception unit 13, an input user storage unit 14, an input information transmission unit 15, a participant user setting unit 16, and an input user setting unit 17. Furthermore, users may configure meeting settings using these functions by operating the terminal device 5 in the same manner as they would by operating the information input device 2.
[0045] The conference management device 4 has a communication unit 35 and a management unit 36. Each of these units is a function or means realized by the CPU 501 executing instructions contained in one or more programs installed in the information processing device that constitutes the conference management device 4. The storage unit 37 can be realized by a storage device such as the HD 504 of the conference management device 4.
[0046] The communication unit 35 is a communication function of the conference management device 4, and it transmits and receives information with the information input device 2 and the terminal device 5 via the communication network 3. For example, the communication unit 35 transmits a conference information update notification, which includes information about participating users, received from the communication unit 10 of the information input device 2, to the communication unit 30 of the terminal device 5. The communication unit 35 also transmits user information, which includes the username of the user who inputs information into the information input device 2, and the input user's username, received from the communication unit 10 of the information input device 2, to the communication unit 30 of the terminal device 5.
[0047] The management unit 36 updates the meeting information stored in the storage unit 37 of the meeting management device 4 based on the meeting information update request received from the communication unit 10 of the information input device 2.
[0048] The memory unit 37 stores meeting information in its storage device, including information about participating users (such as user IDs and usernames) and information about users (such as user IDs and usernames) who input information into the information input device 2 (input users).
[0049] <Meeting participation processing> Figure 5 shows an example of a sequence of conference participation processing according to an embodiment of the present invention. In this sequence, the information input device 2 receives operations from the user, such as conference information request, conference selection, participant user selection, and conference participation request, and transmits the requests received from the user to the conference management device 4. The conference management device 4 transmits updated conference information, including information about the selected participant users, to the terminal device 5. The processing of each step in Figure 5 will be described below.
[0050] Step S40: The operation reception unit 21 of the information input device 2 receives an operation from the user requesting meeting information.
[0051] Step S41: The communication unit 10 of the information input device 2 sends a request to the communication unit 35 of the conference management device 4 to acquire conference information.
[0052] Step S42: The communication unit 35 of the conference management device 4 transmits the conference information stored in the storage unit 37 of the conference management device 4 to the communication unit 10 of the information input device 2. Figure 6 is a diagram showing an example of conference information according to an embodiment of the present invention. The conference information 90 in Figure 6 has the following items: "Conference ID", "Conference Name", "Organizer", "Start Date and Time", "End Date and Time", "Expected Participating Users", "Participating Devices", and "Currently Participating Users".
[0053] The "Meeting ID" is an identifier used to identify a meeting.
[0054] "Meeting name" is the name of the meeting.
[0055] "Organizer" is the username of the person who organized the meeting.
[0056] "Start date and time" is the scheduled date and time for the meeting to begin.
[0057] "End date and time" is the scheduled date and time for the meeting to end.
[0058] "Scheduled participants" refers to the usernames of users who are scheduled to attend the meeting.
[0059] "Participating devices" refer to the names of devices used in the meeting, such as information input device 2 and terminal device 5. For information input devices 2, such as electronic whiteboards, information about the setting location, such as the meeting room name, is also included.
[0060] "Participating Users" refers to the usernames of users currently participating in the meeting. For example, in a meeting with "Meeting ID" "001," the "Participating Users" are users A, B, and C participating via electronic whiteboard M, and user D participating via terminal X. The usernames in the "Organizer," "Participating Users," and "Participating Users" fields may also be identifiers that identify the user (user IDs), or they may include both usernames and user IDs. Alternatively, other information (user information) showing the relationship between usernames and user IDs may be stored and used separately from the meeting information 90. Similarly, the "Participating Devices" field may use device names and identifiers that identify the devices (device IDs). Let's return to Figure 5 for further explanation.
[0061] Step S43: The display control unit 20 of the information input device 2 displays a meeting selection screen on the screen (display 280) of the information input device 2 based on the meeting information received by the communication unit 10 of the information input device 2. Figure 7 is a diagram showing an example of a meeting selection screen according to an embodiment of the present invention. The meeting selection screen 91 in Figure 7 displays the contents of "Date and Time" and "Meeting Name," which are items of the meeting information 90 in Figure 6, as meetings that the user can select, and a meeting selection button 92 is displayed to the right of the contents of "Meeting Name" for the user to press when selecting a meeting. Let's return to Figure 5 for explanation.
[0062] Step S44: The operation reception unit 21 of the information input device 2 receives the user's operation to select a meeting (the operation of pressing the meeting selection button 92 in Figure 6).
[0063] Step S45: The display control unit 20 of the information input device 2 displays meeting information for the selected meeting on the screen (display 280) of the information input device 2, based on the user's meeting selection result and meeting information. Figure 8 is a diagram showing an example of a meeting information display screen according to an embodiment of the present invention. The meeting information display screen 93 in Figure 8 displays the contents for the items "Meeting Name," "Organizer," "Date and Time," "Participating Device," and "Scheduled Participating Users" for the meeting selected by the user, as well as a meeting participation button 94 that the user presses when requesting to join the meeting. Let's return to Figure 5 for explanation.
[0064] Step S46: The operation reception unit 21 of the information input device 2 receives an operation by the user requesting to join a meeting (the operation of pressing the meeting participation button 94 in Figure 8).
[0065] Step S47: The display control unit 20 of the information input device 2 displays a participant selection screen on the screen (display 280) of the information input device 2 for selecting users to participate in the meeting. Figure 9 is a diagram showing an example of a participant selection screen according to an embodiment of the present invention. The participant selection screen 95 in Figure 9 displays the names of users scheduled to participate in the meeting, participant selection buttons 96 for selecting participants to join the meeting, and a confirmation button 97 to be pressed when confirming the selection of participants to join the meeting.
[0066] Here, the display control unit 20 may remove (exclude) the usernames of users who are already participating in the meeting from the list of users scheduled to participate in the meeting displayed on the participant selection screen 95. This reduces the number of participants displayed on the screen, making it easier to select participants.
[0067] Furthermore, the display control unit 20 may display only the usernames of participants that have been set to be selectable as participants in the meeting on the participant selection screen 95. To this end, the participant setting unit 16 of the information input device 2 sets in advance whether or not each user scheduled to participate in the meeting is selectable as a participant (i.e., whether or not their username can be displayed on the participant selection screen 95). This setting by the participant setting unit 16 may be done when creating meeting information (when determining the date and time of the meeting and the participants). Alternatively, instead of the user operating the information input device 2 to make the setting, the user may operate the terminal device 5 in the same manner to make the setting. This prevents a user who selects participants by operating the information input device 2 from falsely selecting a user who will not actually be participating in the meeting. Let's return to Figure 5 for further explanation.
[0068] Step S48: The participant user reception unit 11 of the information input device 2 receives the user's operation to select participants to join the meeting (the operation of pressing the participant user selection button 96 in Figure 9) and the operation to confirm the selection of participants (the operation of pressing the confirmation button 97 in Figure 9).
[0069] Step S49: The participant user storage unit 12 of the information input device 2 stores information about the participant user selected in step S48 in the storage unit 22 of the information input device 2. The participant user storage unit 12 stores the updated meeting information 90 in the storage unit 22, for example, by adding at least one of the username and user ID of the participant user selected in step S48 to the contents of the "Participating Users" item of the meeting information 90 in Figure 6.
[0070] Step S50: The communication unit 10 of the information input device 2 sends a request to update the meeting information (meeting information update request) to the communication unit 35 of the meeting management device 4, which includes information about the participating users selected in step S48 (user name, user ID, etc.).
[0071] Step S51: The display control unit 20 of the information input device 2 displays a meeting screen on the screen (display 280) of the information input device 2 for displaying materials to be shared in the meeting.
[0072] Step S52: The management unit 36 of the conference management device 4 updates the conference information stored in the storage unit 37 of the conference management device 4 based on the conference information update request received by the communication unit 35 of the conference management device 4 in step S50. The management unit 36 stores the updated conference information 90 in the storage unit 37 by, for example, adding at least one of the usernames and user IDs of the participating users included in the conference information update request to the contents of the "Participating Users" item of the conference information 90 in Figure 6.
[0073] Step S53: The communication unit 35 of the conference management device 4 sends a conference information update notification (user name, user ID, etc.) containing information about the participating users selected in step S48 to the communication unit 30 of the terminal device 5.
[0074] Step S54: The control unit 33 of the terminal device 5 updates the list of participating users stored in the storage unit 34 of the terminal device 5 based on the conference information update request received by the communication unit 30 of the terminal device 5 in step S53. The control unit 33 updates the list of participating users by, for example, adding at least one of the username and user ID of the participating users included in the conference information update request.
[0075] Through the above process, the information input system 1 can recognize users participating in a meeting via the information input device 2, such as an electronic whiteboard. This is because the information input device 2 accepts an operation to select a participant to join the meeting via the information input device 2, stores information about the participant in the storage unit 22, and transmits it to the terminal device 5 via the meeting management device 4.
[0076] <Process for displaying the username of the user entering information> Figure 10 shows an example of a sequence for displaying the username of a user who inputs information according to an embodiment of the present invention. In this sequence, the information input device 2 receives an operation to select an input user from among the participating users to input information into the information input device 2, and transmits the input information entered by the input user and information about the input user to the terminal device 5 via the conference management device 4. The processing of each step in Figure 10 will be described below.
[0077] Step S60: The operation reception unit 21 of the information input device 2 receives an operation to display an input user selection screen (input user selection screen) for the user to select a user to input information.
[0078] Step S61: The display control unit 20 of the information input device 2 displays the input user selection screen on the screen (display 280) of the information input device 2 based on the meeting information stored in the storage unit 22 of the information input device 2. As explained in the meeting participation process by sequence in Figure 5, the storage unit 22 of the information input device 2 stores meeting information including information about participating users (user name, user ID, etc.). On the input user selection screen, the input users that can be selected are the same as the users currently participating in the meeting (participating users). Figure 11 is a diagram showing an example of the input user selection screen according to an embodiment of the present invention. The input user selection screen 98 in Figure 11 displays the usernames of the input user selection candidates, an input user selection button 99 for selecting an input user, and a confirmation button 100 to be pressed when confirming the selection of an input user.
[0079] Here, the display control unit 20 may display only the usernames of participating users who have been set to be selectable as input users to input information into the information input device 2 on the input user selection screen 98. To this end, the input user setting unit 17 of the information input device 2 sets in advance whether or not each user scheduled to participate in the meeting is selectable as an input user to input information into the information input device 2 (i.e., whether or not their username can be displayed on the input user selection screen 98). This setting by the input user setting unit 17 may be done when creating meeting information (when deciding on the date and time of the meeting and the participants). Alternatively, instead of the user operating the information input device 2 to make the setting, the user may operate the terminal device 5 in the same manner to make the setting. This prevents the user selecting an input user to input information from falsely selecting a user who will not actually input information. Let's return to Figure 10 for further explanation.
[0080] Step S62: The input user reception unit 13 of the information input device 2 accepts an operation by the user operating the information input device 2 to select a user (input user) from among the participating users to input information into the information input device 2.
[0081] Step S63: The input user storage unit 14 of the information input device 2 stores information about the input user selected in step S62 (such as user ID and username) in the storage unit 22 of the information input device 2.
[0082] Step S64: The operation reception unit 21 of the information input device 2 receives information to be entered by the input user selected in step S62. For example, the operation reception unit 21 receives stroke information entered by the input user on the screen (display 280) of the information input device 2 using their hand or a dedicated electronic pen as input information.
[0083] Step S65: The input information transmission unit 15 of the information input device 2 transmits the input information entered by the input user in step S64, along with user information including the input user's username, to the communication unit 35 of the conference management device 4.
[0084] Step S66: The communication unit 35 of the conference management device 4 transmits the received input information and user information to the communication unit 30 of the terminal device 5.
[0085] Step S67: The terminal display control unit 31 of the terminal device 5 displays the input information received by the communication unit 30 of the terminal device 5 in step S66 on the screen (display 506) of the terminal device 5.
[0086] Step S68: The terminal display control unit 31 of the terminal device 5 displays the username of the input user who entered the input information on the screen (display 506) of the terminal device 5, based on the user information received by the communication unit 30 of the terminal device 5 in step S66. The terminal display control unit 31 displays the username inside a speech bubble attached to the displayed input information, for example, to indicate that the input information was entered by the input user. Figure 12 is a diagram showing an example of a screen displaying the username of the user who entered the information according to an embodiment of the present invention. The display screen 101 in Figure 12 displays an input information object 102 that displays the input information entered by the input user and a username display object 103 that displays the username of the user who entered the input information. The username display object 103 is in the shape of a speech bubble attached to the input information object 102, and inside the speech bubble, the username of the user who entered the input information (User A) and information indicating the location of the information input device 2 (Conference Room P) are displayed.
[0087] Through the above process, the information input system 1 can recognize users participating in a meeting via an information input device 2, such as an electronic whiteboard, and display the usernames of users who have entered information into the information input device 2 on the screen of a terminal device 5 located at a remote site. This is because the information input device 2 accepts an operation to select an input user from among the participants in the meeting, and transmits the input information entered by the input user, along with user information including the input user's username, to the terminal device 5 via the meeting management device 4.
[0088] <Adding and removing participating users> Figure 13 shows an example of a sequence for adding and deleting participating users according to an embodiment of the present invention. In this sequence, the information input device 2 receives operations from a user to add and delete participating users to a meeting, and transmits updated meeting information, including information about the added and deleted participating users, to the terminal device 5 via the meeting management device 4. Note that only adding or deleting participating users may be performed. The processing of each step in Figure 13 will be described below.
[0089] Step S70: The operation reception unit 21 of the information input device 2 receives an operation from the user requesting the addition or deletion of users (participating users) to join the meeting.
[0090] Step S71: The display control unit 20 of the information input device 2 displays the participant user selection screen 95 shown in Figure 9 on the screen (display 280) of the information input device 2, based on the meeting information stored in the storage unit 22 of the information input device 2. Here, the information input device 2 stores meeting information, including information about participating users, in the storage unit 22, as explained in the meeting participation processing sequence in Figure 5.
[0091] Furthermore, the display control unit 20 may remove (exclude) the usernames of users who are already participating in the meeting from the list of users scheduled to participate in the meeting displayed on the participant selection screen 95. This reduces the number of participants displayed on the screen, making it easier to select participants.
[0092] Furthermore, the display control unit 20 may also display only the usernames of participants that have been set to be selectable as participants in the meeting on the participant selection screen 95. To this end, the participant setting unit 16 of the information input device 2 sets in advance whether or not each user scheduled to participate in the meeting is selectable as a participant (i.e., whether or not their username can be displayed on the participant selection screen 95). This prevents a user who operates the information input device 2 to select participants from falsely selecting users who will not actually be participating in the meeting.
[0093] Step S72: The operation reception unit 21 of the information input device 2 receives operations by the user to add and remove participants to the meeting (operations of pressing the participant selection button 96 in Figure 9 corresponding to the participant to be added or removed). That is, if the operation reception unit 21 receives a press of the participant selection button 96 for a participant who has not been selected, the corresponding user is added as a participant. Also, if the operation reception unit 21 receives a press of the participant selection button 96 for a participant who has already been selected, the corresponding user is removed from the list of participants. Furthermore, the operation reception unit 21 receives an operation to confirm the addition and removal of participants (operations of pressing the confirmation button 97 in Figure 9).
[0094] Step S73: The participant user storage unit 12 of the information input device 2 stores information about the participant users added and deleted in step S72 in the storage unit 22 of the information input device 2. For example, the participant user storage unit 12 stores the updated meeting information 90 in the storage unit 22 by adding at least one of the username and user ID of the participant user added in step S72 to the contents of the "Participating Users" item of the meeting information 90 in Figure 6. Alternatively, the participant user storage unit 12 stores the updated meeting information 90 in the storage unit 22 by deleting at least one of the username and user ID of the participant user deleted in step S72 from the contents of the "Participating Users" item of the meeting information 90 in Figure 6.
[0095] Step S74: The communication unit 10 of the information input device 2 sends a request to the communication unit 35 of the conference management device 4 to update the conference information (conference information update request), which includes information about the participant users finally selected by the addition and deletion of participant users in step S72 (user name, user ID, etc.). Alternatively, the conference information update request may include information about the added participant users and information about the deleted participant users.
[0096] Step S75: The management unit 36 of the conference management device 4 updates the conference information stored in the storage unit 37 of the conference management device 4 based on the conference information update request received by the communication unit 35 of the conference management device 4 in step S74. The management unit 36 stores the updated conference information 90 in the storage unit 37 by, for example, adding or deleting at least one of the usernames and user IDs of the added and deleted participating users included in the conference information update request to the contents of the "Participating Users" item of the conference information 90 in Figure 6.
[0097] Step S76: The communication unit 35 of the conference management device 4 sends a conference information update notification to the communication unit 30 of the terminal device 5, which includes information about the participating users that were added and removed in step S72.
[0098] Step S77: The control unit 33 of the terminal device 5 updates the list of participating users stored in the storage unit 34 of the terminal device 5 based on the conference information update request received by the communication unit 30 of the terminal device 5 in step S76. The control unit 33 updates the list of participating users by, for example, adding and deleting at least one of the usernames and user IDs of the added and deleted participating users included in the conference information update request.
[0099] Through the above process, the information input system 1 makes it possible to add and remove users (participating users) who join a meeting (at the start of the meeting) via an information input device 2 such as an electronic whiteboard, not only when joining the meeting but also during the meeting.
[0100] <Processing to detect changes in the user entering information> Figure 14 is a diagram showing an example of a flowchart relating to the process for determining a change in the user inputting information according to an embodiment of the present invention. In this flowchart, the information input device 2 determines whether the user inputting information to the information input device 2 has changed, based on the start time and end time of the information input performed to the information input device 2. The processing of each step in Figure 14 will be described below.
[0101] Step S80: The input time detection unit 18 of the information input device 2 detects the end time of the information input performed on the information input device 2. The input time detection unit 18 considers, for example, the time when the input user's hand or electronic pen leaves the screen as the end time of the information input. However, if the time from when the input user's hand or electronic pen leaves the screen until it touches the screen again is within a predetermined period of time, the current information input may be considered to be continuing. That is, if the time from when the hand or electronic pen leaves the screen until it touches the screen again is greater than or equal to a predetermined period of time, the time when the hand or electronic pen leaves the screen is considered the end time.
[0102] Step S81: The input time detection unit 18 of the information input device 2 detects the start time of the information input that will follow the information input performed in step S80. For example, after detecting the end time of the information input in step S80, the input time detection unit 18 sets the time when the input user's hand or electronic pen touches the screen as the start time of the next information input.
[0103] Step S82: The input user determination unit 19 of the information input device 2 calculates the difference (referred to as the information input interval) between the end time of the information input detected in step S80 and the start time of the next information input detected in step S81. If the information input interval is greater than or equal to a predetermined time, the input user determination unit 19 transitions the process to step S83; otherwise, it transitions the process to step S84.
[0104] Step S83: The input user determination unit 19 of the information input device 2 determines that the input user who inputs information into the information input device 2 has changed to another user, and then proceeds to step S85.
[0105] Step S84: The input user determination unit 19 of the information input device 2 terminates the change determination process according to this flowchart after determining that the input user who inputs information into the information input device 2 has not made any changes.
[0106] Step S85: The display control unit 20 of the information input device 2 displays the input user selection screen on the screen (display 280) of the information input device 2.
[0107] Step S86: The input user reception unit 13 of the information input device 2 accepts an operation to select a different user as the input user to input information into the information input device 2.
[0108] Step S87: The input user storage unit 14 of the information input device 2 stores user information about another user selected in step S86 in the storage unit 22 of the information input device 2 as information of the input user (user name, user ID, etc.) that inputs information to the information input device 2.
[0109] Step S88: The input information transmission unit 15 of the information input device 2 transmits the input information entered into the information input device 2 and information about the user who entered the input information (user name, user ID, etc.) to the communication unit 35 of the conference management device 4. The communication unit 35 of the conference management device 4 transmits the received input information and information about the user who entered the input information (user name, user ID, etc.) to the communication unit 30 of the terminal device 5.
[0110] Step S89: The terminal display control unit 31 of the terminal device 5 displays the input information received by the communication unit 30 of the terminal device 5 and information about the input user who entered the input information (user name, user ID, etc.) on the screen (display 506) of the terminal device 5. Figure 15 is a diagram showing an example of a screen that displays the username of a changed input user according to an embodiment of the present invention. The display screen 104 in Figure 15 displays an input information display object 105 that displays the input information entered by the changed input user (another user) and a username display object 106 that displays the username of the changed user (another user) who entered the input information. The username display object 106 is in the shape of a speech bubble attached to the input information display object 105, and inside the speech bubble, the username of the user (user B) of the user (another user) who entered the changed input information and information indicating the location of the information input device 2 (conference room P) are displayed.
[0111] Through the above process, the information input system 1 can detect when the user inputting information into the information input device 2, such as an electronic whiteboard, changes to another user, and automatically display the input user selection screen on the screen of the information input device 2. This eliminates the need for the user operating the information input device 2 to perform an operation to request the display of the input user selection screen when the user inputting information into the information input device 2 changes.
[0112] Although several embodiments for carrying out the present invention have been described above, the present invention is not limited in any way to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the present invention.
[0113] For example, the example of the functional block configuration diagram in Figure 4 is divided according to its main function to facilitate understanding of the processing performed by the information input system 1, information input device 2, conference management device 4, and terminal device 5. The present invention is not limited by the way the processing units are divided or the names of those units. The processing in the information input system 1, information input device 2, conference management device 4, and terminal device 5 can be further divided into more processing units depending on the processing content. Furthermore, a single processing unit can be divided to include even more processing.
[0114] Furthermore, each function of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules designed to execute each of the functions described above.
[0115] Furthermore, the described apparatus represents only one of several computing environments for carrying out the embodiments disclosed herein. In one embodiment, the information input system 1, information input device 2, conference management device 4, and terminal device 5 include multiple computing devices such as a server cluster. The multiple computing devices are configured to communicate with each other via any type of communication link, including networks and shared memory, and to perform the processing disclosed herein.
[0116] Examples of the present invention are as follows: <1> An information input system comprising an information input device and a terminal device that can communicate with a conference management device, wherein the information input device comprises: a participant user reception unit that accepts an operation to select a participant user to participate in the conference from among users scheduled to participate in the conference via the information input device; a participant user storage unit that stores information about the participant user in a storage unit; a display control unit that displays an input user selection screen on the screen of the information input device for selecting an input user to input information into the information input device from among the participant users; an input user reception unit that accepts an operation to select the input user on the input user selection screen; an input user storage unit that stores information about the input user in a storage unit; and an input information transmission unit that transmits input information entered by the input user and user information including the username of the input user to the conference management device, and the terminal device comprises a terminal display control unit that displays the input information and the username of the input user on the screen of the terminal device to indicate that the input information was entered by the input user, based on the input information and user information received from the conference management device. <2> The information input device further includes a display control unit that, when selecting a participant user, displays the usernames of users excluding those already participating in the meeting on the screen of the information input device. <1> This is the information input system described in [the document]. <3> The aforementioned participant user reception unit accepts operations to add and remove the aforementioned participant users. <1> or the above <2> This is the information input system described in [the document]. <4> At least one of the information input device and the terminal device further includes a participant user setting unit that sets whether or not each user scheduled to participate in the meeting can be selected as a participant user. <1> or the above <3> It is an information input system described in one of the following. <5> At least one of the information input device and the terminal device further includes an input user setting unit that sets whether or not each user scheduled to participate in the meeting can be selected as the input user. <1> or the above <4> It is an information input system described in one of the following. <6> The information input device further comprises: an input time detection unit that detects the start and end times of input for each piece of input information; an input user determination unit that detects that the input user has changed to another user based on the difference between the end time of the input information and the start time of the next piece of input information entered after the input information; when the input user determination unit determines that the input user has changed to another user, the display control unit displays the input user selection screen on the screen of the information input device; the input user reception unit accepts an operation to select the other user as the input user on the input user selection screen; the input user storage unit stores information about the other user in its storage unit; the input information transmission unit transmits information including the input information and the username of the other user to the conference management device; and the terminal display control unit of the terminal device displays the input information and the username of the other user on the screen to indicate that the input information was entered by the other user, based on the information including the input information and the username of the other user received from the conference management device. <1> or the above <5> It is an information input system described in one of the following. [Explanation of symbols]
[0117] 1. Information Input System 2. Information input device 3. Communication Network 4. Conference Management System 5 Terminal devices 10 Communications Department 11. Participant Registration Department 12 Participating User Memory Unit 13 Input User Reception Section 14 Input User Storage Unit 15 Input Information Transmission Unit 16. Participant User Settings Section 17 Input User Settings Section 18 Input time detection unit 19 Input User Determination Unit 20 Display Control Unit 21 Operation Reception Section 22 Memory section 30 Communications Department 31 Terminal Display Control Unit 32 Operation reception unit 33 Control Unit 34 Storage section 35 Communications Department 36 Management Department 37 Memory section [Prior art documents] [Patent Documents]
[0118] [Patent Document 1] Japanese Patent Publication No. 2020-194371
Claims
1. An information input system comprising an information input device and a terminal device that can communicate with a conference management device, The aforementioned information input device is A participant registration unit that accepts the operation of selecting participants from among the users scheduled to participate in the meeting via the information input device, A participant user storage unit that stores information about the aforementioned participant user in a storage unit, A display control unit that displays an input user selection screen on the screen of the information input device for selecting an input user from among the participating users to input information into the information input device, The input user selection screen includes an input user reception unit that accepts the operation to select the input user, An input user storage unit that stores information about the input user in the storage unit, An input information transmission unit transmits user information, including the input information entered by the input user and the username of the input user, to the conference management device. Equipped with, The aforementioned terminal device is A terminal display control unit, which, based on the input information and user information received from the conference management device, displays the input information and the username of the input user on the screen of the terminal device to indicate that the input information was entered by the input user, An information input system equipped with the following features.
2. The information input system according to claim 1, wherein the display control unit, when selecting a participant user, displays the usernames of users excluding users who are already participating in the meeting on the screen of the information input device.
3. The information input system according to claim 1 or claim 2, wherein the participant user reception unit accepts operations to add and delete the participant users.
4. At least one of the information input device and the terminal device is The information input system according to claim 1, further comprising a participant user setting unit that sets whether or not each user scheduled to participate in the aforementioned meeting is eligible to be selected as a participant user.
5. At least one of the information input device and the terminal device is The information input system according to claim 1, further comprising an input user setting unit that sets whether or not each user scheduled to participate in the aforementioned meeting can be selected as an input user.
6. The aforementioned information input device is An input time detection unit detects the start and end times of each input piece of information, An input user determination unit detects that the input user has changed to another user based on the difference between the end time of the input information and the start time of the input information that was input after the input information, Furthermore, If the input user determination unit determines that the input user has changed to another user, The display control unit causes the input user selection screen to be displayed on the screen of the information input device. The input user reception unit receives an operation to select the other user as the input user on the input user selection screen. The input user storage unit causes the storage unit to store information about the other user, The input information transmission unit transmits the input information and information including the username of the other user to the conference management device. The information input system according to claim 1, wherein the terminal display control unit of the terminal device displays the input information and the username of the other user on the screen to indicate that the input information was entered by the other user, based on information received from the conference management device, which includes the input information and the username of the other user.
7. An information input device in an information input system comprising an information input device and a terminal device that can communicate with a conference management device, A participant registration unit that accepts the operation of selecting participants from among the users scheduled to participate in the meeting via the information input device, A participant user storage unit that stores information about the aforementioned participant user in a storage unit, A display control unit that displays an input user selection screen on the screen of the information input device for selecting an input user from among the participating users to input information into the information input device, The input user selection screen includes an input user reception unit that accepts the operation to select the input user, An input user storage unit that stores information about the input user in the storage unit, An input information transmission unit transmits user information, including the input information entered by the input user and the username of the input user, to the conference management device. An information input device equipped with the following features.
8. An information input method performed by an information input system comprising an information input device and a terminal device that can communicate with a conference management device, A participant registration step that accepts the operation of selecting participants from among the users scheduled to participate in the meeting via the information input device, A participant user storage step involves storing information about the aforementioned participant user in a storage unit, A display control step that displays an input user selection screen on the screen of the information input device for selecting an input user from among the participating users to input information into the information input device, The input user selection screen includes an input user reception step that accepts an operation to select the input user, An input user storage step involves storing information about the input user in the storage unit, An input information transmission step of transmitting input information entered by the input user and user information including the username of the input user to the conference management device, A display control step that, based on the input information and the user information, displays the input information and the username of the input user on the screen of the terminal device to indicate that the input information was entered by the input user, An information input method that includes the following features.
9. An information input system equipped with an information input device and a terminal device that can communicate with a conference management device, A participant registration step that accepts the operation of selecting participants from among the users scheduled to participate in the meeting via the information input device, Participant user storage step, which involves storing information about the aforementioned participating users in a storage unit, A display control step that displays an input user selection screen on the screen of the information input device for selecting an input user from among the participating users to input information into the information input device, In the input user selection screen, an input user reception step accepts an operation to select the input user. An input user storage step involves storing information about the input user in a storage unit. An input information transmission step that transmits user information, including the input information entered by the input user and the username of the input user, to the conference management device. A display control step in which, based on the input information and the user information, the input information and the username of the input user are displayed on the screen of the terminal device to indicate that the input information was entered by the input user. A program that executes the command.
Citation Information
Patent Citations
Electronic conference display system
JP1995284076A
Remote conference system, shared work space server, and remote conference method and program
JP2006005590A
Electronic board system
JP2009053956A
Communication terminal, sharing system, communication method, and program
JP2019192226A
Information processing device, information processing system, information processing method, and program
JP2020194371A
