Conference support device, conference support system, conference support method, and program

Abstract

The purpose is to prevent the leakage of meeting contents. [Solution] A meeting support device connected to a decision support system that presents support information to assist participants in a meeting in making decisions, comprising: an input receiving means for receiving voice input from a meeting participant or handwritten text input from a meeting participant; a transmission eligibility determination means for determining whether or not to transmit text data representing the voice or handwritten text received by the input receiving means to the decision support system; a transmission means for transmitting the text data if the transmission eligibility determination means determines to transmit the text data to the decision support system; and a display means for displaying the support information transmitted from the decision support system in response to the transmission of the text data by the transmission means.

Description

Technical Field

[0001] The present invention relates to a meeting support device, a meeting support system, a meeting support method, and a program.

Background Art

[0002] Decision support systems that are used for the management, operation, planning, etc. of an organization and support decision-making, such as in a meeting body, have been conventionally known. In recent years, services (decision support services) using such decision support systems have come to be provided as cloud-based services.

[0003] Also, an electronic blackboard device that can input handwritten characters, etc. using an electronic pen, etc. on a touch panel is known (see, for example, Patent Document 1). Such an electronic blackboard device is used, for example, to record the speech content, agenda content, etc. in a meeting.

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, for example, by transmitting the meeting content such as the speech content and agenda content input to the electronic blackboard device to a decision support service, the decision-making of a meeting body, etc. can be supported.

[0005] However, by transmitting the meeting content input to the electronic blackboard device to a decision support service, there is a possibility that, for example, confidential information included in the meeting content may be leaked.

[0006] One embodiment of the present invention has been made in view of the above points, and an object thereof is to prevent the leakage of meeting content.

Means for Solving the Problems

[0007] To achieve the above objective, one embodiment of the present invention is a conference support device connected to a decision support system that presents support information to assist participants in a conference in making decisions, comprising: an input receiving means for receiving voice input from a conference participant or handwritten text input from a conference participant; a transmission eligibility determination means for determining whether or not to transmit text data representing the voice or handwritten text received by the input receiving means to the decision support system; a transmission means for transmitting the text data if the transmission eligibility determination means determines to transmit the text data to the decision support system; and a display means for displaying the support information transmitted from the decision support system in response to the transmission of the text data by the transmission means. [Effects of the Invention]

[0008] According to one embodiment of the present invention, it is possible to prevent the leakage of meeting contents. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows the system configuration of an example of an electronic whiteboard system according to the first embodiment. [Figure 2] This figure shows the hardware configuration of an example of an electronic whiteboard device according to the first embodiment. [Figure 3] This figure shows the hardware configuration of an example of a character conversion device according to the first embodiment. [Figure 4] This figure shows the functional configuration of an example of an electronic whiteboard system according to the first embodiment. [Figure 5] This is a sequence diagram showing an example of the input process for handwritten characters according to the first embodiment. [Figure 6] This figure shows an example of information regarding whether or not transmission is permitted. [Figure 7] This figure shows an example of a screen displaying decision support information. [Figure 8] This figure shows an example of a screen displaying an icon indicating that the meeting content will not be sent. [Figure 9]It is a sequence diagram showing an example of voice input processing according to the first embodiment. [Figure 10] It is a diagram showing an example of a screen on which information indicating that text conversion of voice cannot be performed is displayed. [Figure 11] It is a sequence diagram showing another example of voice input processing according to the first embodiment. [Figure 12] It is a diagram showing a functional configuration example of an electronic blackboard system according to the second embodiment. [Figure 13] It is a sequence diagram showing an example of handwriting character input processing according to the second embodiment. [Figure 14] It is a diagram showing an example of a screen for selecting whether to transmit the meeting content. [Figure 15] It is a sequence diagram showing an example of voice input processing according to the second embodiment. [Figure 16] It is a diagram showing a functional configuration example of an electronic blackboard system according to the third embodiment. [Figure 17] It is a sequence diagram showing an example of handwriting character input processing according to the third embodiment. [Figure 18] It is a diagram showing an example of a screen for selecting whether to cancel the transmission of the meeting content. [Figure 19] It is a sequence diagram showing an example of voice input processing according to the third embodiment. [Figure 20] It is a diagram showing a functional configuration example of an electronic blackboard device according to the fourth embodiment. [Figure 21] It is a diagram showing an example of confidential word information. [Figure 22] It is a sequence diagram showing an example of handwriting character input processing according to the fourth embodiment. [Figure 23] It is a sequence diagram showing an example of voice input processing according to the fourth embodiment.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0011] [First Embodiment] <System Configuration> First, the system configuration of the electronic blackboard system 1 according to this embodiment will be described while referring to FIG. 1. FIG. 1 is a diagram showing an example of the system configuration of the electronic blackboard system 1 according to this embodiment.

[0012] As shown in FIG. 1, the electronic blackboard system 1 according to this embodiment includes an electronic blackboard device 10 and a character conversion device 20. Further, the electronic blackboard system 1 according to this embodiment is communicably connected to a voice conversion service 30 and a decision-making support service 40 via a wide-area network N1 such as the Internet.

[0013] The electronic blackboard device 10 is a device that is used, for example, in meetings, classes, etc., and can display electronic files, etc. on a display, and can perform handwritten character input using an electronic pen, etc., and sound collection (input) of voice using a microphone. Such an electronic blackboard device 10 is also referred to as an Interactive Whiteboard (IWB).

[0014] In addition, the electronic blackboard device 10 displays various information provided from the decision-making support service 40 (that is, for example, various information for supporting the decision-making of the meeting body in a meeting using the electronic blackboard device 10) on the display.

[0015] The character conversion device 20 is an information processing device that converts data (handwritten character data) indicating handwritten characters input to the electronic blackboard device 10 into text data using technologies such as character recognition.

[0016] Note that the electronic blackboard device 10 and the character conversion device 20 are communicably connected via a network such as an in-house LAN (Local Area Network). However, the electronic blackboard device 10 and the character conversion device 20 may be communicably connected via the network N1, for example.

[0017] The voice conversion service 30 is an external system or device that provides a service for converting voice data (voice data) input to the electronic whiteboard device 10 into text data, for example, using a technology such as speech recognition.

[0018] The decision support service 40 is an external system or device that provides services to support user decision-making using technologies such as artificial intelligence (AI) or intelligent agents (IA). Specifically, the decision support service 40 provides the electronic whiteboard device 10 with various information to support decision-making in a meeting, for example, based on text data received from the character conversion device 20 or the voice conversion service 30.

[0019] In this embodiment, the voice conversion service 30 and the decision support service 40 are cloud-based external services. However, the voice conversion service 30 and the decision support service 40 are not limited to these, and may be services provided by an ASP (Application Service Provider) or web services, for example.

[0020] Furthermore, the electronic whiteboard system 1 shown in Figure 1 is just one example, and other configurations are possible. For example, the character conversion device 20 may be included in the electronic whiteboard device 10. In this case, the electronic whiteboard device 10 converts handwritten character data into text data. Alternatively, for example, the voice conversion service 30 may be included in the electronic whiteboard system 1, or the character conversion device 20 may be an external device that provides a cloud-based character conversion service.

[0021] <Hardware Configuration> Next, the hardware configuration of the electronic whiteboard device 10 according to this embodiment will be described with reference to Figure 2. Figure 2 is a diagram showing the hardware configuration of an example of the electronic whiteboard device 10 according to this embodiment.

[0022] As shown in Figure 2, the electronic whiteboard device 10 according to this embodiment includes an input device 11, a display device 12, an external interface 13, a communication interface 14, and a ROM 15 (Read Only Memory). Furthermore, the electronic whiteboard device 10 according to this embodiment includes a RAM (Random Access Memory) 16, a CPU (Central Processing Unit) 17, an HDD (Hard Disk Drive) 18, and a sound collection device 19. Each of these hardware components is connected via bus B1.

[0023] The input device 11 is a touch panel or the like, and is used to input various operations by the user (for example, inputting handwritten characters). The display device 12 is a display or the like, and displays various information (for example, handwritten characters, various texts, various icons, etc.).

[0024] External I / F 13 is an interface to an external device. An external device could be a recording medium 13a, for example. This allows the electronic whiteboard device 10 to read from and write to the recording medium 13a via the external I / F 13. The recording medium 13a could be, for example, a USB memory stick, CD, DVD, or SD memory card.

[0025] The communication interface 14 is an interface for connecting the electronic whiteboard device 10 to a network N1 or the like. This allows the electronic whiteboard device 10 to communicate with other devices (for example, a character conversion device 20 or a voice conversion service 30) via the communication interface 14.

[0026] HDD18 is a non-volatile storage device that stores programs and data. The programs and data stored in HDD18 include the OS (Operating System), which is the basic software that controls the entire electronic whiteboard device 10, and application programs that provide various functions on the OS.

[0027] Furthermore, the HDD18 manages the programs and data it stores using a predetermined file system and / or database (DB). The electronic whiteboard device 10 may also have a drive device that uses flash memory as a storage medium (e.g., a solid-state drive: SSD) instead of the HDD18.

[0028] ROM15 is a non-volatile semiconductor memory that can retain programs and data even when the power is turned off. ROM15 stores programs and data such as the BIOS (Basic Input / Output System), OS settings, and network settings that are executed when the electronic whiteboard device 10 starts up. RAM16 is a volatile semiconductor memory that temporarily holds programs and data.

[0029] The CPU 17 is a computing unit that controls and implements the functions of the entire electronic whiteboard device 10 by reading programs and data from storage devices such as ROM 15 and HDD 18 onto RAM 16 and executing processing.

[0030] The sound collection device 19 is, for example, a microphone, and collects sounds from the surrounding area of ​​the electronic whiteboard device 10.

[0031] The electronic whiteboard device 10 according to this embodiment has the hardware configuration shown in Figure 2, which enables various processes as described later.

[0032] Next, the hardware configuration of the character conversion device 20 according to this embodiment will be described with reference to Figure 3. Figure 3 is a diagram showing the hardware configuration of an example of the character conversion device 20 according to this embodiment.

[0033] As shown in Figure 3, the character conversion device 20 according to this embodiment includes an input device 21, a display device 22, an external I / F 23, and a communication I / F 24. Furthermore, the character conversion device 20 according to this embodiment includes a ROM 25, a RAM 26, a CPU 27, and an HDD 28. Each of these hardware components is connected via bus B2.

[0034] The input device 21 is a keyboard, mouse, touch panel, etc., and is used to input various operations by the user. The display device 22 is a display, etc., and displays various information. The character conversion device 20 may also be used by connecting at least one of the input device 21 and the display device 22 to bus B2 when necessary.

[0035] External I / F 23 is an interface to an external device. An external device could be a recording medium 23a, for example. This allows the character conversion device 20 to read from and write to the recording medium 23a via the external I / F 23. The recording medium 23a could be, for example, a USB memory stick, CD, DVD, or SD memory card.

[0036] The communication interface 24 is an interface for connecting the character conversion device 20 to the network N1, etc. This allows the character conversion device 20 to communicate with other devices (for example, the electronic whiteboard device 10 or the decision support service 40, etc.) via the communication interface 24.

[0037] HDD28 is a non-volatile storage device that stores programs and data. The programs and data stored in HDD28 include the OS, which is the basic software that controls the entire character conversion device 20, and application programs that provide various functions on the OS.

[0038] Furthermore, the HDD28 manages the programs and data it stores using a predetermined file system and / or database (DB). The character conversion device 20 may also have a drive device that uses flash memory as its storage medium (e.g., a solid-state drive: SSD) instead of the HDD28.

[0039] ROM25 is a non-volatile semiconductor memory that can retain programs and data even when the power is turned off. ROM25 stores programs and data such as the BIOS, OS settings, and network settings that are executed when the electronic whiteboard device 10 starts up. RAM26 is a volatile semiconductor memory that temporarily holds programs and data.

[0040] The CPU 27 is an arithmetic unit that controls and implements the functions of the entire character conversion device 20 by reading programs and data from storage devices such as ROM 25 and HDD 28 onto RAM 26 and executing processing.

[0041] The character conversion device 20 according to this embodiment has the hardware configuration shown in Figure 3, which enables various processes as described later.

[0042] <Functional Configuration> Next, the functional configuration of the electronic whiteboard system 1 according to this embodiment will be described with reference to Figure 4. Figure 4 is a diagram showing an example of the functional configuration of the electronic whiteboard system 1 according to this embodiment.

[0043] As shown in Figure 4, the electronic whiteboard device 10 according to this embodiment includes an input receiving unit 101, a display control unit 102, an authentication processing unit 103, a communication unit 104, a handwritten character data generation processing unit 105, a voice input unit 106, a voice data generation processing unit 107, and a transmission feasibility determination unit 108. Each of these functional units is realized by processing that one or more programs installed in the electronic whiteboard device 10 cause the CPU 17 to execute.

[0044] Furthermore, the electronic whiteboard device 10 according to this embodiment has a transmission eligibility information storage unit 109. This storage unit can be implemented using, for example, an HDD 18. Alternatively, this storage unit may be implemented using a storage device or the like connected to the electronic whiteboard device 10 via a network.

[0045] The input reception unit 101 accepts input from the user for various operations. Specifically, the input reception unit 101 accepts input from the user for handwritten characters, various selection operations, etc. In addition, the input reception unit 101 accepts input from the user for authentication information necessary to start using the electronic whiteboard device 10.

[0046] The display control unit 102 displays various types of information. Specifically, the display control unit 102 displays handwritten characters and various screens. In addition, the display control unit 102 displays the text indicated by the text data converted by the voice conversion service 30. Furthermore, the display control unit 102 displays the decision support information indicated by the decision support data transmitted from the decision support service 40.

[0047] The authentication processing unit 103 performs authentication based on the authentication information received by the input receiving unit 101. Specifically, the authentication processing unit 103 performs authentication by determining, for example, whether the user ID and password combination (authentication information) received by the input receiving unit 101 matches a pre-configured user ID and password combination.

[0048] The communication unit 104 communicates various types of data with other devices (for example, the character conversion device 20 and the voice conversion service 30). Specifically, the communication unit 104 transmits, for example, the handwritten character data generated by the handwritten character data generation processing unit 105 to the character conversion device 20. This allows the electronic whiteboard device 10 to convert the handwritten character data into text data using the character conversion device 20 and transmit it to the decision support service 40.

[0049] Furthermore, the communication unit 104 transmits, for example, the audio data generated by the audio data generation processing unit 107 to the audio conversion service 30. This allows the electronic whiteboard device 10 to convert the audio data into text data using the audio conversion service 30 and transmit it to the decision support service 40.

[0050] Furthermore, the communication unit 104 receives decision support data from the decision support service 40 via the character conversion device 20 or the voice conversion service 30. Decision support data refers to data that provides information to support decision-making (for example, information that presents solutions or alternative measures for issues that are on the agenda of a meeting).

[0051] When the input receiving unit 101 receives an input operation for handwritten characters, the handwritten character data generation processing unit 105 generates data representing these handwritten characters (handwritten character data). The handwritten character data generation processing unit 105 also transmits the generated handwritten character data to the character conversion device 20 via the communication unit 104, according to the determination result by the transmission feasibility determination unit 108.

[0052] The audio input unit 106 receives audio input. That is, the audio input unit 106 receives sound (voice) collected by the sound collection device 19.

[0053] The voice data generation processing unit 107 generates data (voice data) representing the voice input by the voice input unit 106. The voice data generation processing unit 107 also transmits the generated voice data to the voice conversion service 30 via the communication unit 104, according to the determination result by the transmission feasibility determination unit 108.

[0054] The transmission eligibility determination unit 108 refers to the transmission eligibility information stored in the transmission eligibility information storage unit 109 and determines whether or not to transmit, for example, the contents of the meeting (i.e., handwritten character data and voice data) to the character conversion device 20 and the voice conversion service 30.

[0055] Here, the transmission eligibility information is associated with the user ID of the user using the electronic whiteboard device 10 and information for determining whether transmission is permitted (for example, the user's job title), as will be described later. Therefore, the transmission eligibility determination unit 108 determines whether handwritten character data and voice data can be transmitted, for example, according to the job title associated with the user ID of the user authenticated by the authentication processing unit 103.

[0056] The transmission eligibility information storage unit 109 stores transmission eligibility information that the transmission eligibility determination unit 108 uses to determine whether or not handwritten character data and voice data can be transmitted. Details of the transmission eligibility information will be described later.

[0057] As shown in Figure 4, the character conversion device 20 according to this embodiment has a communication unit 201 and a character conversion processing unit 202. Each of these functional units is realized by processing that one or more programs installed in the character conversion device 20 cause the CPU 27 to execute.

[0058] The communication unit 201 communicates various types of data with other devices (for example, the electronic whiteboard device 10 and the decision support service 40). Specifically, the communication unit 104 transmits, for example, text data converted by the character conversion processing unit 202 to the decision support service 40. The communication unit 104 also transmits decision support data received from the decision support service 40 to the electronic whiteboard device 10.

[0059] The character conversion processing unit 202 converts the handwritten character data received via the communication unit 201 into text data. The character conversion processing unit 202 converts the handwritten character data into text data using, for example, OCR (Optical Character Recognition) technology.

[0060] <Processing details> Next, we will describe the details of the processing of the electronic whiteboard system 1 according to this embodiment.

[0061] First, we will explain, with reference to Figure 5, the case in which, for example, meeting participants input meeting content in handwritten characters during a meeting using the electronic whiteboard device 10. Figure 5 is a sequence diagram showing an example of the handwritten character input process according to this embodiment.

[0062] First, the input reception unit 101 of the electronic whiteboard device 10 receives an input operation for authentication information to allow a user, such as a meeting participant, to start using the electronic whiteboard device 10 (step S501). The authentication information input operation can be performed, for example, by the user entering a user ID and password pair (authentication information) on a predetermined screen displayed by the display control unit 102.

[0063] Alternatively, the user may input authentication information by holding an IC (Integrated Circuit) card over a designated area on the electronic whiteboard device 10. In this case, the input reception unit 101 accepts the authentication information recorded on the IC card.

[0064] Next, the authentication processing unit 103 of the electronic whiteboard device 10 performs authentication based on the authentication information received by the input receiving unit 101 (step S502). That is, the authentication processing unit 103 performs authentication by determining, for example, whether the user ID and password combination (authentication information) received by the input receiving unit 101 matches a pre-set user ID and password combination.

[0065] In the following explanation, we will assume that the authentication in step S502 above was successful. However, the authentication process in step S502 above is not required. In other words, the electronic whiteboard device 10 according to this embodiment only needs to have received at least a user ID input in step S501 above.

[0066] Next, the transmission eligibility determination unit 108 of the electronic whiteboard device 10 refers to the transmission eligibility information stored in the transmission eligibility information storage unit 109 and determines whether or not to transmit the handwritten character data to the character conversion device 20 (transmission eligibility) (step S503).

[0067] Here, the transmission eligibility information stored in the transmission eligibility information storage unit 109 will be explained with reference to Figure 6. Figure 6 is a diagram showing an example of the transmission eligibility information stored in the transmission eligibility information storage unit 109.

[0068] As shown in Figure 6, the transmission eligibility information stored in the transmission eligibility information storage unit 109 includes data items such as "User ID," "Name," and "Position." The "User ID" is identification information that identifies the user using the electronic whiteboard device 10. The "Name" is the name of the user. The "Position" is the user's position (for example, department head or section chief). In this way, the transmission eligibility information is associated with the User ID and information such as the position.

[0069] Here, the transmission eligibility determination unit 108 determines whether or not to transmit by, for example, determining whether or not the job title associated with the user ID included in the authentication information received by the input reception unit 101 is a predetermined job title.

[0070] In other words, the transmission eligibility determination unit 108 refers to the transmission eligibility information stored in the transmission eligibility information storage unit 109 and determines, for example, that transmission is not permitted if the position associated with the user ID included in the authentication information is a position of department head or higher. On the other hand, the transmission eligibility determination unit 108 determines that transmission is permitted if, for example, the position associated with the user ID included in the authentication information is a position lower than department head.

[0071] Furthermore, in step S501 described above, if multiple authentication credentials are entered (for example, if all meeting participants hold up their IC cards), the transmission permission determination unit 108 only needs to determine whether the position associated with at least one of the user IDs included in these multiple authentication credentials is a predetermined position.

[0072] Furthermore, the transmission eligibility determination unit 108 is not limited to determining transmission eligibility based on the user's job title, but may also determine transmission eligibility based on, for example, the organization, department, team, or section to which the user belongs. Moreover, the transmission eligibility determination unit 108 may also determine transmission eligibility based on, for example, the device ID or installation location of the electronic whiteboard device 10, rather than the user using the electronic whiteboard device 10. Note that "name," "job title," "organization," "department," "team," and "section" are examples of user attribute information in the claims. Also, "job title" is an example of job title information in the claims.

[0073] In step S503, if the transmission feasibility determination unit 108 determines that transmission is permitted, the electronic whiteboard system 1 according to this embodiment performs the processing described in steps S504 to S509 each time a handwritten character input operation is performed on the electronic whiteboard device 10.

[0074] In other words, the input receiving unit 101 of the electronic whiteboard device 10 receives input operations for handwritten characters by the user. Then, the handwritten character data generation processing unit 105 of the electronic whiteboard device 10 generates data (handwritten character data) that represents the handwritten characters received by the input receiving unit 101 (step S504).

[0075] In this case, the handwritten character data generation processing unit 105 may generate image data representing each handwritten character entered by the user as handwritten character data, or it may generate stroke data representing each stroke of each handwritten character as handwritten character data. The input operation of handwritten characters can be performed, for example, by the user writing characters on the display device 12 using a dedicated electronic pen or the like.

[0076] The display control unit 102 of the electronic whiteboard device 10 displays the handwritten characters indicated by the handwritten character data generated by the handwritten character data generation processing unit 105 on the display device 12 (step S505). As a result, the handwritten characters entered by the user are displayed.

[0077] Next, the handwritten character data generation processing unit 105 of the electronic whiteboard device 10 transmits the handwritten character data to the character conversion device 20 via the communication unit 104 (step S506).

[0078] When the character conversion processing unit 202 of the character conversion device 20 receives handwritten character data via the communication unit 201, it converts the handwritten character data into text data (step S507).

[0079] Next, the character conversion processing unit 202 of the character conversion device 20 transmits the text data converted in step S507 to the decision support service 40 via the communication unit 201 (step S508). Note that the transmission of text data can be done, for example, using a Web API (Application Programming Interface) provided by the decision support service 40.

[0080] The decision support service 40 then transmits the decision support data to the electronic whiteboard device 10 via the character conversion device 20.

[0081] In addition, in step S508 above, the character conversion device 20 may also send text data back to the electronic whiteboard device 10. In this case, the electronic whiteboard device 10 sends the text data sent back from the character conversion device 20 to the decision support service 40.

[0082] When the display control unit 102 of the electronic whiteboard device 10 receives decision support data via the communication unit 104, it displays the decision support information (step S509).

[0083] In other words, the display control unit 102 displays the decision support information G110 indicated by the decision support data on the screen G100 displayed on the display device 12, for example, as shown in Figure 7.

[0084] In the example shown in Figure 7, decision support information G110 is displayed indicating that Option B, which is similar to Option A entered by the user, is being implemented by another project (Project ○×).

[0085] As described above, the electronic whiteboard system 1 according to this embodiment converts handwritten characters entered by the user into text and transmits it to the decision support service 40, thereby displaying information on the electronic whiteboard device 10 to support decision-making, for example, in a meeting. As a result, meetings using the electronic whiteboard device 10 can be expected to reduce unnecessary discussions and enable faster decision-making.

[0086] On the other hand, if the transmission feasibility determination unit 108 determines in step S503 that transmission is not possible, the electronic whiteboard system 1 according to this embodiment performs the process of step S510, which will be described later. Furthermore, thereafter, the electronic whiteboard system 1 according to this embodiment performs the processes of steps S511 and S512, which will be described later, each time a handwritten character input operation is performed on the electronic whiteboard device 10.

[0087] In other words, the display control unit 102 of the electronic whiteboard device 10 displays an icon indicating that the meeting content will not be transmitted (i.e., the handwritten data will not be transmitted to the character conversion device 20) (step S510).

[0088] In other words, the display control unit 102 displays an icon G210 on the screen G200 displayed on the display device 12, for example, as shown in Figure 8, indicating that the meeting contents will not be transmitted (i.e., the meeting contents are confidential). This allows, for example, meeting participants to know that the contents handwritten on the electronic whiteboard device 10 will not be transmitted to an external party (decision support service 40). Therefore, for example, meeting participants can discuss agenda items that include confidential information without hesitation. Note that the icon G210 is an example of a display component within the claims.

[0089] Furthermore, in the screen G200 shown in Figure 8, for example, if the user presses icon G210 (the operation to remove the "Confidential" label), the electronic whiteboard device 10 may transmit the meeting content (i.e., transmit handwritten character data to the character conversion device 20).

[0090] Next, the input receiving unit 101 of the electronic whiteboard device 10 receives input operations for handwritten characters from the user. Then, the handwritten character data generation processing unit 105 of the electronic whiteboard device 10 generates data (handwritten character data) representing the handwritten characters received by the input receiving unit 101 (step S511).

[0091] Next, the display control unit 102 of the electronic whiteboard device 10 displays the handwritten characters indicated by the handwritten character data generated by the handwritten character data generation processing unit 105 on the display device 12 (step S512). As a result, the handwritten characters entered by the user are displayed.

[0092] Thus, the electronic whiteboard device 10 according to this embodiment determines whether or not to transmit the handwritten meeting content to an external service (decision support service 40, etc.) according to the role of the participant (user) using the electronic whiteboard device 10.

[0093] Therefore, according to the electronic whiteboard system 1 of this embodiment, for example, it is possible to prevent situations in which confidential information is leaked to the decision support service 40 by having the contents of a meeting attended by company executives, etc., handwritten on the electronic whiteboard device 10.

[0094] Furthermore, the decision support service 40 may provide optimal decision support data based on accumulated past information. In such a decision support service 40, confidential information (or information based on such confidential information) transmitted to the decision support service 40 may be provided to other users of the electronic whiteboard device 10 as decision support information.

[0095] Therefore, according to the electronic whiteboard system 1 of this embodiment, it is possible to prevent situations in which confidential information, etc., is provided to other users of the electronic whiteboard device 10 as decision support information.

[0096] Next, we will explain, with reference to Figure 9, the case in which audio collected from the content of a meeting, such as speech by meeting participants, is input in a meeting using the electronic whiteboard device 10. Figure 9 is a sequence diagram showing an example of the audio input processing according to this embodiment. Note that the processing in steps S901 to S903 is the same as the processing in steps S501 to S503 in Figure 5, so the explanation will be omitted.

[0097] In step S903, if the transmission feasibility determination unit 108 determines that transmission is permitted, the electronic whiteboard system 1 according to this embodiment performs the processing described in steps S904 to S908 each time sound is collected by the sound collection device 19 of the electronic whiteboard device 10.

[0098] In other words, the audio input unit 106 of the electronic whiteboard device 10 receives the sound collected by the sound collection device 19. Then, the audio data generation processing unit 107 of the electronic whiteboard device 10 generates data (audio data) that represents the sound input by the audio input unit 106 (step S904).

[0099] Next, the audio data generation processing unit 107 of the electronic whiteboard device 10 transmits the audio data to the audio conversion service 30 via the communication unit 104 (step S905). The audio conversion service 30 then converts the audio data into text data and sends it back to the electronic whiteboard device 10.

[0100] Next, the display control unit 102 of the electronic whiteboard device 10 displays the text indicated by the text data returned from the speech conversion service 30 (step S906). This allows, for example, the content spoken by meeting participants to be displayed as text on the display device 12 of the electronic whiteboard device 10. If, for example, multiple text data and their confidence levels (an index value indicating the likelihood of conversion) are returned from the speech conversion service 30, the display control unit 102 should display the text indicated by the text data with the highest confidence level.

[0101] Meanwhile, the speech conversion service 30 transmits the text data to the decision support service 40 (step S907). The decision support service 40 then transmits the decision support data to the electronic whiteboard device 10 via the speech conversion service 30.

[0102] If the text data transmission process in step S907 described above is not performed, the electronic whiteboard device 10 may transmit the text data to the decision support service 40.

[0103] When the display control unit 102 of the electronic whiteboard device 10 receives decision support data via the communication unit 104, it displays the decision support information (step S908). As a result, the decision support information is displayed on the display device 12 of the electronic whiteboard device 10, similar to step S509 in Figure 5.

[0104] On the other hand, if the transmission feasibility determination unit 108 determines in step S903 that transmission is not possible, the electronic whiteboard system 1 according to this embodiment performs the processing described in step S909.

[0105] In other words, the display control unit 102 of the electronic whiteboard device 10 displays, for example, the screen G300 shown in Figure 10 (step S909). The screen G300 shown in Figure 10 is a screen that displays information indicating that speech-to-text conversion is not possible.

[0106] Thus, in this embodiment, if the transmission feasibility determination unit 108 determines that transmission is not possible, the electronic whiteboard device 10 notifies the user that speech-to-text conversion is not possible.

[0107] As described above, the electronic whiteboard system 1 according to this embodiment determines whether or not to transmit handwritten data and voice data depending on the user using the electronic whiteboard device 10. This allows the electronic whiteboard system 1 according to this embodiment to, for example, not transmit meeting content depending on the user's attributes (e.g., job title or department).

[0108] Therefore, according to the electronic whiteboard system 1 of this embodiment, it is possible to prevent situations in which, for example, the content spoken or handwritten in a highly confidential meeting attended by company executives, etc., is leaked to an external party (decision support service 40, etc.).

[0109] Although the above explanation used different sequence diagrams to describe handwritten character input and voice input, these may be performed simultaneously. In other words, the electronic whiteboard device 10 according to this embodiment may perform handwritten character input simultaneously with voice input.

[0110] In this case, it may be possible to control whether or not to send data to the decision support service 40 by sending a flag (transmission permission flag) to the voice conversion service 30 along with the voice data, indicating whether or not to allow the sending of text data to the decision support service 40.

[0111] Therefore, the audio input processing when the electronic whiteboard device 10 transmits a transmission permission flag along with the audio data will be explained below with reference to Figure 11. Figure 11 is a sequence diagram showing another example of the audio input processing according to this embodiment. Note that the processing in steps S1101 to S1103 is the same as the processing in steps S901 to S903 in Figure 9, so its explanation will be omitted.

[0112] In step S1103, if the transmission feasibility determination unit 108 determines that transmission is permitted, the electronic whiteboard system 1 according to this embodiment performs the processing described in steps S1104 to S1108 each time sound is collected by the sound collection device 19 of the electronic whiteboard device 10.

[0113] In other words, the audio input unit 106 of the electronic whiteboard device 10 receives the sound collected by the sound collection device 19. Then, the audio data generation processing unit 107 of the electronic whiteboard device 10 generates data (audio data) that represents the sound input by the audio input unit 106 (step S1104).

[0114] Next, the audio data generation processing unit 107 of the electronic whiteboard device 10 transmits the audio data and a transmission permission flag to the audio conversion service 30 via the communication unit 104 (step S1105). At this time, the audio data generation processing unit 107 sets the value of the transmission permission flag to "1", which indicates permission to transmit text data to the decision support service 40, and transmits it.

[0115] The voice conversion service 30 then converts the voice data into text data and sends it back to the electronic whiteboard device 10.

[0116] Next, the display control unit 102 of the electronic whiteboard device 10 displays the text indicated by the text data returned from the voice conversion service 30 (step S1106).

[0117] On the other hand, the speech conversion service 30 sends the text data to the decision support service 40 because the value of the transmission permission flag is "1" (step S1107). The decision support service 40 then sends the decision support data to the electronic whiteboard device 10 via the speech conversion service 30.

[0118] When the display control unit 102 of the electronic whiteboard device 10 receives decision support data via the communication unit 104, it displays the decision support information (step S1108).

[0119] On the other hand, if the transmission feasibility determination unit 108 determines in step S1103 that transmission is not possible, the electronic whiteboard system 1 according to this embodiment performs the processing described in steps S1109 to S1111.

[0120] In other words, the audio input unit 106 of the electronic whiteboard device 10 receives the sound collected by the sound collection device 19, similar to step S1104 described above. Then, the audio data generation processing unit 107 of the electronic whiteboard device 10 generates data (audio data) that represents the sound input by the audio input unit 106 (step S1109).

[0121] Next, the audio data generation processing unit 107 of the electronic whiteboard device 10 transmits the audio data and a transmission permission flag to the audio conversion service 30 via the communication unit 104 (step S1110). At this time, the audio data generation processing unit 107 sets the value of the transmission permission flag to "0", which indicates that the transmission of text data to the decision support service 40 is not permitted, and transmits it.

[0122] The voice conversion service 30 then converts the voice data into text data and sends it back to the electronic whiteboard device 10. However, since the value of the transmission permission flag is "0", the voice conversion service 30 does not send the text data to the decision support service 40.

[0123] Next, the display control unit 102 of the electronic whiteboard device 10 displays the text indicated by the text data returned from the voice conversion service 30, similar to step S1106 above (step S1111).

[0124] Thus, if the transmission of text data to the decision support service 40 can be controlled by sending a transmission permission flag to the speech conversion service 30, the electronic whiteboard device 10 according to this embodiment sends the transmission permission flag to the speech conversion service 30 along with the audio data. As a result, the electronic whiteboard device 10 according to this embodiment can display the text data converted from the audio data even if the transmission permission determination unit 108 determines that transmission is not permitted, as described in steps S1109 to S1111 above.

[0125] [Second Embodiment] Next, a second embodiment will be described. In the second embodiment, for example, a case will be described in which the user can choose whether or not to transmit the meeting content on the electronic whiteboard device 10 before the start of the meeting.

[0126] <Functional Configuration> First, the functional configuration of the electronic whiteboard system 1 according to this embodiment will be described with reference to Figure 12. Figure 12 is a diagram showing an example of the functional configuration of the electronic whiteboard system 1 according to this embodiment. Note that the description of the functional configuration, which is the same as that of the first embodiment, will be omitted.

[0127] As shown in Figure 12, the electronic whiteboard device 10 of the electronic whiteboard system 1 according to this embodiment has a transmission eligibility determination unit 108A. The transmission eligibility determination unit 108A determines whether or not to transmit handwritten character data and voice data to the character conversion device 20 and the voice conversion service 30, according to the selection made on a predetermined screen (a screen for the user to select whether or not to transmit the meeting content) displayed by the display control unit 102.

[0128] <Processing details> Next, we will describe the details of the processing of the electronic whiteboard system 1 according to this embodiment.

[0129] First, we will explain, with reference to Figure 13, the case in which, for example, meeting participants input meeting content in handwritten characters during a meeting using the electronic whiteboard device 10. Figure 13 is a sequence diagram showing an example of the handwritten character input process according to this embodiment. Note that the processes in steps S1301 and S1302 are the same as the processes in steps S501 and S502 in Figure 5, so their explanation will be omitted.

[0130] Following step S1302, the display control unit 102 of the electronic whiteboard device 10 displays a screen G400 for the user to select whether or not to send the meeting content, as shown in Figure 14 (step S1303).

[0131] Here, the screen G400 shown in Figure 14 includes a "YES" button G410 for selecting whether to send the meeting content (sending allowed) and a "NO" button G420 for selecting whether to not send the meeting content (sending not allowed).

[0132] Next, the transmission eligibility determination unit 108A of the electronic whiteboard device 10 determines whether or not to transmit the handwritten character data to the character conversion device 20 (transmission eligibility) (step S1304). That is, the transmission eligibility determination unit 108A determines whether or not to transmit by determining, for example, whether the "YES" button G410 or the "NO" button G420 is selected on the screen G400 shown in Figure 14.

[0133] If, in step S1304, the transmission feasibility determination unit 108A determines that transmission is permitted, the electronic whiteboard system 1 according to this embodiment performs the processing in steps S1305 to S1310 each time a handwritten character input operation is performed on the electronic whiteboard device 10. Note that the processing in steps S1305 to S1310 is the same as the processing in steps S504 to S509 in Figure 5, so its explanation is omitted.

[0134] On the other hand, if the transmission feasibility determination unit 108A determines in step S1304 that transmission is not possible, the electronic whiteboard system 1 according to this embodiment performs the process in step S1311. Subsequently, the electronic whiteboard system 1 according to this embodiment performs the processes in steps S1312 and S1313 each time a handwritten character input operation is performed on the electronic whiteboard device 10. Note that the processes in steps S1311 to S1313 are the same as the processes in steps S510 to S512 in Figure 5, so their explanation is omitted.

[0135] Thus, in the electronic whiteboard system 1 according to this embodiment, the electronic whiteboard device 10 allows the user to select whether or not to transmit handwritten character data, thereby controlling the transmission of such data. For this reason, in a meeting using the electronic whiteboard device 10 according to this embodiment, for example, meeting participants can select whether or not to transmit handwritten character data before the meeting begins, depending on the agenda items to be discussed.

[0136] Next, we will explain, with reference to Figure 15, the case in which audio is input from a meeting using the electronic whiteboard device 10, for example, from the content of a meeting spoken by a meeting participant. Figure 15 is a sequence diagram showing an example of the audio input processing according to this embodiment. Note that the processing in steps S1501 and S1502 is the same as the processing in steps S901 and S902 in Figure 9, so their explanation will be omitted.

[0137] Following step S1502, the display control unit 102 of the electronic whiteboard device 10 displays a screen G400 for the user to select whether or not to send the meeting content, as shown in Figure 14, similar to step S1303 above (step S1503).

[0138] Next, the transmission eligibility determination unit 108A of the electronic whiteboard device 10 determines whether or not to transmit the audio data to the audio conversion service 30 (transmission eligibility) (step S1504). That is, the transmission eligibility determination unit 108A determines whether or not to transmit by determining, for example, whether the "YES" button G410 or the "NO" button G420 is selected on the screen G400 shown in Figure 14.

[0139] If, in step S1504, the transmission feasibility determination unit 108A determines that transmission is permitted, the electronic whiteboard system 1 according to this embodiment performs the processing in steps S1505 to S1509 each time sound is collected by the sound collection device 19 of the electronic whiteboard device 10. Note that the processing in steps S1505 to S1509 is the same as the processing in steps S904 to S908 in Figure 9, so its explanation is omitted.

[0140] On the other hand, if the transmission feasibility determination unit 108A determines in step S1504 that transmission is not possible, the electronic whiteboard system 1 according to this embodiment proceeds to the process of step S1510. Note that the process of step S1510 is the same as the process of step S909 in Figure 9, so its explanation is omitted.

[0141] Thus, in the electronic whiteboard system 1 according to this embodiment, the electronic whiteboard device 10 allows the user to select whether or not to transmit handwritten character data, thereby controlling the transmission of such data. For this reason, in a meeting using the electronic whiteboard device 10 according to this embodiment, for example, meeting participants can select whether or not to transmit audio data before the meeting begins, depending on the topics they plan to discuss.

[0142] As described above, in the electronic whiteboard system 1 according to this embodiment, the user of the electronic whiteboard device 10 can choose whether or not to transmit the contents of the meeting to the decision support service 40, for example, before the start of the meeting. This allows the electronic whiteboard system according to this embodiment to choose whether or not to transmit the contents of the meeting to the decision support service 40, for example, depending on the agenda of the scheduled meeting.

[0143] [Third Embodiment] Next, a third embodiment will be described. In the third embodiment, if the decision support service 40 contains pre-registered terms (confidential words) or similar terms (similar words) in the text data, it will return decision support data indicating that the meeting content contains confidential information.

[0144] Therefore, in this embodiment, if the electronic whiteboard device 10 receives decision support data indicating that the meeting content contains confidential information during a meeting, for example, it will display a predetermined screen, allowing the user to choose whether or not to stop transmitting the meeting content thereafter.

[0145] <Functional Configuration> First, the functional configuration of the electronic whiteboard system 1 according to this embodiment will be described with reference to Figure 16. Figure 16 is a diagram showing the functional configuration of an example of the electronic whiteboard system 1 according to this embodiment. Note that the description of the functional configuration, which is the same as that of the first embodiment, will be omitted.

[0146] As shown in Figure 16, the electronic whiteboard device 10 of the electronic whiteboard system 1 according to this embodiment has a decision support data determination unit 110. Furthermore, the electronic whiteboard device 10 of the electronic whiteboard system 1 according to this embodiment does not have a transmission feasibility determination unit 108. The decision support data determination unit 110 determines whether the decision support data received via the communication unit 104 indicates that the meeting content contains confidential information.

[0147] <Processing details> Next, we will describe the details of the processing of the electronic whiteboard system 1 according to this embodiment.

[0148] First, we will explain, with reference to Figure 17, the case in which, for example, a meeting participant inputs the meeting content in handwritten characters during a meeting using the electronic whiteboard device 10. Figure 17 is a sequence diagram showing an example of the handwritten character input process according to this embodiment. Note that the processes of steps S1701 and S1702 are the same as the processes of steps S1301 and S1302 in Figure 13, so their explanation will be omitted.

[0149] In this embodiment, the electronic whiteboard system 1 performs the processes of steps S1703 to S1709 each time a handwritten character input operation is performed on the electronic whiteboard device 10. Note that the processes of steps S1703 to S1706 are the same as the processes of steps S1305 to S1308 in Figure 13, so their explanation is omitted.

[0150] Following step S1706, the text data converted in step S1706 is transmitted to the decision support service 40 via the communication unit 201 of the character conversion device 20 (step S1707).

[0151] The decision support service 40 then transmits the decision support data to the electronic whiteboard device 10 via the character conversion device 20. At this time, the decision support service 40 determines, for example, whether the text indicated by the text data received from the character conversion device 20 contains confidential words or similar words. If the decision support service 40 determines that the text indicated by the text data contains confidential words or similar words, it transmits decision support data indicating that confidential information is included to the electronic whiteboard device 10 via the character conversion device 20.

[0152] Here, confidential words are terms that have been pre-registered with the decision support service 40 by the user of the electronic whiteboard device 10, and include terms related to confidential matters, such as "litigation," "business plan," and "patent." Similar words are terms that are semantically similar to or related to confidential words, such as terms similar to the confidential word "litigation," such as "trial," "judgment," and "lawsuit." Similar words are determined by the decision support service 40 using technologies such as artificial intelligence or intelligent agents, based on confidential words registered by the user, for example.

[0153] The decision support data determination unit 110 of the electronic whiteboard device 10 determines whether or not the decision support data received via the communication unit 104 indicates that it contains confidential information (step S1708).

[0154] In step S1708, if it is determined that the data is decision support data indicating that it contains confidential information, the display control unit 102 displays a screen G500 for selecting to cancel the transmission of the meeting content, for example, as shown in Figure 18 (step S1709). Note that the screen G500 shown in Figure 18 is an example of a claim selection screen.

[0155] Here, screen G500 shown in Figure 18 includes a "YES" button G510 for selecting to cancel the transmission of meeting content and a "NO" button G520 for selecting not to cancel the transmission of meeting content.

[0156] On the other hand, if it is determined in step S1708 that the data is decision support data indicating that it does not contain confidential information, the display control unit 102 displays the decision support information (step S1710).

[0157] Thus, in the electronic whiteboard system 1 according to this embodiment, for example, a user of the electronic whiteboard device 10 can stop transmitting meeting content (handwritten text data) from that point onward by pressing the "YES" button G510 on the screen G500 shown in Figure 18. On the other hand, in the electronic whiteboard system 1 according to this embodiment, for example, a user of the electronic whiteboard device 10 can continue transmitting meeting content (handwritten text data) by pressing the "NO" button G520 on the screen G500 shown in Figure 18.

[0158] Next, we will explain, with reference to Figure 19, the case in which audio collected from the content of a meeting, such as speech by meeting participants, is input in a meeting using the electronic whiteboard device 10. Figure 19 is a sequence diagram showing an example of the audio input processing according to this embodiment. Note that the processing in steps S1901 and S1902 is the same as the processing in steps S1501 and S1502 in Figure 15, so their explanation will be omitted.

[0159] In this embodiment, the electronic whiteboard system 1 performs the processing steps S1903 to S1909 each time sound is collected by the sound collection device 19 of the electronic whiteboard device 10. Note that the processing steps S1903 to S1905 are the same as the processing steps S1505 to S1507 in Figure 15, so their explanation is omitted.

[0160] The voice conversion service 30 converts the voice data received from the electronic whiteboard device 10 into text data and transmits it to the decision support service 40 (step S1905). The decision support service 40 then transmits the decision support data to the electronic whiteboard device 10 via the voice conversion service 30.

[0161] At this time, the decision support service 40 determines, for example, whether the text data received from the speech conversion service 30 contains confidential words or similar words. If the decision support service 40 determines that the text data contains confidential words or similar words, it transmits decision support data indicating that confidential information is included to the electronic whiteboard device 10 via the speech conversion service 30.

[0162] The decision support data determination unit 110 of the electronic whiteboard device 10 determines whether or not the decision support data received via the communication unit 104 indicates that it contains confidential information (step S1907).

[0163] If, in step S1907, it is determined that the data is decision support data indicating that confidential information is included, the display control unit 102 displays, for example, screen G500 shown in Figure 18, in the same manner as in step S1709 (step S1908).

[0164] On the other hand, if it is determined in step S1907 that the data is decision support data indicating that it does not contain confidential information, the display control unit 102 displays the decision support information (step S1909).

[0165] Thus, in the electronic whiteboard system 1 according to this embodiment, for example, a user of the electronic whiteboard device 10 can stop transmitting meeting content (audio data) from that point onward by pressing the "YES" button G510 on the screen G500 shown in Figure 18. On the other hand, in the electronic whiteboard system 1 according to this embodiment, for example, a user of the electronic whiteboard device 10 can continue transmitting meeting content (audio data) by pressing the "NO" button G520 on the screen G500 shown in Figure 18.

[0166] As described above, in the electronic whiteboard system 1 according to this embodiment, a screen for selecting whether or not to stop transmitting the meeting content is displayed on the electronic whiteboard device 10 based on the decision support data received from the decision support service 40. As a result, with the electronic whiteboard system 1 according to this embodiment, for example, if the agenda of the meeting becomes confidential midway through, it becomes possible to stop transmitting the meeting content midway through the meeting.

[0167] [Fourth Embodiment] Next, a fourth embodiment will be described. In the fourth embodiment, the electronic whiteboard device 10 converts handwritten character data and audio data into text data, and determines whether or not the text data contains confidential information.

[0168] <Functional Configuration> First, the functional configuration of the electronic whiteboard system 1 according to this embodiment will be described with reference to Figure 20. Figure 20 is a diagram showing the functional configuration of an example of the electronic whiteboard device 10 according to this embodiment. Note that the description of the functional configuration, which is the same as that of the first embodiment, will be omitted.

[0169] As shown in Figure 20, the electronic whiteboard device 10 according to this embodiment includes a speech conversion processing unit 111, a character conversion processing unit 112, and a confidentiality determination unit 113. Each of these functional units is realized by processing that one or more programs installed in the electronic whiteboard device 10 cause the CPU 17 to execute.

[0170] Furthermore, the electronic whiteboard device 10 according to this embodiment does not have a transmission feasibility determination unit 108. In addition, the electronic whiteboard device 10 according to this embodiment has a confidential word information storage unit 114. This storage unit can be implemented using, for example, an HDD 18. Note that this storage unit may also be implemented using a storage device or the like that is connected to the electronic whiteboard device 10 via a network.

[0171] The speech conversion processing unit 111 converts the speech data generated by the speech data generation processing unit 107 into text data, for example, using a technology such as speech recognition.

[0172] The character conversion processing unit 112 converts the handwritten character data generated by the handwritten character data generation processing unit 105 into text data, for example, using OCR technology.

[0173] The confidentiality determination unit 113 refers to the confidential word information stored in the confidential word information storage unit 114 and determines whether the text data converted by the speech conversion processing unit 111 and the character conversion processing unit 112 contains confidential words or similar words.

[0174] The confidential word information storage unit 114 stores confidential word information. Here, the confidential word information stored in the confidential word information storage unit 114 will be explained with reference to Figure 21. Figure 21 is a diagram showing an example of confidential word information stored in the confidential word information storage unit 114.

[0175] As shown in Figure 21, the confidential word information stored in the confidential word information storage unit 114 has similar words associated with each confidential word, which are terms similar to or related to that confidential word.

[0176] Confidential words are registered, for example, by the user of the electronic whiteboard device 10. Similar words are determined, for example, by the electronic whiteboard device 10 or a system connected to the electronic whiteboard device 10 via a network, etc., using technologies such as artificial intelligence or intelligent agents, based on the confidential words registered by the user, etc.

[0177] <Processing details> Next, we will describe the details of the processing of the electronic whiteboard system 1 according to this embodiment.

[0178] First, we will explain, with reference to Figure 22, the case in which, for example, meeting participants input meeting content in handwritten characters during a meeting using the electronic whiteboard device 10. Figure 22 is a sequence diagram showing an example of the handwritten character input process according to this embodiment. Note that the processes of steps S2201 and S2202 are the same as the processes of steps S1701 and S1702 in Figure 17, so their explanation will be omitted.

[0179] In this embodiment, the electronic whiteboard device 10 performs the processing in steps S2203 to S2209 each time a handwritten character input operation is performed. Note that the processing in steps S2203 and S2204 is the same as the processing in steps S1703 and S1704 in Figure 17, so their explanation is omitted.

[0180] Following step S2204, the character conversion processing unit 112 of the electronic whiteboard device 10 converts the handwritten character data generated in step S2203 into text data (step S2205).

[0181] Next, the confidentiality determination unit 113 of the electronic whiteboard device 10 refers to the confidential word information stored in the confidential word information storage unit 114 and determines whether or not at least one of the confidential word and similar words is included in the text indicated by the text data (step S2206).

[0182] In step S2206, if it is determined that the text data does not contain confidential words or similar words, the communication unit 104 of the electronic whiteboard device 10 transmits the text data to the decision support service 40 (step S2207). The decision support service 40 then transmits the decision support data to the electronic whiteboard device 10.

[0183] When the display control unit 102 of the electronic whiteboard device 10 receives decision support data via the communication unit 104, it displays the decision support information (step S2208).

[0184] On the other hand, if it is determined in step S2206 that confidential words and similar words are included, the display control unit 102 of the electronic whiteboard device 10 displays a screen G500 for selecting to cancel the transmission of the meeting content, as shown in Figure 18, for example (step S2209).

[0185] Thus, the electronic whiteboard device 10 according to this embodiment converts handwritten character data into text data and determines whether or not the text data contains confidential words or the like. As a result, the electronic whiteboard device 10 according to this embodiment can transmit only the text data containing confidential words or the like to the decision support service 40.

[0186] Next, we will explain, with reference to Figure 23, the case in which audio collected from the content of a meeting, such as speech by meeting participants, is input in a meeting using the electronic whiteboard device 10. Figure 23 is a sequence diagram showing an example of the audio input processing according to this embodiment. Note that the processing in steps S2301 and S2302 is the same as the processing in steps S1901 and S1902 in Figure 19, so their explanation will be omitted.

[0187] In this embodiment, the electronic whiteboard device 10 performs the processing in steps S2303 to S2309 each time sound is collected by the sound collection device 19. Note that the processing in step S2303 is the same as the processing in step S1903 in Figure 19, so its explanation is omitted.

[0188] Following step S2304, the audio conversion processing unit 111 of the electronic whiteboard device 10 converts the audio data generated in step S2303 into text data (step S2304).

[0189] Next, the display control unit 102 of the electronic whiteboard device 10 displays the text indicated by the text data converted in step S2304 (step S2305).

[0190] Next, the confidentiality determination unit 113 of the electronic whiteboard device 10 refers to the confidential word information stored in the confidential word information storage unit 114 and determines whether or not at least one of the confidential word and similar words is included in the text indicated by the text data (step S2306).

[0191] In step S2306, if it is determined that the text data does not contain confidential words or similar words, the communication unit 104 of the electronic whiteboard device 10 transmits the text data to the decision support service 40 (step S2307). The decision support service 40 then transmits the decision support data to the electronic whiteboard device 10.

[0192] When the display control unit 102 of the electronic whiteboard device 10 receives decision support data via the communication unit 104, it displays the decision support information (step S2308).

[0193] On the other hand, if it is determined in step S2306 that confidential words and similar words are included, the display control unit 102 of the electronic whiteboard device 10 displays a screen G500 for selecting to cancel the transmission of the meeting content, as shown in Figure 18, for example (step S2309).

[0194] As described above, the electronic whiteboard device 10 according to this embodiment converts audio data into text data and determines whether or not the text data contains confidential words or the like. As a result, the electronic whiteboard device 10 according to this embodiment can transmit only the text data containing confidential words or the like to the decision support service 40.

[0195] In the first to fourth embodiments described above, we explained, as an example, the case in which handwritten characters or voice input are entered into the electronic whiteboard device 10. However, the embodiments described above are not limited to this and can be applied to devices other than the electronic whiteboard device 10.

[0196] For example, each of the above embodiments can also be applied to a scanner device that scans a document and generates image data. In this case, for example, in the second embodiment described above, the user can choose whether or not to send the image data to the decision support service 40 before scanning the document with the scanner device. Also, for example, in the fourth embodiment described above, if the image data generated by the scanner device contains confidential words or the like, the user can choose whether or not to send the image data to the decision support service 40.

[0197] Furthermore, for example, each of the above embodiments can also be applied to a projector device that projects an image based on image data. In this case, for example, in the second embodiment described above, the user can choose whether or not to transmit the image data of the projected image to the decision support service 40. Also, for example, in the fourth embodiment described above, if the image data of the projected image contains confidential words, etc., the user can choose whether or not to transmit the image data to the decision support service 40.

[0198] Furthermore, for example, each of the above embodiments can also be applied to a video conferencing terminal for transmitting and receiving image data and audio data between multiple terminals. In this case, for example, in the second embodiment described above, the user can choose whether or not to transmit the image data and audio data transmitted and received between multiple terminals to the decision support service 40. Also, for example, in the fourth embodiment described above, if the image data and audio data transmitted and received between multiple terminals contain confidential words, the user can choose whether or not to transmit the image data and audio data to the decision support service 40.

[0199] Furthermore, while the above embodiments describe cases where the electronic whiteboard system 1 is connected to the decision support service 40 via the network N1, the system is not limited to this. That is, for example, the decision support service 40 may be included in the electronic whiteboard system 1.

[0200] Furthermore, the electronic whiteboard device 10 may also have a function that implements the services provided by the decision support service 40 (i.e., a decision support function). In this case, the transmission feasibility determination unit 108 of the electronic whiteboard device 10 can determine whether or not to provide decision support through the decision support function using text data such as voice data or handwritten character data. In this case, the decision support function of the electronic whiteboard device 10 (an example of the decision support means in the claims) creates support information based on the text data.

[0201] The electronic whiteboard device 10 is an example of a meeting support device within the claims. The electronic whiteboard system 1 is an example of a meeting support system within the claims. The decision support service 40 is an example of a decision support system within the claims. The input receiving unit 101 is an example of an input receiving means within the claims. The display control unit 102 is an example of a display means within the claims. The communication unit 104 is an example of a transmission means within the claims. The transmission feasibility determination unit 108 and transmission feasibility determination unit 108A are examples of transmission feasibility determination means within the claims. The confidentiality determination unit 113 is an example of a confidentiality determination means within the claims. The voice conversion processing unit 111 is an example of a voice conversion means within the claims. The character conversion processing unit 112 is an example of a character conversion means within the claims. The transmission feasibility information storage unit 109 is an example of a storage means within the claims.

[0202] The present invention is not limited to the embodiments specifically disclosed above, and various modifications, changes, and combinations are possible without departing from the scope of the claims. [Explanation of Symbols]

[0203] 1. Electronic whiteboard system 10. Electronic whiteboard device 20 Character Converter 30 Voice Conversion Services 40. Decision support services 101 Input Reception Section 102 Display Control Unit 103 Authentication Processing Unit 104 Communications Department 105 Handwritten Character Data Generation Processing Unit 106 Voice Input Section 107 Audio Data Generation Processing Unit 108 Transmission permission determination unit 109 Transmission permission information storage unit 201 Communications Department 202 Character conversion processing unit [Prior art documents] [Patent Documents]

[0204] [Patent Document 1] Patent No. 5644266

Claims

1. A meeting support device connected to a decision support system that presents support information to assist participants in making decisions during a meeting, An input receiving means for receiving voice input from participants of the aforementioned meeting or handwritten text input from participants of the aforementioned meeting, A transmission feasibility determination means for determining whether or not to transmit the text data representing the voice or handwritten characters received by the input reception means to the decision support system, If the transmission feasibility determination means determines that the text data should be transmitted to the decision support system, the transmission means for transmitting the text data is provided. A display means for displaying the support information transmitted from the decision support system in response to the transmission of the text data by the transmission means, A conference support device.

2. The system includes a confidentiality determination means for determining whether or not confidential information is included in the voice or handwritten character text data received by the input receiving means. The transmission feasibility determination means is: If the confidentiality determination means determines that the text data contains confidential information, it is determined not to transmit the text data to the decision support system. The conference support device according to claim 1, wherein if the confidentiality determination means determines that the text data does not contain confidential information, it determines to transmit the text data to the decision support system.

3. The system includes a speech conversion means that converts the speech data received by the input receiving means into text data. The aforementioned confidentiality determination means is The conference support device according to claim 2, which determines whether or not the text data converted by the speech conversion means contains confidential information.

4. The system includes a character conversion means that converts the character data representing the handwritten characters received by the input receiving means into text data. The aforementioned confidentiality determination means is The conference support device according to claim 2 or 3, which determines whether or not the text data converted by the character conversion means contains confidential information.

5. The aforementioned confidentiality determination means is The conference support device according to claim 3 or 4, which determines whether the text data contains terms indicating confidential information or terms similar to such terms.

6. The aforementioned input receiving means is The system accepts an operation to select whether or not to allow the transmission of the text data to the decision support system. The transmission feasibility determination means is: When the input receiving means receives an operation indicating permission to transmit the text data, it is determined to transmit the text data to the decision support system. The conference support device according to any one of claims 1 to 5, wherein if the input receiving means receives an operation indicating that the transmission of the text data is not permitted, it is determined that the text data will not be transmitted to the decision support system.

7. The conference support device has a storage means for storing the user ID of a user and attribute information of the user in association with each other. The aforementioned input receiving means is The system accepts the input of authentication information for using the aforementioned conference support device. The transmission feasibility determination means is: The conference support device according to any one of claims 1 to 5, wherein it determines whether or not to transmit the text data to the decision support system based on attribute information stored in the storage means in association with the user ID included in the authentication information received by the input receiving means.

8. The attribute information is job title information indicating the user's job title, The transmission feasibility determination means is: If the job title indicated by the job title information stored in the storage means in association with the user ID included in the authentication information received by the input receiving means is a predetermined job title or higher, it is determined not to transmit the text data to the decision support system. The conference support device according to claim 7, wherein if the position indicated by the position information stored in the storage means in association with the user ID included in the authentication information received by the input receiving means is not a predetermined position or higher, it is determined to transmit the text data to the decision support system.

9. The system includes a confidentiality determination means for determining whether the support information transmitted from the decision support system in response to the transmission of the text data by the transmission means is information indicating that the text data contains confidential information. The aforementioned display means is The conference support device according to any one of claims 1 to 8, wherein if the confidentiality determination means determines that the support information is information indicating that the text data contains confidential information, a selection screen is displayed for selecting whether or not to cancel the transmission of the text data by the transmission means.

10. The aforementioned display means is The meeting support device according to any one of claims 1 to 9, wherein if the transmission permission determination means determines that the text data should not be transmitted to the decision support system, a display component indicating that the contents of the meeting are confidential is displayed.

11. A meeting support device that assists participants in decision-making during a meeting, An input receiving means for receiving voice input from participants of the aforementioned meeting or handwritten text input from participants of the aforementioned meeting, A determination means for determining whether or not to provide support for the decision-making using the voice or handwritten character text data received by the input receiving means, If the determination means determines that the text data should be used to support the decision-making, the decision support means creates support information to assist the decision-making of the participants in the meeting based on the text data. A display means for displaying the support information created by the decision support means, A conference support device.

12. A meeting support system connected to a decision support system that presents support information to assist participants in making decisions during a meeting, An input receiving means for receiving voice input from participants of the aforementioned meeting or handwritten text input from participants of the aforementioned meeting, A transmission feasibility determination means for determining whether or not to transmit the text data representing the voice or handwritten characters received by the input reception means to the decision support system, If the transmission feasibility determination means determines that the text data should be transmitted to the decision support system, the transmission means for transmitting the text data is provided. A display means for displaying the support information transmitted from the decision support system in response to the transmission of the text data by the transmission means, A conference support system.

13. A meeting support system that assists participants in decision-making during meetings, An input receiving means for receiving voice input from participants of the aforementioned meeting or handwritten text input from participants of the aforementioned meeting, A determination means for determining whether or not to provide support for the decision-making using the voice or handwritten character text data received by the input receiving means, If the determination means determines that the text data should be used to support the decision-making, the decision support means creates support information to assist the decision-making of the participants in the meeting based on the text data. A display means for displaying the support information created by the decision support means, A conference support system.

14. A meeting support method used in a meeting support device connected to a decision support system that presents support information to assist participants in making decisions during a meeting, An input reception procedure for receiving audio or handwritten text input from participants of the aforementioned meeting, A transmission feasibility determination procedure for determining whether or not to transmit the text data representing the voice or handwritten characters received by the input reception procedure to the decision support system, If the transmission feasibility determination procedure determines that the text data should be transmitted to the decision support system, a transmission procedure for transmitting the text data is performed. A display procedure for displaying the support information transmitted from the decision support system in response to the transmission of the text data by the transmission procedure, A meeting support method that has the following features.

15. A meeting support device connected to a decision support system that presents support information to assist participants in making decisions during a meeting, An input receiving means for receiving audio input from participants of the aforementioned meeting or handwritten text input from participants of the aforementioned meeting. A transmission feasibility determination means that determines whether or not to transmit the voice or handwritten text data received by the input reception means to the decision support system. If the transmission feasibility determination means determines that the text data should be transmitted to the decision support system, the transmission means for transmitting the text data A display means that displays the support information transmitted from the decision support system in response to the transmission of the text data by the transmission means. A program designed to function as such.

Images