Memorandum Creation Program

Abstract

To provide a highly convenient memorandum creation program.SOLUTION: A memorandum creation program allows a computer to perform an acquisition step for acquiring voice of utterance during a conversation (S107); a conversion step for converting acquired voice into a character string; an identification step for identifying a speaker of voice acquired in the acquisition step based on a feature of the acquired voice; a character string addition step for associating the character string converted in the conversion step with the speaker identified in the identification step and adding it to a memorandum stored in a storage device in time series; an input reception step for receiving prescribed input during a conversation (S115); and a topic addition step for adding a mark indicating one topic in a plurality of topics stored in the storage device to the memorandum when prescribed input is received in the input reception step (S117).SELECTED DRAWING: Figure 10

Description

[Technical Field]

[0001] The present invention relates to a memo-creating program, and more particularly to a memo-creating program for creating a memo of a conversation involving multiple topics. [Background technology]

[0002] When a conversation such as a meeting, interview, or meeting is held, memorandums such as minutes, memos, or contracts are created to record the content of the conversation. Memorandums are usually created after the conversation has ended, while reviewing what the participants said. For this reason, creating memoranda takes a considerable amount of time after the conversation has ended. There is a demand for memoranda to be created quickly.

[0003] Patent Documents 1 and 2 listed below propose a device that identifies a speaker based on the audio of what is said during a conversation and creates minutes of a meeting by transcribing the audio of what is said during the conversation.

[0004] The following Patent Document 1 discloses a minutes creation system that acquires speech content in a meeting as audio information, processes the audio information, embeds speaker information in the processed information, and generates minutes based on the information in which the speaker information is embedded.

[0005] Patent Document 2 listed below discloses a minutes output device that includes an information acquisition unit, a voice acquisition unit, a voice recognition unit, a discrimination unit, and an output control unit. The information acquisition unit acquires information about the number of participants in a meeting. The voice acquisition unit acquires data about the voice in the meeting. The voice recognition unit recognizes voice based on the data about the voice acquired by the voice acquisition unit and converts it into text as the speaker's utterance. The discrimination unit identifies the speaker based on the information about the number of participants acquired by the information acquisition unit and the data about the voice acquired by the voice acquisition unit. The output control unit outputs minutes that associate a label indicating the speaker identified by the discrimination unit with the content of the utterance converted into text by the voice recognition unit. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 10-294798 [Patent Document 2] Japanese Patent Publication No. 2020-95210 Summary of the Invention [Problem to be solved by the invention]

[0007] In the prior art, memos contain text strings converted from speech, but the correspondence between the text strings and each topic is not clear. To clarify the correspondence between the text strings and each topic, the creator of the memo had to read the entire text string of the memo and add text strings indicating each topic at the appropriate starting point of each topic in the memo. This made the prior art less convenient.

[0008] The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide a highly convenient memorandum creation program. [Means for solving the problem]

[0009] A memo creation program according to one aspect of the present invention is a memo creation program for creating a memo of a conversation including a plurality of topics, and includes: an acquisition step for acquiring audio of utterances made during the conversation; a conversion step for converting the audio acquired in the acquisition step into a character string; an identification step for identifying the speaker of the audio acquired in the acquisition step based on characteristics of the audio acquired in the acquisition step; and a character string addition step for associating the character string converted in the conversion step with the speaker identified in the identification step and adding the character string converted in the conversion step to the memo stored in a storage device in chronological order. a display step of displaying on a display unit a screen including a first area displaying a plurality of topics and an ongoing topic among the plurality of topics, and a second area displaying a memorandum stored in a storage device, the second area being an area different from the first area; an input receiving step of receiving a predetermined input during a conversation; and a symbol indicating a break in a topic when the predetermined input is received at the input receiving step. stored in a storage deviceA computer is caused to execute a topic adding step of adding a character string after the latest character string added in the character string adding step in the memorandum, and an end accepting step of accepting an input to end the conversation, and after the symbol is added to the memorandum in the topic adding step, if the input to end the conversation is not accepted in the end accepting step, audio of the utterances made during the conversation is acquired in the acquisition step. In the input receiving step, a selection of the next topic of the ongoing topic from among the plurality of topics displayed in the first area or a check mark in a check box corresponding to the next topic displayed in the first area is received as a predetermined input. .

[0011] In the memorandum creation program, preferably, in the displaying step, the character string converted in the converting step is displayed on the display unit in a different manner for each speaker.

[0012] In the memorandum creation program, preferably, the symbol includes a character string of one of a plurality of topics stored in the storage device. nothing.

[0013] In the above memorandum creation program, preferably, the computer is further made to execute a pre-start acquisition step of acquiring the voices of the participants in the conversation before the conversation starts, and a feature registration step of registering the features of the voices acquired in the pre-start acquisition step in a storage device in association with the participants, and in the identification step, the speaker of the voice acquired in the acquisition step is identified based on the features of the voice registered in the feature registration step.

[0014] In the above memorandum creation program, preferably, the computer is further made to execute an approval receiving step of receiving input approving the memorandum from the speakers identified in the identification step after the conversation ends, and a confirmation step of confirming the memorandum if approval inputs are received from all speakers identified in the identification step in the approval receiving step.

[0015] In the above memorandum creation program, preferably, the approval acceptance step includes a first approval acceptance step of accepting input approving the memorandum from the speaker identified in the identification step on a computer on which the memorandum creation program is installed, and a second approval acceptance step of accepting input approving the memorandum from the speaker identified in the identification step via a network line from a computer other than the computer on which the memorandum creation program is installed.

[0016] In the above memorandum creation program, preferably, the acquisition step includes a first acquisition step of acquiring audio of utterances made during a conversation on a computer on which the memorandum creation program is installed, and a second acquisition step of acquiring audio of utterances made during a conversation via a network line from a computer other than the computer on which the memorandum creation program is installed.

[0017] In the above memorandum creation program, preferably, the computer is further made to execute a screen transmission step of transmitting screen data displaying an ongoing topic among the multiple topics to a computer other than the computer on which the memorandum creation program is installed via a network line. [Effects of the Invention]

[0018] According to the present invention, a highly convenient memorandum creation program can be provided. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a diagram schematically illustrating a usage mode of a memo creation device 1 according to a first embodiment of the present invention. [Figure 2] 1 is a block diagram showing a configuration of a memo creation device 1 according to a first embodiment of the present invention. [Figure 3] 10 is a diagram schematically showing a speaker information table stored in storage device 14. FIG. [Figure 4] FIG. 2 is a diagram schematically showing a conference menu table stored in the storage device 14. [Figure 5] FIG. 3 is a diagram showing a home screen 31 of a memo creation application in the first embodiment of the present invention. [Figure 6] FIG. 3 is a diagram showing a conference setting screen 32 of a memorandum creation application in the first embodiment of the present invention. [Figure 7] FIG. 2 is a diagram showing a first state of a minutes creation screen 33 of a memorandum creation application in the first embodiment of the present invention. [Figure 8] FIG. 10 is a diagram showing a second state of the minutes creation screen 33 of the memorandum creation application in the first embodiment of the present invention. [Figure 9] FIG. 3 is a diagram showing a minutes approval screen 34 of the memorandum creation application in the first embodiment of the present invention. [Figure 10] 4 is a flowchart showing a process performed by the memo creation device 1 in a conference mode according to the first embodiment of the present invention. [Figure 11] This is a subroutine of the character conversion process (S113) in FIG. [Figure 12] FIG. 3 is a diagram showing a voice registration screen 35 of a memo creation application in the first embodiment of the present invention. [Figure 13] 4 is a flowchart showing a process performed by the memo creation device 1 in a voice registration mode according to the first embodiment of the present invention. [Figure 14] FIG. 3 is a diagram showing a meeting menu creation screen 37 of a memorandum creation application in the first embodiment of the present invention. [Figure 15] 4 is a flowchart showing a process performed by the memo creation device 1 in a meeting menu creation mode according to the first embodiment of the present invention. [Figure 16] FIG. 10 is a diagram showing a minutes selection screen 38 of the memorandum creation application in the first embodiment of the present invention. [Figure 17] FIG. 10 is a diagram showing a distribution destination input screen 39 of a memorandum creation application in the first embodiment of the present invention. [Figure 18] 4 is a flowchart showing a process performed by the memorandum creation device 1 in a minutes distribution mode according to the first embodiment of the present invention. [Figure 19]FIG. 10 is a diagram illustrating the operation of the memo creation device 1 in the second embodiment of the present invention. [Figure 20] FIG. 10 is a diagram showing a state in which a check box 290 is checked on a conference setting screen 32 of a memo creation application in the second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0020] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0021] The memorandum creation program in the following embodiments creates a memorandum of a conversation that includes multiple topics. "Memorandum" means something written down so as not to be forgotten, and includes minutes, memos, contracts, etc. "Conversation" means an exchange of words between two or more people, and includes meetings, interviews, and face-to-face meetings.

[0022] In the following embodiments, an example will be described in which the conversation targeted by the memorandum creation program is a meeting, the memorandum is a meeting minutes, and the topic of the conversation is the agenda of the meeting. The type of conversation handled by the memorandum creation program is arbitrary, and may be a meeting, interview, etc.

[0023] [First embodiment]

[0024] (Memorandum creation device 1 usage)

[0025] FIG. 1 is a diagram schematically showing a usage mode of a memo creation device 1 according to a first embodiment of the present invention.

[0026] Referring to FIG. 1, the memo creation device 1 is composed of a terminal such as a PC (Personal Computer) or a smartphone. In this embodiment, at least a user UR possesses the memo creation device 1. The user UR is, for example, one of the participants in a conference who prepares the minutes of the meeting. As shown in FIG. 1(a), the memo creation device 1 may be placed in a position (preferably near the user UR) where the voices of each participant are acquired in a conference in real space where multiple participants gather. As shown in FIG. 1(b), the memo creation device 1 may be placed near a terminal 3 used by the user UR in a web conference. The terminal 3 itself may be the memo creation device 1. A web conference is a conference held by multiple participants at different locations, each connecting their terminals 3 to each other via a network line 7 and transmitting and receiving at least the voices of each of the multiple participants.

[0027] The network line 7 may be a dedicated line such as a wired or wireless LAN (Local Area Network), a public line, or wireless communication. The network line 7 connects various devices using the TCP / IP (Transmission Control Protocol / Internet Protocol) protocol. Devices connected to the network line 7 can exchange various types of data with each other.

[0028] (Configuration of memorandum creation device 1)

[0029] Fig. 2 is a block diagram showing the configuration of a memo creation device 1 according to a first embodiment of the present invention. Fig. 2(a) is a block diagram showing the hardware configuration of the memo creation device 1. Fig. 2(b) is a block diagram showing the functional configuration of the memo creation device 1.

[0030] 2(a), the memorandum creation device 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage device 14, a network interface 15, an operation unit 16, a display unit 17, and a microphone 18. The ROM 12, RAM 13, storage device 14, network interface 15, operation unit 16, display unit 17, and microphone 18 are each connected to the CPU 11 via a bus.

[0031] The CPU 11 controls the entire memorandum creation device 1. The CPU 11 also executes programs stored in the ROM 12 and the storage device 14.

[0032] The ROM 12 is, for example, a flash ROM. Various programs executed by the CPU 11 and various fixed data are stored in the ROM 12. The ROM 12 may be non-rewritable.

[0033] The RAM 13 is the main memory of the CPU 11. The RAM 13 is used to temporarily store data and the like required when the CPU 11 executes a program.

[0034] The storage device 14 is, for example, a hard disk drive (HDD) or a solid state drive (SSD), and stores various data such as the memorandum creation program 50 and data related to the memorandum creation program 50 (such as minutes, speaker information table, and conference menu table). The memorandum creation program 50 is a program related to a memorandum creation application.

[0035] The network interface 15 communicates with other devices according to instructions from the CPU 11 using a communication protocol such as TCP / IP.

[0036] The operation unit 16 receives various instructions from the user.

[0037] The display unit 17 displays various types of information.

[0038] The microphone 18 picks up sounds around the memo creation device 1 and converts them into electrical signals.

[0039] 2(b), memo creation device 1 includes a voice acquisition unit 501, a conversion unit 502, an identification unit 503, a character string addition unit 504, an operation display unit 505, a topic addition unit 506, a feature registration unit 507, an approval reception unit 508, a communication unit 509, and a translation unit 510. Each of voice acquisition unit 501, conversion unit 502, identification unit 503, character string addition unit 504, operation display unit 505, topic addition unit 506, feature registration unit 507, approval reception unit 508, communication unit 509, and translation unit 510 is realized by CPU 11 loading memo creation program 50 into RAM 13 and executing it.

[0040] The voice acquisition unit 501 acquires the voices of the participants in the conversation using the microphone 18. Before the conversation starts, the voice acquisition unit 501 acquires the voices of the participants in the conversation using the microphone 18.

[0041] The conversion unit 502 converts the voice acquired by the voice acquisition unit 501 into a character string.

[0042] The identification unit 503 extracts feature data of the voice acquired by the voice acquisition unit 501. The feature data is also called voiceprint data. The identification unit 503 identifies the speaker of the voice acquired by the voice acquisition unit 501 based on the extracted feature data.

[0043] The identification unit 503 may extract feature data, for example, by the following method: The identification unit 503 digitizes the waveform of the voice acquired by the voice acquisition unit 501, and divides the digitized voice waveform into blocks at regular time intervals. The identification unit 503 calculates a feature vector from each block and extracts the calculated feature vector as feature data.

[0044] A character string adding unit 504 associates the character string converted by the converting unit 502 or the character string translated by the translating unit 510 with the speaker identified by the identifying unit 503, and adds the character string to the memorandum in chronological order.

[0045] The operation display unit 505 accepts various operations via the operation unit 16 and displays various screens on the display unit 17. The operation display unit 505 accepts operations such as an additional input for adding a topic to a memo during a conversation. The operation display unit 505 displays a screen of the memo creation app on the display unit 17.

[0046] When the topic adding unit 506 receives an additional input via the operation display unit 505, it adds a symbol indicating a topic break to the memo.

[0047] The feature registration unit 507 registers the features of the participants' voices, which are acquired by the voice acquisition unit 501 before the start of the conversation, in the speaker information table in association with the participants.

[0048] After the conversation ends, the approval receiving unit 508 receives inputs approving the memorandum from the speakers identified by the identification unit 503. When the approval receiving unit 508 receives inputs approving the memorandum from all speakers, it finalizes the memorandum.

[0049] The communication unit 509 communicates with other terminals different from the memorandum creation device 1 regarding the creation and transmission of memorandums.

[0050] In a predetermined case, the translation unit 510 translates the character string converted by the conversion unit 502 into a set language.

[0051] FIG. 3 is a diagram schematically showing a speaker information table stored in storage device 14. As shown in FIG.

[0052] Referring to Fig. 3, the speaker information table is a table in which speaker information is registered. The speaker information includes the speaker's name, feature data of the speaker's voice, and the display color of the character string of the speaker's utterance. Here, the speaker information table includes four pieces of speaker information that have been registered in the past. For example, the speaker information listed at the top of the four pieces of speaker information includes the speaker name "A," feature data named "Data a," and the display color "black."

[0053] In a predetermined case, the memo creation device 1 extracts feature data based on the acquired voice. The feature data is, for example, a feature vector calculated based on the waveform of the voice. If the extracted feature data is new feature data that is not registered in the speaker information table, the memo creation device 1 registers new speaker information including the new feature data in the speaker information table.

[0054] FIG. 4 is a diagram showing a schematic diagram of a conference menu table stored in the storage device 14. As shown in FIG.

[0055] Referring to FIG. 4, the conference menu table is a table in which conference menus are registered. A conference menu includes a type of conference and multiple agenda items to be discussed in that type of conference. Here, the conference menu table includes three conference menu items that have been registered in the past. For example, the conference menu listed at the top of the three conference menus includes a conference type called "Regular Meeting" and agenda items related to this conference type, "1. Confirmation of Sales," "2. Confirmation of Projected Sales," and "3. Presentation of Issues from Each Department." The memorandum creation device 1 may add a new conference menu item to the conference menu table in a predetermined case.

[0056] It should be noted that the order of deliberation may or may not be set for the multiple agenda items in the meeting menu, as shown in FIG.

[0057] (Home screen mode)

[0058] FIG. 5 is a diagram showing a home screen 31 of the memorandum creation application in the first embodiment of the present invention.

[0059] 5, the user UR performs a predetermined input (for example, pressing an icon of a memo creation application) through the operation unit 16. When the predetermined input is received, the memo creation device 1 starts up the memo creation application, enters the home screen mode, and displays the home screen 31 of the memo creation application on the display unit 17.

[0060] The home screen 31 includes a message 20 prompting the user to select a mode, and buttons 21, 23, 25, and 27. Button 21 is a button for selecting the conference mode. Button 23 is a button for selecting the voice registration mode. Button 25 is a button for selecting the conference menu creation mode. Button 27 is a button for selecting the minutes distribution mode.

[0061] (Conference mode)

[0062] When starting a conference, the user UR presses the button 21 on the home screen 31 via the operation unit 16. When the button 21 is pressed, the memo creation device 1 transitions to conference mode and first displays the conference setting screen 32 shown in FIG. 4 on the display unit 17.

[0063] FIG. 6 is a diagram showing a conference setting screen 32 of the memorandum creation application in the first embodiment of the present invention.

[0064] Referring to FIG. 6, conference setting screen 32 is a screen for setting the conference and minutes, and includes list box 210, check box 211, list box 212, buttons 213 and 214, and check box 290, which will be described later.

[0065] List box 210 accepts the setting of the type of meeting. The types of meetings registered in the meeting menu table (FIG. 4) are displayed in list box 210. In this example, list box 210 displays the types of meetings, "Regular Meeting," "Sales Contract," and "Labor-Management Agreement," and the type of meeting, "Regular Meeting," is set.

[0066] A check box 211 accepts a setting as to whether or not the language of the minutes should be unified.

[0067] List box 212 accepts the language setting when a check mark is placed in check box 211. Here, the candidates "Japanese" and "English" are displayed in list box 212, and "Japanese" is set as the language. When the check mark is removed from check box 211, list box 212 is grayed out and cannot be set.

[0068] Button 213 is a button for confirming the set contents, and button 214 is a button for discarding the set contents.

[0069] The user UR sets the meeting and minutes on the meeting setting screen 32, and then presses the button 213 via the operation unit 16 to start the meeting. When the button 213 is pressed, the memo creation device 1 confirms the settings, creates new minutes in the storage device 14, and starts capturing audio of comments made during the meeting. The memo creation device 1 also displays the minutes creation screen 33 shown in FIG. 7 on the display unit 17. When the button 214 is pressed, the memo creation device 1 discards the settings and returns to the home screen 31.

[0070] 7 and 8 are diagrams showing the minutes creation screen 33 of the memo creation app in the first embodiment of the present invention. Note that in Fig. 7, Fig. 9, and Fig. 17, differences in the display color of the text in the minutes text box are expressed by differences in the hatching applied to the text.

[0071] Referring to FIG. 7, minutes creation screen 33 is a screen that is displayed while minutes are being created (in other words, during the meeting), and includes a title 215, a check box 216, a text box 217, and a scroll bar 218.

[0072] The title 215 displays the set type of meeting and the agenda item under discussion (in other words, the topic in progress). Here, the type of meeting, "Regular Meeting," and the agenda item, "Sales Confirmation," which is the first agenda item for the meeting type, "Regular Meeting," are displayed. By displaying the agenda items under discussion on the minutes-taking screen 33 in this way, anyone viewing the minutes-taking screen 33 can easily understand the agenda items under discussion. The agenda items under discussion included in the title 215 are displayed in a different format from the agenda items added to the check boxes 216 (for example, in a larger size than the agenda items added to the check boxes 216).

[0073] The number of check boxes 216 provided is the same as the number of agenda items. The corresponding agenda item is displayed in each check box 216. In this example, three check boxes 216 are provided. Each check box 216 corresponds to one of the three agenda items, "sales confirmation," "projected sales confirmation," and "raising issues from each department," for the type of meeting called "regular meeting."

[0074] The text box 217 displays the minutes stored in the storage device 14. The portion of the minutes displayed in the text box 217 can be changed by moving the scroll bar 218.

[0075] When starting to discuss the first agenda item, the user UR checks the check box 216 corresponding to the first agenda item on the minutes creation screen 33 via the operation unit 16. When a check mark is added to the check box 216, the memorandum creation device 1 adds a symbol 219 indicating the agenda item corresponding to the check box 216 to the minutes stored in the storage device 14, and updates the minutes displayed in the text box 217 to the latest one. In this example, the user UR checks the check box 216a corresponding to the first agenda item, "1. Sales Confirmation." The memorandum creation device 1 adds the symbol 219, which includes the order of the agenda item "1. Sales Confirmation" and the string of the agenda item, to the beginning of the minutes.

[0076] It should be noted that if the order of the agenda items is set in the meeting menu, the symbol 219 indicating the first agenda item may be added to the minutes stored in the storage device 14 without any input by the user UR.

[0077] When the memo creation device 1 acquires audio of speech during a conversation through the microphone 18, it converts the acquired audio into text. If the setting to unify the language of minutes is enabled on the conference setting screen 32 and audio in a language different from the set language is acquired, the memo creation device 1 converts the acquired audio into text in the language of the audio and then translates the converted text into the set language.

[0078] Furthermore, when the memo creation device 1 acquires audio of a conversation through the microphone 18, it extracts feature data of the audio from the acquired audio by the audio acquisition unit 501. The memo creation device 1 compares the extracted feature data with the speaker information table. If speaker information matching the extracted feature data is registered in the speaker information table, the memo creation device 1 uses the speaker information to identify the speaker and display color of the converted character string. On the other hand, if speaker information matching the extracted feature data is not registered in the speaker information table, the memo creation device 1 sets arbitrary speaker names and display colors in the speaker information and registers new speaker information including the extracted feature data in the speaker information table. The memo creation device 1 uses the new speaker information to identify the speaker and display color of the converted character string.

[0079] The memorandum creation device 1 associates the converted character string with the identified speaker, adds it to the minutes stored in the storage device 14 in chronological order (for example, so that the character strings of the comments are arranged from one side of the minutes to the other in chronological order), and updates the minutes displayed in the text box 217 to the latest one. The character string of each speaker in the minutes displayed in the text box 217 is displayed in the display color described in the speaker information of that speaker. In this case, a black character string related to the comment of speaker "A" and a blue character string related to the comment of speaker "B" are added to the minutes in the text box 217. The display color may also be reflected in the character string of each speaker in the minutes stored in the storage device 14. Note that the converted character string is preferably displayed in a different manner for each speaker, and the character string may be displayed so that the font, size, etc., in addition to the display color, differ for each speaker.

[0080] The memorandum creation device 1 may accept amendments to the minutes displayed in the text box 217 through the operation unit 16. The amendments to the minutes displayed in the text box 217 are reflected in the minutes stored in the storage device 14.

[0081] Referring to FIG. 8, when the user UR moves on to the next agenda item during a meeting, the user UR checks the check box 216 corresponding to the next agenda item on the minutes creation screen 33 via the operation unit 16. When the check mark is added to the check box 216, the memo creation device 1 adds a symbol 219 indicating the agenda item corresponding to the check box 216, for example, after the most recently converted character string in the minutes stored in the storage device 14, and updates the minutes displayed in the text box 217 to the latest one. In this example, the user UR checks the check box 216b corresponding to the next agenda item, "2. Confirmation of expected sales." The memo creation device 1 adds the symbol 219, which includes the order of the agenda item "2. Confirmation of expected sales" and the character string of the agenda item, after the character string related to the statement of the speaker "A" in the minutes, "A: Since there seems to be no other opinions, let's move on to the next agenda item."

[0082] The input that triggers adding an agenda item to the minutes is arbitrary, and may be, in addition to adding a check mark as described above, obtaining a voice that reads out the next agenda item, or selecting an agenda item displayed on the minutes creation screen 33. Furthermore, if the order of agenda items is set in the meeting menu, the input that triggers adding an agenda item to the minutes may be obtaining a voice that indicates that the agenda item will be moved to the next agenda item, or an operation to move to the next minutes.

[0083] Furthermore, the symbol 219 added to the minutes may be any symbol indicating a break in a topic, and may be a page break symbol, a line break symbol, etc., in addition to the above-mentioned symbols indicating the agenda. The symbol indicating the agenda may be a symbol including the above-mentioned character string of the agenda, or may be a number indicating the order of the agenda.

[0084] When the user UR ends the meeting, he / she performs a predetermined input (for example, double-clicking the title 215 via the operation unit 16, or checking the check boxes of all the agenda items). When the predetermined input is received, the memorandum creation device 1 displays the minutes approval screen 34 shown in FIG. 9 on the display unit 17.

[0085] FIG. 9 is a diagram showing the minutes approval screen 34 of the memorandum creation application in the first embodiment of the present invention.

[0086] Referring to FIG. 9, minutes approval screen 34 is a screen for accepting approval of the minutes from speakers recorded in the minutes, and includes a text box 220, a scroll bar 221, and a plurality of buttons 222.

[0087] The minutes stored in the storage device 14 are displayed in the text box 220. The minutes at the end of the meeting include converted character strings of the comments made by the speakers during the meeting and symbols indicating the agenda inserted at appropriate points in the converted character strings. The portion of the minutes displayed in the text box 220 can be changed by moving the scroll bar 221.

[0088] The memo creation device 1 may accept amendments to the minutes displayed in the text box 220 through the operation unit 16. The amendments to the minutes displayed in the text box 220 are reflected in the minutes stored in the storage device 14.

[0089] Each of the multiple buttons 222 is pressed when the participant displayed in the text box 220 approves the minutes. In this example, there are four speakers in the meeting: "A," "B," "C," and "D," and a button 222 is displayed for each of the four participants.

[0090] A speaker in a conference views the minutes displayed in text box 220, and if he or she approves the minutes, presses button 222 corresponding to that person via operation unit 16. The pressed button 222a is grayed out and cannot be pressed again.

[0091] When all buttons 222 have been pressed, the memo creation device 1 finalizes the minutes and ends the conference mode. The memo creation device 1 may finalize the minutes after adding information indicating that all participants have approved the minutes (such as the string "All speakers authenticated") to the minutes. The memo creation device 1 may also finalize the minutes after adding information such as characteristic data of each participant and the date and time of the conference. After finalization, the minutes are stored in the storage device 14 in an uneditable state.

[0092] The memorandum creation device 1 may acquire information about the participants of the meeting by inputting it through the operation unit 16, and finalize the minutes when approval (pressing the button 22) is received from all the participants.

[0093] FIG. 10 is a flowchart showing the process performed by the memo creating device 1 in the conference mode according to the first embodiment of the present invention.

[0094] 10, when the mode shifts to the conference mode, CPU 11 displays conference setting screen 32 and accepts settings for the conference and minutes (S101). Next, CPU 11 determines whether the set contents have been confirmed (S103).

[0095] In step S103, if it is determined that the set contents have not been confirmed (discarded) (NO in S103), the CPU 11 displays the home screen 31 and ends the process.

[0096] If it is determined in step S103 that the set contents have been confirmed (YES in S103), the CPU 11 creates new minutes and stores them in the storage device 14 (S105). Next, the CPU 11 starts capturing audio (S107) and displays the minutes creation screen 33 (S109). Next, the CPU 11 determines whether or not audio has been captured (S111).

[0097] In step S111, if it is determined that a voice has been acquired (YES in S111), the CPU 11 performs a text conversion process (S113), and the process proceeds to step S115.

[0098] In step S111, if it is determined that audio is not to be acquired (NO in S111), the CPU 11 proceeds to the process of step S115.

[0099] In step S115, the CPU 11 determines whether or not an input to add an agenda item has been accepted (S115).

[0100] If it is determined in step S115 that an input to add an agenda item has been received (YES in S115), the CPU 11 adds the necessary agenda item after the most recently converted character string in the minutes stored in the storage device 14 (S117), and updates the minutes displayed on the conference setting screen 32 (S119). Next, the CPU 11 determines whether an input to end the conference has been received (S121).

[0101] If it is determined in step S115 that the input to add an agenda item has not been accepted (NO in S115), or if it is determined in step S121 that the input to end the conference has not been accepted (NO in S121), the CPU 11 proceeds to the processing of step S111.

[0102] If it is determined in step S121 that an input to end the conference has been received (YES in S121), the CPU 11 displays the minutes approval screen 34 and receives approval for the minutes from the participants (S123). Next, the CPU 11 determines whether approval for the minutes has been received from all participants (S125). The CPU 11 repeats the process of step S125 until it determines that approval for the minutes has been received from all participants.

[0103] If it is determined in step S125 that approval of the minutes has been received from all participants (YES in S125), the CPU 11 finalizes the minutes (S127) and ends the process.

[0104] FIG. 11 shows a subroutine of the character conversion process (S113) in FIG.

[0105] 11, in the characterization process (S113), CPU 11 converts the acquired voice into a character string in the language of the acquired voice (S151). Next, CPU 11 determines whether or not a setting to unify the language of the minutes is valid (S153).

[0106] In step S153, if it is determined that the setting to unify the language of the minutes is valid (YES in S153), the CPU 11 determines whether the converted voice is in a language different from the set language (S154).

[0107] In step S154, if it is determined that the converted voice is in a language different from the set language (YES in S154), the CPU 11 translates the converted character string (S155), and proceeds to the process of step S159.

[0108] If it is determined in step S153 that the setting to unify the language of the minutes is not valid (NO in S153), or if it is determined in step S154 that the converted audio is not in a language different from the set language (NO in S154), the CPU 11 proceeds to processing in step S159.

[0109] In step S159, the CPU 11 extracts feature data from the acquired voice (S159), and determines whether or not speaker information including the feature data is registered in the speaker information table (S161).

[0110] In step S161, if it is determined that speaker information including feature data is registered in the speaker information table (YES in S161), the CPU 11 proceeds to the process of step S165.

[0111] In step S161, if it is determined that speaker information including feature data is not registered in the speaker information table (NO in S161), CPU 11 registers new speaker information including feature data in the speaker information table (S163), and proceeds to processing of step S165.

[0112] In step S164, the CPU 11 identifies the speaker (S164). Next, the CPU 11 associates the converted or translated character string with the speaker of the identified speaker information and adds it to the minutes stored in the storage device 14 in chronological order (S165). Next, the CPU 11 updates the minutes displayed on the minutes creation screen 33 to the latest one (S167) and returns.

[0113] (Voice registration mode)

[0114] The memo creation device 1 may register the voice feature data of the meeting participants in the speaker information table before the meeting starts. This allows the speaker to be identified with high accuracy when there are many participants in the meeting.

[0115] Before starting the meeting, a participant of the meeting presses button 23 on the home screen 31 (FIG. 3) via the operation unit 16. When button 23 is pressed, the memo creation device 1 transitions to a voice registration mode, and first displays voice registration screen 35 shown in FIG. 12(a) on the display unit 17.

[0116] FIG. 12 is a diagram showing a voice registration screen 35 of the memorandum creation application in the first embodiment of the present invention.

[0117] 12(a), the voice registration screen 35 is a screen for registering voice feature data of the participants in the speaker information table, and includes a message 231 encouraging speech, and buttons 232 and 233. The button 232 is a button for starting acquisition of the spoken voice. The button 233 is a button for ending the voice registration mode.

[0118] A participant of the conference presses button 232 on the voice registration screen 35 via the operation unit 16 and then makes a predetermined utterance. The memo creation device 1 acquires the voice of the utterance and extracts feature data from the acquired voice. If the memo creation device 1 succeeds in extracting the feature data, it displays a speaker name registration screen 36 shown in FIG. 12(b) on the display unit 17.

[0119] Referring to FIG. 12(b), speaker name registration screen 36 is a screen for registering a speaker name and display color in the speaker information table, and includes message 234 prompting the user to set the speaker name and display color, text box 235, combo box 236, and buttons 237 and 238. Text box 235 accepts input of the speaker name. Combo box 236 accepts the setting of the display color from among a plurality of color candidates. Button 237 is a button for confirming the set content. Button 238 is a button for discarding the content if no setting is made.

[0120] Here, the text box 235 is left blank (that is, an arbitrary speaker name is set), and the display color is set to "black."

[0121] When a conference participant wants to set his / her own participant name and display color in the minutes, he / she makes the necessary settings in the text box 235 and the combo box 236 via the operation unit 16 and then presses the button 237. When the button 237 is pressed, the memo creation device 1 registers the set participant name and display color and the extracted feature data in the speaker information table as new speaker information. On the other hand, when a conference participant does not want to set his / her own participant name and display color in the minutes, he / she presses the button 238 via the operation unit 16. When the button 238 is pressed, the memo creation device 1 registers an arbitrary participant name and display color different from the participant name and display color already registered in the speaker information table, and the extracted feature data in the speaker information table as new speaker information.

[0122] FIG. 13 is a flowchart showing the process performed by the memo creating device 1 in the voice registration mode according to the first embodiment of the present invention.

[0123] Referring to FIG. 13, when the mode shifts to the voice registration mode, CPU 11 displays voice registration screen 35 (S201), and determines whether or not an instruction to start acquiring the voice of the voice has been accepted (S203).

[0124] In step S203, if it is determined that the instruction to start acquiring the voice of the utterance has not been accepted (NO in S203), the CPU 11 ends the process.

[0125] If it is determined in step S203 that an instruction to start acquiring the voice of the utterance has been received (YES in S203), the CPU 11 starts acquiring the voice and extracting the feature data (S205). Next, the CPU 11 determines whether the extraction of the feature data has been successful (S207). The CPU 11 repeats the process of step S207 until it determines that the extraction of the feature data has been successful.

[0126] If it is determined in step S207 that the extraction of the feature data has been successful (YES in S207), the CPU 11 displays the speaker name registration screen 36 (S209) and determines whether or not an operation to set the speaker name and display color has been accepted (S211).

[0127] If it is determined in step S211 that an operation to set the speaker name and display color has been accepted (YES in S211), CPU 11 registers the speaker information including the set speaker name and display color and the feature data in the speaker information table (S213), and terminates the processing.

[0128] In step S211, if it is determined that the operation to set the speaker name and display color is not accepted (NO in S211), CPU 11 registers speaker information including an arbitrary speaker name and display color and feature data in the speaker information table (S215), and terminates the processing.

[0129] (Meeting menu creation mode)

[0130] The memo creation device 1 may accept the registration of a new conference menu in the conference menu table through the conference menu creation mode. This allows the user UR to create minutes that match the content of the conference when the desired conference menu is not in the conference menu table.

[0131] Before starting the meeting, a meeting participant presses button 25 on home screen 31 (FIG. 3) via operation unit 16. When button 25 is pressed, memorandum creation device 1 transitions to a meeting menu creation mode, and displays meeting menu creation screen 37 shown in FIG. 14 on display unit 17.

[0132] FIG. 14 is a diagram showing a meeting menu creation screen 37 of the memorandum creation application in the first embodiment of the present invention.

[0133] Referring to FIG. 14, the conference menu creation screen 37 is a screen for registering a conference menu in the conference menu table, and includes text boxes 251 and 252 and buttons 253, 254, 255, and 256. The text box 251 is an input field for the type of conference. A plurality of text boxes 252 are provided. Each of the plurality of text boxes 252 is an input field for an agenda and accepts input of each of a plurality of agenda items related to the type of conference entered in the text box 251. The button 253 is a button for decreasing the number of text boxes 252 by one. The button 254 is a button for increasing the number of text boxes 252 by one. The button 255 is a button for registering the entered content. The button 256 is a button for discarding the entered content.

[0134] Here, the word "interview" is entered as the type of meeting, and three topics are entered as topics: "1. Self-introduction," "2. Work history," and "3. Reasons for applying." The order of topics can be set arbitrarily.

[0135] On the meeting menu creation screen 37, the user UR inputs the type of meeting in text box 251 via the operation unit 16, inputs the meeting agenda in text box 252, and then presses button 255. When button 255 is pressed, the memo creation device 1 registers the input meeting agenda and topic as a meeting menu in the meeting menu table. When button 256 is pressed, the memo creation device 1 discards the content input on the meeting menu creation screen 37 and returns to the home screen 31.

[0136] FIG. 15 is a flowchart showing the process performed by the memo creation device 1 in the conference menu creation mode according to the first embodiment of the present invention.

[0137] Referring to FIG. 15, when the mode shifts to the conference menu creation mode, the CPU 11 displays the conference menu creation screen 37 (S301), and determines whether an operation to increase or decrease the number of input fields for the agenda has been accepted (S302).

[0138] In step S302, if it is determined that an operation to increase or decrease the number of input fields for the agenda has been received (YES in S302), CPU 11 increases or decreases the number of input fields for the agenda in accordance with the operation (S303), and proceeds to the process of step S305.

[0139] In step S302, if it is determined that an operation to increase or decrease the number of input fields for the agenda is not accepted (NO in S302), the CPU 11 proceeds to the process of step S305.

[0140] In step S305, the CPU 11 determines whether or not an operation to register a conference menu has been accepted (S305).

[0141] In step S305, if it is determined that an operation to register a conference menu has been accepted (YES in S305), the CPU 11 registers the input conference menu in the conference menu table (S307), and ends the process.

[0142] In step S305, if it is determined that the operation to register the conference menu has not been accepted (NO in S305), the CPU 11 discards the input conference menu and ends the process.

[0143] (Minutes distribution mode)

[0144] The memorandum creation device 1 may distribute the finalized minutes stored in the storage device 14 to the necessary recipients in accordance with the operation of the user UR. This allows the user UR to distribute the created minutes to the desired recipients (such as participants in the meeting).

[0145] After the meeting ends, the user UR presses the button 27 on the home screen 31 (FIG. 3) via the operation unit 16. When the button 27 is pressed, the memorandum creation device 1 transitions to the minutes distribution mode and first displays the minutes selection screen 38 shown in FIG.

[0146] FIG. 16 is a diagram showing the minutes selection screen 38 of the memorandum creation application in the first embodiment of the present invention.

[0147] Referring to FIG. 16, the minutes selection screen 38 is a screen for selecting minutes to be distributed, and includes a message 271 prompting the user to select minutes to be distributed, a radio button 272, and buttons 273 and 274. The radio button 272 accepts the selection of minutes to be distributed from the minutes stored in the storage device 14. The same number of radio buttons 272 as the number of minutes stored in the storage device 14 are displayed, and one radio button 272 corresponds to the file name of one minutes. Here, the file name of the minutes is a combination of the type of meeting related to the minutes and the date and time of the meeting. Button 273 is a button for confirming the selected minutes. Button 274 is a button for discarding the selection of minutes.

[0148] The memorandum creation device 1 may accept input of a destination (such as a URL of an external server) for saving the minutes to be distributed, instead of accepting selection of the minutes to be distributed from among the minutes stored in the storage device 14.

[0149] The user UR selects the file name of the minutes to be distributed on the minutes selection screen 38 via the operation unit 16, and then presses button 273. When button 273 is pressed, the memo creation device 1 displays a distribution destination input screen 39 on the display unit 17. When button 274 is pressed, the memo creation device 1 discards the content entered on the minutes selection screen 38 and returns to the home screen 31.

[0150] FIG. 17 is a diagram showing a distribution destination input screen 39 of the memorandum creation application in the first embodiment of the present invention.

[0151] Referring to Figure 17, the distribution destination input screen 39 is a screen that accepts input of distribution destinations for the minutes, and includes a message 275 prompting input of distribution destinations, a text box 276, a scroll bar 277, a text box 278, and buttons 279 and 280.

[0152] The text box 276 displays the selected minutes in an uneditable state. The portion of the minutes displayed in the text box 276 can be changed by moving the scroll bar 277. The text box 278 is an input field for distribution destinations (email addresses, etc.). The number of text boxes 278 displayed may be the same as the number of speakers included in the selected minutes. The number of text boxes 278 may be increased or decreased by input from the operation unit 16. The button 279 is a button for confirming the entered distribution destinations. The button 280 is a button for discarding the entered distribution destinations.

[0153] The user UR inputs the distribution destinations of the minutes on the distribution destination input screen 39 via the operation unit 16, and then presses the button 279. When the button 279 is pressed, the memo creation device 1 distributes (sends) the selected minutes to the input distribution destinations. When the button 280 is pressed, the memo creation device 1 discards the content input on the distribution destination input screen 39 and returns to the home screen 31.

[0154] FIG. 18 is a flowchart showing the process performed by the memorandum creation device 1 in the minutes distribution mode according to the first embodiment of the present invention.

[0155] Referring to FIG. 18, when the mode is shifted to the minutes distribution mode, CPU 11 displays minutes selection screen 38 (S401), and determines whether or not the selected agenda has been confirmed (S403).

[0156] If it is determined in step S403 that the selected agenda item has been confirmed (YES in S403), the CPU 11 displays the distribution destination input screen 39 (S405). Next, the CPU 11 determines whether the input distribution destination has been confirmed (S407).

[0157] In step S407, if it is determined that the input distribution destinations have been confirmed (YES in S407), the CPU 11 transmits the selected minutes to the input distribution destinations (S409), and ends the process.

[0158] If it is determined in step S403 that the selected agenda item has not been confirmed (discarded) (NO in S403), or if it is determined in step S407 that the input distribution destination has not been confirmed (discarded) (NO in S407), the CPU 11 ends the processing.

[0159] [Second embodiment]

[0160] Fig. 19 is a diagram illustrating the operation of the memo creation device 1 in the second embodiment of the present invention. Fig. 20 is a diagram illustrating a state in which a check mark is added to the check box 290 on the conference setting screen 32 of the memo creation app in the second embodiment of the present invention.

[0161] 19 and 20, in this embodiment, the memo creation device 1 accepts input to a memo creation application from at least one terminal 3 via a network line 7 during a web conference. The memo creation device 1 is a terminal used by a user UR, and the terminal 3 is a terminal used by a conference participant PT other than the user UR. The terminal 3 includes a CPU, a ROM, a RAM, a storage device, a network interface, an operation unit, a display unit, a microphone, and the like. In addition to the memo creation device 1, the terminal 3 may also store a memo creation program 50. In this case, the terminal 3 may instead execute part of the processing executed by the memo creation device 1 (for example, processing executed by the conversion unit 502 or the identification unit 503). The memo creation program 50 itself may have the function of transmitting and receiving images and audio necessary for a web conference.

[0162] 20 , when accepting input from the terminal 3 while creating minutes, the user UR checks the check box 290 when making settings on the conference setting screen 32. When the check box 290 is checked, the memorandum creation device 1 generates connection information 291 (such as an IP address or URL) and displays it on the conference setting screen 32. The connection information 291 is information necessary to connect to the memorandum creation device 1 through the network line 7.

[0163] The user UR notifies the participant PT of the connection information 291 by sending an e-mail from the memorandum creation device 1 to the terminal 3, for example (process PR1).

[0164] The participant PT who has acquired the connection information 291 connects the terminal 3 to the memorandum creation device 1 based on the connection information 291 at the start of the conference (process PR2).

[0165] When displaying the minutes creation screen 33 on the display unit 17, the memorandum creation device 1 transmits data of the displayed minutes creation screen 33 to the terminal 3 (process PR3). Based on the received data, the terminal 3 displays the minutes creation screen 33 on the display unit of the terminal 3.

[0166] The terminal 3 transmits the audio of the participant PT's speech during the conference, acquired through the microphone of the terminal 3, to the memo creation device 1 (process PR4). The memo creation device 1 processes the audio acquired from the terminal 3 in the same way as it processes the audio acquired through the microphone 18 of the memo creation device 1 (converting it into text, identifying the speaker, etc.).

[0167] When displaying the minutes approval screen 34 on the display unit 17, the memorandum creation device 1 transmits data of the displayed minutes approval screen 34 to the terminal 3 (process PR5). Based on the received data, the terminal 3 displays the minutes approval screen 34 on the display unit of the terminal 3.

[0168] The terminal 3 transmits the input approving the minutes received through the operation unit of the terminal 3 to the memorandum creation device 1 (process PR6). When the memorandum creation device 1 receives the input approving the minutes from the terminal 3, it reflects the input on the minutes approval screen 34 displayed on the display unit 17. Furthermore, when the memorandum creation device 1 receives the input approving the minutes through the operation unit 16, it reflects the input on the minutes approval screen 34 displayed on the display unit 17.

[0169] The memorandum creating device 1 cuts off the connection with the terminal 3 when the minutes are finalized and the conference mode is ended.

[0170] The configurations and operations of memorandum creation program 50 and memorandum creation device 1 other than those described above are the same as those in the first embodiment, and therefore description thereof will not be repeated.

[0171] [Effects of the embodiment]

[0172] According to the above-described embodiment, the speaker is identified based on the audio of the utterances made during the conversation, and the audio of the utterances made during the conversation is converted into text and added to the memo, making it easy to create a memo of the conversation. In addition, by performing a predetermined input during the conversation, symbols indicating the division of topics are added to the memo, making it possible to clarify the correspondence between the character strings in the memo and each topic. As a result, convenience can be improved.

[0173] [others]

[0174] The various screens of the memo creation application in the above-described embodiment are merely examples, and other display modes may be used.

[0175] The above-described embodiments can be combined as appropriate.

[0176] The above-described embodiments and modifications should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0177] 1. Memorandum Creation Device 3. Terminal 7 Network lines 11 CPU(Central Processing Unit) 12 ROM (Read Only Memory) 13 RAM (Random Access Memory) 14 Storage device 15 Network Interface 16 Control section 17 Display section 18. Mike 20, 231, 234, 271, 275 messages 21,23,25,27,213,214,222,222a,232,233,237,238,253,254,255,256,273,274,279,280 buttons 31 Home screen 32 Conference setting screen 33 Minutes creation screen 34 Minutes Approval Screen 35 Voice registration screen 36 Speaker name registration screen 37 Meeting menu creation screen 38 Minutes selection screen 39 Distribution destination input screen 50 Memorandum Creation Program 210,212 List Box 211, 216, 216a, 216b, 290 Checkboxes 215 Title 217,220,235,251,252,276,278 Text Box 218,221,277 Scrollbar 219 symbols 236 Combo Box 272 Radio Buttons 291 Connection Information 501 Voice Acquisition Unit 502 Conversion Unit 503 Specific part 504 String Addition Section 505 Operation display section 506 Topic Addition Section 507 Feature Registration Department 508 Approval Reception Department 509 Communications Department 510 Translation Department PR1, PR2, PR3, PR4, PR5, PR6 processing

Claims

1. A memo creation program for creating a memo of a conversation including multiple topics, an acquisition step of acquiring audio of utterances during the conversation; a conversion step of converting the speech acquired in the acquisition step into a character string; an identifying step of identifying a speaker of the voice acquired in the acquiring step based on characteristics of the voice acquired in the acquiring step; a character string adding step of associating the character string converted in the converting step with the speaker identified in the identifying step and adding the character string to the memorandum stored in a storage device in chronological order; a display step of displaying on a display unit a screen including a first area displaying the plurality of topics and an ongoing topic among the plurality of topics, and a second area displaying a memorandum stored in the storage device, the second area being an area different from the first area; an input receiving step of receiving a predetermined input during the conversation; a topic adding step of adding a symbol indicating a topic break to the memo stored in the storage device after the latest character string added in the character string adding step when the predetermined input is received in the input receiving step; an end accepting step of accepting an input to end the conversation; After the symbol is added to the memorandum in the topic adding step, if an input to end the conversation is not accepted in the end accepting step, audio of utterances made during the conversation is acquired in the acquiring step; A memorandum creation program that, in the input acceptance step, accepts as the specified input the selection of the next topic after the ongoing topic from among the multiple topics displayed in the first area, or the addition of a check mark to a check box corresponding to the next topic displayed in the first area.

2. 2. The memorandum creation program according to claim 1, wherein in said displaying step, the character string converted in said converting step is displayed on said display unit in a different manner for each speaker.

3. 3. The memorandum creation program according to claim 1, wherein the symbol includes a character string of one of the plurality of topics stored in the storage device.

4. a pre-start acquisition step of acquiring voices of participants of the conversation before the conversation starts; a feature registration step of registering the voice features acquired in the pre-start acquisition step in the storage device in association with the participants; 4. The memorandum creation program according to claim 1, wherein in the identifying step, the speaker of the voice acquired in the acquiring step is identified based on the voice characteristics registered in the characteristics registering step.

5. an approval receiving step of receiving an input approving the memorandum from the speaker identified in the identification step after the conversation ends; A memorandum creation program as described in any one of claims 1 to 4, further comprising causing a computer to execute a confirmation step of confirming the memorandum when the approval input is received from all speakers identified in the identification step in the approval receiving step.

6. The approval receiving step a first approval receiving step of receiving, in a computer having the memorandum creation program installed therein, an input approving the memorandum from the speaker identified in the identifying step; The memorandum creation program of claim 5, further comprising a second approval receiving step of receiving an input approving the memorandum from the speaker identified in the identification step via a network line from a computer other than the computer on which the memorandum creation program is installed.

7. The obtaining step includes: a first acquisition step of acquiring, in a computer having the memorandum creation program installed thereon, a voice of a utterance made during the conversation; A memorandum creation program as described in any one of claims 1 to 6, further comprising a second acquisition step of acquiring audio of utterances made during the conversation via a network line from a computer other than the computer on which the memorandum creation program is installed.

8. A memorandum creation program as described in any one of claims 1 to 7, further comprising a screen transmission step of transmitting screen data displaying an ongoing topic among the plurality of topics to a computer other than the computer on which the memorandum creation program is installed via a network line.

Images