Information processing device, information processing method, program, and recording medium

Abstract

To improve the ease of creating a minute book for an interview.SOLUTION: An information processing device includes a display processing unit which performs processing of displaying an editing screen comprising a text display area that displays interview text data obtained by converting sound-recording data of an interview into a text, an analysis result display area that displays analysis result text data being text data showing the analysis result related to the content of the interview, and a text editing area being an area to which the analysis result text data can be transferred and in which the transferred analysis result text data can be edited.SELECTED DRAWING: Figure 22

Description

[Technical field]

[0001] The present invention relates to an information processing device and method, a program, and a recording medium, and in particular to a technique for supporting the creation of minutes of an interview. [Background technology]

[0002] For example, in the case of business negotiations conducted as part of a company's sales activities, or other interviews that involve dialogue between multiple people, it is common practice to prepare minutes summarizing the contents of the meetings.

[0003] Furthermore, as described in Patent Document 1 below, there is a technique for converting the speech of each person in a business negotiation into text based on audio recording data of the business negotiation, and for creating a summary of the content of the business negotiation based on the converted speech data. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 7223469 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, Patent Document 1 discloses that a screen is presented to the user that includes a text display area (the "Transcription" area in Figure 3) that displays the text data of utterances made during business negotiations, and a summary display area (the "Summary" area in Figure 3) that displays, in text data, a summary of the business negotiations generated based on the text data.

[0006] Displaying the summary of the business negotiation as text data, as in the summary display area described above, is beneficial in that the user can use the summary text data when creating minutes of the meeting.

[0007] However, the screen described in Patent Document 1 does not have an area that allows the creation of minutes, and in order to create minutes by reusing the summary text data, the user is forced to go to the trouble of opening a separate editing screen (separate software) to edit the text for the minutes.

[0008] The present invention has been made in consideration of the above circumstances, and has an object to improve the ease of creating minutes of interviews. [Means for solving the problem]

[0009] The information processing device of the present invention is equipped with a display processing unit that performs processing to display an editing screen including a text display area that displays interview text data obtained by converting recorded data of an interview into text, an analysis result display area that displays analysis result text data, which is text data that shows the analysis results related to the content of the interview, and a text editing area, which is an area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited. According to the above configuration, an editing screen including not only a text display area and an analysis result display area but also a text editing area is displayed, so that it is possible to eliminate the need to open a separate editing screen when creating minutes using the analysis result text data. Effect of the Invention

[0010] According to the present invention, it is possible to reduce the effort required for a user to create minutes of an interview, and to improve the ease of creating minutes. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a minutes-taking support system according to an embodiment. [Diagram 2] FIG. 1 is a block diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment. [Diagram 3]FIG. 2 is a block diagram illustrating an example of a hardware configuration of a server device according to an embodiment. [Figure 4] 13 is a diagram showing an example of a registration screen for interview participant information in an embodiment. FIG. [Diagram 5] FIG. 13 is a diagram showing an example of a recording list screen in the embodiment. [Figure 6] FIG. 13 is a diagram showing an example of a confirmation screen in the embodiment. [Figure 7] FIG. 13 is a diagram showing an example of an error screen in the embodiment. [Figure 8] FIG. 13 is a diagram showing an example of an editing screen (before speaker / group setting and analysis processing are performed) in the embodiment. [Figure 9] FIG. 13 is a diagram showing an example of a setting screen for setting speaker groups in the embodiment. [Figure 10] 13 shows an example of information displayed in the speaker / group setting area after information has been set. FIG. [Figure 11] FIG. 13 is a diagram showing an example of an editing screen (after setting speakers and groups) in the embodiment. [Figure 12] 13 is a diagram showing an example of display of analysis result text data on an editing screen. FIG. [Figure 13] 11A and 11B are diagrams illustrating an example of a change operation of already-set group information. [Figure 14] 14 is a diagram illustrating an example of a display state of the spoken text display area in response to the change operation shown in FIG. 13 being performed. FIG. [Figure 15] 11 is an explanatory diagram of a keyword search function and a batch text replacement function on the edit screen. [Figure 16] FIG. 13 is an explanatory diagram of a keyword search function and a batch text replacement function on the edit screen. [Figure 17] FIG. 13 is an explanatory diagram of the arrangement order of text data of main points copied to a text editing area. [Figure 18] FIG. 13 is an explanatory diagram of the arrangement order of text data of main points copied to the text editing area. [Figure 19]FIG. 13 is an explanatory diagram of the arrangement order of text data of main points copied to the text editing area. [Figure 20] FIG. 13 is an explanatory diagram of the arrangement order of text data of main points copied to the text editing area. [Figure 21] 13A and 13B are diagrams illustrating a schematic diagram of a horizontal size change of a spoken text display area and a vertical size change of a gist list display area. [Figure 22] FIG. 2 is an explanatory diagram of functions of an information processing apparatus according to an embodiment; [Diagram 23] FIG. 2 is an explanatory diagram of functions of a server device according to an embodiment. [Figure 24] 13 is a flowchart of a process performed when the minutes editor is launched. [Diagram 25] 13 is a flowchart of a process relating to group setting. [Figure 26] 13 is a flowchart of a process corresponding to execution of an analysis process. [Figure 27] 13 is a flowchart of a process for creating minutes using a text editing area. [Figure 28] FIG. 13 is a diagram showing a configuration example of a modified example of a minutes-taking support system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present invention will be described in the following order. <1. System configuration example> <2. Configuration example of information processing device> <3. Flow from interview to creating minutes and example of display screen> <4. Example of functional configuration> <5. Processing Procedure> <6. Variations> <7. Summary of the embodiment>

[0013] <1. System configuration example> FIG. 1 is a block diagram showing an example of the configuration of a minutes-taking support system 100 including an information processing device according to an embodiment of the present invention. As shown in the figure, the minutes creation support system 100 as an embodiment includes an information processing device 1 and a server device 20. The information processing device 1 and the server device 20 are configured with a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The information processing device 1 and the server device 20 are capable of mutual data communication via a network NT, which is a predetermined communication network such as the Internet.

[0014] The minutes creation support system 100 of the embodiment has a function of recording the interview, a function of analyzing the contents of the interview based on the recorded interview data, and a function of presenting text data showing the results of the analysis (hereinafter referred to as "analysis result text data") to the user on a screen. The user can use the analysis result text data presented on the screen to create minutes of the interview.

[0015] In this embodiment, a "business negotiation" between a sales representative Hs and a customer Hc is taken as an example of an "interview." The sales representative Hs is a person who participates in business negotiations, performs sales activities, and takes minutes of the business negotiations. The sales representative Hs can be considered as the host in a business meeting, while the customer Hc can be considered as the guest in the meeting.

[0016] The information processing device 1 is a computer device such as a PC (personal computer), a tablet terminal, or a smartphone used by a sales representative Hs. In this example, the business negotiation is conducted face-to-face between a sales representative Hs and a customer in a real space, such as a conference room, in which the information processing device 1 is placed. Here, the participants in the interview are multiple sales representatives Hs and multiple customers Hc (specifically, in the example, two of each), but the business negotiation may be conducted with the participation of at least one sales representative Hs and one customer Hc.

[0017] The information processing device 1 has a function of recording the business negotiations. The recorded data of the business negotiations obtained by the recording function is transmitted to the server device 20 via the network NT, and is stored (accumulated) in the server device 20.

[0018] The server device 20 has a function of converting recorded data of an interview (a business negotiation in this example) into text, i.e., a function of generating text data by transcribing (writing down) spoken portions of the interview, and an analysis function of performing an analysis process related to the contents of the interview based on the text data obtained by the text conversion function (hereinafter referred to as "interview text data"). Specifically, the analysis function in this embodiment is a function of performing a summary creation process that is a process of creating a summary of the interview, a main point list creation process that is a process of creating a list of main points of the interview, and a question and answer identification process that is a process of identifying question portions and answer portions in the interview.

[0019] In the minutes creation support system 100, text data showing the analysis results obtained by the analysis function of the server device 20 as described above (hereinafter referred to as "analysis result text data") is displayed on a screen to the sales representative Hs as a user. Specifically, the analysis result text data showing the analysis results as a summary, a list of key points, questions and answers, etc. as described above is displayed on a screen and presented to the user. In this example, it is assumed that the screen display of such analysis result text data is performed by the information processing device 1.

[0020] The user can efficiently create minutes by using the analysis result text data of the interview presented as described above. Specifically, the user can transcribe (copy) text data such as a summary presented as the analysis result text data and use it to create minutes, which eliminates the need to create minutes from scratch, improving the efficiency of creating minutes.

[0021] In this embodiment, the analysis result text data is presented by displaying one editing screen (editing screen Ge, described later) including an analysis result display area for displaying the analysis result text data and a text editing area for creating minutes. Here, the text editing area is an area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited.

[0022] Since an editing screen including not only an analysis result display area but also a text editing area is displayed, it is possible to eliminate the need to open a separate editing screen when creating minutes using the analysis result text data. Therefore, the effort required for the user to create minutes of an interview can be reduced, and the ease of creating minutes can be improved. In particular, when the interview is a business meeting as in this example, the improved ease of creating minutes can improve the efficiency of business negotiation activities and contribute to an improvement in the success rate.

[0023] <2. Configuration example of information processing device> FIG. 2 is a block diagram showing an example of a hardware configuration of the information processing device 1. As shown in FIG. 2, the information processing device 1 includes a CPU 1a, a ROM 2, and a RAM 3. The CPU 1a functions as an arithmetic processing unit that performs various processes, and executes the various processes according to a program stored in the ROM 2 or a program loaded from the storage unit 9 to the RAM 3. The RAM 3 also stores data and the like required for the CPU 1a to execute the various processes, as appropriate.

[0024] The CPU 1a, the ROM 2, and the RAM 3 are connected to one another via a bus 4. To this bus 4, an input / output interface (I / F) 5 is also connected.

[0025] An input unit 6 for inputting various information is connected to the input / output interface 5. Specifically, the input unit 6 has an operation input unit having an operator or an operation device for inputting operation information by a user, and an audio input unit for inputting an audio signal detected by a microphone. In the input unit 6, various types of operators and operation devices are assumed as the operation input unit, such as a keyboard, a mouse, a key, a touch panel, a touch pad, a dial, a remote controller, etc. An operation is detected by the operation input unit, and a signal corresponding to the detected operation is interpreted by the CPU 1a. In addition, in the input unit 6, the audio signal input by the audio input unit is stored in a storage device such as the memory unit 9 described later under the control of the CPU 1a, or is converted from an electrical signal to sound via the audio output unit 8 and output (emitted as sound).

[0026] Further, the input / output interface 5 is connected, either integrally or separately, to a display unit 7 formed of an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) panel, and an audio output unit 8 formed of a speaker, etc. The display unit 7 is used to display various types of information, and is configured by, for example, a display device provided in the housing of the information processing device 1, a separate display device connected to the information processing device 1, or the like.

[0027] The display unit 7 executes display of images for various image processing, moving images to be processed, etc. on the display screen based on instructions from the CPU 1a. Also, the display unit 7 displays various operation menus, icons, messages, etc., that is, GUI (Graphical User Interface), based on instructions from the CPU 1a.

[0028] The input / output interface 5 may be connected to a storage unit 9 and a communication unit 10 . The storage unit 9 is configured with a hard disk drive (HDD) or a solid state drive (SSD) and stores various types of information.

[0029] The communication unit 10 performs communication processing via a transmission path such as the Internet, and communication with various devices via wired / wireless communication, bus communication, and the like.

[0030] A drive 12 is also connected to the input / output interface 5 as required, and a removable recording medium 11 such as a memory card or an optical disk is appropriately attached thereto.

[0031] The drive 12 allows data files such as programs used in each process to be read from the removable recording medium 11. The read data files are stored in the storage unit 9, and images and sounds contained in the data files are output on the display unit 7 and the audio output unit 8. In addition, the computer programs and the like read from the removable recording medium 11 are installed in the storage unit 9 as necessary.

[0032] In the information processing device 1 having the above hardware configuration, for example, software for the processing of this embodiment can be installed via network communication by the communication unit 10 or a removable recording medium 11. Alternatively, the software may be stored in advance in the ROM 2, the storage unit 9, etc.

[0033] The CPU 1a performs processing operations based on various programs, thereby executing information processing and communication processing required to realize processing of the information processing device 1 as an embodiment described later.

[0034] FIG. 3 is a block diagram showing an example of the hardware configuration of the server device 20. As shown in FIG. In the following description, parts that are similar to parts that have already been described will be given the same reference numerals and description thereof will be omitted.

[0035] The difference from the information processing device 1 shown in FIG. 2 is that an analysis unit 20b is added. For convenience of explanation, the CPU 1a included in the server device 20 will be referred to as CPU 20a as shown in the figure.

[0036] The analysis unit 20b is configured as, for example, a signal processor or an AI (Artificial Intelligence) processor, and performs various analysis processes related to the contents of the interview based on the recorded data of the interview. Specifically, in this example, the analysis unit 20b performs at least the summary creation process, the main point list creation process, and the question and answer identification process described above. The details of the analysis processes executed by the analysis unit 20b, including the summary creation process, the main point list creation process, and the question and answer identification process, will be described later.

[0037] Here, the analysis process by the analysis unit 20b may be executed by the CPU 20a, particularly when the analysis process is performed as a rule-based process rather than an AI process.

[0038] The server device 20 is not limited to being configured as a single computer device as shown in Fig. 3, but may be configured as a system of multiple computer devices. The multiple computer devices may be systemized using a LAN (Local Area Network) or the like, or may be located in a remote location using a VPN (Virtual Private Network) using the Internet or the like. The multiple computer devices may include computer devices as a server group (cloud) available through a cloud computing service.

[0039] <3. Flow from interview to creating minutes and example of display screen> As described above, the business negotiation in this example is conducted face-to-face in real space between the sales representative Hs and the customer Hc, and the content of the conversation during the business negotiation is recorded by the information processing device 1 used by the sales representative Hs. In this example, a software program (hereinafter referred to as "recording software") for realizing various functions related to recording business negotiations is installed in the information processing device 1, and sales representative Hs conducts business negotiations with the recording software running. It is also possible to adopt a so-called SaaS (Software as a Service) type configuration in which recording software is stored on the server device 20 side and the software is provided as a service.

[0040] FIG. 4 shows an example of a participant information registration screen Gr displayed by the recording software. As shown in the figure, the registration screen Gr has input boxes b1, b2, and b3 for inputting the company name, name, and position of the customer Hc (customer) in the business negotiation, and an input box b4 for inputting the name of the sales representative Hs himself. Input boxes b1, b2, and b3 for customer Hc can be added by operating an add button B1 in the figure, making it possible to input information for a plurality of customers Hc. The registration screen Gr also includes a start button B2 for issuing an instruction to start recording.

[0041] In this registration screen Gr, the sales representative Hs inputs the company name, name, and job title of the customer Hc, as well as his own name, and operates the start button B2 to cause the information processing device 1 to start recording the business negotiation.

[0042] Although not shown in the figure, after recording begins, a recording stop button is displayed on the screen of the recording software, and the sales representative Hs can operate the stop button to instruct the information processing device 1 to stop recording the business negotiation (end instruction).

[0043] When an instruction to stop recording the business negotiation is given, the CPU 1a of the information processing device 1 performs processing for storing the recording data of the business negotiation and the participant information in the server device 20. Specifically, the recording data of the business negotiation, the information on the name and job title of the customer Hc entered on the registration screen Gr, and the information on the name of the sales representative Hs are transmitted to the server device 20 and stored therein.

[0044] The server device 20 associates the recorded data of the business negotiation sent from the information processing device 1 with participant information (information on the company name, name, position, and name of the sales representative Hs of the customer Hc) and stores them in a specified storage device such as the memory unit 19. At this time, the server device 20 assigns a negotiation ID, which serves as an identifier for the negotiation, to each recording data of the negotiation.

[0045] In the minutes-taking support system 100 of this embodiment, a list of recording data of business negotiations stored in the server device 20 can be presented to a user as a sales representative Hs. Specifically, in this example, the above-mentioned recording software is provided with a function for accessing such a list of recorded data. In other words, in this case, the user as the sales representative Hs can receive a recording list screen Gi, which is a list screen of recorded data, by operating an access button (not shown) to the recorded data list displayed on the screen of the recording software.

[0046] FIG. 5 shows an example of the recording list screen Gi. As shown in the figure, the recording list screen Gi displays, for each business negotiation ID, date and time information of the business negotiation, a play button Bp, participant information, and an input memo field. In this example, the date and time information of the business negotiation includes the start time (recording start time) and end time (recording end time). The playback button Bp is a button for issuing an instruction to play back the recording data of the business negotiation associated with the business negotiation ID. The information entered on the registration screen Gr is displayed as the participant information. If there are any items on the registration screen Gr that have not been entered, a message to that effect is displayed. In the input memo field, memo information after the business negotiation can be input as text. The information input in the input memo field is stored in association with the business negotiation ID.

[0047] In addition, the recording list screen Gi can also display links to data on materials used in business negotiations (see "Main Materials" in the figure).

[0048] On the recording list screen Gi, a minutes creation button B3 for instructing the start of software as a minutes editor is displayed for each business negotiation ID. The user as the sales representative Hs operates the minutes creation button B3 displayed on the recording list screen Gi for the business negotiation for which the minutes are to be created.

[0049] In response to the operation of the minutes creation button B3, the information processing device 1 performs a process of launching software as a minutes editor. The minutes editor is software that displays the above-mentioned editing screen Ge, that is, a screen for creating minutes including an analysis result display area and a text editing area, and performs processes related to creating minutes.

[0050] In the above example, the recording software is given the ability to access the recording list screen Gi, but access to the recording list screen Gi can be achieved by specifying the URI (Uniform Resource Identifier) ​​of the recording list screen Gi, regardless of the software used.

[0051] In addition, in this example, the process for creating minutes using the editing screen Ge is performed by minutes software installed on the information processing device 1, but it is also possible for the minutes software to take the aforementioned SaaS type form, that is, the software is stored on the server device 20 side and the software is provided as a service.

[0052] In addition, in the above example, the recorded data of the business negotiation is transmitted to the server device 20 in response to the operation to stop recording. However, the recorded data may also be transmitted to the server device 20 in response to an operation by the sales representative Hs after the business negotiation, separate from the operation to stop recording, or may be transmitted in real time during the business negotiation.

[0053] As described below, in this embodiment, the editing screen Ge displayed by the minutes editor is provided with a button that instructs the execution of analysis processing related to the contents of the business negotiation, such as creating the summary described above, and the server device 20 executes the analysis processing in response to the operation of the button. In this example, this analysis process is provided to the sales representative Hs as a paid service, and a contract is made in advance between the provider of the paid analysis process service and the company to which the sales representative Hs belongs regarding the number of times the analysis process can be used and the period during which it can be used. As an example for the purpose of explanation, the number of times the analysis process can be used is managed on a company basis, but it is also possible to manage the number of times the analysis process can be used on another basis, such as on a sales representative Hs basis.

[0054] In the server device 20 of this example, information for managing the number of times the analysis process can be used and the period during which it can be used, as determined by the contract, is stored. Specifically, information on the number of times the analysis process can be used and the period during which it can be used, and information indicating the number of times the analysis process is used after the contract is made (number of times it is executed: in this example, the number of times per company) are stored.

[0055] In this example, the information processing device 1 (CPU 1a) inquires of the server device 20 about the number of times and the period during which the analysis process can be used, in response to the operation of the minutes creation button B3 and the execution of the process of launching the minutes editor. In this example, this inquiry is made by specifying the company ID for identifying the company to which the sales representative Hs belongs. Based on the information of the company ID specified by the information processing device 1, the server device 20 refers to the information on the number of times the analysis process can be used, the number of times it is used, and the period during which it can be used that are managed in association with the company ID, and performs a process of determining whether or not the conditions for enabling the analysis process are met based on this information. Specifically, in this example, it is determined whether or not both the number of times condition that the number of times the analysis process of the company is used is equal to or less than the number of times it can be used, and the time limit condition that the current date and time is within the period during which the analysis process can be used are met.

[0056] The server device 20 returns the result of this determination to the information processing device 1. Specifically, the result of the determination as to whether or not the number of times condition is satisfied and the result of the determination as to whether or not the time limit condition is satisfied are returned.

[0057] Based on the response information from the server device 20, the CPU 1a judges whether or not both the number of times condition and the time limit condition are satisfied. If it is determined that both the number of times condition and the deadline condition are satisfied, the CPU 1a performs processing to display a confirmation screen Ga shown in FIG. 6, and if it is determined that at least either the number of times condition or the deadline condition is not satisfied, the CPU 1a performs processing to display an error screen Gb shown in FIG. 7.

[0058] The confirmation screen Ga shown in Fig. 6 displays the available time and the remaining number of times to summarize. The available time is information indicating the remaining time for which the analysis process can be executed, and in this example, as shown in the figure, information indicating the ratio of the remaining time to the available period under the contract is displayed together with the information on the remaining time. The remaining number of times abstraction can be performed is information indicating how many more times the analysis process can be performed under the contract, and in this example, together with the information on the remaining number of times, information indicating the ratio of the remaining number of times to the number of times that can be used under the contract is displayed.

[0059] On the confirmation screen Ga, information on the available period is required to display information on the available time, and information on the available number of times and the number of uses is required to display information on the remaining number of times to summarize. When the CPU 1a determines that both the number of times condition and the deadline condition are met, it performs processing to obtain information on the available period, the available number of times, and the number of uses from the server device 20.

[0060] By displaying such a confirmation screen Ga, in the case where the analysis process is provided as a paid service, the user can easily know whether or not it is time to renew the contract.

[0061] The error screen Gb shown in FIG. 7 displays at least message information indicating that the availability conditions of the analysis process are not met. Specifically, in this example, message information indicating which of the above-mentioned deadline conditions and number of times conditions are not met, and message information indicating that the minutes editor cannot be started because the availability conditions are not met are displayed. As the former message information, when only the deadline condition of the deadline condition and the number of times condition is not met, message information indicating that the deadline condition is not met, such as "the available period has been exceeded" as exemplified in the figure, is displayed. Also, when only the number of times condition of the deadline condition and the number of times condition is not met, message information indicating that the number of times condition is not met, such as "the available number of times has been exceeded", is displayed, and when both the deadline condition and the number of times condition are not met, message information indicating that both the deadline condition and the number of times condition are not met, such as "the available period and the number of times has been exceeded", is displayed.

[0062] An OK button B5 is displayed on the error screen Gb. The user as the sales representative Hs can close the error screen Gb by operating this OK button B5.

[0063] An OK button B4 is displayed on the confirmation screen Ga shown in Fig. 6. In response to the operation of this OK button B4, the CPU 1a performs a process of closing the confirmation screen Ga and a process of displaying an edit screen Ge shown in Fig. 8.

[0064] The editing screen Ge shown in FIG. 8 is the editing screen Ge before an instruction to execute the analysis process is given. As will be described later, in the editing screen Ge of this example, a display area for analysis result text data (analysis result display area Aa, which will be described later) is displayed on the screen in response to an instruction to execute analysis processing.

[0065] The editing screen Ge in Figure 8 includes an utterance text display area At, a recording period display area Ap, a speaker / group setting area Ah, and a text editing area Ae, as well as an input box b5, a play button Bp, copy (transcription) buttons B10 and B11, an analysis execution button B13, a speaker setting instruction button B14, an output button B15, and a clipboard copy button B16.

[0066] As shown in the figure, in the editing screen Ge of this example, the speech text display area At, the speaker / group setting area Ah, and the text editing area Ae are arranged from left to right on the screen in the following order: utterance text display area At, speaker / group setting area Ah, text editing area Ae. In this example, the recording period display area Ap is disposed below the spoken text display area At.

[0067] The spoken text display area At is an area in which text data of spoken portions in an interview are displayed for each speaker. In this embodiment, the text data of the spoken portion is generated by converting the recorded data of the interview into text by the server device 20. The technology for converting the recorded voice data into text, i.e., the technology for converting voice data into text data, is a well-known technology, and a detailed description thereof will be omitted here.

[0068] In this example, the server device 20 divides the speech portion into a predetermined number of blocks and manages them. The block unit here is, for example, a unit of the duration of the speech. In other words, the timing at which the speech is interrupted is recognized as the end of a block.

[0069] Furthermore, the server device 20 in this embodiment also performs speaker separation processing based on the recorded data. The speaker separation process is a process for identifying which speaker each speech portion is from. Specifically, for example, a voiceprint analysis process is performed on the recorded data, and a speaker ID is associated with each detected voiceprint. For example, speaker A, speaker B, speaker C, etc. are assigned as this speaker ID. Then, a process for identifying the speech section for each speaker in the recorded data is performed based on the voiceprint information for each speaker. By identifying the speech section for each speaker in this way for the recorded data, it is possible to identify the correspondence between the speech portion and the speaker for the speech text data obtained by converting the recorded data into text.

[0070] The CPU 1a displays the text data of the speech part for each speaker in the speech text display area At based on the text data of each speech part obtained by the speaker separation processing of the server device 20 and information indicating the correspondence between each speech part and the speaker ID. In this example, the text data of the speech portions of each speaker are displayed in chronological order from the top to the bottom of the screen. In this example, the speech text display area At displays speaker icons as identifiers of the speech parts for each speaker. At the stage of Fig. 8, the speaker icons display speaker IDs such as speakers A, B, and C that are assigned in the speaker separation process.

[0071] In addition, in the utterance text display area At at the stage of Fig. 8, all the text data of the utterance portion for each speaker is displayed close to either the left or right end of the utterance text display area At. Specifically, in this example, the text data is displayed close to the left end of the utterance text display area At as shown in the figure.

[0072] The recording period display area Ap is an area for displaying recording period display information that graphically represents the recording period of the interview. As shown in the figure, in the recording period display area Ap in this example, information showing the recording period of the interview in the form of a bar extending in the left-right direction is displayed as recording period display information. In the recording period display area Ap, a seek bar Sb for indicating the playback position of the recording data is displayed in association with the recording period display information. This seek bar Sb can be moved left and right, and the user can operate the play button Bp after moving the seek bar Sb to instruct the information processing device 1 to play the recording data from the playback position indicated by the position of the seek bar Sb.

[0073] In this embodiment, the recording period display information displays information showing the distribution of the speech period for each speaker. Specifically, the recording period display information in this case displays a bar indicating the recording period for each speaker, and displays the information on the speech period for each speaker in a different display format for each speaker. For example, it is possible to display the color or pattern of the speech period for each speaker differently. In this example, the bar for each speaker indicating the recording period displays the speaker icon of the corresponding speaker.

[0074] By displaying information showing the distribution of speaking periods for each speaker as recording period display information as described above, the user can easily grasp information such as which speaker spoke for how long during what period during the interview, and the amount of speech each speaker made, allowing the user to easily understand which speaker's speech they should pay attention to when creating the minutes. In addition, by displaying the speech period information for each speaker in a different display format for the recording period display information, the user can intuitively identify the speech period for each speaker. When a user wants to check the recording data for a specific speech portion of a specific speaker during the process of creating minutes, the ease of searching for that speech portion can be improved.

[0075] In addition, in the recording period display area Ap of this embodiment, the negotiation process period information Is is displayed in association with the recording period display information. Here, the negotiation process period information Is is information indicating the name and period of each negotiation process when the negotiation is divided into processes according to a predetermined criterion.

[0076] The server device 20 in this embodiment performs a process of identifying negotiation steps in a negotiation based on the audio recording data of the negotiation. The negotiation steps referred to here are stages in the progress of the negotiation, and examples of such information include "ice-breaker (small talk)", "needs analysis", "proposal / explanation", and "negotiation". Specifically, the server device 20 performs a process of identifying the negotiation process based on text data obtained by converting the audio recording data of the negotiation into text. This process may be performed by an AI model generated by performing machine learning such as deep learning using the text data as learning input data and the correct answer data of the negotiation process as teacher data. Alternatively, it may be realized as a rule-based process in which frequently occurring words for each negotiation process are predetermined as process identification keywords, and the negotiation process is identified based on the results of matching with the process identification keywords.

[0077] The CPU 1a performs display processing of the negotiation process period information Is based on the period information (information indicating the start time and end period of a process) for each negotiation process obtained as a result of the processing for identifying the negotiation process by the server device 20. In the figure, an example of the negotiation process period information Is is shown when five processes, ST1 to ST5, are identified as the negotiation process.

[0078] By displaying the negotiation process period information Is, i.e., the chronological information of the negotiation process, in association with the recording period display information as described above, when a user wishes to check the recording data of a specific speech portion of a specific speaker during the process of creating minutes, it is possible to improve the ease of searching for that speech portion.

[0079] Although the recording period display information has been described above as an example in which the recording period is represented by a bar shape, the recording period may also be represented by another shape such as an arc shape. When the recording period is represented in an arc shape, it is possible to use, as the playback position indication operator, an operator that performs rotational movement, rather than an operator that performs sliding movement, such as the seek bar Sb.

[0080] The speaker / group setting area Ah is an area for setting the name of each speaker and the group for each speaker. Group setting here means setting which group each speaker belongs to, with respect to two groups: the self-group, which is the group on the sales representative Hs (user)'s side, and the other-side group, which is the group on the sales representative Hs's other side (i.e., the customer Hc's side).

[0081] In the speaker / group setting area Ah, when group setting has not been performed, each speaker is displayed to indicate that she belongs to the other party's group, as shown in the figure. Note that the display mode when group setting has not been performed is not limited to this, and other display modes may be adopted, such as a display indicating that each speaker belongs to the user's group.

[0082] In the editing screen Ge of this example, when the user wishes to set the speaker's name and group, he or she operates the speaker setting instruction button B14. Then, a setting screen Gs for setting speakers and groups as shown in FIG. 9 is displayed on the speaker / group setting area Ah. As shown in the figure, the setting screen Gs is provided with an input box b6 for inputting the speaker's name, a selection operator for selecting one's own group / other party group, a save button B20, and a cancel button B21. Here, an example of the setting screen Gs for speaker B is shown, but in this example, in response to the operation of the speaker setting instruction button B14 described above, the setting screen Gs is displayed in sequence starting from speaker A, and the user can input name information in the input box b6 starting from speaker A, set a group by operating the selection operator s1, and perform a save operation using the save button B20, thereby inputting the name and setting a group for each speaker. When the cancel button B21 is operated on the setting screen Gs, the CPU 1a ends the acceptance of the setting operation of the speaker name and group, and performs processing to return to the screen display state of FIG. 8, for example.

[0083] FIG. 10 shows an example of display information in the speaker / group setting area Ah when the name and group for each speaker are set on the setting screen Gs described above. As shown in the figure, the set name information is displayed for each speaker. Also, as shown in Figure 8 above, in the speaker / group setting area Ah, before the name of each speaker is set, information such as A, B, or C indicating the speaker ID is displayed as the speaker icon, but after the name is set, the speaker icon displays the initial letter of the name, as shown in Figure 10. In this case, in the speaker / group setting area Ah, the speaker set to the other party's group is displayed in the other party's group area, and the speaker set to your own group is displayed in your own group area, according to the group settings for each speaker.

[0084] In this example, the settings of the name and group for each speaker in the speaker / group setting area Ah are also reflected in the speech text display area At. Specifically, as in the editing screen Ge shown in FIG. 11, the speaker icon for each speaker in the spoken text display area At is changed to a notation showing the initials of the set name.

[0085] Furthermore, in the utterance text display area At, in accordance with the group setting for each speaker, the utterance text data of the speaker belonging to the self-group is moved toward one of the left and right ends, and the utterance text data of the speaker belonging to the other-group is moved toward the other left and right end. Specifically, in this example, the utterance text data of the speaker belonging to the self-group is moved toward the right end of the utterance text display area At, and the utterance text data of the speaker belonging to the other-group is moved toward the left end of the utterance text display area At.

[0086] This allows the user to intuitively distinguish between the utterances of the user's group and the other party's group in the interview text data displayed in the utterance text display area At. In particular, when the interview is a business negotiation as in this embodiment, the user as the sales representative Hs can refer to the utterances of the person on the other party's group, the customer Hc, all at once, which increases convenience.

[0087] In this example, the setting information of the name of each speaker in the speaker / group setting area Ah is also reflected in the display information in the recording period display area Ap. Specifically, the display of the speaker icon displayed in each bar for each speaker will be changed from the speaker ID to the initials of the speaker's name.

[0088] It is also possible to associate an employee identifier with the information input into the input box b6 shown in FIG. Specifically, when name information is input in input box b6, an employee database or the like is searched to identify an employee identifier (employee number, etc.) associated with the name, and the identified employee identifier and the input name information are linked as speaker information for the recorded data. Alternatively, the opposite (when an employee identifier is input instead of a name, corresponding name information is searched and the name information and employee identifier are linked as speaker information for the recorded data) may be done. This increases convenience because users can search by both name and identifier when accessing the recorded data or minutes after they have been created.

[0089] In the editing screen Ge, the analysis execution button B13 is a button for instructing the execution of analysis processes related to the contents of the interview, such as the creation of a summary, etc. Specifically, in this example, it is a button for instructing the execution of the summary creation process, the main points list creation process, and the question and answer identification process.

[0090] In this example, the analysis processes as the summary creation process, the main point creation process, and the question and answer identification process are performed in the server device 20. Therefore, when the analysis execution button B13 is operated, the CPU 1a issues an instruction to the server device 20 to execute the analysis process.

[0091] The CPU 1a displays the analysis result text data obtained as a result of the analysis process performed by the server device 20 on the editing screen Ge.

[0092] FIG. 12 shows an example of the analysis result text data displayed on the editing screen Ge. In the editing screen Ge, the analysis result text data is displayed in the analysis result display area Aa. As shown in the figure, the analysis result display area Aa in this example is disposed in a position between the speaker / group setting area Ah and the text editing area Ae in the left-right direction of the screen.

[0093] The analysis result display area Aa is provided with a summary display area A1, a main points list display area A2, and a question and answer display area A3, as well as copy buttons B25, B26, and B27. The summary display area A1 is an area for displaying text data of the summary created in the summary creation process, and the main point list display area A2 is an area for displaying text data of the main point list created in the main point list creation process, that is, text data for each main point. The question and answer display area A3 is an area for displaying text data of the question portion and text data of the answer portion identified in the question and answer identification process.

[0094] The copy button B25 is a button for instructing to copy the text data displayed in the summary display area A1 to the text editing area Ae. In the summary display area A1 of this example, it is possible to perform a range designation operation of the text data, and the user can designate the range of the text data to be copied in the summary display area A1 and then operate the copy button B25 to instruct to copy the text data of the designated range to the text editing area Ae.

[0095] In the gist list display area A2, a check box cb for enabling selection of text data on a gist unit basis is provided for each gist. Further, a copy button B26 is provided for the main point list display area A2. The user can check any one of the check boxes cb for each key point and then operate the copy button B26 to instruct the text data of the key point corresponding to the checked check box cb to be copied to the text editing area Ae.

[0096] In the present example, the text data for each main point is arranged in the main point list display area A2 in the chronological order of the original utterance. Specifically, in the present example, the text data for a main point whose original utterance is older is arranged higher in the main point list display area A2.

[0097] In the question and answer display area A3, text data showing the question portion and text data showing the answer portion are displayed. In the question and answer display area A3 of this example, text data showing the question portion and text data showing the answer portion are arranged in the chronological order of the original utterances.

[0098] The copy button B27 is a button for instructing copying of the text data in the question and answer display area A3 to the text editing area Ae. In question and answer display area A3, it is possible to perform an operation to specify the text data of the question portion and answer portion to be copied. After performing an operation to specify the range of the text data of the question portion and answer portion to be copied in question and answer display area A3, the user can issue an instruction to copy the specified text data to text editing area Ae by operating copy button B27.

[0099] In the question and answer display area A3 of this example, the text data showing the question portion and the text data showing the answer portion are displayed so that it is possible to identify whether the comment is made by the user's group or the other party's group. Specifically, in this example, for the question and answer portions of your group, the text data is displayed toward the right edge of question and answer display area A3, and for the question and answer portions of the other group, the text data is displayed toward the left edge of question and answer display area A3. This makes it easier for a user to understand specific questions or answers from his or her own or the other party when creating minutes of a meeting.

[0100] Here, the analysis result display area Aa is provided with a summary display area A1, a main points list display area A2, and a question and answer display area A3, and in the analysis result display area Aa in this embodiment, the summary display area A1 is arranged on the uppermost side among these display areas. In other words, the CPU 1a performs display processing of the analysis result display area Aa so that the text data showing the summary is arranged on the uppermost side.

[0101] Here, "upper right" means the direction toward the top of the screen when the spoken text display area At, the analysis result display area Aa, and the text editing area Ae are arranged in the left-right direction of the screen, and means the direction toward the left of the screen when the spoken text display area At, the analysis result display area Aa, and the text editing area Ae are arranged in the top-to-bottom direction of the screen. Information displayed on the screen tends to be viewed starting from the top of the screen. Therefore, by arranging the "Summary" at the topmost part of the screen as described above, it is possible to have the user check the contents of the "Summary" before referring to the "Main Points" and "Questions and Answers." In other words, it is possible to have the user understand the overall outline of the interview from the "Summary" before referring to the "Main Points" and "Questions and Answers," making it easier for the user to understand the contents of the "Main Points" and "Questions and Answers." Therefore, the time required for the user to understand the contents of the interview can be shortened, and the efficiency of creating minutes can be improved.

[0102] In addition, in the analysis result display area Aa, the arrangement order of the summary display area A1, the main points list display area A2, and the question and answer display area A3 may be changeable based on a user operation (customizable by the user). On the other hand, it is also possible to make it impossible for the user to customize the arrangement order of the spoken text display area At, the analysis result display area Aa, and the text editing area Ae on the editing screen Ge.

[0103] Next, the text editing area Ae will be described. The text editing area Ae is an area in which the analysis result text data in the analysis result display area Aa can be transcribed and the transcribed analysis result text data can be edited. The user can use this text editing area Ae to create minutes of the meeting. Since the analysis result text data in the analysis result display area Aa, such as a list of key points or a summary, can be copied and used in the sentences that make up the minutes, there is no need to input the sentences for creating the minutes from scratch, and the efficiency of creating the minutes can be improved.

[0104] In the text editing area Ae in this embodiment, when the transferred analysis result text data is corrected, the corrected text portion is displayed in a different display mode from the uncorrected text portion. Although not shown, when the analysis result text data copied from the analysis result display area Aa is corrected by a user operation in the text editing area Ae, for example, the corrected text portion is displayed in a different color from the uncorrected text portion. Alternatively, only the corrected text portion may be displayed in bold or underlined.

[0105] In addition, in this embodiment, when the transcribed analysis result text data is corrected in the text editing area Ae, the CPU 1a performs a process of recording the text data before and after correction in a memory device in association with each other. The text data before and after the correction is recorded in a memory device in the information processing device 1, such as the storage unit 19 of the information processing device 1. Alternatively, the text data before and after the correction may be recorded in a memory device in an external device of the information processing device 1, such as the storage unit 19 of the server device 20.

[0106] Here, the text data before and after the correction in the text editing area Ae can be used for training the minutes creator. Specifically, for example, by having a low performer who is inexperienced in minutes creation refer to the text data before and after the correction by a high performer who is skilled in minutes creation, it becomes possible for the low performer to learn the skills related to minutes creation, which can contribute to the development of the low performer creator. In particular, if the interview is a business meeting, it becomes possible for the low performer to learn the skills of a high performer sales representative, which can contribute to the improvement of the sales representative's skills. In addition, the above-mentioned pre- and post-correction text data can also be used to improve and enhance the functionality of the analysis process for obtaining analysis result text data from the recorded interview data. Specifically, for example, when the analysis process is performed using an AI model, the pre- and post-correction text data can be used as learning data for machine learning to improve and enhance the analysis process. Or, even when the analysis process is performed using rule-based processing, the pre- and post-correction text data can be referred to in updating the analysis process, which can contribute to improving and enhancing the analysis process.

[0107] In addition, there are other benefits to saving the text data before and after the correction as described above, such as the following: For example, if a sales representative Hs1 modifies the minutes of a meeting to read "President xx likes golf," while another sales representative Hs2 modifies the same summary by deleting the phrase "likes golf," then sales representative Hs1 will be recognized as a high performer and sales representative Hs2 as a low performer based on past sales negotiation results, etc. Additionally, we envision an AI that automatically creates meeting minutes. In this case, by saving the text data before and after the correction, the AI ​​can learn the correction tendency of the sales representative Hs1 (always recording the customer's hobbies in the minutes, and adding a subject so that it is clear whose hobby it is). Specifically, it is possible to make the AI ​​acquire the function of recording the customer's hobbies in the minutes, including the name of the person.

[0108] In the editing screen Ge, an output button B15 and a clipboard copy button B16 are provided as operators related to the text editing area Ae. The output button B15 is a button for instructing output of the text (text as minutes) created in the text editing area Ae in a predetermined file format such as Word. The clipboard copy button B16 is a button for instructing copying of the text created in the text editing area Ae to the clipboard. By providing the output button B15 and the clipboard copy button B16, the user can save the created text data as the minutes in the information processing device 1 in a predetermined file format.

[0109] Furthermore, in the editing screen Ge of this example, an upload button B17 and a submission button B18 are also provided as operators related to the text editing area Ae. The upload button B17 is a button for instructing uploading of the text created in the text editing area Ae to a cloud server of a predetermined sales information management service (for example, Salesforce: registered trademark). For example, when the upload button B17 is operated, a dialog is displayed, and when the user specifies his / her company name on the dialog and performs an operation to instruct uploading, the text created in the text editing area Ae is uploaded to the above-mentioned cloud server.

[0110] The post button B18 is a button for instructing to post the text created in the text editing area Ae as shared information in a specified sales communication service (e.g., Slack: registered trademark). For example, when the post button B18 is operated, a dialog is displayed, and when the user designates a channel related to information sharing on the dialog and performs an operation to instruct to execute posting, the text created in the text editing area Ae is posted as shared information in the designated channel in the above-mentioned sales communication service.

[0111] In addition, in the editing screen Ge of this example, a copy button B10 and a copy button B11 are also provided as operators for issuing a copy instruction to the text editing area Ae. The copy button B10 is a button for instructing to copy the text data in the speech text display area At to the text editing area Ae. The copy button B11 is a button for instructing to copy the speaker name information and group setting information set in the speaker / group setting area Ah to the text editing area Ae. By providing these copy buttons, the efficiency of creating minutes can be further improved.

[0112] Here, in the editing screen Ge in this embodiment, it is possible to change the group information that has already been set in the speaker / group setting area Ah. Specifically, it is possible to change the set group information by dragging the display part of the speaker whose group setting is to be changed in the speaker / group setting area Ah, as shown in Fig. 13. In the illustrated example, the group setting of a speaker who belonged to the user's group is changed so that the speaker now belongs to the other party's group.

[0113] In this embodiment, when the group setting is changed as described above, the display position of the utterance text data in the utterance text display area At is changed according to the changed group setting information. Specifically, according to the changed group setting information, the display position of the utterance text data for the speaker whose group setting has been changed is switched between left edge alignment and right edge alignment (see the transition from FIG. 13 to FIG. 14).

[0114] Although not shown in the drawings, when the group setting is changed, the question and answer display area A3 of the analysis result display area Aa may also be switched between left edge alignment and right edge alignment in a similar manner.

[0115] Furthermore, the editing screen Ge of this embodiment is provided with a keyword search function and a text batch replacement function targeting the spoken text display area At. This point will be explained with reference to FIG. 15 and FIG. FIG. 15 illustrates an example of the state in which the input box b5 is clicked. When the input box b5 is clicked, a cursor CR is displayed in the input box b5, and a search button B30 and a replace button B31 are displayed below the input box b5. When a user wishes to perform a keyword search, the user inputs a keyword into the input box b2 and then operates the search button B30. In response to this operation, a keyword search is performed in the spoken text display area At. Although not shown in the figure, the keyword portion is highlighted in the spoken text display area At after the keyword search is performed. Examples of the highlighting here include displaying in a different color, making it bold, underlining, filling in a predetermined color, and the like.

[0116] When a batch replacement is desired, the user operates the replace button B31. Then, as shown in Fig. 16, for example, a replacement operation window Wc is displayed below the replacement button B31. The replacement operation window Wc has an input box b7 for inputting a search string, which is a string to be searched for, an input box b8 for inputting a replacement string, and an execute button B32 for issuing an instruction to execute a batch replacement. The user can issue an instruction to execute a batch replacement in which all strings matching the search string in the utterance text display area At are replaced with the replacement string by operating the execute button B32 after inputting the search string in the input box b7 and the replacement string in the input box b8.

[0117] Although the example given here is one in which the target range of the keyword search and the batch replacement is limited to the utterance text display area At, the target range of the keyword search and the batch replacement may include a display area other than the utterance text display area At, such as the analysis result display area Aa. Alternatively, the target range of the keyword search and the batch replacement may be a display area other than the utterance text display area At.

[0118] As described above, in the main points list display area A2 of the analysis result display area Aa, the text data of the main points is arranged in an order that follows the chronological order of the original utterance. However, in this embodiment, in the text editing area Ae, the text data of the main points transcribed from the main points list display area A2 is arranged in the order in which the transcription was performed.

[0119] A specific example will be described with reference to Figures 17 to 20. Note that, for convenience of illustration, Figures 17 to 20 mainly show only the analysis result display area Aa and the text editing area Ae of the editing screen Ge. Fig. 17 shows a state in which the text data of the third main point in the main point list display area A2 is selected as the target for copying. When the copy button B26 is operated in this state, the text data of the selected third main point is copied to the text editing area Ae, as shown in Fig. 18.

[0120] Next, as shown in FIG. 19, it is assumed that the text data of the first main point is selected as the object to be copied in the main point list display area A2. When the copy button B26 is operated in this state, the text data of the selected first main point is copied to the text editing area Ae, as shown in Fig. 20. At this time, the copied text data of the first main point is arranged below the text data of the third main point, as shown in the figure.

[0121] The minutes are not necessarily arranged according to the chronological order of the utterances in the interview, but are created by the user arranging the contents of the utterances in an appropriate order. Therefore, if the transcribed text data of the main points were arranged in the text editing area Ae according to the chronological order of the original utterances, the user may be forced to perform unnecessary rearrangement of the text data of the main points, which may reduce the efficiency of creating the minutes. By arranging the text data of the main points in the text editing area Ae in the order in which they were transcribed as described above, it is possible to prevent such unnecessary order changing operations from being performed, thereby improving the efficiency of creating minutes.

[0122] Furthermore, in the editing screen Ge in this embodiment, the size of each display area can be changed. FIG. 21 shows a schematic diagram of the horizontal size change of the spoken text display area At and the vertical size change of the gist list display area A2. For example, it is conceivable to change the size of a display area in response to an operation of dragging an edge of the display area, or to provide a button for instructing a size change for each display area, and to change the size of the display area in response to an operation of the button.

[0123] <4. Example of functional configuration> A functional configuration for realizing the information processing method according to the embodiment described above will be described with reference to Figs. FIG. 22 is an explanatory diagram of various functions of the CPU 1a of the information processing device 1 as an embodiment. As shown in the figure, the CPU 1a has functions as an interview recording section F11, a display processing section F12, and a recording processing section F13.

[0124] The interview recording section F11 is a function for recording the interview, and in this example, is a function realized by a software program such as the recording software described above.

[0125] The display processing unit F12 performs processing for displaying an editing screen Ge including an utterance text display area At, an analysis result display area Aa, and a text editing area Ae, like the editing screen Ge shown in FIG.

[0126] In this example, the display processing unit F12 performs processing to display information indicating the distribution of the speaking periods of each speaker during the interview as recording period display information in the recording period display area Ap. The display processing unit F12 also performs processing for displaying, on the editing screen Ge, a playback position indication operator (seek bar Sb) for indicating the playback position of the recording data in association with the recording period display information. Furthermore, the display processing unit F12 performs processing for displaying the negotiation process period information in association with the recording period display information in the recording period display area Ap. The display processing unit F12 also performs processing for displaying the information on the speech period in the recording period display information in a different display mode for each speaker.

[0127] In addition, in response to a group setting operation (group attribute setting operation) being performed in the speaker / group setting area Ah, the display processing unit F12 performs processing for the text data to be displayed in the utterance text display area At, such that the utterance text data of a speaker belonging to the same group is moved to one end of the utterance text display area At, and the utterance text data of a speaker belonging to the other group is moved to the other end of the utterance text display area At.

[0128] Furthermore, the display processing unit F12 performs display processing of the analysis result display area Aa so that, among the text data indicating the summary, the text data indicating the list of key points, and the text data indicating the question portion and the answer portion, the text data indicating the summary is positioned at the top right of the analysis result display area Aa.

[0129] In addition, the display processing unit F12 performs processing to display the text data indicating the question portion and the text data indicating the answer portion in the question and answer display area A3 of the analysis result display area Aa in such a way that it is possible to identify whether the comment came from the user's group or the other party's group.

[0130] Furthermore, the display processing unit F12 arranges the text data of each key point in the key point list display area A2 in an order that follows the chronological order of the original utterance, and arranges the text data of the key points transcribed in the text editing area Ae in the order in which they were transcribed.

[0131] Furthermore, when the transcribed analysis result text data is corrected in the text editing area Ae, the display processing unit F12 performs processing for displaying the corrected text portion in a display mode different from that of the uncorrected text portion.

[0132] Furthermore, in this example, the display processing unit F12, when the minutes editor is launched, performs processing to display the available time and the remaining number of available times for the analysis process as described above in Fig. 6. At this time, if it is determined that the conditions for enabling the analysis process are not satisfied, it performs processing to display an error screen Gb as shown in Fig. 7.

[0133] The display processing unit F12 in this example also performs the processes related to the keyword search and collective replacement described with reference to FIGS. Furthermore, the display processing unit F12 in this example performs processing for displaying an upload button B17 and a post button B18 on the edit screen Ge.

[0134] In addition, when an operation to change the group setting is performed in the speaker / group setting area Ah, the display processing unit F12 in this example performs processing to change the left / right alignment of the text data in the utterance text display area At (and the question and answer display area A3) based on the changed group setting information, as described above in Figures 13 and 14.

[0135] When the transcribed analysis result text data is corrected in the text editing area Ae, the recording processing unit F13 performs processing for recording the text data before and after correction in the memory device in association with each other.

[0136] FIG. 23 is an explanatory diagram of various functions possessed by the server device 20 as an embodiment, with FIG. 23A showing functions possessed by the CPU 20a in the server device 20, and FIG. 23B showing functions possessed by the analysis unit 20b in the server device 20.

[0137] In FIG. 23A, a CPU 20a has a function as a sound recording data recording unit F21. The audio recording unit F21 performs a process of recording the audio recording data of the interview transmitted from the information processing device 1 in a predetermined memory device such as the storage unit 19.

[0138] As described above, the server device 20 in this embodiment has a function of converting recorded interview data into text, and in this example, this text conversion function is a function possessed by the CPU 20a. Furthermore, the server device 20 in this embodiment has a function of dividing an utterance portion into the above-mentioned block units and managing the divided portions, and this function is also a function possessed by the CPU 20a. Furthermore, the server device 20 in this embodiment performs the above-mentioned speaker separation processing, and the speaker separation processing is also performed by the CPU 20a.

[0139] In FIG. 23B, the analysis unit 20b has functions as a summary creation processing unit F22, a main point list creation processing unit F23, and a question and answer identification processing unit F24. The summary creation processing unit F22 performs a summary creation process, which is a process of creating a summary of the interview, based on the text data of the audio recording data of the interview. The main point list creation processing unit F23 performs a main point list creation process, which is a process for creating a list of main points of the interview, based on the text data of the audio recording data of the interview. The question and answer identification process unit F24 performs a question and answer identification process, which is a process for identifying the question portion and the answer portion in the interview, based on the text data of the recorded data of the interview.

[0140] Here, the summary creation process, main point list creation process, and question and answer identification process can each be realized as a process using an AI model. For example, the summary creation process can be realized by using an AI model trained by machine learning such as deep learning so that text data can be used as input data and a summary can be obtained as output data. Similarly, the main point list creation process and question and answer identification process can be realized by using an AI model trained by machine learning such as deep learning so that text data can be used as input data and a main point list, question portion, and answer portion can be obtained as output data.

[0141] Alternatively, the summarization process, the main point list creation process, and the question and answer identification process may be realized as rule-based processes. For example, the summary creation process may be realized by a processing method of identifying unnecessary sentences in spoken language and deleting the unnecessary sentences. Also, the main point list creation process may be realized by a processing method of dividing the summary created in the summary creation process according to a predetermined rule, for example by dividing it by periods, and identifying each divided sentence as a main point. Also, the question / answer identification process may be realized by a processing method of identifying the question part in the utterance based on the recorded data, on the premise that the ending of the question part is raised, and identifying the part of the utterance next to the question part as the answer part.

[0142] In this embodiment, the server device 20 also performs the process of identifying the above-mentioned negotiation process (negotiation process identification process), but in this example, this negotiation process identification process is performed by the analysis unit 20b. As mentioned above, this negotiation process identification process can be performed by an AI model generated by machine learning such as deep learning using text data of negotiations as learning input data and correct answer data of the negotiation process as teacher data. Alternatively, it can be realized as a rule-based process in which frequently occurring words for each negotiation process are defined in advance as process identification keywords, and the negotiation process is identified based on the results of matching with the process identification keywords.

[0143] <5. Processing Procedure> An example of a specific process procedure to be executed to realize an information processing method according to an embodiment will be described with reference to the flowcharts of FIGS. In this example, the processes shown in FIGS. 24 to 27 are executed by the CPU 1a in the information processing device 1 based on a program stored in the ROM 2 or the storage unit 19, for example. As described above, the processes according to the embodiment may be realized in a SaaS format. In that case, the processes shown in FIGS.

[0144] FIG. 24 is a flowchart showing the process performed when the minutes editor is launched. In step S101, the CPU 1a waits until a minutes creating operation is performed, that is, until the minutes creating button B3 shown in FIG.

[0145] In step S101, when it is determined that the minutes creation button B3 has been operated and a minutes creation operation has been performed, the CPU 1a proceeds to step S102 and determines whether the time limit and number of times conditions are met. As described above, when the minutes creation button B3 has been operated, the CPU 1a executes a process to launch the minutes editor and inquires of the server device 20 about the number of times the analysis process can be used and the available period by specifying the company ID. In response to this, based on the information of the company ID specified by the information processing device 1, the server device 20 refers to the information on the number of times the analysis process can be used, the number of times used, and the available period managed in association with the company ID, and determines based on this information whether the conditions for the execution of the analysis process, that is, the number of times condition that the number of times the analysis process is used by the company is equal to or less than the number of times used, and the time limit condition that the current date and time is within the available period of the analysis process, are both met. In the process of step S102, the CPU 1a obtains the determination result of whether the number condition is satisfied or not and the determination result of whether the time limit condition is satisfied or not from the server device 20, and determines whether the time limit and the number condition are satisfied or not.

[0146] If it is determined in step S102 that the time limit and number of times conditions are met, the CPU 1a proceeds to step S103 to perform a process of displaying the time limit and number of times information. Specifically, the CPU 1a obtains information on the available period and the available number of times and the number of times of use from the server device 20, and based on this information, performs a process of displaying on the display unit 7 a confirmation screen Ga including information on the available time and the remaining number of times to abstract as shown in FIG.

[0147] On the other hand, if it is determined in step S102 that the time limit and the number of times conditions are not met (at least one of the time limit condition and the number of times condition is not met), the CPU 1a proceeds to step S105 and performs a process of displaying an error screen Gb. That is, as illustrated in FIG. 7, the CPU 1a performs a process of displaying an error screen Gb including message information indicating that the availability condition of the analysis process is not met on the display unit 7.

[0148] When the CPU 1a has performed the display process of the time limit and the number of times information in step S103, the CPU 1a performs the display process of the editing screen Ge in the following step S104. That is, as shown in Fig. 8, the CPU 1a performs the process of displaying the editing screen Ge (the editing screen Ge before the speaker / group setting and the analysis process) including the utterance text display area At, the speaker / group setting area Ah, the text editing area Ae, and the recording period display area Ap on the display unit 7. At this time, the CPU 1a performs a process of displaying information showing the distribution of speech sections for each speaker as recording period display information in the recording period display area Ap. The CPU 1a also performs a process of displaying the speech periods for each speaker in different display modes in the recording period display information. The CPU 1a also performs a process of displaying the recording period display information in association with a seek bar Sb. The CPU 1a also performs a process of displaying the recording period display information in association with negotiation process period information Is. In addition, the CPU 1a performs a process of displaying an upload button B17 and a submission button B18 on the edit screen Ge.

[0149] The CPU 1a ends the series of processes shown in FIG. 24 when it has performed the display process in step S104 or when it has performed the display process in step S105.

[0150] FIG. 25 is a flowchart of the process relating to group setting. It is assumed that the process of displaying the edit screen Ge has already been executed in step S104 before the process shown in Fig. 25 is executed. This also applies to the process of Fig. 26 described later.

[0151] In step S201, the CPU 1a waits until a group setting operation is performed, that is, until a group setting operation is performed in the speaker / group setting area Ah as described above with reference to Figs.

[0152] When it is determined in step S201 that a group setting operation has been performed, the CPU 1a proceeds to step S202 and executes text edge alignment processing of the text display area according to the group setting information for each speaker. Specifically, in the utterance text display area At, the CPU 1a performs processing to align the utterance text data of the speaker set in the self-group to the right edge of the area and the utterance text data of the speaker set in the other-party group to the left edge of the area.

[0153] After executing the process of step S202, the CPU 1a ends the series of processes shown in FIG.

[0154] FIG. 26 is a flowchart of a process corresponding to execution of the analysis process. In step S301, the CPU 1a waits until an instruction to execute analysis is given, that is, until the above-mentioned analysis execution button B13 is operated.

[0155] When it is determined that the analysis execution button B13 has been operated and an instruction to execute analysis has been issued, the CPU 1a proceeds to step S302 and performs a process of displaying the analysis result. That is, as shown in FIG. 12, the CPU 1a performs a process of displaying the editing screen Ge including the analysis result display area Aa on the display unit 7. When an instruction to execute analysis is given, the CPU 1a instructs the server device 20 to execute an analysis process, and acquires the analysis result text data obtained as a result of the analysis process from the server device 20. Specifically, in this example, the text data acquired is a summary, a list of main points, and questions and answers. The CPU 1a performs a process to display the text data of each item thus acquired in the analysis result display area Aa on the editing screen Ge.

[0156] At this time, the CPU 1a performs the display process of step S302 so that the summary display area A1 is located on the rightmost side (the upper side in this example) in the analysis result display area Aa. The CPU 1a also performs the process of displaying the text data indicating the question portion and the text data indicating the answer portion in the question and answer display area A3 so that it is possible to identify which of the group, the user's group or the other party's group, the comment came from. Moreover, the CPU 1a performs processing so that the text data of the main points is arranged in the main point list display area A2 in the order according to the chronological order of the original speech.

[0157] After executing the process of step S302, the CPU 1a ends the series of processes shown in FIG.

[0158] FIG. 27 is a flowchart of a process for creating minutes using the text editing area Ae. It is assumed that, when the process shown in FIG. 27 is executed, the analysis process has already been executed and the editing screen Ge including the analysis result display area Aa has been displayed in the previous step S302.

[0159] In step S401, the CPU 1a waits until a transfer operation is performed, that is, until a copy operation is performed using the copy button B25, B26, or B27 on the analysis result text data in the analysis result display area Aa.

[0160] If it is determined in step S401 that a transfer operation has been performed, the CPU 1a proceeds to step S402 to perform a transfer process according to the operation, that is, a process of copying the analysis result text data instructed by the transfer operation into the text editing area Ae. At this time, if the analysis result text data instructed to be transcribed is text data of key points in the key point list, the CPU 1a performs processing so that the text data of the key points is arranged in the order of copying in the text editing area Ae.

[0161] In step S403 following step S402, the CPU 1a waits until a correction operation is performed on the transcribed text, that is, until a correction operation is performed on the copied text data in the text editing area Ae.

[0162] In step S403, when it is determined that a correction operation has been performed on the transcribed text, the CPU 1a proceeds to step S404 and performs a correction-corresponding display process. Specifically, in this example, the CPU 1a performs a process of displaying the corrected text portion in a display mode different from that of the uncorrected text portion.

[0163] In step S405 following step S404, the CPU 1a performs a process of recording the pre-correction / post-correction text, i.e., a process of recording the pre-correction text data and the post-correction text data in a predetermined memory device such as the storage unit 19 in association with each other. As described above, the pre-correction / post-correction text data may be recorded in a memory device in an external device of the information processing device 1, such as the storage unit 19 of the server device 20.

[0164] After executing the process of step S405, the CPU 1a ends the series of processes shown in FIG.

[0165] In addition, with regard to the recording process in step S405, it is conceivable to record not only the text before and after correction, but also information on which item ("Summary," "List of Main Points," or "Questions and Answers") the copied portion is from, as well as information on the negotiation process related to the copied portion.

[0166] <6. Variations> The embodiment is not limited to the specific example described above, and various modified configurations may be adopted. For example, in the above example, the interview is a business negotiation, but interviews to which the technology of the present invention can be applied include various opportunities for people to communicate with each other, such as business negotiations, as well as interviews in the medical field, counseling, lectures, speeches, education, and entertainment.

[0167] In addition, although the above describes an example in which the interview is conducted face-to-face, the technology of the present invention can also be suitably applied to cases in which the interview is conducted as an online interview. 28 illustrates an example in which an online interview is conducted between an information processing device 1 used by a sales representative Hs and an information processing device 30 such as a PC used by a customer Hc. Here, the online interview can be realized by exchanging at least audio between the information processing device 1 and the information processing device 30. Of course, a camera can be provided to conduct an online interview with video. By using video data as well as audio recording data as information relating to the interview, it becomes possible to perform analysis based on the speaker's gestures and hand movements in the analysis process, thereby improving analysis performance.

[0168] In Figure 28, dotted arrows indicate the transmission path of the voices of the interview participants, with the voice of sales representative Hs being picked up by the microphone of information processing device 1, and the voice of customer Hc being picked up by the microphone of information processing device 30, and then input to information processing device 1 via network NT. In this case, the information processing device 1 records the interview not only the voice data picked up by its own microphone but also the voice data acquired from the information processing device 30. Then, the information processing device 1 records the recorded data in the server device 20 as shown by the solid arrow in the figure. The processing of the server device 20 and the information processing device 1 after the recorded data is thus recorded in the server device 20 is the same as that in the case of a face-to-face interview, and therefore a duplicate explanation will be avoided.

[0169] In addition, in the above example, the device (server device 20) that performs the analysis process of the interview content based on the recorded data and the device (information processing device 1) that performs the display process of the editing screen Ge are separate devices, but it is also possible to configure the analysis process and the display process of the editing screen Ge to be performed by the same information processing device. For example, when the function of the editing screen Ge is provided to the information processing device 1 as a WEB application, the display process of the editing screen Ge (the process of displaying the editing screen Ge on the display unit 7 of the information processing device 1) is performed on the server device 20 side, so that the server device 20 is configured to perform the analysis process and the display process of the editing screen Ge.

[0170] <7. Summary of the embodiment> As described above, the information processing device (1 or server device 20) as an embodiment is equipped with a display processing unit (F12) that performs processing to display an editing screen (Ge) including a text display area (utterance text display area At) that displays interview text data obtained by converting the recorded data of the interview into text, an analysis result display area (Aa) that displays analysis result text data, which is text data showing the analysis results related to the content of the interview, and a text editing area (Ae) that is an area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited. According to the above configuration, an editing screen including not only a text display area and an analysis result display area but also a text editing area is displayed, so that it is possible to eliminate the need to open a separate editing screen when creating minutes using the analysis result text data. Therefore, according to this embodiment, it is possible to reduce the effort required for a user to create minutes of an interview, and to improve the ease of creating minutes. In particular, when the interview is a business meeting, the improved ease of creating minutes can improve the efficiency of business negotiations and contribute to an improvement in the success rate.

[0171] In addition, in the information processing device as an embodiment, the editing screen is provided with a recording period display area that displays recording period display information that graphically represents the recording period of the interview, and the display processing unit performs processing to display information indicating the distribution of the speaking periods of each speaker during the interview as the recording period display information. This enables the user to easily grasp information such as which speaker spoke during what period and for how long, as well as the amount of speech each speaker made. Therefore, the user can easily understand which speaker's remarks should be focused on when creating the minutes, thereby improving the efficiency of creating the minutes.

[0172] Furthermore, in the information processing device of the embodiment, the display processing section performs processing for displaying, on the editing screen, a playback position indicating operator for indicating a playback position of recorded data in association with the recording period display information. In this case, the user can specify the playback position of the recorded data by operating the playback position specifying operator while referring to the information on the speech section for each speaker indicated by the recording period display information. Therefore, when a user wants to check the recorded data of a specific part of a speech by a specific speaker during the process of creating minutes, the ease of searching for that part of the speech can be improved, thereby improving the efficiency of creating minutes.

[0173] Furthermore, in the information processing device of the embodiment, the interview is a business negotiation, and the display processing unit performs processing to display business negotiation process period information, which is information indicating the name and period of each business negotiation process when the business negotiation is divided into processes according to predetermined criteria, in association with the recording period display information on the editing screen. By also displaying the chronological information of the negotiation process in association with the recording period display information, when a user wants to check the recording data of a specific part of a speech by a specific speaker during the process of creating minutes, it is possible to further improve the ease of searching for that part of the speech. Therefore, the efficiency of creating minutes can be further improved.

[0174] In addition, in the information processing device according to the embodiment, the display processing unit performs processing for displaying information on the speech period in a different display mode for each speaker. This makes it possible to display the speech period of each speaker in a different color or pattern, for example, so that the user can intuitively distinguish the speech period of each speaker. Therefore, if a user wants to check the recording data of a specific part of a speech by a specific speaker during the process of creating minutes, the ease of searching for that part of the speech can be further improved, thereby further improving the efficiency of creating minutes.

[0175] Furthermore, in the information processing device as an embodiment, the editing screen is capable of accepting a group attribute setting operation which is a setting operation as to whether each speaker in the interview belongs to a self-group which is the user's own group or a partner's group which is the user's partner's group, and in response to the group attribute setting operation being performed, the display processing unit performs processing for the interview text data to be displayed in the text display area such that the spoken text data of speakers belonging to the self-group is moved to one end of the text display area and the spoken text data of speakers belonging to the partner's group is moved to the other end of the text display area. This allows the user to intuitively distinguish between the statements of the user's group and the other group in the interview text data displayed in the text display area. In particular, when the interview is a business meeting, the user as a sales representative can refer to all the statements of the customers in the other group, which increases convenience.

[0176] Furthermore, in the information processing device as an embodiment, analysis processes related to the content of the interview include a summary creation process which creates a summary of the interview, a key point list creation process which creates a list of key points of the interview, and a question and answer identification process which identifies the question and answer parts in the interview, and the display processing unit performs display processing of the analysis result display area so that, among the text data indicating the summary created in the summary creation process, the text data indicating the list of key points created in the key point list creation process, and the text data indicating the question and answer parts identified in the question and answer identification process, the text data indicating the summary is positioned at the uppermost side in the analysis result display area. Here, "upper right" means the upper side of the screen when the text display area, analysis result display area, and text editing area are arranged horizontally on the screen, and means the left side of the screen when the text display area, analysis result display area, and text editing area are arranged vertically on the screen. Information displayed on the screen tends to be viewed starting from the top of the screen. Therefore, by arranging the "Summary" at the topmost part of the screen as described above, it is possible to have the user check the contents of the "Summary" before referring to the "Main Points" and "Questions and Answers." In other words, it is possible to have the user understand the overall outline of the interview from the "Summary" before referring to the "Main Points" and "Questions and Answers," making it easier for the user to understand the contents of the "Main Points" and "Questions and Answers." Therefore, the time required for the user to understand the contents of the interview can be shortened, and the efficiency of creating minutes can be improved.

[0177] In addition, in the information processing device as an embodiment, processes for analyzing the content of the interview include a summary creation process for creating a summary of the interview, a key point list creation process for creating a list of the main points of the interview, and a question and answer identification process for identifying the question and answer parts in the interview, and the editing screen is capable of accepting a group attribute setting operation for setting whether each speaker in the interview belongs to a self-group which is the user's own group or an other party's group which is the user's other party's group, and the display processing unit performs a process of displaying in the analysis result display area text data indicating the summary created in the summary creation process, text data indicating the list of main points created in the key point list creation process, and text data indicating the question and answer parts identified in the question and answer identification process, as well as a process of displaying the text data indicating the question part and the text data indicating the answer part in a manner that makes it possible to identify whether the comment came from the self-group or the other party's group. This makes it easier for a user to understand specific questions or answers from his or her own or the other party when creating minutes of a meeting.

[0178] Furthermore, in the information processing device as an embodiment, analysis processes related to the content of the interview include a summary creation process for creating a summary of the interview, a key point list creation process for creating a list of key points of the interview, and a question and answer identification process for identifying the question and answer parts in the interview, and the display processing unit performs a process of displaying, in the analysis result display area, text data indicating the summary created in the summary creation process, text data indicating the list of key points created in the key point list creation process, and text data indicating the question and answer parts identified in the question and answer identification process, and in the editing screen, for the list of key points displayed in the analysis result display area, text data can be transcribed into the text editing area for each key point, and the display processing unit arranges the text data of each key point in the display area of ​​the list of key points in a sequence that follows the chronological order of the original utterance, and arranges the text data of the key points transcribed into the text editing area in the order in which they were transcribed. The minutes are not necessarily arranged according to the chronological order of the utterances in the interview, but are created by the user arranging the contents of the utterances in an appropriate order. Therefore, if the transcribed text data of the main points were arranged in the chronological order of the original utterances in the text editing area, the user may be forced to perform unnecessary rearrangement of the text data of the main points, which may reduce the efficiency of creating the minutes. By arranging the text data of the main points in the text editing area in the order in which they were transcribed as described above, it is possible to prevent such unnecessary order changing operations from being performed, thereby improving the efficiency of creating minutes.

[0179] Furthermore, in an information processing device as an embodiment, when the transcribed analysis result text data is corrected in the text editing area, the display processing unit performs processing to display the corrected text portion in a display mode different from that of the uncorrected text portion. This allows the user to clearly see whether the analysis result text data constituting the minutes has been used as is or has been partially modified.

[0180] In addition, in the information processing device as an embodiment, a recording processing unit (F13) is provided which, when the transcribed analysis result text data is corrected in the text editing area, performs a process of recording the text data before correction and the text data after correction in correspondence with each other in a memory device. The above-mentioned pre- and post-correction text data can be used to train minutes writers. Specifically, for example, by having a low performer who is inexperienced in minutes writing refer to the pre- and post-correction text data by a high performer who is skilled in minutes writing, it becomes possible for the low performer to learn skills related to minutes writing, which can contribute to the training of low performer minutes writers. In particular, when the interview is a business meeting, it becomes possible for the low performer to learn the skills of a high performer sales representative, which can contribute to the improvement of the sales representative's skills. In addition, the above-mentioned pre- and post-correction text data can also be used to improve and enhance the functionality of the analysis process for obtaining analysis result text data from the recorded interview data. Specifically, for example, when the analysis process is performed using an AI model, the pre- and post-correction text data can be used as learning data for machine learning to improve and enhance the analysis process. Or, even when the analysis process is performed using rule-based processing, the pre- and post-correction text data can be referred to in updating the analysis process, which can contribute to improving and enhancing the analysis process.

[0181] An information processing method as an embodiment is an information processing method in which an information processing device performs processing to display an editing screen including a text display area that displays interview text data obtained by converting recorded data of the interview into text, an analysis result display area that displays analysis result text data, which is text data that shows the analysis results related to the content of the interview, and a text editing area, which is an area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited. With such an information processing method, it is possible to obtain the same functions and effects as those of the information processing device according to the above embodiment.

[0182] The program as the embodiment is a program that causes a computer device such as a CPU 1a to execute all or part of the processing shown in FIGS. In other words, the program as an embodiment is a program readable by a computer device and causes the computer device to execute a process of displaying an editing screen including a text display area that displays interview text data obtained by converting the recorded data of the interview into text, an analysis result display area that displays analysis result text data, which is text data that shows the analysis results related to the content of the interview, and a text editing area, which is an area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited.

[0183] Such a program can realize a computer device that executes all or part of the functions of the information processing device 1 described in the embodiment. For example, by downloading the program to a personal computer, a portable information processing device, or the like, the personal computer can be made to function as the information processing device 1.

[0184] Such a program can be pre-recorded in a HDD as a recording medium built into a device such as a computer device, or in a ROM in a microcomputer having a CPU, etc. Also, the program can be provided by being temporarily or permanently recorded on a removable recording medium such as a memory card or an optical disk. Such programs can also be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet. [Explanation of symbols]

[0185] 1. Information processing device 20 Server device NT Network Hs Sales Representative Hc customer 1a,20a CPU 2 ROM 3 RAM 4. Bus 5 Input / Output Interface 6 Input section 7 Display section 8 Audio output section 9 Memory section 10. Communications Department 11 Removable storage media 12 Drive 20b Analysis Department F11 Interview Recording Section F12 Display processing part F13 Recording Processing Unit F21 Audio data recording section F22 Summary creation processing section F23 Summary List Creation Department F24 Question and Answer Specific Processing Unit 30 Information processing device Group registration screen Ga Confirmation Screen Gb Error Screen Ge Editing Screen At Speech text display area Ah Speaker / Group Settings Area Ae Text Editing Area Ap Recording period display area Aa Analysis result display area B17 Upload button B18 Post button Sb Seek Bar Is Negotiation process period information Gs setting screen

Claims

1. a display processing unit that performs processing to display an editing screen including a text display area that displays interview text data that has been converted from audio recording data of an interview, an analysis result display area that displays analysis result text data that is text data showing an analysis result related to the contents of the interview, and a text editing area that is an area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited. Information processing device.

2. The editing screen is provided with a recording period display area for displaying recording period display information that graphically represents the recording period of the interview, The display processing unit is A process of displaying information showing a distribution of speaking periods for each speaker during the interview as the recording period display information is performed. The information processing device according to claim 1 .

3. The display processing unit is A process is performed to display, on the editing screen, a playback position indicating operator for indicating a playback position of the recording data in association with the recording period display information. The information processing device according to claim 2 .

4. The interview is a business meeting, The display processing unit performs a process of displaying, on the editing screen, negotiation process period information, which is information indicating the name and period of each negotiation process when the negotiation is divided into processes according to a predetermined criterion, in association with the recording period display information. The information processing device according to claim 2 .

5. The display processing unit performs processing for displaying the information on the speech period in a different display mode for each speaker. The information processing device according to claim 2 .

6. On the editing screen, a group attribute setting operation can be accepted, which is a setting operation as to whether each speaker in the interview belongs to a self-side group that is a group on the user's side or a partner-side group that is a group on the other side of the user, In response to the group attribute setting operation, the display processing unit performs a process of moving the spoken text data of the speaker belonging to the one-side group to one end side of the text display area and the spoken text data of the speaker belonging to the other-side group to the other end side of the text display area, with respect to the interview text data to be displayed in the text display area. The information processing device according to claim 1 .

7. As a process for analyzing the contents of the interview, a summary creation process for creating a summary of the interview, a main point list creation process for creating a main point list of the interview, and a question and answer identification process for identifying a question portion and an answer portion in the interview are performed. The display processing unit performs display processing of the analysis result display area such that, among the text data indicating the summary created in the summary creation process, the text data indicating the main points created in the main points list creation process, and the text data indicating the question portion and the answer portion identified in the question and answer identification process, the text data indicating the summary is arranged on the uppermost side in the analysis result display area. The information processing device according to claim 1 .

8. As a process for analyzing the contents of the interview, a summary creation process for creating a summary of the interview, a main point list creation process for creating a main point list of the interview, and a question and answer identification process for identifying a question portion and an answer portion in the interview are performed. On the editing screen, a group attribute setting operation can be accepted, which is a setting operation as to whether each speaker in the interview belongs to a self-side group that is a group on the user's side or a partner-side group that is a group on the other side of the user, The display processing unit is a process for displaying, in the analysis result display area, text data showing the summary created in the summary creation process, text data showing the main point list created in the main point list creation process, and text data showing the question portion and the answer portion identified in the question and answer identification process; The text data showing the question portion and the text data showing the answer portion are displayed in such a way that it is possible to identify which of the self-group and the other-group made the comment. The information processing device according to claim 1 .

9. As a process for analyzing the contents of the interview, a summary creation process for creating a summary of the interview, a main point list creation process for creating a main point list of the interview, and a question and answer identification process for identifying a question portion and an answer portion in the interview are performed. the display processing unit performs processing for displaying, in the analysis result display area, text data indicating the summary created in the summary creation processing, text data indicating the main point list created in the main point list creation processing, and text data indicating the question portion and the answer portion identified in the question and answer identification processing; on the editing screen, text data can be transcribed for each main point of the list of main points displayed in the analysis result display area into the text editing area, the display processing unit arranges the text data of each main point in a display area of ​​the main point list in a time sequence according to the chronological order of the original utterance; The text data of the main points transcribed in the text editing area is arranged in the order in which the text data was transcribed. The information processing device according to claim 1 .

10. The display processing unit performs processing for displaying the corrected text portion in a display mode different from that of the uncorrected text portion when the transcribed analysis result text data is corrected in the text editing area. The information processing device according to claim 1 .

11. a recording processing unit that performs processing for recording the text data before and after correction in a memory device in association with each other when the transcribed analysis result text data is corrected in the text editing area; 11. The information processing device according to claim 1.

12. An information processing device, A process is performed to display an editing screen including a text display area for displaying interview text data obtained by converting recorded interview data into text, an analysis result display area for displaying analysis result text data which is text data showing an analysis result relating to the contents of the interview, and a text editing area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited. Information processing methods.

13. A computer readable program, and causing the computer device to execute a process of displaying an editing screen including a text display area for displaying interview text data obtained by converting recorded data of an interview into text, an analysis result display area for displaying analysis result text data which is text data showing an analysis result relating to the contents of the interview, and a text editing area which is an area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited. program.

14. A recording medium having a computer-readable program recorded thereon, A program is recorded on the computer device to execute a process of displaying an editing screen including a text display area for displaying interview text data obtained by converting recorded interview data into text, an analysis result display area for displaying analysis result text data which is text data showing an analysis result relating to the contents of the interview, and a text editing area in which the analysis result text data can be transcribed and the transcribed analysis result text data can be edited. Recording medium.

Images