Interview support device, interview support method, program, recording medium

Abstract

To enable easy and appropriate management of actions that occur during interviews. [Solution] The control unit of the interview support device performs the following: a text conversion process that acquires interview audio data and converts the audio data into text data; an action setting process that analyzes the text data obtained from the text conversion process and sets action items; and an output control process that performs display output control or transmission output control according to the action items set in the action setting process.

Description

Technical Field

[0001] The present technology relates to an interview support device, an interview support method, a program, and a recording medium, and particularly relates to the technical field of information processing for supporting activities such as sales.

Background Art

[0002] In sales activities of corporations and the like, customer relationship information is managed using a CRM (Customer Relationship Management) system. For example, items to be elicited during interviews (business negotiations, etc.) with customers are input into a customer relationship information management screen by the CRM system and shared within the sales team.

[0003] Further, as a technology for supporting sales activities, Patent Document 1 below discloses a technology for storing a user ID (identification), a customer ID, a call start time, and the like in the CRM during a business negotiation.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0005] Although effective utilization of sales information is expected by using the CRM system, each sales representative has a demand to more easily and appropriately manage actions and tasks generated by interviews. For example, when a sales representative makes some promise to the other party in a conversation during an interview, it is convenient if the action is explicitly managed.

[0006] Therefore, this disclosure aims to facilitate the management of actions that need to be taken as a result of meetings between sales representatives and customers, etc. [Means for solving the problem]

[0007] The interview support device according to this technology includes a control unit that performs a text conversion process to acquire interview audio data and convert the audio data into text data, an action setting process to analyze the text data obtained in the text conversion process and set action items, and an output control process to perform display output control or transmission output control according to the action items set in the action setting process. The system converts audio information from business meetings and other discussions into text data, analyzes the text data to determine the actions that sales representatives should take, and then displays or sends this information. [Effects of the Invention]

[0008] This technology allows for the automatic and accurate detection and output of actions resulting from interviews. This reduces the workload for sales representatives and enables appropriate action management. [Brief explanation of the drawing]

[0009] [Figure 1] This is an explanatory diagram illustrating an example configuration of the management system according to the embodiment. [Figure 2] This is a block diagram of an example configuration of the sound collection device according to the embodiment. [Figure 3] This is a block diagram of an example configuration of the business opportunity management server in the embodiment. [Figure 4] This is a block diagram of an example configuration of the customer relationship management server according to the embodiment. [Figure 5] This is an explanatory diagram illustrating an example of how action items are displayed in the embodiment. [Figure 6] This is an explanatory diagram illustrating an example of highlighting action items in the embodiment. [Figure 7] This is an explanatory diagram illustrating other examples of how the action items of the embodiment are displayed. [Figure 8] This is a flowchart of processing related to action items of the embodiment. [Figure 9] This is a flowchart of action item setting processing of the embodiment. [Figure 10] This is a flowchart of executor determination processing of the embodiment. [Figure 11] This is a flowchart of deadline determination processing of the embodiment. [Figure 12] This is a flowchart of action item display and reminder processing of the embodiment. [Figure 13] This is an explanatory diagram of a display example when the executor is unknown in the embodiment. [Figure 14] This is an explanatory diagram of an executor input window of the embodiment. [Figure 15] This is an explanatory diagram of a display example when the deadline is unknown in the embodiment. [Figure 16] This is an explanatory diagram of a deadline input window of the embodiment. [Description of Embodiments]

[0010] Hereinafter, embodiments according to the present technology will be described in the following order. <1. System Configuration Example> <2. Configuration Example of Each Apparatus> <3. Display and Processing Related to Action Management of the Embodiment> <4. Effects and Modified Examples of the Embodiment>

[0011] Note that in the embodiment, "business negotiation" conducted between a sales representative and a customer is cited as an example of "interview".

[0012] <1. System Configuration Example> Figure 1 is a block diagram showing a configuration example of a customer relationship management (CRM) system 100 (hereinafter referred to as "management system 100") configured to include an information processing apparatus that functions as the interview support apparatus of the embodiment. As illustrated, the management system 100 includes a business negotiation management server 40, a sound collection device 20, and a customer relationship management server 50.

[0013] The sound collection device 20 includes, for example, a plurality of microphones arranged at different positions on the device main body, and a display unit 27 for displaying information. For example, one of the plurality of microphones is defined as an opposite-party microphone that should collect the utterance of the counterparty in the business negotiation, and the other one is defined as a self-side microphone that should collect the utterance of the self-side in the business negotiation. In this example, the sound collection device 20 is configured as a smartphone, and the management system 100 of this example adopts a mode in which the smartphone is used as a device for recording interviews.

[0014] In the case where the sound collection device 20 is a smartphone, the plurality of microphones may be microphones built in the smartphone, microphones connected to the smartphone, or both of them. It should be noted that having a plurality of microphones is merely an example, and the sound collection device 20 may be a device provided with a single microphone.

[0015] The business negotiation is conducted between a salesperson Hs and a customer Hc, and the sound collection device 20 is placed at the site of the business negotiation or the like to record the conversation voice of the business negotiation. The salesperson Hs is a person who participates in the business negotiation to conduct sales activities, and performs input or the like for recording information such as the content of the business negotiation in the customer relationship management server 50 and creates minutes after the business negotiation, and is a person positioned as a user of the management system 100. The salesperson Hs can be regarded as the person on the host side in the interview as the business negotiation. On the other hand, the customer Hc can be regarded as the person on the guest side in the interview. As for the business negotiation here, a face-to-face business negotiation in which the salesperson Hs and the customer Hc actually meet face to face is taken as an example. However, since it is sufficient that the environment allows conversation, a situation in which the salesperson Hs can record the conversation of the business negotiation using the sound collection device 20 in a remote business negotiation is also acceptable.

[0016] A smartphone has an application program (also abbreviated as "app") installed for using the management system 100, such as the sales negotiation management app described later. When this sales negotiation management app is launched, various interface processes related to the management system 100 are performed, such as recording sales negotiations. In this embodiment, the sound-collecting device 20 is a smartphone, and thus the sound-collecting device 20 can also be used as a terminal device for sales representatives. For example, the sound-collecting device 20, which functions as a smartphone, can be used not only to record business negotiations, but also as a device to input various details and information about the business negotiations into the customer relationship management server 50 after the negotiations have taken place.

[0017] Note that the sound recording device 20 and the terminal device used by sales representative Hs may be separate devices. In that case, the sound recording device 20 only needs to have the function of recording audio and transmitting it to the sales negotiation management server 40, and the terminal device should be capable of performing various inputs and viewing information after the sales negotiation.

[0018] In Figure 1, the business negotiation management server 40 and the customer relationship management server 50 are configured as computer devices equipped with a microcomputer having a processor such as a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory). The sound pickup device 20 can also be considered a computer device if it uses a terminal device such as a smartphone.

[0019] The sound collection device 20 is capable of communicating data with the business negotiation management server 40 and the customer relationship management server 50 via a predetermined communication network, such as the Internet, which is called Network NT. Furthermore, the business negotiation management server 40 and the customer relationship management server 50 are also capable of communicating data with each other via the NT network.

[0020] The management system 100 has functions such as converting the content of a business negotiation into text data based on the recorded data of the negotiation, performing analysis related to the content of the negotiation, presenting text data showing the results of the analysis to the user on the screen, and presenting an extraction screen to the user and recording the content related to the negotiation according to the user's input. In particular, the management system 100 of this embodiment also extracts, manages, and provides to the user the next actions that should be taken as a result of the negotiation, such as matters that the sales representative Hs promised to the customer Hc during the negotiation.

[0021] Furthermore, sales representatives Hs, their superiors, colleagues, and other individuals with access privileges to the management system 100 can view various types of information provided by the sales opportunity management server 40 and the customer relationship management server 50 on the display unit 27 of the sound-collecting device 20 (a smartphone) or on the display unit of other terminal devices such as personal computers (not shown). These sales representatives Hs and others can also input various types of information related to sales opportunities into the sales opportunity management server 40 and the customer relationship management server 50, so that this information can be managed as sales opportunity data.

[0022] The sound recording device 20 has a function for recording business negotiations. Specifically, the sound recording device 20 records the sound signal using a built-in or connected microphone to record the business negotiation. The recorded data of the business negotiation is transmitted to the business negotiation management server 40 via the network NT and stored (accumulated) in the business negotiation management server 40.

[0023] In this embodiment, the function related to recording business negotiations is implemented by a "business negotiation management application." In some cases, this business negotiation management application is provided as a so-called SaaS (Software as a Service) type application, where the software (software program) for the business negotiation management application is stored on the business negotiation management server 40 and the software is provided as a service. In that case, various processes of the sound recording device 20 using a smartphone, such as sending the recorded audio data to the business negotiation management server 40 and user interface processing related to the management system 100, are executed by the sound recording device 20 based on control from the business negotiation management server 40.

[0024] Alternatively, the business negotiation management application may be installed on the sound-collecting device 20, which functions as a smartphone, or on another terminal device, so that the same processing can be performed on the smartphone or other terminal device.

[0025] The customer relationship management server 50 is a server that constitutes the CRM system. It stores and manages various types of customer information for clients and provides services to clients as needed. In the example in Figure 1, a client is, for example, the company to which sales representative Hs belongs. By storing and managing, for example, the customer relationship management server 50 can be used for sales management, sales strategies, and employee training for client companies.

[0026] In this embodiment, the business negotiation management server 40 and the customer relationship management server 50 are assumed to be managed by different businesses. The customer relationship management server 50 is managed by the CRM provider, while the sales opportunity management server 40 is managed by a different provider than the CRM provider.

[0027] In this case, the CRM provider has released a CRM application (hereinafter referred to as "CRM application"), and in the management system 100 of this embodiment, sales representative Hs, as a user of the sound collection device 20, is able to use the CRM application. Specifically in this example, the CRM application is installed on the sound collection device 20, and sales representative Hs is able to use the various functions provided by the CRM application. Furthermore, it is also possible to adopt a SaaS model for CRM applications.

[0028] <2. Examples of each device configuration> The configuration examples of each information processing device that constitutes the management system 100 of this embodiment will be described.

[0029] Figure 2 is a block diagram showing an example of the hardware configuration of the sound collection device 20. The sound-collecting device 20 includes a processor 21, a ROM 22, and a RAM 23. The processor 21 functions as an arithmetic processing unit that performs various processes and executes various processes according to the program stored in the ROM 22 or the program loaded into the RAM 23 from the storage unit 29. The RAM 23 also appropriately stores data necessary for the processor 21 to perform various processes.

[0030] The processor 21, ROM 22, and RAM 23 are interconnected via a bus 24. An input / output interface (I / F) 25 is also connected to this bus 24.

[0031] An input unit 26, consisting of controls and operating devices, is connected to the input / output interface 25. For example, the input unit 26 can be various controls and operating devices such as a keyboard, mouse, keys, dial, touch panel, touchpad, or remote controller. In this example, the touch panel in the input unit 26 is formed on the display screen of the display unit 27, and the user can perform touch operations on the display screen. The input unit 26 detects user operations, and the signal corresponding to the input operation is interpreted by the processor 21.

[0032] Furthermore, a display unit 27, such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) panel, and an audio output unit 28, such as a speaker, are connected to the input / output interface 25, either as an integrated unit or as separate components. The display unit 27 is used for displaying various types of information and is configured, for example, as a display device provided on the housing of the sound collection device 20, as described above.

[0033] The display unit 27 displays images for various image processing tasks and videos to be processed on the display screen based on instructions from the processor 21. The display unit 27 also displays various operation menus, icons, messages, etc., i.e., a GUI (Graphical User Interface), based on instructions from the processor 21.

[0034] The input / output interface 25 may also be connected to a storage unit 29 or a communication unit 30. The memory unit 29 consists of HDDs (Hard Disk Drives) and SSDs (Solid State Drives), and performs various types of information storage.

[0035] The communications unit 30 performs communication processing via transmission lines such as the internet, downloads applications, wired / wireless communication with various devices, and bus communication.

[0036] The input / output interface 5 is also connected to a drive 32 as needed, and removable recording media 31 such as memory cards or optical discs are installed as appropriate.

[0037] Drive 32 allows the system to read data files, such as programs used for various processes, from the removable recording medium 31. The read data files are stored in the storage unit 29, or images and sounds contained in the data files are output by the display unit 27 and the audio output unit 28. Computer programs and other data read from the removable recording medium 31 are installed in the storage unit 29 as needed.

[0038] Furthermore, the sound pickup unit 33 is connected to the input / output interface 25. The sound pickup unit 33 is comprised of the aforementioned microphone, an amplifier for amplifying the sound signal from the microphone, and an A / D converter for A / D (Analog to Digital) conversion of the amplified sound signal. The sound signal from the sound pickup unit 33 is recorded at least temporarily in a storage device such as the memory unit 29, thereby enabling the recording of the interview.

[0039] Furthermore, the sensor unit 35 is connected to the input / output interface 25. The sensor unit 35 comprehensively represents the sensors that the sound-collecting device 20, as a smartphone, has, for example, an image sensor that makes up the camera. The sensor unit 35 also includes an IMU (Inertial Measurement Unit) equipped with an accelerometer, angular velocity sensor, and compass sensor. The sensor unit 35 also includes a GPS (Global Positioning System) receiver as a location information sensor.

[0040] Figure 3 is a block diagram showing an example of the hardware configuration of the sales opportunity management server 40. The business negotiation management server 40 comprises a processor 1, ROM 2, RAM 3, bus 4, input / output interface 5, input unit 6, display unit 7, audio output unit 8, storage unit 9, communication unit 10, and drive 12. Here, the processor 1, ROM 2, RAM 3, bus 4, input / output interface 5, input unit 6, display unit 7, audio output unit 8, storage unit 9, communication unit 10, and drive 12 are the same as the processor 21, ROM 22, RAM 23, bus 24, input / output interface 25, input unit 26, display unit 27, audio output unit 28, storage unit 29, communication unit 30, and drive 32 in the sound collection device 20 shown in Figure 2, so redundant explanation will be avoided. A removable recording medium 11, such as a memory card or optical disc, is appropriately mounted in drive 12, similar to the removable recording medium 31 described above.

[0041] In the sales opportunity management server 40, the control unit, processor 1, may be, for example, a signal processing processor or an AI (Artificial Intelligence) processor with more advanced processing capabilities than the sound acquisition device 20. For example, processor 1 performs various analysis processes related to the content of the interview, such as text conversion, based on the recorded interview data. The analysis process by processor 1 may be performed as rule-based processing rather than AI processing. Processor 1 may also perform various processes in cooperation with external LLMs (Large Language Models). For example, processor 1 may perform various processes including outputting prompts to the external LLM and receiving responses from the LLM. Alternatively, a processor equipped with an LLM may be provided within the sales opportunity management server 40.

[0042] The processor 1 performs processing operations based on various programs stored in the memory unit 9, ROM 2, etc., thereby executing the information processing and communication processing necessary to realize the processing of the business negotiation management server 40.

[0043] The diagram shows the functions of processor 1, particularly the functions that realize the processing of the embodiment described later, namely the text conversion processing unit 1a, the action setting unit 1b, and the output control unit 1c.

[0044] The text processing unit 1a is a function that acquires the audio data of the business negotiation obtained by the sound acquisition device 20 in real time or non-real time, and performs text processing to convert the acquired audio data into text data. The audio data of the business negotiation and its text data are stored in the business negotiation management server 40.

[0045] The action setting unit 1b analyzes the text data of the business negotiation obtained through the text conversion process, automatically determines the actions to be performed and the deadlines for those actions, and sets the action items. In some cases, audio data of the business negotiation may also be used to set the action items. In this disclosure, "action" refers to the collective actions that the host and guest must take as a result of the meeting. Therefore, in this embodiment, "action" refers to the actions that the sales representative Hs and customer Hc must take as a result of the business negotiation. For example, actions include tasks to be performed, administrative work, sales activities, communication, and other actions that are desirable to be managed as so-called to-dos. In this embodiment, the actions that the sales representative Hs and customer Hc have mutually agreed to take during the business negotiation are set and managed as action items. Specifically, "creating a quote" and "contacting the customer to schedule the next business negotiation" are set as action items as things to be done after the business negotiation. Action items are either saved on the opportunity management server 40 or linked to opportunity data on the customer relationship management server 50.

[0046] The output control unit 1c is a function that controls the display output or the transmission output according to the action items set in the action setting process. For example, the output control unit 1c processes actions such as making the action items that arose from a business negotiation viewable by the sales representative Hs, or sending notifications according to the action items.

[0047] The processor 1 of the business opportunity management server 40 is equipped with these functions, which are realized through integration processing with software programs and external LLMs, etc., and can perform actions such as setting action items described later, and display control and transmission control based on them.

[0048] The business negotiation management server 40 is not limited to being a single computer device as shown in Figure 3, but may be configured as a system of multiple computer devices. These multiple computer devices may be systematized via a LAN (Local Area Network), or they may be located remotely via a VPN (Virtual Private Network) using the Internet. The multiple computer devices may also include computer devices that function as a group of servers (cloud) available through cloud computing services.

[0049] Figure 4 is a block diagram showing an example of the hardware configuration of the customer relationship management server 50. In the following explanation, parts that are the same as those already explained will be denoted by the same reference numeral and their explanation will be omitted.

[0050] Figure 4 shows essentially the same configuration as Figure 3. For the sake of explanation, the processor, which is the control unit of the customer relationship management server 50, will be referred to as "processor 51". The processor 51 in Figure 4 performs CRM processing. However, the processor 51 may also be equipped with the functions of the text processing unit 1a, action setting unit 1b, and output control unit 1c described above. In other words, although the processing in the embodiment described later is performed by the processor 1 of the business opportunity management server 40, it is also conceivable that the processor 51 of the customer relationship management server 50 performs similar processing.

[0051] The customer relationship management server 50 is not limited to being a single computer device as shown in Figure 4; it may also be configured as a system of multiple computer devices. In this case, the multiple computer devices may be systematized via a LAN, or they may be located in remote locations via a VPN using the Internet, etc. The multiple computer devices may include computer devices that function as a group of servers (cloud) available through cloud computing services.

[0052] <3. Display and processing related to action management in the embodiment> The following describes an example of processing performed by processor 1 of the business opportunity management server 40. Although this is described as processing performed by processor 1, similar processing may be performed by processors 21 or 51.

[0053] Figure 5 shows an example of a screen display that can be viewed by, for example, sales representative Hs or their supervisor. For example, it is one example of a screen that may be displayed on the terminal device of sales representative Hs when they request to view past sales negotiations from the sales negotiation management server 40.

[0054] In the following, the term "terminal device" may refer to a smartphone used as a sound-collecting device 20 by sales representative Hs, etc., or it may refer to other personal computers or tablet devices. In any case, the scenario envisioned is one in which sales representative Hs, etc., requests the display of sales negotiation information from the sales negotiation management server 40 using some kind of terminal device.

[0055] Figure 5 shows an example of a sales opportunity information screen 60, which displays information about a specific sales opportunity as provided by the sales opportunity management server 40. In this example, the sales opportunity title 61, summary tab 62, CRM integration tab 63, action management tab 64, and transcription area 65 are displayed. The figure shows the action management tab 64 selected, with the action management area 64A displayed.

[0056] Transcription area 65 displays text data transcribed from audio recordings made during business negotiations. For example, the spoken words of sales representative Hs and customer Hc are displayed as text. The spoken words of sales representative Hs and customer Hc may be distinguished by color, display position, or other means.

[0057] Although not shown in the diagram, when the Summary tab 62 is selected, a Summary area is displayed showing a summary of the deal details, and when the CRM Integration tab 63 is selected, a CRM Integration area is displayed showing input fields for CRM integration.

[0058] As shown in the diagram, the Action Management area 64A, which is displayed when the Action Management tab 64 is selected, lists and displays one or more action items AK that have occurred as a result of a sales opportunity. For example, actions that occurred as a result of a particular sales opportunity can be displayed immediately after that opportunity. Alternatively, if multiple sales opportunities have been held with a certain customer Hc regarding a certain product, the actions that occurred as a result of those opportunities, including past opportunities, will be displayed.

[0059] For each action item AK, the deadline and the person responsible for carrying it out are indicated, along with the specific actions that should be taken as the "next action."

[0060] The next steps outline specific tasks that need to be done, such as "creating and sending a proposal" and "scheduling a meeting." Each action item AK also has a deadline, and they are displayed chronologically in order of approaching deadlines. The diagram shows an example where four action items AK are displayed in order of approaching deadlines. Displaying information in chronological order makes it easier for viewers to understand the correct sequence of actions to take.

[0061] Furthermore, as shown in Figure 6, for example, action items AK with approaching deadlines may be highlighted along with an alert mark 64B to alert sales representatives Hs and others. Action items AK that have already been performed may be removed from the list, or they may remain in the list and be displayed in some inconspicuous manner. Action items AK that have not been performed by the deadline may be given a stronger warning.

[0062] The "Executor" column displays the person who should carry out the action indicated as the next action. The Executor can be a specific individual's name, but it is better to indicate whether the Executor is a sales representative (Hs) or a customer (Hc), as shown in the diagram, by using terms such as "Sales" or "Customer."

[0063] In the example in Figure 5, the display of action item AK when the executor is "Sales" and action item AK when the executor is "Customer" are different. For example, the color, brightness, pattern, font weight, size, font, presence or absence of a border, whether or not it is outlined in white, or a combination of these, should make it clear whether the action is performed by the sales representative Hs or the customer Hc. In particular, considering that this sales opportunity information screen 60 is viewed by the sales representative Hs and their superiors, it would be good if action item AK when the executor is "Sales" is displayed prominently.

[0064] As illustrated in Figure 7, the action items AK on the sales representative Hs side and the action items AK on the customer Hc side may also be listed separately in area 64A1 and area 64A2. Even when divided by area, it is best to display them in order of approaching deadlines within each area.

[0065] For example, we will now describe an example of processing performed by the processor 1 of the business opportunity management server 40 to enable the display of such an action management area 64A. Figure 8 shows an example of processing to extract actions generated by a business opportunity. The following processing examples can be considered as processes performed by the processor 1 using the text processing unit 1a, action setting unit 1b, and output control unit 1c functions shown in Figure 3. The processing may also include processes in which the processor 1 utilizes an external LLM.

[0066] In step S101 of Figure 8, processor 1 acquires the audio data of the business negotiation as the target for processing. There are various possible timings for this processing in Figure 8. For example, it can be performed in parallel with the execution of the business negotiation, or it can be performed after the business negotiation. If it is during the execution of the business negotiation, for example, audio data transmitted from the sound collection device 20 in near real time can be acquired and the processing in Figure 8 can be performed. If it is after the business negotiation, audio data that has been transmitted from the sound collection device 20 in the past and stored in the business negotiation management server 40 will be acquired as the target for processing.

[0067] In step S102, processor 1 performs text conversion on the audio data acquired for processing. This results in text data that transcribes the sales negotiation audio.

[0068] In step S103, processor 1 analyzes the text data and sets the action item AK. For example, Figure 9 shows an example of the process for setting the action item AK. In step S150 of Figure 9, processor 1 extracts candidate text from the text data to be used as action item AK. For example, the following text:

[0069] "I will send you the proposal by next weekend." "I'll make plans and contact you soon." "Please complete your order by April 10th." "I will call you later regarding that matter." "Could you please give me three days to prepare the estimate?" "Please let me take it back for now."

[0070] For example, Processor 1 extracts statements that can be presumed to indicate a promise of some action after a business negotiation by analyzing text data. This extraction can use AI processing with a learning model that has learned utterances indicating that some action should be taken. Alternatively, a simpler approach is to create a database of example sentences promising actions and extract matching or similar utterances through comparison processing.

[0071] In step S151, Processor 1 groups together the extracted candidate texts that contain the same action content, allowing for confirmation of actions being canceled, modified, or duplicated. For example, an action that was initially agreed upon during a business negotiation may become unnecessary due to subsequent discussions. Alternatively, a deadline may be changed during a business negotiation conversation. Furthermore, the same action may be mentioned multiple times during a conversation for confirmation. Therefore, Processor 1 determines the action content for each extracted candidate text and groups together statements containing the same action content. Finally, it determines how that action content was agreed upon.

[0072] For example, suppose the following statement was made regarding the creation of a quotation: (SP1) "Could I get a quote?" (SP2) "Okay, then I will prepare the estimate and send it to you by the 15th, the day after tomorrow." (SP3) "There's no need to rush. It's fine if you give it to me around the 25th." (SP4) "Okay, I'll send you the estimate by the 25th." Let's assume that (SP4) is extracted from these four candidate texts (SP1). However, these are all utterances with a common action content: sending a quotation. Therefore, it is not appropriate to treat each as a separate action item AK. Therefore, Processor 1 combines candidate texts that contain common action content into one, enabling it to determine what the final agreement is.

[0073] In step S152, processor 1 determines the action that should be taken in the sales opportunity. For example, it evaluates candidate texts (SP1) through (SP4), which are grouped by common action content as shown above, in chronological order, and ultimately determines the action that should be taken. In the example above, the existence of one action, "Send a quotation," will be determined.

[0074] For each candidate text, after grouping in step S151, the final promised action is determined in step S152, resulting in the determination of one or more actions.

[0075] In step S153, processor 1 determines who will perform each of the determined actions. The executor is the person who should perform that action. Here, the executor is not a specific individual, but rather determined to be either the sales side, i.e., the company to which sales representative Hs belongs, or the customer Hc.

[0076] Figure 10 shows an example of the processing in step S153. Note that the processing in Figure 10 is performed for each action determined in step S152.

[0077] Processor 1 performs voice recognition in step S170. Processor 1 analyzes the voice data for one or a group of candidate texts that have been determined to be a single action. For example, participants in a business negotiation can be identified by voiceprint analysis. At a minimum, it becomes possible to distinguish the speaker for each candidate text. In addition, the voiceprint of sales representative Hs may be registered in advance so that the utterances of sales representative Hs in the voice data can be identified. Furthermore, by using a directional microphone to determine the direction of sound, it is possible to distinguish between sales representative Hs and customer Hc for each candidate text. As mentioned above, if the sound pickup device 20 is equipped with multiple microphones, it is also possible to determine whether the speech is coming from sales representative Hs or customer Hc based on the sound pickup direction that can be determined by each microphone.

[0078] Processor 1 also performs contextual determination in step S171. For one or a group of candidate texts that have been determined to be a single action, Processor 1 estimates whether the utterance is from the sales representative Hs or the customer Hc, based on the wording and surrounding utterances.

[0079] In step S172, processor 1 determines the executor based on the results of voice recognition and contextual recognition. For example, in the case of the action from candidate text (SP1) to (SP4) above, if voice recognition determines that candidate text (SP4) uttering "Send the estimate" is spoken by sales representative Hs, then the executor of the action can be determined to be sales representative Hs. The executor can also be determined to be sales representative Hs based on contextual recognition of candidate text (SP1) to (SP4) and the surrounding context. The system can either perform voice recognition or contextual recognition, or it can perform both to improve the accuracy of the recognition.

[0080] In step S173, processor 1 branches the process depending on whether it was able to determine the executor. If it was able to determine the executor, processor 1 proceeds to step S174 and sets the determined executor as the executor for that action. If the executor cannot be determined, processor 1 proceeds to step S175 and sets the action to "executor unknown".

[0081] In step S153 of Figure 9, the executor is determined as described above, and in step S154, the processor 1 determines the deadline for each action. An example of the process in step S154 is shown in Figure 11. Note that the process in Figure 11 is performed for each action set in step S152.

[0082] Processor 1 searches for deadline utterances in step S180. For example, Processor 1 analyzes one or a group of candidate texts that have been determined to be a single action and extracts utterances related to deadlines. For example, in the candidate texts (SP1) to (SP4) above, there are utterances such as "the day after tomorrow, the 15th," "around the 25th," and "by the 25th." Other utterances related to deadlines include, for example, "by March 20th," "by the end of this month," "tomorrow," "by next week," and "by the middle of next month." Processor 1 extracts these utterances that are presumed to be related to deadlines from the candidate texts.

[0083] In step S181, processor 1 determines whether any of the extracted deadline statements contain an utterance indicating a specific deadline date or time. This refers to an utterance that specifies a numerical value as a deadline, such as "I will send it by March 20th" or "I will send it by noon on March 20th." If such an utterance is found, the process proceeds to step S183 to set the deadline for the action. In this case, the date and time of the utterance are set as the deadline.

[0084] If no utterance exists that specifies a particular due date or time, processor 1 proceeds to step S182 and determines whether any of the extracted due date utterances indicated a due date even though they did not explicitly state a number as a day or time. Such utterances are descriptively referred to as "non-date due dates." Examples include "tomorrow," "by the end of next week," and "by the middle of next month."

[0085] If an utterance indicating a non-date deadline is made, processor 1 proceeds to step S184, where it first obtains information on the date and time the business negotiation took place and uses this as the reference date and time. Then, in step S185, processor 1 calculates the deadline based on the reference date and time and the content of the utterance. For example, let's say the business negotiation took place on Wednesday, March 19th, from 2 PM to 3 PM. This will be used as the reference date and time, and the calculation will be based on the content of the conversation. If the utterance is "the day after tomorrow," the deadline will be March 21st. If the statement is "sometime next week," the deadline will be March 28th (Friday). If the statement is "by the middle of next month," the deadline will be April 15th. Processor 1 sets the deadline for the action to a date calculated from the reference date and time and the content of the spoken non-date and time deadline.

[0086] There are cases where there are no utterances specifying a date and time, nor utterances specifying a non-date and time deadline. For example, utterances that do not mention a deadline, such as "I will send you the quotation," or ambiguous utterances such as "soon" or "later." In these cases, the deadline cannot be determined from the utterance itself. Therefore, in step S186, processor 1 uses the date and time the business negotiation took place as the reference date and time, and proceeds to step S186 to perform the deadline estimation process.

[0087] Processor 1 estimates a specific deadline date and time by referring to information about the action, such as the type of action, and information about the business opportunity, such as the person involved in the business opportunity, the product, the industry type, past business history, and the business opportunity phase. Depending on the type of action, it's possible to estimate to some extent how long it will take. For example, at sales representative Hs's company, it can be determined that preparing a quote typically takes three days, while simple communication can be done immediately. Furthermore, by using negotiation information, a comprehensive assessment can be made based on factors such as the practices of the other party and industry, the required time for different types of products, past history, and the current negotiation phase, allowing for a reasonably accurate determination of the required time for appropriate actions.

[0088] The negotiation phase refers to the stages involved in the negotiation process for a single transaction. A single transaction is not completed in a single meeting; rather, it typically goes through multiple stages, such as understanding customer needs, making a proposal, and negotiating, before reaching a conclusion and closing the deal. Each of these stages is referred to as a negotiation phase.

[0089] Once Processor 1 has estimated the duration required for the action, it calculates a date and time by adding the required duration to the reference date and time, and sets that as the estimated deadline.

[0090] Processor 1 determines in step S188 whether an estimated deadline has been obtained through this process. For example, depending on the content of the utterance, it may not be possible to estimate a deadline. If a deadline can be estimated, processor 1 proceeds to step S189 and sets the estimated deadline as the deadline for the action. If the deadline cannot be estimated, processor 1 proceeds to step S190 and sets the action to "deadline unknown".

[0091] After the process shown in Figure 11 is performed in step S154 of Figure 9, processor 1 proceeds to step S155 to set the action item AK. In other words, the process up to this point has determined one or more actions that have been promised to be performed in the opportunity, as well as the executor and deadline for each action. Therefore, the action item AK is set as a set that includes the action, the executor, and the deadline.

[0092] Processor 1 performs the processing shown in Figure 9 (and Figures 10 and 11) in step S103 of Figure 8. This makes it possible to manage the matters promised to be executed in the deal as action items AK.

[0093] Furthermore, it is conceivable that all or part of the processing shown in Figure 9 (and Figures 10 and 11) above could be performed by Processor 1 using an LLM located externally or internally within the business opportunity management server 40.

[0094] Processor 1 lists the action items AK in step S104 of Figure 8, and performs processes to store them and to link them with the CRM. For example, Processor 1 saves the list of action items AK as opportunity information in the database inside the opportunity management server 40. Processor 1 also sends the list of action items AK to the customer relationship management server 50 so that information about actions related to the opportunity is registered in the CRM. In other words, it is registered in conjunction as one of the opportunity information items.

[0095] In step S105, processor 1 ensures that, based on the configured action item AK, for example, sales representative Hs's schedule registration and notifications are performed. For example, if sales representative Hs is using an application as a scheduler on a terminal device, processor 1 sends information to the scheduler so that the contents of the configured action item AK are registered. In other words, it ensures that a synchronous registration process for an external application is executed.

[0096] Processor 1 may also be configured to send a notification to the email address or account of sales representative Hs indicating the action item AK that was set up this time. Furthermore, if processor 1 can obtain the customer Hc's email address or account information, it may send a notification to customer Hc indicating the action item AK that was set up this time. These steps in S105 allow sales representatives Hs and customers Hc to easily recognize that actions to be taken after the deal have been set.

[0097] After performing the process shown in Figure 8, the processor 1 can display the business opportunity information screen 60, which includes the contents of the action management tab 64 shown in Figure 5, in response to a request from a terminal device of a user, such as sales representative Hs or their supervisor. Figure 12 shows an example of the processing of processor 1, which controls the display of the business negotiation information screen 60 and provides reminder notifications.

[0098] In step S201, processor 1 determines whether or not a user has requested to view the opportunity information screen 60 for a particular opportunity (access request). Here, we will specifically describe this as a request to view the action management tab 64.

[0099] When a display request is received, processor 1 performs an alert determination in step S210. This process determines whether there are any action items AK in the requested opportunity information whose time period from the current time to the deadline is less than or equal to a predetermined threshold time. If such an item exists, that action item AK is set as an alert target.

[0100] In step S211, processor 1 sets up a list for displaying the action management tab 64. Specifically, it sets up a list of action items AK arranged in order of approaching due dates as the display data. If there are any action items AK that are subject to an alert, it sets up the system to display an alert for those action items AK. For example, it sets up the system to display an alert mark 64B or highlight it as shown in Figure 6. Processor 1 also configures each action item AK to be displayed in different ways depending on whether the executor is the sales representative Hs or the customer Hc.

[0101] Furthermore, if Processor 1 contains an action item AK with an unknown due date, it ensures that the action item AK is placed at the top of the due date sorting order. Furthermore, if Processor 1 contains an action item AK with an unknown executor, it ensures that the action item AK is placed at the top of the order of deadlines.

[0102] After configuring these display settings, processor 1 controls the display of the action management tab 64 in step S212. In other words, it makes it possible for users to view the action management tab 64 as shown in Figure 5, for example, by browsing from their terminal device.

[0103] If there are any action items (AK) that trigger alerts, the user will see a display similar to Figure 6. For example, if the specified threshold time is set to 1 day, action items (AK) that will expire within 1 day from the current time will be highlighted.

[0104] If the list contains an action item AK with an unknown executor, the user will see a display similar to Figure 13. For example, in a list sorted by due date, an action item AK with a blank executor field will be displayed first, prioritizing it over the due date sorting order. The blank field may be the executor input field 64C.

[0105] If the list contains an action item AK with an unknown due date, the user will see a display similar to Figure 15. For example, in a list sorted by due date, an action item AK with a blank due date field will be displayed first. The blank field may be, for example, the due date input field 64D.

[0106] For example, by displaying the Action Management tab 64 on the sales opportunity information screen 60 as described above, users can easily recognize the necessary actions without the hassle of registering them. Alerts are also displayed to provide warnings.

[0107] While the Action Management tab 64 is displayed, processor 1 monitors the user's editing operations in step S213 and monitors the end of the display of the Action Management tab 64 in step S215.

[0108] If the user performs an operation such as clicking on input field 64C or input field 64D, the processor 1 recognizes this as an editing operation and proceeds to step S214 to perform operation-related processing. For example, clicking on input field 64C is recognized as an input operation by the executor, and a window 68 as shown in Figure 14 is displayed. The executor is then set according to the user's operation on window 68. Window 68 has an input field 68a, which allows selection of, for example, "Sales" or "Customer" via a pull-down menu. OK button 68b and Cancel button 68c are also provided for user operation. When the "executor" is entered by the user in this window 68, processor 1 updates the list order in the currently displayed action management area 64A so that the action item AK is displayed in order according to its deadline. Processor 1 also updates the executor of the action item AK and links it to the CRM.

[0109] When the input field 64D is clicked, the processor 1 recognizes this as an input operation for a deadline and displays a window 69 as shown in Figure 16. The processor then sets the deadline according to the user's operation on the window 69. The window 69 has an input field 69a, which allows the user to select the deadline date and time, for example, from a pull-down menu, and also has OK button 69b and Cancel button 69c to allow user operation. When the user enters a "deadline" in this window 69, the processor 1 updates the list order in the currently displayed action management area 64A so that the action item AK is displayed in the order corresponding to the deadline. The processor 1 also updates the deadline for the action item AK and links it to the CRM.

[0110] Furthermore, steps S213 and S214 may allow for a wider variety of editing operations. For example, the user may be able to update the description of the action by clicking on the "Next Action" field. Also, the deadline and the person who will perform the action may be able to be changed by clicking on the "Due Date" or "Performer" fields.

[0111] Regarding the person performing the action, while it is initially set to "Sales" or "Customer," it may be possible to allow users to edit and register specific names of the people in charge. For example, for action item AK, which is set to "Sales," the name of a staff member in the business group to which sales representative Hs belongs may be assigned.

[0112] It would also be good to allow editing to update the status of a single action item AK itself, and to display a notification indicating that the update has been reflected. For example, when a user enters an input indicating that an action has been completed, processor 1 either removes the action item AK from the display or changes the display to explicitly indicate that it has been completed.

[0113] If processor 1 determines in step S215 that the display of the action management tab 64 has ended, it terminates the processing related to the display of the action management tab 64.

[0114] In parallel with the display output control of the action management area 64A as described above, processor 1 also performs processing related to the output of reminder notifications. Processor 1 determines the reminder timing in step S202. For example, Processor 1 refers to the due date of each action item AK set in the opportunity and determines whether or not it is the reminder timing. The threshold for determining the reminder timing may be, for example, the predetermined threshold time for the alert display described above, or other threshold periods may be used. The threshold time may also be set according to the content of the action item AK. For example, the threshold time may be set longer for actions that take a long time.

[0115] If it is determined that it is time to remind a certain action item AK, the processor 1 proceeds to step S220 to determine the notification recipient. For example, the notification recipient is determined based on the configured executor. For example, if the sender is listed as "Sales," the recipients will be determined to be sales representative Hs, their superiors, and colleagues. If the sender is listed as "Customer," the recipient may be customer Hc, or there may be no recipient at all. Alternatively, even if the sender is a "Customer," the recipient may be sales representative Hs. This is to allow sales representative Hs to be aware of the other party's actions.

[0116] In step S221, processor 1 sends a reminder notification to the determined recipient. For example, it sends a message to the recipient's terminal device indicating the action that should be taken by the deadline.

[0117] Although the processes described in Figures 8 to 12 above were described as processes of processor 1, they can also be interpreted as processes of processor 21 or processor 50a.

[0118] <4. Effects and Modified Examples of the Embodiments> According to the business negotiation management server 40, which is an embodiment of the interview support device described in this disclosure, the following effects can be obtained.

[0119] The business negotiation management server 40 includes a processor 1 as a control unit, which comprises a text processing unit 1a that acquires audio data of a meeting (business negotiation) and converts the audio data into text data, an action setting unit 1b that analyzes the text data and sets action items AK that indicate the actions to be performed, and an output control unit 1c that performs display output control or transmission output control according to the set action items. This allows sales representatives (Hs) and customers (Hc) to review the actions agreed upon during the sales negotiation through screen displays or message notifications. In other words, a record of the actions is automatically generated, which can be used to inform post-sales activities.

[0120] In this embodiment, an example is given in which the processor 1 performs a control process as an output control process, which displays one or more action items AK set in the action setting process in order of approaching due date and time (see Figures 5, 12, etc.). By arranging the configured action items AK in order of due date and time, sales representatives Hs can easily check the priority of what they need to do.

[0121] In this embodiment, the processor 1 determines the executor of the action item in the action setting process, and in the output control process, it displays the action item in a different display manner for each executor (see Figures 5 and 7, etc.). For example, for each action item AK, whether the performer is the sales representative Hs or the customer Hc will be displayed using different display methods, such as differences in color, brightness, shade, decorative display, and display position or area. This allows viewers to clearly understand what the sales representative Hs and the other party should do.

[0122] In this embodiment, the processor 1 determines whether the executor of action item AK is the host or the guest in the action setting process, and in the output control process, it displays whether the executor is the host or the guest (see Figures 5, 10, 12, etc.). For example, instead of displaying the individual name as the executor for each action item AK, the system will determine and display whether it is the sales representative Hs or the customer Hc. This clearly indicates whether the action should be performed by the sales representative Hs's company or the customer. The sales representative Hs's company can then understand what needs to be done as a team.

[0123] In this embodiment, an example was given in which processor 1 performs contextual analysis of text data during action setting processing to determine who is performing the action item (see Figure 10). Contextual analysis of text data may allow us to determine whether a statement containing action item AK was made by our party or the other party. Furthermore, contextual analysis may also determine whether the statement was an action the user intended to perform or a request for the other party to perform it. Therefore, determining the performer through contextual analysis can improve the accuracy of the determination.

[0124] In this embodiment, an example was given in which processor 1 performs sound analysis of audio data during the action setting process to determine the person performing the action item (see Figure 10). By analyzing the sound data, such as voiceprint analysis and directional analysis of speech, it may be possible to determine whether a statement containing action items AK was made by our party or the other party. Therefore, determining the performer through sound analysis can improve the accuracy of the determination. Furthermore, using both sound analysis and contextual analysis of text data is desirable to improve the accuracy of the judgment.

[0125] In this embodiment, if the processor 1 cannot determine the executor of action item AK, it displays the action without presenting the executor during the output control process, and also enables executor input, setting the executor according to the input (see Figures 12, 13, and 14). For example, if the executor cannot be determined through contextual analysis or sound analysis, the next action is displayed with the executor field left blank. In this case, an interface is provided that allows the user to input the executor, enabling the executor to be set. This allows accurate information to be set even when automatic determination is not possible.

[0126] In the embodiment, an example was given in which the processor 1, in output control processing, controls the display of action items that the executor cannot determine in a different display manner than the action items that the executor has determined. Action items AK with an unknown executor should be displayed prominently. For example, they can be displayed at the top or highlighted, as shown in Figure 13. This allows the user to confirm the action and prompts them to input the executor's name.

[0127] In this embodiment, an example was given in which the processor 1 performs output control processing to send information about action item AK for registration with the executor's scheduler. For example, as shown in step S105 of Figure 8, the information for action item AK is sent so that the automatically configured action item AK is registered in a scheduler application or similar device launched on the executor's terminal device. This automates the schedule registration process, thereby increasing the work efficiency of sales representative Hs.

[0128] In this embodiment, an example was given in which the processor 1 performs output control processing, which involves sending information about the action item as a message to the executor's terminal device. For example, as shown in step S105 of Figure 8, the automatically configured action item AK is sent as a message to the executor's terminal device. This allows sales representatives Hs, etc., to easily recognize the content of the automatically configured action item AK.

[0129] In this embodiment, an example is given in which the processor 1, in output control processing, determines the reminder timing based on the deadline set for the action item, and sends a reminder notification to the executor's terminal device in response to the determination that it is the reminder timing (see Figure 12). For each action item AK, the current date and time are compared with the deadline, and reminders are sent to at least the person responsible for the action item AK that is approaching its deadline. This helps sales representatives Hs, customers Hc, etc., not forget to perform actions and meet deadlines.

[0130] The action setting unit 1b of the processor 1, which is the control unit of the business negotiation management server 40 in this embodiment, analyzes the text data obtained from the text conversion process, automatically determines the action to be performed and the deadline for the action, and sets the action item. This allows sales representatives (Hs) and customers (Hc) to review the actions agreed upon during the sales negotiation, along with their deadlines and dates, through screen displays or message notifications. In other words, an action log is automatically generated, which can be used to inform post-sales activities.

[0131] In this embodiment, an example was given in which the processor 1, in the action setting process, extracts utterance content that specifies the deadline or deadline date and time for the action from the text data and determines the deadline for the action (see Figure 11). For example, if a sales representative (Hs) or customer (Hc) mentions a specific deadline for each action item (AK), such as the due date or time, the deadline for action item (AK) can be automatically set by extracting that information.

[0132] In one embodiment, the processor 1 extracts non-date and time-based deadline utterances from text data in the action setting process, and determines the deadline for the action based on the non-date and time-based deadline utterances and the interview date and time (see Figure 11). This scenario assumes that for each action, the sales representative Hs or customer Hc indicates a deadline without specifying a concrete one. For example, statements such as "tomorrow," "by next week," "by the middle of next month," "soon," or "later" are used, without specifying a date or time. In such cases, the system estimates a specific deadline based on the date and time of the business negotiation. This allows for the automatic setting of action item AK, even for deadlines that are conventionally used in business negotiations.

[0133] In this embodiment, the processor 1 determines the action deadline by extracting utterances related to the action deadline from text data during the action setting process. However, if it is not possible to extract utterances related to the action item deadline from the text data, an example is given in which the deadline is estimated using action information or opportunity information to determine the action deadline (see Figure 11). If neither the sales representative (Hs) nor the customer (Hc) mentions a deadline for an action, the system will estimate a specific deadline by referring to information about the action, such as the type of action, and information about the deal itself, such as the other party involved, the product, the industry, past deal history, and the deal phase. This allows for the automatic setting of a deadline that reflects a reasonably appropriate timeframe, even if no deadline is mentioned during the deal.

[0134] In this embodiment, if the processor 1 cannot determine the deadline for an action, the output control process displays the action item AK without specifying the deadline, enables deadline input, and sets the deadline according to the input (see Figures 11, 15, and 16). In some cases, the deadline cannot be determined even through deadline estimation. In such cases, the action item AK is displayed with the deadline field left blank. By providing an interface that allows the user to enter the deadline, the deadline can be set. This ensures that accurate deadline information can be set even when automatic deadline determination is not possible.

[0135] In this embodiment, an example is given in which the processor 1, in the output control process, controls the display of action item AK for which the deadline of the action item cannot be determined, in a different display manner than action item AK for which the deadline has been determined (step S211 in Figure 12). Action items AK with an unknown deadline should be displayed prominently. For example, they can be displayed at the top or highlighted, as shown in Figure 15. This allows users to confirm the deadline and prompts them to enter it.

[0136] In this embodiment, the processor 1 performs output control processing to display action items whose period from the current date and time to the deadline is less than a predetermined threshold in a different display manner than action items whose period from the current date and time to the deadline is greater than or equal to the predetermined threshold (step S211 in Figure 12). Action items AK with approaching deadlines will be displayed prominently. For example, an alert mark 64B will be added or highlighted as shown in Figure 6. This will provide an alert function for the user.

[0137] The effects of the processing performed by processor 1 described above can also be achieved by processors 21 and 51 performing similar processing. In other words, not only the business negotiation management server 40 in the embodiment, but also the customer relationship management server 50 and the sound acquisition device 20 can operate as the interview support device of this disclosure.

[0138] Furthermore, the embodiments are not limited to the specific examples described above, and various modified configurations can be adopted.

[0139] The program in this embodiment is a program that causes the target computer device to execute the processing of processor 1 as shown in Figures 8 to 12. In other words, the program as an embodiment is a program that causes a computer device to execute the following: a text conversion process that acquires audio data of a meeting (business negotiation) and converts the audio data into text data; an action setting process that analyzes the text data obtained from the text conversion process and sets action items; and an output control process that performs display output control or transmission output control according to the action items set in the action setting process.

[0140] Furthermore, the program of this embodiment can also be described as a program that causes a computer device to execute the following: a text conversion process that acquires audio data of a meeting (business negotiation) and converts the audio data into text data; an action setting process that analyzes the text data obtained from the text conversion process, automatically determines the action and the deadline for the action, and sets the action items; and an output control process that performs display output control or transmission output control according to the action items set in the action setting process.

[0141] These programs enable the realization of a computer device that implements the functions of the sales opportunity management server 40 described in the embodiment. For example, by downloading the program to a personal computer, portable information processing device, etc., the personal computer, etc. can be made to function as an information processing device such as the sales opportunity management server 40.

[0142] Such programs can be recorded on recording media. These media include hard disk drives (HDDs) built into computer devices, ROMs (ROMs) in microcomputers, and non-volatile memory. Programs can be pre-recorded on these recording media. They can also be temporarily or permanently recorded and provided on removable recording media such as memory cards and optical discs. Furthermore, such programs can be downloaded from download sites via networks such as LANs (Local Area Networks) and the Internet.

[0143] The information processing device in this embodiment is used to process business negotiations between a person in charge and a customer, but the technology of the information processing device can be applied not only to so-called business negotiations, but also to various types of meetings in fields such as medicine, education, consulting, and counseling. [Explanation of Symbols]

[0144] 1 processor 1a Text Processing Unit 1b Action setting section 1c Output control unit 20 Sound collection device 50 Customer Relationship Management Server 60 Sales Opportunity Management Server 100 Customer Relationship Management Systems (Management Systems)

Claims

1. This involves acquiring audio data from an interview and then performing a text conversion process to convert the audio data into text data. The text data obtained from the text conversion process is analyzed, and an action setting process is performed to set action items. An output control process that performs display output control or transmission output control according to the action item set in the aforementioned action setting process, Equipped with a control unit that performs the following actions Interview support device.

2. The control unit, As part of the output control process, a control process is performed to display one or more action items set in the action setting process in order of proximity to their due date and time. The interview support device according to claim 1.

3. The control unit, In the aforementioned action setting process, the person who will perform the action item is determined, As part of the output control process, control processing is performed to display action items in a different display manner for each executor. The interview support device according to claim 1.

4. The control unit, In the aforementioned action setting process, it is determined whether the executor of the action item is the host or the guest. The output control process performs a control process that displays whether the executor is the host or the guest. The interview support device according to claim 3.

5. The control unit, In the aforementioned action setting process, contextual analysis of the text data is performed to determine who will perform the action item. The interview support device according to claim 3 or claim 4.

6. The control unit, In the aforementioned action setting process, the audio data is analyzed to determine who is performing the action item. The interview support device according to claim 3 or claim 4.

7. The control unit, If the person performing the action item cannot be determined, In the output control process described above, the display is executed without indicating the executor, and the executor input is enabled, and the executor is set according to the input. The interview support device according to claim 3 or claim 4.

8. The control unit, The output control process performs a control process that displays action items for which the executor cannot determine the action item in a different display manner than the action items for which the executor has determined the action item. The interview support device according to claim 7.

9. The control unit, In the aforementioned action setting process, the person who will perform the action item is determined, The output control process involves sending the action item information to the scheduler registration of the determined executor. The interview support device according to claim 1.

10. The control unit, In the aforementioned action setting process, the person who will perform the action item is determined, The output control process described above involves sending a message containing information about the action item to the terminal device of the person who performed the action. The interview support device according to claim 1.

11. The control unit, In the aforementioned action setting process, the person who will perform the action item is determined, In the output control process described above, the reminder timing is determined for the action items set in the action setting process based on the set deadline, and a reminder notification is sent to the terminal device of the person who performed the action if the reminder timing is determined to be met. The interview support device according to claim 1.

12. Information processing device, This involves acquiring audio data from an interview and then performing a text conversion process to convert the audio data into text data. The text data obtained from the text conversion process is analyzed, and an action setting process is performed to set action items. An output control process that performs display output control or transmission output control according to the action item set in the aforementioned action setting process, A method for providing interview support.

13. A program that can be read by a computer device, This involves acquiring audio data from an interview and then performing a text conversion process to convert the audio data into text data. The text data obtained from the text conversion process is analyzed, and an action setting process is performed to set action items. The computer device is instructed to perform an output control process that controls either the display output or the transmission output according to the action items set in the aforementioned action setting process. program.

14. A recording medium on which a program readable by a computer device is stored, This involves acquiring audio data from an interview and then performing a text conversion process to convert the audio data into text data. The text data obtained from the text conversion process is analyzed, and an action setting process is performed to set action items. A program is recorded that causes the computer device to execute an output control process that performs display output control or transmission output control according to the action items set in the action setting process. Recording medium.

Images