Information processing systems, information processing devices, information processing methods, programs

The information processing system enhances order forecast accuracy by analyzing customer voice data through text conversion and large-scale language models, allowing sales teams to prioritize high-probability leads.

JP2026112535APending Publication Date: 2026-07-07RICOH CO LTD

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
RICOH CO LTD
Filing Date
2024-12-25
Publication Date
2026-07-07

AI Technical Summary

Technical Problem

Conventional information processing systems for business negotiations lack accuracy in determining the order acceptance probability, as they do not utilize the voice of customers during negotiations.

Method used

An information processing system that includes an acquisition unit for spoken audio, a text data acquisition unit for converting audio to text, and an analysis result acquisition unit for determining the likelihood of receiving orders based on text analysis using a large-scale language model.

Benefits of technology

Improves the accuracy of order forecasts by analyzing customer voice data, enabling sales representatives to focus on promising leads, reducing workload and optimizing resource allocation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026112535000001_ABST
    Figure 2026112535000001_ABST
Patent Text Reader

Abstract

We provide an information processing system, information processing device, information processing method, and program that improve the accuracy of order forecasts. [Solution] In the information processing system 1, the information processing device 10 includes an acquisition unit 512 that acquires spoken audio from a first participant on the selling side and a second participant on the buying side recorded in online communication regarding business negotiations for a product, a text data acquisition unit 513 that acquires text data converted from the spoken audio by speech recognition, and an analysis result acquisition unit 514 that acquires information regarding the likelihood of receiving orders for the product as a result of analyzing the text data spoken by the second participant.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing apparatus, an information processing method, and a program.

Background Art

[0002] There is known an information processing system that performs online communication by transmitting and receiving voice between a plurality of terminal devices, and further transmitting and receiving content data including video. Such online communication may be used in business negotiations.

[0003] There is known a technique for extracting business negotiations with a high probability of receiving an order (see, for example, Patent Document 1). Patent Document 1 discloses a technique for calculating the order acceptance probability of a tender based on the elapsed time from the time of service implementation before receiving an order, calculating a value index of the tender based on the order acceptance probability of the tender, the expected order amount, and the customer rating, and displaying it on the screen.

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the conventional technology has a problem that the accuracy of the obtained order acceptance probability is low. For example, although the voice of a customer with whom a salesperson has negotiated may contain information suggesting the order acceptance probability, the voice of the customer is not used in the determination of the order acceptance probability in the conventional technology.

[0005] In view of the above problems, the present invention provides a technique for improving the accuracy of the order acceptance probability.

Means for Solving the Problems

[0006] In view of the above issues, the present invention provides an information processing system comprising: an acquisition unit for acquiring spoken audio from a first participant and a second participant participating in a business negotiation for a product; a text data acquisition unit for acquiring text data converted from the spoken audio by speech recognition; and an analysis result acquisition unit for acquiring information regarding the likelihood of receiving orders for the product as a result of analyzing the text data spoken by the second participant. [Effects of the Invention]

[0007] This invention can provide a technology that improves the accuracy of order forecasts. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram illustrates the inputs to a Large-Scale Language Model (LLM) and the outputs from the LLM. [Figure 2] This figure shows an example of the system configuration of an information processing system. [Figure 3] This figure shows a modified example of the system configuration of an information processing system. [Figure 4] This diagram shows an example of a computer hardware configuration. [Figure 5] This figure shows an example of the hardware configuration of a terminal device. [Figure 6] This figure shows an example of the functional configuration of an information processing system. [Figure 7] This figure shows an example of sales negotiation information stored in the sales negotiation information storage unit. [Figure 8] This figure shows an example of a business negotiation analysis result stored in the analysis result memory unit. [Figure 9] This figure shows an example of read information stored in the read information storage unit. [Figure 10] This diagram shows examples of lead definitions and opportunity definitions. [Figure 11] This diagram shows an example of the correspondence between opportunity types and lead definitions. [Figure 12]This is an example sequence diagram illustrating the process flow of an information processing system that generates business negotiation analysis results from spoken audio. [Figure 13] Figure 12 is a flowchart illustrating an example of the processing performed by the terminal device in step S5. [Figure 14] This figure shows an example of the operation screen of a terminal device. [Figure 15] This figure shows an example of a sales opportunity list screen displayed on an administrator's terminal or a sales representative's terminal. [Figure 16] This figure shows an example of a text display screen shown on an administrator's terminal or a sales representative's terminal. [Figure 17] This figure shows an example of a sales negotiation analysis results display screen shown on an administrator terminal or a sales representative's terminal device. [Figure 18] This figure shows a modified example of the functional configuration of an information processing system. [Modes for carrying out the invention]

[0009] Below, we will describe an information processing system and the information processing method performed by the information processing system as an example of a form for implementing this disclosure.

[0010] <Business negotiation analysis results> In a typical sales negotiation process for a product, an appointment setter schedules an appointment with the customer, a sales representative conducts the negotiation (for example, online), and reports the details of the negotiation to the company. The company, upon receiving the report, wants to allocate time and effort to deals that have a high probability of leading to a sale. However, the subjective reports of the negotiation content by the sales representatives were sometimes inaccurate. As a result, sales representatives sometimes wasted time and effort by dealing with deals that did not lead to a sale.

[0011] Therefore, in this embodiment, after a salesperson conducts an online negotiation, it is determined whether the case has a high probability of receiving an order or a low probability of receiving an order based on the negotiation content, and it is displayed on the terminal device of the manager or the like. Since the manager can allocate time, labor, etc. only to the cases with a high probability of receiving an order, the burden on the salesperson can be reduced.

[0012] In this embodiment, a large language model (LLM) is used for the analysis of the communication content. Also, in this embodiment, negotiation is mainly used as an example of communication for explanation. The information processing device inputs the negotiation content into the large language model, and the large language model outputs the presence or absence of the probability of receiving an order, etc. (hereinafter sometimes referred to as lead quality) created based on insights.

[0013] FIG. 1 is a diagram for explaining the input to the large language model and the output from the large language model. The input to the large language model 304 mainly consists of three elements: text data 301, definitions 302, and prompts 303. (1) For example, the speech of a meeting is converted into text data 301 by speech recognition. (2) Also, the person in charge on the system side, the salesperson, or the manager, etc. of this embodiment sets the definition 302 of potential customers and the definition 302 of non-potential customers. The details of these definitions 302 will be described later. Note that a potential customer or a potential case means a "customer or case with a high probability of receiving an order" and may be referred to as a "hot lead". A non-potential customer or a non-potential case means a "customer or case with a low probability of receiving an order" and may be referred to as a "cold lead". (3) The prompt 303 is conventionally a chat message sent by the user to the large language model 304. In this embodiment, it is a request, instruction, or command input by the information processing device to the large language model 304. The prompt 303 is, for example, "Please determine whether it is a potential customer or a non-potential customer".

[0014] In response to such an input, the large language model 304 outputs the lead quality. The lead quality is, for example, a potential customer (hot), a non-potential customer (cold), or neither.

[0015] In this embodiment, the information processing system can determine lead quality based on the content and definition of the business negotiation. Sales representatives can reduce their workload by focusing negotiations on promising leads that are likely to result in orders.

[0016] <About Terminology> Communication refers to conveying opinions, ideas, etc., to another person through words, gestures, facial expressions, etc. The content of communication is not restricted; it can be any interaction between two or more people. The interaction can be online or in person. Furthermore, the analysis method of this embodiment may be applied to seminars where one party speaks unilaterally. For example, communication may include business negotiations, meetings, medical consultations, telemedicine, classes, distance lectures, seminars, or counseling conducted using web conferencing.

[0017] Merchandise refers to goods or services that are sold or provided to customers. Examples of goods include printing equipment, projectors, interactive whiteboards (IWBs), digital signage and other output devices, head-up displays (HUDs), industrial machinery, imaging devices, sound collection devices, medical equipment, networked home appliances, automobiles (connected cars), personal computers (PCs), mobile phones, smartphones, tablet devices, game consoles, personal digital assistants (PDAs), and digital cameras. In addition, any goods that are the subject of commercial transactions are considered merchandise. Services include, for example, services provided directly by store employees to customers, and various data provision and data processing services provided to users via the internet or corporate networks.

[0018] Information regarding the likelihood of securing a sale refers to information that allows one to determine whether the likelihood of securing a sale is high or low, such as whether or not there is a likelihood of securing a sale. It may also include cases where the information regarding the likelihood of securing a sale is neither high nor low. Information regarding the likelihood of securing a sale may also include the probability (percentage or ratio) of securing a sale. Information regarding the likelihood of securing a sale is sometimes referred to as lead quality. Lead quality is indicated by terms such as "hot leads," which represent prospects or potential deals with a high likelihood of securing a sale, and "cold leads," which represent non-prospects or non-prospects with a low likelihood of securing a sale.

[0019] The large-scale language model (held by the text analysis device described later) is a so-called generative AI that provides a service allowing users to converse with artificial intelligence (AI) in natural language. The large-scale language model is a natural language processing model trained using a large amount of text data. The large-scale language model takes in a vast amount of text beforehand and learns knowledge from it using deep learning, reinforcement learning, etc. The large-scale language model uses this knowledge to provide response messages in response to prompts.

[0020] Examples of large-scale language models or systems incorporating large-scale language models include GPT-3, GPT-4, Transformer, and BERT (all registered trademarks). Other large-scale language models may also be used.

[0021] A definition is the process of clearly defining the meaning of something using words. A definition serves as the criteria, conditions, or guidelines for evaluating a sales opportunity. A lead quality definition clarifies how a large-scale language model determines the likelihood of a sale when analyzing text data. A sales opportunity definition clarifies how a large-scale language model evaluates a sales opportunity when analyzing text data.

[0022] The first and second participants are those participating in the business negotiation, with one being the seller and the other the buyer. In this embodiment, these will be described using the terms sales representative and customer.

[0023] <System Configuration> Figure 2 shows an example of the system configuration of an information processing system 1 according to one embodiment. The information processing system 1 includes, for example, an external system 3 connected to a communication network 2 such as the Internet or a LAN (Local Area Network), an information processing device 10, a text analysis device 5, multiple terminal devices 100a, 100b, 100c, 100d, ..., and an administrator terminal 101, etc. Of these, the external system 3 and the text analysis device 5 do not necessarily have to be included in the information processing system 1, and the information processing device 10 may use these services as appropriate. In the following description, when referring to any terminal device among the multiple terminal devices 100a, 100b, 100c, 100d, ..., the term "terminal device 100" will be used.

[0024] Information processing system 1 is a system that analyzes or evaluates online business negotiations (hereinafter simply referred to as "business negotiations") conducted by sending and receiving at least voice between terminal device 100 and other terminal devices 100. Note that online business negotiations are just one example; business negotiations may also be conducted face-to-face. Furthermore, business negotiations are an example of communication. Here, the following explanation assumes that communication is defined as a business negotiation.

[0025] Terminal device 100 is a general-purpose information terminal used by sales representatives and customers participating in business negotiations, such as a PC (Personal Computer), tablet, or smartphone. Alternatively, terminal device 100 may be an electronic device with online meeting capabilities, such as a video conferencing system or an IWB (Interactive White Board). An IWB is a whiteboard with electronic blackboard functionality that allows for mutual communication, and is also called an electronic blackboard. Here, as an example, the following explanation will be given assuming that terminal device 100 is a general-purpose information terminal.

[0026] External system 3 is a system that provides, for example, an online meeting service, a sales support service, or an emotion recognition service. For example, a sales representative participating in a business negotiation can conduct a business negotiation with a customer via online meeting by using an online meeting application installed on terminal device 100, or a web browser, etc., to access the online meeting service provided by external system 3. In this embodiment, the online meeting service provided by external system 3 may be any online meeting service.

[0027] Furthermore, the information processing device 10 can acquire various types of information from the sales support service provided by the external system 3, such as deal negotiation information, customer information, or sales member activity information. The sales support service is a service that assists sales activities and is also known as SFA (Sales Force Automation).

[0028] Furthermore, the information processing device 10 can acquire emotional information, such as the motivation of customers participating in business negotiations, by utilizing an emotion estimation service provided by the external system 3. The emotion estimation service is, for example, a service that uses emotion estimation AI to estimate emotions or changes in feelings from human voice or facial expressions.

[0029] The information processing device 10 is, for example, an information processing device having the configuration of a computer, or a system including multiple computers. The information processing device 10 acquires the spoken voices of the sales representatives and customers participating in the business negotiation and converts the acquired spoken voices into text data using speech recognition. The information processing device 10 requests the text analysis device 5 to analyze the text data. The analysis of the text data is an analysis of the content of the business negotiation.

[0030] The text analysis device 5 analyzes text data using a large-scale language model and provides a text analysis service that outputs sales opportunity analysis results and lead quality. The text analysis device 5 exposes an API (Application Programming Interface), and the information processing device 10 calls this API and sends text data, etc., to which the information processing device 10 obtains the sales opportunity analysis results and lead quality. The information processing device 10 sends the sales opportunity analysis results and lead quality to the administrator terminal 101 or the sales representative's terminal device 100.

[0031] The administrator terminal 101 is an information terminal, such as a PC, tablet, or smartphone, used by administrators or others who manage multiple sales representatives. Administrators can use the web browser or other software provided on the administrator terminal 101 to access the information processing device 10 and view the sales negotiation analysis results and other information provided by the information processing device 10.

[0032] Note that the system configuration of the information processing system 1 shown in Figure 2 is just one example. For example, at least some of the online meeting service, sales support service, and sentiment estimation service provided by the external system 3 may be provided by the information processing device 10. In this case, the information processing system 1 does not need to have the external system 3, as shown in Figure 3.

[0033] Furthermore, the information processing device 10 may also have a text analysis device 5 (large-scale language model).

[0034] <Hardware Configuration> (Computer hardware configuration) The external system 3, the information processing device 10, and the administrator terminal 101 each have a hardware configuration of a computer 200, for example, as shown in Figure 4. Note that the external system 3 and the information processing device 10 may be implemented by multiple computers 200. Furthermore, the terminal device 100 may, as an example, have a hardware configuration of a computer 200, as shown in Figure 4.

[0035] Figure 4 shows an example of the hardware configuration of a computer according to one embodiment. The computer 200 includes, for example, a CPU (Central Processing Unit) 201, ROM (Read Only Memory) 202, RAM (Random Access Memory) 203, HD (Hard Disk) 204, HDD (Hard Disk Drive) controller 205, display 206, external device connection I / F (Interface) 207, network I / F 208, keyboard 209, pointing device 210, DVD-RW (Digital Versatile Disk Rewritable) drive 212, media I / F 214, GPU 226, and bus line 215, as shown in Figure 4.

[0036] Furthermore, if the computer 200 is the terminal device 100, the computer 200 may also include, for example, a microphone 221, a speaker 222, an audio input / output interface 223, a CMOS (Complementary Metal Oxide Semiconductor) sensor 224, and an image sensor interface 225.

[0037] Of these, the CPU 201 controls the overall operation of the computer 200. The ROM 202 stores programs used to start the computer 200, such as the IPL (Initial Program Loader). The RAM 203 is used, for example, as a work area for the CPU 201. The HD 204 stores programs such as the OS (Operating System), applications, device drivers, and various data. The HDD controller 205 controls the reading or writing of various data to the HD 204, for example, according to the control of the CPU 201. Note that the HD 204 and the HDD controller 205 are examples of storage devices provided by the computer 200.

[0038] Display 206 displays various information, such as a cursor, menu, window, text, or image. Note that display 206 may be located outside of computer 200. External device connection I / F 207 is an interface for connecting various external devices to computer 200. Network I / F 208 is an interface for connecting computer 200 to communication network 2 and communicating with other devices.

[0039] The keyboard 209 is a type of input device equipped with multiple keys for inputting characters, numbers, and various instructions. The pointing device 210 is a type of input device for selecting and executing various instructions, selecting processing targets, moving the cursor, and so on. The keyboard 209 and the pointing device 210 may be located outside the computer 200.

[0040] The DVD-RW drive 212 controls the reading or writing of various data to the DVD-RW 211, which is an example of a removable recording medium. Note that the DVD-RW 211 is not limited to DVD-RW; other recording media may also be used. The media interface 214 controls the reading or writing (storage) of data to the media 213, such as flash memory.

[0041] Microphone 221 is a built-in circuit that converts sound into electrical signals. Speaker 222 is a built-in circuit that converts electrical signals into physical vibrations to produce sounds such as music and speech. Audio input / output interface 223 is a circuit that processes the input and output of audio signals between microphone 221 and speaker 222 according to the control of CPU 201.

[0042] The CMOS sensor 224 is a type of built-in imaging means that captures an image of a subject (e.g., a self-portrait) and obtains image data according to the control of the CPU 201. The computer 200 may have other imaging means, such as a CCD (Charge Coupled Device) sensor, instead of the CMOS sensor 224. The image sensor interface 225 is a circuit that controls the driving of the CMOS sensor 224.

[0043] Bus line 215 includes an address bus, a data bus, and various control signals for electrically connecting the above-mentioned components.

[0044] (Terminal device hardware configuration) Figure 5 shows an example of the hardware configuration of a terminal device 100 according to one embodiment. Here, an example of the hardware configuration of the terminal device 100 when the terminal device 100 is an information terminal such as a smartphone or a tablet terminal will be described. Note that the terminal device 100 may also be an electronic device equipped with a computer configuration such as a video conferencing device or an IWB and online conferencing functions. Furthermore, the administrator terminal 101 may have the hardware configuration of the terminal device 100 as shown in Figure 5.

[0045] In the example shown in Figure 5, the terminal device 100 includes a CPU 401, ROM 402, RAM 403, storage device 404, CMOS sensor 405, image sensor I / F 406, acceleration / direction sensor 407, media I / F 409, GPS (Global Positioning System) receiver 410, and the like.

[0046] Of these, the CPU 401 controls the operation of the entire terminal device 100 by executing a predetermined program. The ROM 402 stores programs used to start the CPU 401, such as an IPL. The RAM 403 is used as the work area for the CPU 401. The storage device 404 is a large-capacity storage device that stores programs such as the OS and applications, and various data, and is implemented by, for example, an SSD (Solid State Drive) or flash ROM.

[0047] The CMOS sensor 405 is a type of built-in imaging means that captures an image of a subject (mainly a self-portrait) and obtains image data according to the control of the CPU 401. The terminal device 100 may have imaging means such as a CCD sensor instead of the CMOS sensor 405. The image sensor interface 406 is a circuit that controls the driving of the CMOS sensor 405. The acceleration / direction sensor 407 is a type of sensor such as an electronic magnetic compass, gyrocompass, or acceleration sensor that detects the Earth's magnetic field. The media interface 409 controls the reading or writing (storage) of data to or from the media (storage medium) 408, such as flash memory. The GPS receiver 410 receives GPS signals (positioning signals) from GPS satellites.

[0048] Furthermore, the terminal device 100 includes a long-range communication circuit 411, an antenna 411a for the long-range communication circuit 411, a CMOS sensor 412, an image sensor interface 413, a microphone 414, a speaker 415, an audio input / output interface 416, a display 417, an external device connection interface 418, a short-range communication circuit 419, an antenna 419a for the short-range communication circuit 419, and a touch panel 420.

[0049] Of these, the long-distance communication circuit 411 is a circuit that communicates with other devices, for example, via the communication network 2. The CMOS sensor 412 is a type of built-in imaging means that captures an image of a subject and obtains image data according to the control of the CPU 401. The image sensor interface 413 is a circuit that controls the driving of the CMOS sensor 412. The microphone 414 is a built-in circuit that converts sound into electrical signals. The speaker 415 is a built-in circuit that converts electrical signals into physical vibrations to produce sounds such as music and speech. The sound input / output interface 416 is a circuit that processes the input and output of sound signals between the microphone 414 and the speaker 415 according to the control of the CPU 401.

[0050] The display 417 is a type of display means, such as a liquid crystal or organic EL (electroluminescence), that displays images of the subject and various icons. The external device connection I / F 418 is an interface for connecting various external devices. The short-range communication circuit 419 includes a circuit for performing short-range wireless communication. The touch panel 420 is a type of input means that allows the user to operate the terminal device 100 by pressing the display 417.

[0051] Furthermore, the terminal device 100 is equipped with a bus line 421. The bus line 421 includes an address bus, a data bus, and the like for electrically connecting each component, such as the CPU 401 shown in Figure 5.

[0052] Note that the hardware configuration of the terminal device 100 shown in Figure 5 is just one example. The terminal device 100 may have any other hardware configuration as long as it has a computer configuration, communication circuit, display, microphone, speaker, etc.

[0053] <Functional Configuration> Next, an example of the functional configuration of the information processing system 1 will be described. Figure 6 is a diagram showing an example of the functional configuration of the information processing system 1 according to one embodiment. Here, the following explanation will be given assuming that the information processing system 1 has the system configuration shown in Figure 2.

[0054] (Functional configuration of terminal devices) The terminal device 100 achieves the functional configuration shown in Figure 6 by having the CPU 201 execute a program stored on a storage medium such as an HD204, DVD-RW211, or media 213. In the example in Figure 6, the terminal device 100 includes a communication unit 501, a conference control unit 502, an audio transmission unit 503, a display control unit 504, an operation reception unit 505, and an audio playback unit 506, etc. At least some of the above functional configurations may be implemented by hardware. Also, in Figure 6, terminal devices 100b, ... may have any functional configuration as long as they can conduct online conferences with terminal device 100a via the communication network 2 and external system 3, etc.

[0055] The communication unit 501 connects the terminal device 100 to the communication network 2 using, for example, a network interface 208, and performs communication processing to communicate with other devices such as an external system 3, an information processing device 10, or another terminal device 100.

[0056] The conference control unit 502 performs a series of processes related to online meetings, such as connecting to an online meeting, sending and receiving spoken audio (and video) of the online meeting, and inputting and outputting spoken audio (and video). The processes performed by the conference control unit 502 may be the same as those for a typical online meeting.

[0057] The audio transmission unit 503 acquires the spoken voice of a sales representative participating in a business negotiation using an online meeting, as well as the spoken voice of a customer participating in the same negotiation, and performs audio transmission processing to send it to the information processing device 10. For example, the audio transmission unit 503 acquires the voice acquired by the microphone (spoken voice of the sales representative) and the voice output from the speaker (spoken voice of the customer) from the audio input / output interface 223, etc., and transmits the acquired spoken voice (audio data) to the information processing device 10. As a result, the information processing device 10 can acquire the spoken voice of a sales representative participating in a business negotiation using any online meeting service, as well as the spoken voice of a customer.

[0058] However, the audio transmission unit 503 may also acquire the spoken voice of the sales representative and the customer from the conference control unit 502, etc., and transmit the acquired spoken voice (audio data) to the information processing device 10. The audio transmission unit 503 is implemented, for example, by the CPU 201 executing an application program (hereinafter referred to as "app") for the information processing system 1.

[0059] The display control unit 504 performs display control processing to display a screen on a display unit such as the display 206. The operation reception unit 505 performs operation reception processing to receive operations from participants in a business meeting using an input device such as the keyboard 209 or the pointing device 210. The meeting control unit 502, the display control unit 504, and the operation reception unit 505 may be implemented by, for example, a web browser provided by the terminal device 100.

[0060] The audio playback unit 506 performs audio playback processing, which outputs sound from the speaker 222 by playing sound source data.

[0061] (Functional configuration of information processing equipment) The information processing device 10 realizes the various functional configurations of the information processing device 10 as shown in Figure 6 by having the CPU 201, etc., execute a program stored on a storage medium such as HD204, DVD-RW211, or media 213. In the example in Figure 6, the information processing device 10 has a communication unit 511, an acquisition unit 512, a text data acquisition unit 513, an analysis result acquisition unit 514, a business negotiation result recording unit 515, a setting reception unit 516, a provision unit 517, and a storage unit 519. At least some of the above functional configurations may be realized by hardware.

[0062] Furthermore, the memory unit 519 is implemented by storage devices such as the HD204 and HDD controller 205 shown in Figure 4.

[0063] The communication unit 511 connects the information processing device 10 to the communication network 2 using, for example, a network interface 208, and performs communication processing to communicate with other devices such as the terminal device 100, the text analysis device 5, the external system 3, and the administrator terminal 101.

[0064] The acquisition unit 512 performs an acquisition process to acquire the spoken voices (voice data) of the sales representatives and customers participating in the communication. As a specific example, if the communication is a business negotiation, the acquisition unit 512 acquires the spoken voices of the sales representatives and customers participating in the negotiation. For example, the acquisition unit 512 acquires the spoken voice of the sales representative and the spoken voice of the customer transmitted by the voice transmission unit 503 of the terminal device 100a used by the sales representative.

[0065] The text data acquisition unit 513 acquires text data based on the spoken voices (audio data) of the sales representative and the customer acquired by the acquisition unit 512. First, the text data acquisition unit 513 synthesizes the spoken voices of the sales representative and the customer acquired by the acquisition unit 512 and performs a conversation voice creation process to create a conversation voice that includes the spoken voices of the sales representative and the customer. Then, the text data acquisition unit 513 performs existing speech recognition processing to convert the spoken voice into text data. Alternatively, the text data may be obtained by separately recognizing the spoken voices of the sales representative and the customer. In this case, text data related to the spoken voice of the sales representative and text data related to the spoken voice of the customer are generated as text data for a single business negotiation. Therefore, the speaker of the text data is identified. The text data acquisition unit 513 may perform speech recognition itself, or it may request speech recognition from an external speech recognition server and acquire text data as a response.

[0066] The analysis result acquisition unit 514 requests the text analysis device 5 to analyze the text data along with definitions and prompts by calling the API exposed by the text analysis device 5, and in response, it acquires the opportunity analysis results and lead quality from the text analysis device 5.

[0067] The sales negotiation result recording unit 515 records the acquired sales negotiation results and lead quality. The sales negotiation result recording unit 515 assigns a sales negotiation analysis result ID and stores the sales negotiation results in the analysis result storage unit 532, and the lead quality in the lead information storage unit 533.

[0068] The configuration reception unit 516 accepts various settings from administrators and sales representatives. In this embodiment, one of the settings is a sales opportunity definition (an example of a second definition) and a lead definition (an example of a first definition), which will be described later. The configuration reception unit 516 may also accept prompts.

[0069] The provisioning unit 517 performs a provisioning process to provide a sales opportunity analysis results display screen and a sales opportunity list screen. For example, upon request from the administrator terminal 101, the provisioning unit 517 displays the sales opportunity analysis results display screen and the sales opportunity list screen on the administrator terminal 101, etc. The provisioning unit 517 may send the URLs of the sales opportunity analysis results display screen and the sales opportunity list screen to the administrator terminal 101 by email or other means, or by SNS or other means. The provisioning unit 517 may send the sales opportunity analysis results and lead quality to the administrator terminal 101 by email or other means, or by SNS or other means. The sales opportunity analysis results and lead quality may be created upon request from a sales representative or administrator, or they may be created automatically at a predetermined time. The provisioning unit 517 may print the sales opportunity analysis results and lead quality using a printing device.

[0070] The memory unit 519 stores various information, data, and programs, such as spoken audio acquired by the acquisition unit 512, one or more text data acquired by the text data acquisition unit 513, sales negotiation analysis results, and lead quality.

[0071] (Administrator terminal function configuration) The administrator terminal 101 implements the various functional configurations of the administrator terminal 101 as shown in Figure 6 by having the CPU 201 execute a program stored on a storage medium such as HD204, DVD-RW211, or media 213. In the example in Figure 6, the administrator terminal 101 has a functional configuration including a communication unit 521, a display control unit 522, an operation reception unit 523, and an audio playback unit 524. At least some of the above functional configurations may be implemented by hardware.

[0072] The communication unit 521 connects the administrator terminal 101 to the communication network 2 using, for example, a network interface 208, and performs communication processing to communicate with other devices, such as the information processing device 10.

[0073] The display control unit 522 performs display control processing, for example, to display a display screen provided by the information processing device 10, etc., on a display unit such as the display 206. The operation reception unit 523 performs operation reception processing, for example, to receive operations from an administrator or the like on the display screen displayed by the display control unit 522. The display control unit 522 and the operation reception unit 523 may be implemented, for example, by a web browser provided on the administrator terminal 101. For example, the administrator terminal 101 may be a general-purpose information terminal equipped with a web browser.

[0074] The audio playback unit 524 performs audio playback processing, which outputs sound from the speaker 222 by playing sound source data.

[0075] Note that the functional configuration of the information processing system 1 shown in Figure 6 is just one example. For example, the functions of the external system 3 may be provided by the information processing device 10. Also, at least a part of the functional configuration of the information processing device 10 may be provided by the terminal device 100 or the administrator terminal 101, etc. Furthermore, at least a part of the functional configuration of the terminal device 100 may be provided by the information processing device 10 or the external system 3, etc. In short, each functional configuration of the information processing system 1 shown in Figure 6 may be provided by any of the devices included in the information processing system 1.

[0076] (Business negotiation information storage unit 531) Figure 7 shows an example of sales negotiation information stored in the sales negotiation information storage unit 531. The sales negotiation information contains information about sales negotiations conducted by sales representatives. • The Opportunity ID field contains unique identification information that identifies the opportunity. • The sales representative section will list the sales representatives who have communicated with customers for the purpose of business negotiations. The "Meeting Date and Time" field will contain the start and end dates and times of the meeting. • The customer information fields include the name of the company and the name of the contact person involved in the business negotiation. The "Deal Analysis Result ID" field contains unique identification information that identifies the deal analysis result, which is the result of analyzing the deal in question. Multiple deal analysis result IDs may be associated with a single deal. For example, if analysis is performed using different deal definitions, multiple deal analysis result IDs may be registered. The "Data URL" field will contain the URLs for the video and audio recordings of the business meeting, as well as the URLs for the text data obtained through speech recognition. • The self-evaluation section includes an N-level evaluation of the sales negotiation (subjective good or bad) entered by the sales representative. The "Deal Type" field specifies the type of deal selected from the list. The deal type can be changed depending on the customer's industry, etc. For example, the deal type can be determined by the size of the funds the customer is handling. Additionally, the deal type can be arbitrarily set based on factors such as company size and product / service. The "Order Received" item indicates whether or not the deal ultimately resulted in an order being received. For example, "Success" indicates that an order was received, while "Failure" indicates that an order was not received (e.g., purchase of a competitor's product, budget cuts).

[0077] (Analysis result storage unit 532) Figure 8 shows an example of a sales opportunity analysis result stored in the analysis result storage unit 532. The sales opportunity analysis result is the result of analyzing a sales opportunity and is stored in association with a sales opportunity analysis result ID.

[0078] The Deal Analysis Result ID is an identifier that uniquely identifies the deal analysis result, which is the result of analyzing the deal in question. The Deal Definition is an identifier that identifies the deal definition used to evaluate the deal in question.

[0079] • The evaluation criteria for a business negotiation include evaluations based on the business negotiation definition. Specifically, the evaluation is based on an N-level scale to determine whether the negotiation was conducted in accordance with the business negotiation definition. The following is an example. S: Excellent achievement A: Slightly above average B: Meets the standard C: Achievement is somewhat insufficient. D: Not achieved at all The "Challenges in Negotiation" section includes the reasons why the text analysis device 5 determined the above evaluation based on the text data, negotiation definitions, and prompts. An example is shown in Figure 17.

[0080] • The "Issue Location" field contains the locations where issues were extracted during the analysis by the text analysis device 5. These locations are identified by the time elapsed since the start of the business negotiation. Since there are usually multiple issue locations, they are identified by the "Issue ID." The "Issue Details" field contains the specific details of the issues generated by the text analysis device 5. The "Issue Details" field may also be the text data itself.

[0081] The solution section contains the improvements for each individual problem area generated by the text analysis device 5.

[0082] (Read information storage unit 533) Figure 9 shows an example of lead information stored in the lead information storage unit 533. The lead information includes lead quality determined by the text analysis device 5 based on text data, deal definitions, and prompts, and is stored in association with the deal analysis result ID. • The "Deal Analysis Result ID" field contains unique identification information that identifies the deal analysis result, which is the result of analyzing the deal in question. • The Lead Definition field contains identification information that identifies the definition used to determine the lead quality of the opportunity. The "Lead Quality" item is set to the lead quality of the deal, as determined by the text analysis device 5 based on the sales negotiation content. Lead quality can be set to, for example, cold, hot, or neither. Lead quality may also be expressed as a percentage, on an N scale, that is expected to result in an order. The "Reason" field contains the reason for the lead quality determination. The text analysis device 5 returns the lead quality along with the reason for that determination to the information processing device 10. The reason is the identification information (item number in the diagram) of the corresponding lead definition. The reason also records how much time has passed since the start of the business negotiation that the text data used to determine the lead quality was detected. Based on the elapsed time, the information processing device 10 can identify the spoken audio and text data used to determine the lead quality.

[0083] <About definitions and prompts> Next, we will explain the lead definition and prompt that the analysis result acquisition unit 514 transmits when acquiring lead quality information from the text analysis device 5. Note that the lead definition may be included in the prompt, or the prompt may be included in the lead definition; there is no need to strictly distinguish between the two. The prompt is fixed, while the lead definition can be set by the system administrator, sales representative, or manager.

[0084] Figure 10(a) shows an example of a lead definition. A lead definition includes definitions for cold leads and hot leads. Only one of the definitions may be included. For example, an administrator may set only a lead definition for cold leads and have opportunities that do not meet that definition be considered hot leads. Alternatively, an administrator may set only a lead definition for hot leads and have opportunities that do not meet that definition be considered cold leads.

[0085] Definition of cold leads (1) Purpose of information gathering (2) No immediate hiring plans Definition of a hot read (1) Under consideration of competing services (2) Concerns only regarding price Thus, a cold lead is defined as a statement that suggests a low probability of securing an order, while a hot lead is defined as a statement that suggests a high probability of securing an order.

[0086] The text analysis device 5 determines the lead quality of the business opportunity based on these definitions and prompts.

[0087] Figure 10(b) shows an example of a sales negotiation definition. A sales negotiation definition is a definition of statements made to evaluate a sales negotiation, and as an example, it defines a bad sales negotiation. "Bad" refers to statements that hinder the order of the product. In other words, it refers to a sales negotiation where the parties do not get the expected result (for example, the product is not sold). A sales negotiation definition may also define a good sales negotiation. In addition, it may define whether a good relationship has been built with the customer, whether the required information has been obtained, whether the required actions have been promised, etc. 1. Poor listening skills "A bad business deal is one where you don't hear the ultimate goal (higher objective) that can be understood by digging deeper, rather than just the superficial, specific objectives." 2. Poor ability to address concerns. "If the sales team fails to adequately address or follow up on any issues raised by the client, it's a bad deal." Thus, the sales negotiation definition defines statements that hinder the sale of an order (bad statements). The text analysis device 5 generates sales negotiation analysis results by performing sales negotiation analysis based on these sales negotiation definitions and prompts.

[0088] Furthermore, as shown in Figure 11, lead definitions may be switched for each opportunity type. Figure 11 shows an example of the correspondence between opportunity types and lead definitions. In Figure 11, opportunity types are categorized by annual sales, but they may also be categorized by other factors such as product type or company size. It is preferable that lead definitions appropriate to the opportunity type be set. For example, in Figure 11, let's assume annual sales X > annual sales Y. In this case, the lead definition for annual sales X (hot lead definition) and the lead definition for annual sales Y (hot lead definition) are set as follows, as an example. Annual sales X: "The price of over 10 million yen is a concern." Annual sales Y: "The price of over 5 million yen is a concern." By setting the price threshold for the merchandise to correspond to annual sales, the text analysis device 5 can more easily determine whether a lead is a hot lead or a cold lead. When switching lead definitions for each opportunity type, the analysis result acquisition unit 514 obtains the opportunity type from the opportunity information and transmits the lead definition associated with the opportunity type to the text analysis device 5.

[0089] A prompt is an input sentence or question used to give instructions to artificial intelligence (AI) or a computer. The prompt determines how the text analysis device 5 responds. The clearer and more detailed the prompt, the more accurate and relevant the response obtained from the text analysis device 5 will be.

[0090] The lead quality determination prompt in this embodiment includes, for example, a procedure for determining lead quality based on the definitions of hot leads and cold leads (e.g., which definition to prioritize). The lead quality determination prompt includes a request to determine lead quality based on customer text data. The opportunity evaluation prompt includes, for example, the ratio of the number of items met to the total number of items in several opportunity definitions, and the position of that ratio on an N-level evaluation scale. The opportunity evaluation prompt includes a request to generate opportunity analysis results based on sales representative text data.

[0091] <Processing flow> Next, the processing flow of the information processing method according to this embodiment will be described.

[0092] (Overall processing of Information Processing System 1) Figure 12 is a sequence diagram illustrating the process flow by which the information processing system 1 creates business negotiation analysis results from spoken audio.

[0093] S1, S3: The terminal device 100 used by the sales representative (for example, terminal device 100a) participates in a business negotiation using the same online conference as the terminal device used by the customer (for example, terminal device 100b), and is in a state where at least voice conversation is possible. The conference control unit 502 of terminal device 100a connects to a URL obtained from the external system 3. The conference control unit 502 of terminal device 100b also connects to the same URL. This enables online conferencing between terminal devices 100a and 100b. The communication unit 501 of terminal device 100a transmits video data and spoken audio to the external system 3. The communication unit 501 of terminal device 100b transmits video data and spoken audio to the external system 3. Note that video data does not necessarily have to be transmitted or received. Therefore, the spoken audio is separated into the sales representative's voice and the customer's voice.

[0094] S2, S4: External system 3 receives video data and spoken audio from terminal device 100a. External system 3 transmits video data and spoken audio to terminal device 100b. External system 3 receives video data and spoken audio from terminal device 100b. External system 3 transmits video data and spoken audio to terminal device 100a. Terminal devices 100a and 100b repeat steps S1 to S4.

[0095] S5: The audio transmission unit 503 of the terminal device 100a transmits the voice of the sales representative and the voice of the customer participating in the same business negotiation to the information processing device 10. The process of step S5 will be explained in detail in Figure 13. The audio transmission unit 503 may also transmit video data.

[0096] S6: The communication unit 511 of the information processing device 10 receives the spoken voice of the sales representative and the spoken voice of the customer participating in the same business negotiation. If video data is transmitted, the communication unit 511 also receives the video data. The text data acquisition unit 513 performs speech recognition on these spoken voices and acquires text data. The text data is associated with the sales representative or customer in its entirety, by length divided by silent time, or by predetermined length intervals. The text data acquisition unit 513 stores the text data and spoken voice in the storage unit 519. Video data may be stored together with the audio data as recorded video data.

[0097] The amount of text data gradually increases as the online meeting (business negotiation) progresses. The memory unit 519 stores one text data entry for each business negotiation. Furthermore, if another business negotiation takes place, text data corresponding to that negotiation is stored in the memory unit.

[0098] S7: Opportunity analysis and lead quality assessment may be performed automatically or by instruction from the administrator. Furthermore, when an opportunity ends, the information processing device 10 may notify the administrator terminal 101 via email or push notification that the opportunity has ended. The administrator can then check the notification and perform opportunity analysis and lead quality assessment for any opportunities where they wish to review the analysis results and lead quality.

[0099] If instructed by the administrator, the administrator connects the administrator terminal 101 to the information processing device 10 and performs opportunity analysis and lead quality assessment. At or before this time, the administrator (which may be a system-side representative or a sales representative) can set the opportunity definitions and lead definitions to be used for opportunity analysis and lead quality assessment. The administrator may enter new definitions or select existing definitions. The default opportunity definitions and lead definitions may also be used. The setting reception unit 516 accepts the settings for the opportunity definitions and lead definitions.

[0100] S8: The analysis result acquisition unit 514 of the information processing device 10 requests the text analysis device 5 to perform a sales opportunity analysis and determine lead quality. In this embodiment, for the sake of explanation, the sales opportunity analysis and lead quality determination are requested in the same step, but it is not a problem if they are requested at different times. The sales opportunity analysis request includes text data accumulated for each online meeting, a sales opportunity definition, and a prompt for evaluating the sales opportunity. The prompt for evaluating the sales opportunity may include a statement that the analysis will focus on the speech of the sales representative. The lead quality determination request includes text data accumulated for each online meeting (the text data only needs to be sent once), a lead definition, and a prompt for determining lead quality. The prompt for determining lead quality may include a statement that the analysis will focus on the speech of the customer.

[0101] Furthermore, the analysis result acquisition unit 514 may acquire the lead definition associated with the business opportunity type and transmit it to the text analysis device 5.

[0102] The analysis result acquisition unit 514 may request a sales opportunity analysis and a lead quality assessment at the following times. Note that the sales opportunity analysis request and the lead quality assessment request may be sent at different times. • Each time an online meeting ends In this case, the information processing device 10 is suitable for generating sales negotiation analysis results early. For example, it can be used by sales representatives for daily reports, etc. Also, managers can provide early guidance to sales representatives. • At regular intervals (for example, every day, every three days, every week, every two weeks, etc.) In this case, the information processing device 10 can obtain negotiation analysis results and lead quality information from negotiations conducted over a certain period. Administrators can review the negotiation analysis results and lead quality information for relatively unimportant negotiations at their convenience. Furthermore, sales representatives can use this information for weekly or monthly reports, for example. • After a certain number of business deals are completed (for example, a reasonable number such as 3 to 10 is pre-set) In this case, the information processing device 10 can always obtain deal analysis results and lead quality information for a fixed number of deals. - When requested from the administrator terminal 101 or the sales representative's terminal device 100 In this case, for example, a manager can obtain opportunity analysis results and lead quality information at any time they want to check the results of opportunity analysis for important deals or deals conducted by sales representatives they are supervising. Furthermore, a manager can arbitrarily select multiple opportunities and obtain opportunity analysis results and lead quality information for each.

[0103] S9: The analysis result acquisition unit 514 of the information processing device 10 receives the opportunity analysis result and lead quality information as a response to the opportunity analysis request and the lead quality judgment request. The opportunity analysis result and lead quality information are created for each opportunity. At this time, the opportunity analysis result includes the information shown in Figure 8. The lead quality information includes the information shown in Figure 9. The opportunity result recording unit 515 assigns an opportunity analysis result ID. The opportunity result recording unit 515 also assigns a reference ID to the problem areas where the content of a bad opportunity was detected and saves the opportunity analysis result to the analysis result storage unit 532. The opportunity result recording unit 515 saves the lead quality information to the lead information storage unit 533.

[0104] S10: The information processing unit 517 of the information processing device 10 creates a sales opportunity analysis results display screen for displaying sales opportunity analysis results and a sales opportunity list screen for displaying lead quality. In this case, it is assumed that a web application or native application is running on the administrator terminal 101, and the sales opportunity analysis results and lead quality are created based on instructions from the administrator terminal. As described above, the sales opportunity analysis results display screen and the sales opportunity list screen are not necessarily sent in the same step, and each screen is displayed according to screen transitions in response to user operations. The information processing unit 517 may also send the URLs of the sales opportunity analysis results display screen and the sales opportunity list screen to the administrator terminal 101. Alternatively, the information processing unit 517 may create the sales opportunity analysis results and lead quality information as a PDF file or the like, and notify the administrator terminal 101 of the file itself or the URL via email or push notification.

[0105] S11: The communication unit 511 of the information processing device 10 transmits screen information of the sales opportunity analysis results display screen and the sales opportunity list screen to the administrator terminal 101. Screen information of either the sales opportunity analysis results display screen or the sales opportunity list screen may be transmitted. In this case, screen information of the sales opportunity analysis results display screen and the sales opportunity list screen are transmitted, but they are not displayed simultaneously; for example, the transition is from the sales opportunity list screen to the sales opportunity analysis results display screen.

[0106] S12: The communication unit 521 of the administrator terminal 101 receives screen information for the business negotiation analysis results display screen and the business negotiation list screen, and the display control unit 522 displays the business negotiation list screen and the business negotiation analysis results display screen on the display 417 (see Figures 15 and 17).

[0107] (Processing by terminal device) Figure 13 is a flowchart illustrating an example of the processing performed by the terminal device 100a in step S5 of Figure 12.

[0108] In step S21, when the operation reception unit 505 receives an operation to start recording spoken voice, the terminal device 100 executes the processes from step S22 onward.

[0109] Figure 14 shows an example of the operation screen of a terminal device according to one embodiment. The terminal device 100 can display an operation screen such as that shown in Figure 14(a) or Figure 14(b) by executing an application corresponding to the information processing system 1. In addition, participants in a business negotiation can start recording their spoken voice by selecting the "Record" button 811 on the operation screen 810, such as that shown in Figure 14(a).

[0110] In step S22, the voice transmission unit 503 acquires the voices of the sales representatives participating in the business negotiation and the voices of the customers participating in the same business negotiation, and starts a voice transmission process to send the acquired voices to the information processing device 10.

[0111] In step S23, the operation reception unit 505 determines whether or not it has received a request to stop recording. If a participant selects the "Record" button 811 on the operation screen 810 as shown in Figure 14(a), the terminal device 100 displays, for example, the operation screen 820 as shown in Figure 14(b). The participant can also stop recording by selecting the "Stop" button 821 on the operation screen 820 as shown in Figure 14(b).

[0112] If the operation to stop recording is received, the operation reception unit 505 proceeds to step S24. On the other hand, if the operation to stop recording is not received, the operation reception unit 505 repeatedly executes the process in step S23, for example.

[0113] When the process moves to step S24, the voice transmission unit 503 stops or terminates the process of transmitting the spoken voice. Through the process shown in Figure 13, the terminal device 100 can transmit the spoken voices of the sales representative and the customer to the information processing device 10.

[0114] <Example of a business negotiation list screen> Figure 15 shows an example of a sales opportunity list screen displayed by the administrator terminal 101 or the sales representative's terminal device 100. The sales opportunity list screen 600 displays sales opportunity information and lead quality, etc., for multiple sales opportunities on a single screen, with each opportunity representing one record. The column for "Date and Time 602" displays the date and time the business negotiation took place. • Column 603 of the sales opportunity report displays a button to transition to the sales opportunity analysis results screen. The "Title 604" column displays the meeting name and agenda for the online meeting. The "Lead Quality 605" column displays the lead quality determined by the text analysis device 5. "Hot" and "Cold" in the lead quality column indicate whether or not there is a prospect of securing the order. "Hot" means the likelihood of securing the order is above a certain level, and "Cold" means the likelihood of securing the order is below a certain level. The lead quality could also represent the probability of securing the order. The column for Client Company 606 displays the name of the client company. The column for Client Contact Person 607 displays the name of the client's contact person. The column for "Responsible Person 608" displays the name of the sales representative. The column for rating 609 displays the self-assessment entered by the sales representative. The "Opportunity Type 610" column displays the opportunity type for that opportunity as entered by the sales representative. The column for Order 611 displays the success, failure, and incomplete status of the order entered by the sales representative.

[0115] Note that search field 601 is for entering the search key for each column.

[0116] Figure 15 displays the lead quality 605 for each opportunity, and sales representatives are required to close every deal that is identified as a hot lead. First, managers allocate the time and effort of sales representatives to deals identified as hot leads. Furthermore, managers can determine that they should provide guidance to sales representatives if there are deals that were identified as hot leads but failed to close (deals that had the potential to close but failed to close). For this reason, hot leads that failed to close are highlighted in Figure 15. In Figure 15, hot leads that failed to close are highlighted with a background color such as red 612. The entire record may also be highlighted. Thus, managers can identify deals that require guidance from among many opportunities and provide appropriate guidance to sales representatives.

[0117] Furthermore, when an administrator or sales representative hovers over or clicks on an opportunity in, for example, the Lead Quality 605 column, the reason 613 for that lead quality is displayed in a pop-up window. A column for Reason 613 may also exist. Reason 613 indicates which of the multiple items in the lead definition the lead corresponds to.

[0118] In addition, the 600-screen list of business opportunities is organized by sales representative. The ratio of hot leads to the total number of deals, The ratio of cold leads to the total number of deals, The ratio of successful orders to the total number of hot leads, The ratio of the number of failed orders to the total number of hot leads, The ratio of successful orders to the total number of cold leads, The ratio of failed orders to the total number of cold leads may also be displayed. The opportunity list screen 600 may display such statistics by opportunity type, department, company as a whole, etc.

[0119] Furthermore, lead quality 605 or its URL may be notified to the appointment setter via email or other means. The appointment setter can prioritize scheduling appointments for hot leads over cold leads.

[0120] When an administrator or sales representative presses the lead quality button for any sales opportunity, the administrator terminal 101 or the sales representative's terminal device 100 displays the text data that has been determined to be of that lead quality, and the voice playback units 506 and 524 automatically play the spoken audio corresponding to the text data.

[0121] Figure 16 shows an example of a text display screen 700 displayed by the administrator terminal 101 or the sales representative's terminal device 100. The text display screen 700 in Figure 16 includes time-series conversation information 311, negotiation results 312, lead quality column 313, and utterance timeline 314. The time-series conversation information 311 displays the volume 316 when the salesperson spoke, the volume 317 when the customer spoke, and the conversation ratio 318, corresponding to the elapsed time since the start of the business negotiation. The conversation ratio 318 is the ratio (moving average) of the customer's speaking time to the salesperson's speaking time in the most recent fixed period (e.g., 1 minute).

[0122] The time-series conversation information 311 has the time of utterance on the horizontal axis. The display control unit 504 of the administrator terminal 101 or the sales representative's terminal device 100 highlights the same time as the text data that formed the basis for determining lead quality in a frame 320. In the example in Figure 16, the time "02:00" is highlighted in frame 320, and in the utterance timeline 314 described later, the time "02:00" is also highlighted in frame 315. "02:00" is the elapsed time from the start of the business negotiation. The highlighting may also be done by changing the color of the text, the boldness of the text, the font, the background color, etc. Furthermore, the audio playback units 506, 524 of the administrator terminal 101 or the sales representative's terminal device 100 automatically play the utterance at the time "02:00" from the speaker. Therefore, administrators, etc., can check the text data and utterance that formed the basis for determining lead quality. Administrators, etc., can also press any time to play the utterance from that time.

[0123] Furthermore, the time-series conversation information 311 displays time-series video data 319. The time-series video data 319 consists of still images periodically extracted from video data recorded during the business negotiation, or still images taken immediately after content changes. The time-series video data 319 may also allow for playback of the video data itself.

[0124] • The negotiation result 312 displays information related to the outcome of the negotiation, such as negotiation details entered by the sales representative and materials obtained during the negotiation.

[0125] • The Lead Quality column 313 displays the lead quality information determined for the deal in question. The Lead Quality column 313 displays the lead definition, lead quality, reason, and elapsed time, as shown in Figure 9.

[0126] The speech timeline 314 displays the text data, converted by speech recognition, of what the customer and sales representative said, in chronological order. The text data is displayed in correspondence with the elapsed time since the start of the business negotiation. In addition, the voice data of the customer and sales representative is acquired separately according to the input terminal devices 100a and 100b, so it is possible to identify whether the speaker is a sales representative or a customer. Therefore, each statement is associated with either the customer or the sales representative.

[0127] In the speech timeline 314, the text data that formed the basis for determining lead quality is enclosed in frame 315. Administrators can easily identify the text data that formed the basis for determining lead quality.

[0128] Furthermore, in the speech timeline 314, the elapsed time text data identified as problematic area 633 in the sales opportunity analysis results in Figure 17 is highlighted in callouts 321 and 322. The text data highlighted in callouts 321 and 322 is highly likely to have problems from the perspective of sales opportunity definitions. In this way, highlighting problematic text data in sales opportunities in callouts 321 and 322 makes it easier for managers to identify why hot leads are not being closed.

[0129] <Opportunity analysis results display screen> Figure 17 shows an example of a sales opportunity analysis results display screen 630, which is displayed on the administrator terminal 101 or the sales representative's terminal device 100. The sales opportunity analysis results display screen 630 is accessed when any sales opportunity is selected in the sales opportunity report 603 column of the sales opportunity list screen 600. Access to this screen may be direct or via another screen.

[0130] The sales negotiation analysis results display screen 630 includes the following: • Negotiation rating: 631 • 632 challenges during business negotiations • Issue 633 ·Solution 634 All of this information is stored in the analysis result storage unit 532 and is included in the negotiation analysis results created by the text analysis device 5. The administrator can check the negotiation evaluation 631 to grasp the overall evaluation and understand the reasons for that evaluation from the issues 632 during the negotiation. In addition, the administrator can check the specific issues and their solutions 634 from the issue locations 633. When the administrator presses the issue location 633, the text data that formed the basis of the judgment can be displayed as shown in Figure 16, so the actual spoken audio can be checked.

[0131] <Main effects> The information processing system 1 of this embodiment can determine lead quality based on the content of the business negotiation and the lead definition. By allowing sales representatives to focus their negotiations on promising leads that are likely to result in orders, the burden on sales representatives can be reduced.

[0132] <Supplement> Although embodiments of the present invention have been described above, the present invention is not limited to these specific embodiments, and various modifications and applications are possible within the scope of the gist of the present invention as described in the claims.

[0133] For example, in this embodiment, the information processing device 10 acquires the sales opportunity analysis results and lead quality information from the text analysis device 5, but the administrator terminal 101 may acquire the sales opportunity analysis results and lead quality information from the text analysis device 5.

[0134] In this case, as shown in Figure 18, the administrator terminal 101 has some of the functions of the information processing device 10. Figure 18 is a diagram showing a modified example of the functional configuration of the information processing system 1. The administrator terminal 101 has the functions of the information processing device 10 shown in Figure 6: a text data acquisition unit 513, an analysis result acquisition unit 514, a sales negotiation result recording unit 515, a setting reception unit 516, and a provision unit 517. The sales negotiation result recording unit 515 transmits the sales negotiation analysis results and lead quality acquired from the text analysis device 5 to the information processing device 10 via the communication unit 501. The administrator terminal 101 may also have a copy of the storage unit 519. Similar to Figure 18, the sales representative's terminal device 100 may also have some of the functions of the information processing device 10.

[0135] Furthermore, although this embodiment describes an online business negotiation as an example, the negotiation may also be conducted in person. In this case, the meeting device for the negotiation records the spoken audio and video. The meeting device should preferably be able to capture 360 ​​degrees horizontally. The meeting device determines whether the spoken audio belongs to the customer or the sales representative by detecting the direction of the audio. For example, the meeting device may be set up so that the customer is facing the device and the sales representative is on the opposite side. Alternatively, the sales representative may connect their terminal device 100 to the meeting device and set who is in which direction on the application screen.

[0136] Furthermore, the configuration examples in Figure 6 and other figures are divided according to their main functions to facilitate understanding of the processing performed by the information processing device 10. The present invention is not limited by the way the processing units are divided or their names. The processing of the information processing device 10 can be further divided into many more processing units depending on the processing content. It is also possible to divide it so that one processing unit includes even more processing.

[0137] Each function of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules designed to execute each function described above.

[0138] Furthermore, the apparatus described in the examples represents only one of several computing environments for carrying out the embodiments disclosed herein. In one embodiment, the external system 3 and the information processing device 10, etc., include multiple computing devices such as a server cluster. The multiple computing devices are configured to communicate with each other via any type of communication link, including a network and shared memory, and perform the processing disclosed herein.

[0139] Furthermore, the information processing device 10, the terminal device 100, and the administrator terminal 101 can be configured to share the disclosed processing steps, for example, the processes shown in Figure 12, in various combinations. For example, a process executed by the information processing device 10 may be executed by the terminal device 100 or the administrator terminal 101. Also, a process executed by the terminal device 100 and a process executed by the administrator terminal 101 may be executed by the information processing device 10. Furthermore, each element of the information processing device 10 may be combined into a single device or divided into multiple devices.

[0140] <Mode> [Aspect 1] An acquisition unit that acquires the voice recordings of the first participant (the seller) and the second participant (the buyer) during online communication related to a business negotiation for a product, A text data acquisition unit that acquires text data converted from the aforementioned spoken audio by speech recognition, An analysis result acquisition unit obtains information regarding the likelihood of orders for the product as a result of analyzing the text data spoken by the second participant, An information processing system having [Aspect 2] The analysis result acquisition unit inputs the text data and the first definition defining the statements regarding the order forecast into a large-scale language model, and acquires the information regarding the order forecast as output from the large-scale language model. The information processing system described in Embodiment 1. [Aspect 3] A setting reception unit that accepts the above-mentioned first definition, An information processing system according to embodiment 2, having the following characteristics. [Aspect 4] The system includes a display control unit that displays the information regarding the order forecast acquired by the analysis result acquisition unit. An information processing system as described in any one of the three descriptions in each of the three descriptions. [Aspect 5] The aforementioned information regarding the prospect of receiving orders indicates whether or not there is a prospect of receiving orders. When the display control unit displays negotiation information for multiple negotiations on a single screen, it displays whether or not there is a prospect of receiving an order for each negotiation. The information processing system described in Embodiment 4. [Aspect 6] The display control unit further displays whether or not there is a prospect of receiving the order for each business negotiation, and whether or not the order was received successfully or unsuccessfully. Emphasize deals that were likely to be won but ultimately failed to be won. The information processing system described in aspect 5. [Aspect 7] The analysis result acquisition unit acquires, along with the information regarding the order forecast, the reasons for judging the information regarding the order forecast, which are extracted from the first definition that defines the statements regarding the order forecast, from a large-scale language model. The display control unit further displays the reason. An information processing system as described in any one of the descriptions in 4 to 6. [Aspect 8] The analysis result acquisition unit acquires, along with the information regarding the order forecast, information from a large-scale language model that identifies the text data that formed the basis for determining the information regarding the order forecast. If a click is received regarding the aforementioned order forecast information, The display control unit displays the text data that formed the basis for determining the information regarding the expected order, based on the information that identifies the text data. An information processing system as described in any one of the descriptions in 4 to 7. [Aspect 9] Furthermore, the text data that formed the basis for determining the information regarding the expected orders, and which includes an audio playback unit that plays back the spoken audio that was the source of the text data, The information processing system described in Embodiment 8. [Aspect 10] The analysis result acquisition unit further acquires from a large-scale language model an evaluation of the business negotiation obtained by analyzing the text data spoken by the first participant, and information identifying the text data that formed the basis of the evaluation. If a click is received regarding the aforementioned order forecast information, The display control unit displays the text data that formed the basis for the evaluation of the business negotiation, based on the information that identifies the text data. An information processing system as described in any one of the descriptions in 4 to 7. [Aspect 11] The analysis result acquisition unit inputs the text data and a second definition defining statements included in bad deals into a large-scale language model, and obtains from the large-scale language model an evaluation of the deal and information identifying the text data that formed the basis for the evaluation of the deal as output from the large-scale language model. If a click is received regarding the aforementioned order forecast information, The display control unit displays the statement detected based on the second definition based on information that identifies the text data. The information processing system described in aspect 10. [Aspect 12] The first definition mentioned above is pre-associated with the type of deal, The analysis result acquisition unit inputs the text data and the first definition for determining the information regarding the prospect of orders, which corresponds to the type of business opportunity entered by the first participant, into the large-scale language model, and acquires the information regarding the prospect of orders from the large-scale language model. The information processing system described in Embodiment 2. [Explanation of Symbols]

[0141] 1. Information Processing System 2. Communication Network 3. External Systems 10 Information Processing Devices 100, 100a, 100b, 100c, 100d Terminal devices 101 Administrator Terminal [Prior art documents] [Patent Documents]

[0142] [Patent Document 1] Japanese Patent Publication No. 2005-322094

Claims

1. An acquisition unit that acquires the voice recordings of the first participant (the seller) and the second participant (the buyer) during online communication related to business negotiations for a product, A text data acquisition unit that acquires text data converted from the aforementioned spoken audio by speech recognition, An analysis result acquisition unit obtains information regarding the likelihood of orders for the product as a result of analyzing the text data spoken by the second participant, An information processing system having [a certain feature].

2. The analysis result acquisition unit inputs the text data and the first definition defining the statements regarding the order forecast into a large-scale language model, and acquires the information regarding the order forecast as output from the large-scale language model. The information processing system according to claim 1.

3. A setting reception unit that accepts the first definition, The information processing system according to claim 2, having the following features.

4. The system includes a display control unit that displays the information regarding the order forecast acquired by the analysis result acquisition unit. The information processing system according to any one of claims 1 to 3.

5. The aforementioned information regarding the prospect of receiving orders indicates whether or not there is a prospect of receiving orders. When the display control unit displays negotiation information for multiple negotiations on a single screen, it displays whether or not there is a prospect of receiving an order for each negotiation. The information processing system according to claim 4.

6. The display control unit further displays whether or not there is a prospect of receiving the order for each business negotiation, and whether or not the order was received successfully or unsuccessfully. Emphasize deals that were likely to be won but ultimately failed to be won. The information processing system according to claim 5.

7. The analysis result acquisition unit acquires, along with the information regarding the order forecast, the reasons for judging the information regarding the order forecast, which are extracted from the first definition that defines the statement regarding the order forecast, from the large-scale language model. The display control unit further displays the reason. The information processing system according to claim 4.

8. The analysis result acquisition unit acquires, along with the information regarding the order forecast, information from a large-scale language model that identifies the text data that formed the basis for determining the information regarding the order forecast. If a click is received regarding the aforementioned order forecast information, The display control unit displays the text data that formed the basis for determining the information regarding the expected order, based on the information that identifies the text data. The information processing system according to claim 4.

9. Furthermore, the text data that formed the basis for determining the information regarding the expected orders, and which includes an audio playback unit that plays back the spoken audio that was the source of the text data, The information processing system according to claim 8.

10. The analysis result acquisition unit further acquires from a large-scale language model an evaluation of the business negotiation obtained by analyzing the text data spoken by the first participant, and information identifying the text data that formed the basis of the evaluation. If a click is received regarding the aforementioned order forecast information, The display control unit displays the text data that formed the basis for the evaluation of the business negotiation, based on the information that identifies the text data. The information processing system according to claim 4.

11. The analysis result acquisition unit inputs the text data and a second definition defining statements included in bad deals into a large-scale language model, and obtains from the large-scale language model an evaluation of the deal and information identifying the text data that formed the basis for the evaluation of the deal as output from the large-scale language model. If a click is received regarding the aforementioned order forecast information, The display control unit displays the statement detected based on the second definition based on information that identifies the text data. The information processing system according to claim 10.

12. The first definition mentioned above is pre-associated with the type of business opportunity, The analysis result acquisition unit inputs the text data and the first definition for determining the information regarding the expected order, which corresponds to the type of business opportunity entered by the first participant, into the large-scale language model, and acquires the information regarding the expected order from the large-scale language model. The information processing system according to claim 2.

13. An acquisition unit that acquires the voice recordings of the first participant (the seller) and the second participant (the buyer) during online communication related to business negotiations for a product, A text data acquisition unit that acquires text data converted from the aforementioned spoken audio by speech recognition, An analysis result acquisition unit obtains information regarding the likelihood of orders for the product as a result of analyzing the text data spoken by the second participant, An information processing device having

14. An information processing method performed by an information processing device. The acquisition unit processes the acquisition of spoken audio from a first participant (the seller) and a second participant (the buyer) recorded during online communication regarding business negotiations for a product. The text data acquisition unit performs the process of acquiring text data obtained by converting the spoken audio using speech recognition, The analysis result acquisition unit performs the process of acquiring information regarding the expected order status of the product as an analysis result of the text data spoken by the second participant, An information processing method that performs this task.

15. Information processing equipment, An acquisition unit that acquires the voice recordings of the first participant (the seller) and the second participant (the buyer) during online communication related to business negotiations for a product, A text data acquisition unit that acquires text data converted from the aforementioned spoken audio by speech recognition, Analysis result acquisition unit that acquires information regarding the likelihood of orders for the product as a result of analyzing the text data spoken by the second participant, A program designed to function as such.