Information processing method, computer program, server device, and terminal device

Abstract

The present invention provides an information processing method, a computer program, and an information processing device that are expected to support the investigation or analysis of video recordings of business negotiations. [Solution] In an information processing method according to the present embodiment, an information processing device acquires a recorded video of a business meeting, converts audio information relating to speeches of participants in the business meeting into text information based on the acquired video, and displays the converted text information. The information processing device may also record the video of the business meeting, accept conditions for multiple participants in the business meeting to share the video, and generate information for accessing the video of the business meeting based on the accepted conditions. The conditions may specify a point at which playback of the video of the business meeting should begin.

Description

[Technical Field]

[0001] The present invention relates to an information processing method, a computer program, and a server device for handling video of a recorded business negotiation. and Terminal equipment Place Regarding. [Background technology]

[0002] In recent years, by transmitting and receiving data such as images and audio between multiple terminal devices via a network, multiple users using the terminal devices can simultaneously hold conversations, etc. Using this technology, so-called online conferences or remote conferences, in which multiple users in remote locations hold conferences via a network, have become widespread.

[0003] Patent Document 1 proposes an online market system that utilizes an online conference application that allows multiple people to make online video calls and an online payment site, allowing producers and consumers to gather online at the same time and date, and engage in buying and selling activities while seeing each other's faces in real time and interacting, just like a market where people gather in one place to actually buy and sell. This online market system allows consumers to purchase desired products or services through the online payment site. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Utility Model Registration No. 3232531 Summary of the Invention [Problem to be solved by the invention]

[0005] It is expected that online or remote conference systems will be used for business negotiations, for example. With such systems, it is relatively easy to store video footage of business negotiations. Companies and other organizations desire to investigate or analyze the stored video footage of business negotiations in order to improve the quality of business negotiations or sales, but business negotiations can last for several hours, making it difficult to investigate or analyze the video footage.

[0006] The present invention has been made in view of the above circumstances, and its object is to provide an information processing method, a computer program, and a server device that can be expected to support the investigation or analysis of recorded video of business negotiations. and Terminal equipment Place The purpose is to provide. [Means for solving the problem]

[0007] In one embodiment of the information processing method, an information processing device acquires a recorded video of a business meeting, converts audio information relating to the speech of participants in the business meeting into text information based on the acquired video of the business meeting, and displays the converted text information. [Effects of the Invention]

[0008] In one embodiment, it is expected that the present invention will be useful in supporting the investigation or analysis of video recordings of business negotiations. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram illustrating an overview of an information processing system according to an embodiment of the present invention. [Figure 2] 1 is a block diagram showing the configuration of a negotiation recording server device according to an embodiment of the present invention; [Figure 3] FIG. 10 is a schematic diagram showing an example of the configuration of a business negotiation video. [Figure 4] FIG. 2 is a block diagram showing the configuration of a terminal device according to the present embodiment. [Figure 5] 10 is a flowchart showing the procedure of online negotiation processing performed by the negotiation recording server device according to the present embodiment. [Figure 6] FIG. 10 is a schematic diagram showing an example of a display of a business negotiation video. [Figure 7] FIG. 10 is a schematic diagram showing an example of a display of a business negotiation video. [Figure 8] FIG. 10 is a schematic diagram illustrating the sharing of a business negotiation video. [Figure 9] 10 is a flowchart showing the procedure of a business negotiation video sharing process performed by the business negotiation recording server device according to the present embodiment. [Figure 10] FIG. 10 is a schematic diagram for explaining a comment function. [Figure 11] 10 is a flowchart showing a comment processing procedure performed by the negotiation recording server device according to the present embodiment. [Figure 12] FIG. 10 is a schematic diagram showing an example of a search screen for business negotiation videos. [Figure 13] 10 is a flowchart showing the procedure of a negotiation video search process performed by the negotiation recording server device according to the present embodiment. [Figure 14] FIG. 10 is a schematic diagram for explaining a search function for utterance content. [Figure 15] FIG. 10 is a schematic diagram showing an example of a display screen for analysis results. [Figure 16] FIG. 10 is a schematic diagram showing another example of the display screen for analysis results. [Figure 17] 10 is a flowchart showing the procedure of an analysis process performed by the negotiation recording server device according to the present embodiment. [Figure 18] FIG. 10 is a schematic diagram showing an example of display of topic classification results. DETAILED DESCRIPTION OF THE INVENTION

[0010] Specific examples of information processing systems according to embodiments of the present invention will be described below with reference to the drawings. Note that the present invention is not limited to these examples, but is defined by the claims, and is intended to include all modifications within the meaning and scope of the claims.

[0011] <System configuration> FIG. 1 is a schematic diagram illustrating an overview of an information processing system according to this embodiment. In this embodiment, business negotiations conducted using a system such as an online conference or a remote conference are referred to as online business negotiations. In online business negotiations, various online conversations take place between a seller user who sells a product or service and a buyer user who purchases the product or service. Online business negotiations do not necessarily involve the purchase or sale of a product or service. For example, online business negotiations may involve regular or irregular greetings or after-sales service provided by a sales representative or service staff member of a company to a customer, or responses to inquiries from a customer. Other types of conversations may also be involved between a seller and a buyer. Furthermore, online business negotiations are not limited to those conducted between a seller and a buyer, but may also include, for example, sales conferences or meetings between multiple employees of a selling company.

[0012] The information processing system according to this embodiment comprises an online negotiation server device 1 that provides functions for online negotiations via online or remote conferences, a negotiation record server device 2 that records and stores video related to the online negotiations, and a terminal device 3 used by each of multiple users participating in the online negotiations. Note that in this embodiment, the online negotiation server device 1 and the negotiation record server device 2 are separate servers, but this is not limiting, and the functions of the two servers may be integrated into a single server.

[0013] The online business negotiation server device 1 enables users in different locations to exchange information, such as conversations, by relaying the transmission and reception of various data, such as images, voice, and text, between multiple terminal devices 3 via a network. For example, the online business negotiation server device 1 receives data sent by one terminal device 3 and transmits the received data to another terminal device 3.

[0014] The business negotiation recording server device 2 acquires various data transmitted and received between the online business negotiation server device 1 and the multiple terminal devices 3. In this embodiment, the business negotiation video is a video captured by a camera or the like of each terminal device 3 during the online business negotiation and transmitted and received between the multiple terminal devices 3 by the online business negotiation server device 1. The data includes images (video) captured by the camera or the like of the terminal device 3 and audio recorded by a microphone or the like of the terminal device 3. The business negotiation video may include not only video captured by a camera or the like, but also video recorded from, for example, a presentation document or image shared and displayed on multiple terminal devices 3. In online business negotiations, for example, to reduce communication data volume or protect user privacy, business negotiations may be conducted using only audio transmission and reception without transmitting or receiving images captured by the terminal devices 3. In this embodiment, data containing only audio but no images is also referred to as business negotiation video and is treated in the same way as business negotiation video containing images.

[0015] The terminal device 3 is a device used by each user participating in the online business negotiation, and may be, for example, a general-purpose information processing device such as a smartphone, a tablet terminal device, or a personal computer. The terminal device 3 is equipped with a camera for photographing the user and a microphone for capturing the user's voice. However, the camera and microphone may be built into the terminal device 3, or may be external devices connected to the terminal device 3 via a wired or wireless connection. Furthermore, the terminal device 3 may not necessarily have a camera, as long as it has at least a microphone. In this embodiment, one user uses one terminal device 3, but this is not limited thereto. Multiple users may participate in the online business negotiation using one terminal device 3, or one user may participate in the online business negotiation using multiple terminal devices 3.

[0016] In the information processing system according to this embodiment, the business negotiation recording server device 2 converts the speeches of participants in online business negotiations into text from recorded business negotiation videos. The business negotiation recording server device 2 associates the text information of the speeches of the participants with identification information, such as the name or ID of the user who spoke, and information such as the timing of the speech (time from the start of the business negotiation video), and records it in a database together with the business negotiation video. The business negotiation recording server device 2 can use this text information to provide users with a service for searching the recorded business negotiation video by, for example, accepting input of a keyword string.

[0017] In the information processing system according to this embodiment, the business negotiation recording server device 2 performs processing to realize a search function for multiple business negotiation videos recorded in a database. For example, the business negotiation recording server device 2 extracts text information containing search keywords entered by a user on the terminal device 3 based on the text information obtained by converting the audio of the business negotiation video into text as described above, and causes the terminal device 3 to display a list of business negotiation videos corresponding to this text information as search results. The business negotiation recording server device 2 also searches for business negotiation videos based on identification information such as the names or IDs of users who participated in the business negotiations, as well as the dates on which the business negotiations were held.

[0018] In the information processing system according to this embodiment, the business negotiation recording server device 2 performs processing to enable multiple users who participated in the online business negotiation to share business negotiation videos. The business negotiation recording server device 2 transmits information such as a URL (Uniform Resource Locator) for accessing the business negotiation videos recorded in the database to the users (terminal devices 3) who participated in the business negotiation. The users who receive this information on their terminal devices 3 can access the specified URL using an application program such as a web browser to obtain or play the business negotiation videos.

[0019] Furthermore, in the information processing system according to this embodiment, the negotiation recording server device 2 accepts user comments on the negotiation video and records the accepted comments in a database in association with the negotiation video. The negotiation recording server device 2 also performs processing to share the recorded comments among multiple users who participated in the negotiation. For example, when a user is playing (displaying) the negotiation video on the terminal device 3, the negotiation recording server device 2 accepts input of comments on the negotiation video via the terminal device 3. The negotiation recording server device 2 records the input comments in a database in association with the playback time of the negotiation video being played. Thereafter, when the negotiation video is played back, the negotiation recording server device 2 displays the comments on the terminal device 3 together with the negotiation video.

[0020] In the information processing system according to this embodiment, the negotiation recording server device 2 compiles information such as the timing, duration, and number of times each participant speaks during the negotiation, and displays this information on the terminal device 3. The negotiation recording server device 2 may display this information together with the negotiation video, for example, or may compile this information for multiple users belonging to a group such as a corporate department or team, and display the information for each group.

[0021] In the information processing system according to this embodiment, the negotiation recording server device 2 performs processes such as acquiring and recording the negotiation video by using a personified computer program that performs these processes, a so-called bot, participating in the online negotiation as a participant. When the bot participates in the online negotiation, the negotiation recording server device 2 confirms with the other users participating in the online negotiation whether they agree to the bot's participation in the negotiation (recording the video of the negotiation). The negotiation recording server device 2 records whether each participant has given their consent, and, if consent is obtained from all users, allows the bot to participate and records the negotiation video.

[0022] In this embodiment, multiple users use terminal devices 3 to conduct business negotiations online, but this is not limited to this. For example, multiple users may gather in one place to conduct business negotiations (offline). In this case, the terminal devices 3 or some other camera device may film the business negotiations, and the video footage may be acquired by the business negotiation recording server device 2 and recorded in a database.

[0023] <Device configuration> 2 is a block diagram showing the configuration of the negotiation recording server device 2 according to this embodiment. The negotiation recording server device 2 according to this embodiment is configured to include a processing unit 21, a memory unit (storage) 22, and a communication unit (transceiver) 23. Note that in this embodiment, the processing related to recording negotiations will be described as being performed by one server device, but the processing may also be distributed among multiple server devices.

[0024] The processing unit 21 is configured using an arithmetic processing device such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), a GPU (Graphics Processing Unit) or a quantum processor, a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The processing unit 21 reads and executes a server program 22a stored in the storage unit 22 to perform various processes such as recording video of online business negotiations, converting the audio of the recorded business negotiation video into text, and sharing the recorded business negotiation video among multiple participants.

[0025] The storage unit 22 is configured using a large-capacity storage device such as a hard disk. The storage unit 22 stores various programs executed by the processing unit 21 and various data required for the processing of the processing unit 21. In this embodiment, the storage unit 22 stores a server program 22a executed by the processing unit 21. The storage unit 22 also has a business negotiation video DB (database) 22b that records business negotiation videos in association with various information.

[0026] In this embodiment, the server program (computer program, program product) 22a is provided in a form recorded on a recording medium 99 such as a memory card or an optical disc, and the negotiation recording server device 2 reads the server program 22a from the recording medium 99 and stores it in the memory unit 22. However, the server program 22a may also be written to the memory unit 22, for example, during the manufacturing stage of the negotiation recording server device 2. Alternatively, the negotiation recording server device 2 may acquire the server program 22a via communication after distributing it from another remote server device or the like. For example, the server program 22a may be read from the recording medium 99 by a writing device and written to the memory unit 22 of the negotiation recording server device 2. The server program 22a may be provided in a form distributed via a network, or in a form recorded on the recording medium 99.

[0027] 3 is a schematic diagram showing an example of the configuration of the business negotiation video DB 22b. The business negotiation video DB 22b of the business negotiation recording server device 2 according to this embodiment is a database that records business negotiation videos recorded during online business negotiations, and records information such as "date and time," "participants," "business negotiation video," "text information," "comment information," and "analysis information" in association with each other. The "date and time" is information related to the date and time when the online business negotiation took place, and may include information such as the start time, end time, or duration of the online business negotiation.

[0028] The "participants" in the business negotiation video DB22b are information about users who participated in the online business negotiation, and may include information such as "user name," "information destination," and "consent information." The "user name" is information for uniquely identifying each user, and is, for example, character string information such as the user's real name or ID. The "information destination" is information indicating the destination to which various information is sent to each user, and is set to information such as an email address or the ID of the terminal device 3. The "consent information" is, for example, information indicating whether or not each user agreed to the participation of a bot that records video of the business negotiation before the start of the online business negotiation.

[0029] "Business negotiation video" is video recorded of an online business negotiation, and may be, for example, the video file itself, or information indicating the storage location of this file, a file name, etc. The business negotiation video may be recorded as a separate video file for each user who participated in the business negotiation, or may be recorded as a single video file containing a series of videos of multiple users.

[0030] "Text information" is information obtained by converting the speech content of a participant based on the business negotiation video into text, and may include information such as "speech timing," "speaker," "speech text," and "topic information." "Speech timing" is information indicating when the participant spoke. For example, if the playback time of the business negotiation video is 60 minutes, information such as 2 minutes and 50 seconds from the start may be set. "Speech timing" records at least information about the start of the speech, and may also record information such as the end of the speech or the duration of the speech. "Speaker" is information indicating the user who spoke, and may be set to, for example, a username. Note that this embodiment assumes that one user participates in an online business negotiation using one terminal device 3, and which user spoke the speech based on which terminal device 3 the voice was captured (recorded). When multiple users participate in an online business meeting using a single terminal device 3, or when an offline business meeting involving multiple users is filmed with a single camera, the business meeting recording server device 2 can distinguish who is speaking based on characteristics such as the tone of voice, pitch, quality of voice, intonation, or rhythm of the speech. To distinguish between speakers, a learning model based on machine learning, known as AI (Artificial Intelligence), can be used. "Speech text" refers to information obtained by converting the speech of participants contained in a recorded video of the business meeting into text. The speech-to-text conversion process is performed using existing speech recognition processing. "Topic information" refers to information indicating the topics (matters, topics, etc.) contained in the speech text, and can be used to categorize topics such as icebreakers or closings. In this embodiment, the business meeting recording server device 2 classifies the topics of the speech text using a learning model based on machine learning.

[0031] "Comment information" is information about comments such as text or images that are input to the business negotiation video using the terminal device 3 by users who participated in the business negotiation or users who viewed the business negotiation video. "Comment information" may include information such as "playback timing," "inputter," and "comment." "Playback timing" is information indicating the timing of comment input relative to the playback time of the business negotiation video; for example, if the playback time of the business negotiation video is 60 minutes, information such as 2 minutes and 50 seconds from the start may be set. "Inputter" is information indicating the user who input the comment; for example, a username may be set. "Comment" is the entity of the comment input by the user. In this embodiment, the comment is text, but comments such as images or audio may also be used.

[0032] "Analysis information" is information obtained by analyzing the performance of each user who participated in the business negotiation, and may include information such as "user name," "number of utterances," "speech time," and "longest duration of utterance." "User name" is information for uniquely identifying each user. Since this "user name" is the same as the "user name" included in the above-mentioned "participants," the business negotiation recording server device 2 may record "participants" and "analysis information" together. "Number of utterances" is the number of times each user spoke in the business negotiation. "Speech time" is the total amount of time each user spoke in the business negotiation. "Longest duration of utterance" is the longest amount of time during the business negotiation that a user continued speaking without being interrupted by another user.

[0033] The structure of the business negotiation video DB and the items to be recorded shown in FIG. 3 are merely examples and are not limiting.

[0034] The communication unit 23 of the negotiation recording server device 2 communicates with various devices via a network N, which may include a mobile phone communication network, a wireless local area network (LAN), the Internet, etc. In this embodiment, the communication unit 23 communicates with the online negotiation server device 1 and one or more terminal devices 3, etc., via the network N. The communication unit 23 transmits data provided by the processing unit 21 to other devices, and provides data received from other devices to the processing unit 21.

[0035] The storage unit 22 may be an external storage device connected to the negotiation recording server device 2. The negotiation recording server device 2 may also be a multi-computer including multiple computers, or may be a virtual machine virtually constructed by software. The negotiation recording server device 2 is not limited to the above configuration, and may also include, for example, a reading unit that reads information stored in a portable storage medium, an input unit that accepts operation input, or a display unit that displays images.

[0036] In the business negotiation recording server device 2 according to this embodiment, the processing unit 21 reads and executes the server program 22a stored in the storage unit 22, thereby realizing software functional units such as a business negotiation video acquisition unit 21a, a text processing unit 21b, a search processing unit 21c, a sharing processing unit 21d, a comment processing unit 21e, an analysis processing unit 21f, and a consent processing unit 21g in the processing unit 21. Note that in the figure, functional units related to the process of recording business negotiation videos are shown as functional units of the processing unit 21, and functional units related to other processes are not shown.

[0037] The business negotiation video acquisition unit 21a performs processing to acquire business negotiation videos that have been captured by multiple terminal devices 3 participating in the online business negotiation and transmitted and received between the multiple terminal devices 3 by the online business negotiation server device 1. In this embodiment, the business negotiation video acquisition unit 21a acquires business negotiation videos that the online business negotiation server device 1 transmits and receives between the multiple terminal devices 3 by having a bot, which is an anthropomorphized computer program, participate in the online business negotiation. The business negotiation video acquisition unit 21a records the business negotiation videos of the online business negotiations acquired from the online business negotiation server device 1 in the business negotiation video DB 22b of the storage unit 22 together with information such as the "date and time" and "participants."

[0038] The text conversion processing unit 21b converts the speech uttered by the participants in the business negotiation video acquired by the business negotiation video acquisition unit 21a into text. The text conversion processing unit 21b converts the speech into text, for example, using a learning model that has undergone machine learning in advance. The speech-to-text conversion process is performed by so-called speech recognition processing, which is an existing technology and will not be described in detail here. Any method may be used for the speech-to-text conversion process by the text conversion processing unit 21b. The text conversion processing unit 21b converts the speech included in the business negotiation video into text, distinguishing it for each participating user, and records the obtained "speech text" in the business negotiation video DB 22b in association with the "speech timing" and "speaker."

[0039] The text conversion processing unit 21b also performs a process of classifying topics included in the utterance content based on the converted text information. The text conversion processing unit 21b classifies the topics of the text information using, for example, a learning model that has been previously subjected to machine learning. The learning model that outputs topic classification results for input text information may be, for example, a recurrent neural network (RNN), a long short-term memory (LSTM), or a bidirectional encoder representations from transformers (BERT). The process of classifying text information using a learning model is an existing technology, so a detailed description will be omitted. Based on the topic classification results obtained by the learning model, the text conversion processing unit 21b records "topic information" in the business negotiation video DB 22b in association with the "utterance text." Note that one utterance text may contain multiple topics. In this embodiment, the topic classification of the text information is performed by the business negotiation recording server device 2, but this is not limited thereto. Alternatively, a separate server device may perform the topic classification process and transmit the classification results to the business negotiation recording server device 2.

[0040] The search processing unit 21c performs processing to provide the user with a search service for business negotiation videos recorded in the business negotiation video DB 22b. The search processing unit 21c receives input of a search keyword (character string) from the user via, for example, the terminal device 3, and extracts business negotiation videos that include the received search keyword in their "utterance text" from the business negotiation video DB 22b. The search processing unit 21c transmits information about one or more extracted business negotiation videos, such as information about "date," "participants," and thumbnail images of the business negotiation videos, to the terminal device 3, and causes the terminal device 3 to display a list of information about the business negotiation videos that match the search keyword.

[0041] The search processing unit 21c also receives, as search conditions, for example, the name or ID of a user who participated in an online business negotiation, or a topic related to text information, from the user via the terminal device 3. For example, the search processing unit 21c extracts business negotiation videos in which the user with the received username participated from the business negotiation video DB 22b, and transmits information about the extracted one or more business negotiation videos to the terminal device 3 for displaying a list. For example, the search processing unit 21c also extracts business negotiation videos that include text corresponding to the received topic, and transmits information about the extracted one or more business negotiation videos to the terminal device 3 for displaying a list.

[0042] The sharing processing unit 21d performs processing for sharing the business negotiation video recorded in the business negotiation video DB 22b among multiple users. For example, after the online business negotiation is completed, the sharing processing unit 21d allows the users who participated in the online business negotiation to share the business negotiation video by sending the users who participated in the online business negotiation information for accessing the business negotiation video (for playing or displaying the business negotiation video, for example, an e-mail containing a hyperlink). Also, for example, if a list of business negotiation videos is managed for each user, the sharing processing unit 21d allows the users who participated in the online business negotiation to share the business negotiation video by adding the business negotiation video of the online business negotiation in which the user participated to this list. Note that the sharing of business negotiation videos among multiple users may be performed in any manner.

[0043] The comment processor 21e accepts comments from users who have viewed the business negotiation video after the online business negotiation and performs processing to share the accepted comments among multiple users. In this embodiment, when a user plays back the business negotiation video, the user can input a comment in the form of text or an image by specifying a specific playback timing within the playback time of the business negotiation video. The comment processor 21e acquires the comment input at the terminal device 3 and records the "comment" along with information on the "playback timing" and "enter" in the business negotiation video DB 22b in association with the business negotiation video. The comment processor 21e also transmits the input comment to multiple users who are sharing the business negotiation video, or notifies them that a comment has been input, thereby allowing the comment to be shared among multiple users.

[0044] The analysis processing unit 21f performs processing to analyze the characteristics of each user who participated in the online business negotiation based on the business negotiation video recorded in the business negotiation video DB 22b. In this embodiment, the analysis processing unit 21f calculates, for example, the number of times each user spoke (uttered) in the online conference, the total speaking time, and the longest duration of a single utterance, based on the business negotiation video or text information converted from the business negotiation video. The analysis processing unit 21f records the calculated information such as the "number of utterances," "utterance time," and "longest utterance duration" in association with the "user name" in the business negotiation video DB 22b.

[0045] Furthermore, the analysis processing unit 21f tally up, for example, the "number of utterances" and "speaking time" for multiple online business negotiations held over a predetermined period based on the "analysis information" recorded in the business negotiation video DB 22b, and transmits the tallying results to the user's terminal device 3 for display. Furthermore, for example, the analysis processing unit 21f tally up this information for multiple users belonging to a group such as a corporate department or team, and displays information comparing the characteristics of multiple users belonging to the group on the terminal device 3. The analysis processing unit 21f can calculate numerical values ​​indicating various characteristics of each user related to the online business negotiations and display them on the terminal device 3.

[0046] The consent processing unit 21g performs processing to obtain consent from each user participating in the online business negotiation before the start of the online business negotiation or after the start (but before starting to record the business negotiation video). For example, the consent processing unit 21g causes a terminal device 3 that accesses the online business negotiation server device 1 to participate in the online business negotiation to display a message inquiring whether or not the user agrees to the recording of the online business negotiation. The consent processing unit 21g receives a response from the user on the terminal device 3 regarding whether or not the user agrees, and stores the whether or not the user agrees in the "consent information" of the business negotiation video DB 22b. When consent has been obtained from all users participating in the online business negotiation, the consent processing unit 21g causes the business negotiation video acquisition unit 21a to start processing such as acquiring the video of the online business negotiation.

[0047] 4 is a block diagram showing the configuration of a terminal device 3 according to this embodiment. The terminal device 3 according to this embodiment is configured to include a processing unit 31, a memory unit (storage) 32, a communication unit (transceiver) 33, a display unit (display) 34, an operation unit 35, a camera 36, ​​and a microphone 37. The terminal device 3 is used by a user participating in online business negotiations, and may be configured using a general-purpose information processing device such as a smartphone, a tablet terminal device, or a personal computer.

[0048] The processing unit 31 is configured using an arithmetic processing unit such as a CPU or an MPU, a ROM, etc. The processing unit 31 reads and executes the program 32a stored in the storage unit 32 to perform various processes such as a process for realizing online business negotiations, a process for searching for recorded business negotiation videos of online business negotiations, and a process for displaying the business negotiation videos.

[0049] The storage unit 32 is configured using, for example, a non-volatile memory element such as a flash memory or a storage device such as a hard disk. The storage unit 32 stores various programs executed by the processing unit 31 and various data required for processing by the processing unit 31. In this embodiment, the storage unit 32 stores the program 32a executed by the processing unit 31. In this embodiment, the program 32a is distributed by a remote server device or the like, and the terminal device 3 acquires it via communication and stores it in the storage unit 32. However, the program 32a may also be written to the storage unit 32, for example, during the manufacturing stage of the terminal device 3. For example, the program 32a may be recorded on a recording medium 98 such as a memory card or an optical disk, and the terminal device 3 reads the program 32a and stores it in the storage unit 32. For example, the program 32a may be recorded on the recording medium 98 and read by a writing device and written to the storage unit 32 of the terminal device 3. The program 32a may be provided in the form of distribution via a network or in the form of being recorded on the recording medium 98.

[0050] The communication unit 33 communicates with various devices via a network N, which may include a mobile phone communication network, a wireless LAN, the Internet, etc. In this embodiment, the communication unit 33 communicates with the online negotiation server device 1, the negotiation record server device 2, etc. via the network N. The communication unit 33 transmits data provided by the processing unit 31 to other devices, and provides data received from other devices to the processing unit 31.

[0051] The display unit 34 is configured using a liquid crystal display or the like, and displays various images, characters, etc. based on processing by the processing unit 31. The operation unit 35 accepts user operations and notifies the processing unit 31 of the accepted operations. For example, the operation unit 35 accepts user operations using an input device such as a mechanical button or a touch panel provided on the surface of the display unit 34. Furthermore, for example, the operation unit 35 may be an input device such as a mouse and a keyboard, and these input devices may be configured to be detachable from the terminal device 3.

[0052] The camera 36 is configured using an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The camera 36 is disposed, for example, at an appropriate position on the housing of the terminal device 3. The camera 36 provides data of images (moving images) captured by the imaging element to the processing unit 21. The microphone 37 is disposed, for example, at an appropriate position on the housing of the terminal device 3, and acquires sounds around the terminal device 3 (for example, the user's speech) and provides audio data to the processing unit 21. The camera 36 and the microphone 37 may be built into the terminal device 3 or may be configured to be detachable from the terminal device 3.

[0053] Furthermore, in the terminal device 3 according to this embodiment, the processing unit 31 reads and executes the program 32a stored in the storage unit 32, thereby realizing the online business negotiation processing unit 31a, the business negotiation video processing unit 31b, etc. as software functional units in the processing unit 31. Note that the program 32a may be a program dedicated to the information processing system according to this embodiment, or may be a general-purpose program such as an internet browser or web browser.

[0054] The online business negotiation processing unit 31a communicates with the online business negotiation server device 1 via the communication unit 33 and performs various processes for realizing online business negotiations. The online business negotiation processing unit 31a transmits video data, including images captured by a camera 36 and audio captured by a microphone 37, to the online business negotiation server device 1. The online business negotiation processing unit 31a also receives video data related to one or more other users participating in the online business negotiation from the online business negotiation server device 1 and displays the video data in an appropriate arrangement on the display unit 34. As a result, each user participating in the online business negotiation using the terminal device 3 can transmit their own captured images and audio to other users, and can also view the captured images and audio of other users on the terminal device 3. This allows multiple users in remote locations to converse while seeing each other, thereby conducting online business negotiations.

[0055] Furthermore, the online business negotiation processing unit 31a may transmit and receive various data, such as data for presentation materials (which may include still images, moving images, audio, or text information) or text data related to chat calls, in addition to video data containing images and audio of users participating in online business negotiations, to and from the online business negotiation server device 1. This allows these data to be shared among multiple users participating in online business negotiations.

[0056] In the information processing system according to this embodiment, a user who will be hosting an online business negotiation uses a terminal device 3 to register information such as the date and time of the online business negotiation and the participating users in advance with the online business negotiation server device 1. The online business negotiation processing unit 31a of the terminal device 3 accepts the registration operation of this information by the host user and transmits the accepted information to the online business negotiation server device 1. The online business negotiation server device 1 then sends a notification of the online business negotiation, including information such as the date and time of the online business negotiation and a URL or link for accessing the online business negotiation, to the users registered as participants via e-mail or other means.

[0057] The business negotiation video processing unit 31b communicates with the business negotiation recording server device 2 via the communication unit 33, and performs processes such as searching for and displaying business negotiation videos recorded in the business negotiation video DB 22b by the business negotiation recording server device 2. For example, the business negotiation video processing unit 31b displays a list of information about online business negotiations in which the user has participated, accepts the user's selection of one of these online business negotiations, requests video data of the recorded business negotiation video of the accepted online business negotiation from the business negotiation recording server device 2, and plays back the video data sent from the business negotiation recording server device 2 and displays it on the display unit 34.

[0058] The business negotiation video processing unit 31b also accepts, for example, input of search keywords from the user, transmits the accepted keywords to the business negotiation recording server device 2, and receives search results from the business negotiation recording server device 2 to display a list of information related to business negotiation videos that match the keywords. The business negotiation video processing unit 31b also accepts input of comments from the user regarding the displayed business negotiation video, transmits the accepted comments to the business negotiation recording server device 2, and records them in the business negotiation video DB 22b.

[0059] The business negotiation video processing unit 31b also acquires various pieces of information analyzed by the business negotiation recording server device 2 based on the business negotiation video, and displays the acquired information on the analysis results on the display unit 34. The business negotiation recording server device 2 analyzes, for example, the number of times each user spoke in an online conference, the total speaking time, and the longest duration of a single speech, and records these analysis results in the business negotiation video DB 22b and transmits them to the terminal devices 3 of the users who participated in the online business negotiation. The business negotiation video processing unit 31b receives the information on the analysis results transmitted by the business negotiation recording server device 2, and displays the analysis results.

[0060] <Online negotiation processing> In the information processing system according to this embodiment, at least one user who plans to participate in an online business negotiation acts as the organizer and registers information such as the date and time of the online business negotiation and the participants in advance in the online business negotiation server device 1. The online business negotiation server device 1 sends a notification of the online business negotiation to the registered participants, and when the time for the online business negotiation arrives (or at a time before that), it accepts access from the terminal device 3 using the access information such as a URL or link attached to the notification, and starts the online business negotiation.

[0061] Furthermore, the user who hosts the online business negotiation sets the date, time, URL, etc. of the online business negotiation in the business negotiation recording server device 2 using the terminal device 3, and allows a bot that performs the recording process of the business negotiation video by the business negotiation recording server device 2 to participate in the online business negotiation as one user. The bot that participates in the online business negotiation can receive video data sent from the terminal devices 3 of multiple other users via the online business negotiation server device 1 and record the received business negotiation video in the business negotiation video DB 22b.

[0062] In the information processing system according to this embodiment, before a bot in the business negotiation recording server device 2 starts recording business negotiation video related to the online business negotiation, a process is performed to obtain consent for the recording of the business negotiation video from users participating in the online business negotiation. The business negotiation recording server device 2 displays a message or the like on the terminal device 3 of the user participating in the online business negotiation, asking whether or not the user consents to the recording of the business negotiation video, and accepts the user's response to this inquiry. The business negotiation recording server device 2 starts recording the business negotiation video when consent is obtained from all users participating in the online business negotiation. If consent is not obtained from all users (if at least one user refuses to have the business negotiation video recorded), the business negotiation recording server device 2 does not record the business negotiation video and, for example, causes the bot to exit the online business negotiation. Regardless of whether consent is obtained, the business negotiation recording server device 2 records information on whether each user consented in the business negotiation video DB 22b as "consent information."

[0063] The negotiation recording server device 2 may obtain consent by, for example, displaying a dialog box or pop-up window on the display unit 34 of the terminal device 3, displaying a message inquiring whether the user agrees to the recording of the negotiation video, and providing two buttons labeled "Yes" and "No" for accepting a response from the user, and accepting a user's operation on the buttons. Alternatively, the negotiation recording server device 2 may utilize the chat function of the online negotiation to display a message inquiring whether the user agrees to the recording of the negotiation video on the terminal device 3, and obtain responses from each user via the chat function. In this case, the negotiation recording server device 2 records the text of the responses obtained from each user as "consent information" in the negotiation video DB 22b. Alternatively, the negotiation recording server device 2 may output a voice inquiry message to the terminal device 3 and obtain each user's spoken response. In this case, the negotiation recording server device 2 records the voice data of the responses obtained from the users or the text data of the voice data in the negotiation video DB 22b as "consent information." Note that these methods of consent acquisition by the negotiation recording server device 2 are merely examples and are not limiting, and consent acquisition may be performed in any manner.

[0064] Once the business negotiation recording server device 2 starts recording the business negotiation video, it continues recording until the online business negotiation ends. The online business negotiation server device 1 realizes online business negotiations between multiple users by transmitting and receiving video data including images of the users and the users' spoken voices between multiple terminal devices 3 used by multiple users participating in the online business negotiation. After the business negotiation ends and all users exit (the terminal devices 3 disconnect from the online business negotiation server device 1), the business negotiation recording server device 2 performs a process of converting the users' spoken voices included in the business negotiation video recorded in the business negotiation video DB 22b into text. Note that in this embodiment, the business negotiation recording server device 2 performs the process of converting the voice of the business negotiation video into text after the online business negotiation ends, but this is not limited to this, and the voice-to-text conversion may be performed in parallel while the online business negotiation is being conducted.

[0065] The business negotiation recording server device 2 converts the user's speech included in the business negotiation video into text using existing speech recognition processing technology. At this time, the business negotiation recording server device 2 distinguishes the speech for each user who participated in the online business negotiation and converts it into text. The business negotiation recording server device 2 records the text information converted from the speech in the business negotiation video DB 22b in association with the user name of the user who made the speech and information about the timing of the speech in the business negotiation video.

[0066] The business negotiation recording server device 2 also uses a learning model that has undergone machine learning in advance to classify topics contained in the speech content of users who participated in online business negotiations based on text information converted from the audio of the business negotiation video. The learning model may be, for example, a classification model that classifies the topics contained in input text information. Note that the learning model may also classify one piece of input text information into multiple topics. The business negotiation recording server device 2 inputs the text information converted from the audio of the business negotiation video into the learning model and obtains the topic classification results output by the learning model. The business negotiation recording server device 2 associates the obtained topic classification results with the text information and records them as topic information in the business negotiation video DB 22b.

[0067] 5 is a flowchart showing the procedure of the online business negotiation process performed by the business negotiation recording server device 2 according to this embodiment. The processing unit 21 of the business negotiation recording server device 2 according to this embodiment causes a bot that records business negotiation video to participate in the online business negotiation based on a command given from the terminal device 3 in response to an operation by the host of the online business negotiation (step S1).

[0068] Next, the consent processing unit 21g of the processing unit 21 performs a process to obtain consent for the recording of the business negotiation video from users participating in the online business negotiation (step S2). The consent processing unit 21g displays a message on each user's terminal device 3 inquiring whether or not they consent, acquires responses to this inquiry from the users via their terminal device 3, and records the acquired responses from each user as "consent information" in the business negotiation video DB 22b. The consent processing unit 21g determines whether consent has been obtained from all users participating in the online business negotiation (step S3). If consent has not been obtained from all users (S4: NO), that is, if at least one user has refused to record the business negotiation video, the consent processing unit 21g causes the bot to exit the online business negotiation (step S4) and terminates the process.

[0069] If consent is obtained from all users (S3: YES), the business negotiation video acquisition unit 21a of the processing unit 21 acquires the business negotiation video, including video and audio data, transmitted from the terminal device 3 of each user participating in the online business negotiation to the online business negotiation server device 1 via the bot that participated in the online business negotiation, and records the acquired business negotiation video in the business negotiation video DB 22b (step S5). The business negotiation video acquisition unit 21a determines whether the online business negotiation has ended (step S6), and if the online business negotiation has not ended (S6: NO), the process returns to step S5 and continues recording the business negotiation video.

[0070] When the online business negotiation has ended (S6: YES), the text conversion processing unit 21b of the processing unit 21 converts the user's speech included in the business negotiation video recorded in the business negotiation video DB 22b into text (step S7). At this time, the text conversion processing unit 21b records the text converted from the speech in the business negotiation video DB 22b in association with information such as the timing of the speech and the speaker in the online business negotiation. The text conversion processing unit 21b also performs a process of classifying topics included in the user's speech based on the text converted from the speech (step S8). At this time, the text conversion processing unit 21b uses a learning model that classifies topics through machine learning in advance, inputs the converted text into the learning model, and obtains the topic classification results output by the learning model, thereby classifying the topics of the user's speech. After the topic classification process by the text conversion processing unit 21b is completed, the processing unit 21 terminates the online business negotiation process.

[0071] 6 and 7 are schematic diagrams showing an example of a business negotiation video display. For example, a user who participated in an online business negotiation can use a terminal device 3 to access the business negotiation recording server device 2 and view the business negotiation video recorded in the business negotiation video DB 22b. FIG. 6 illustrates a playback screen on which the terminal device 3 plays and displays the business negotiation video. On the business negotiation video playback screen, the terminal device 3 displays, for example, a title string such as "Online Business Meeting" at the top and information on the date and time when the online business negotiation took place, such as "October 4, 2021, 7:00 PM," and displays a video of the business negotiation video below these. In this example, five users and a bot on the business negotiation recording server device 2 participated in the online business negotiation, and a video of the users' images arranged in a 3x2 matrix is ​​displayed.

[0072] The terminal device 3 has a number of buttons arranged in the center of the screen below the display area of ​​the video on the playback screen for operations such as play, rewind, and fast forward, and to the right of these buttons are two alternative buttons for selecting either "video" or "text." The example shown in Figure 6 shows the state when the button labeled "video" is selected, and Figure 7 shows the state when the "text" button is selected (details of Figure 7 will be described later).

[0073] The terminal device 3 provides a seek bar indicating the playback time of the business negotiation video below the area where these multiple buttons are provided on the playback screen. The user can appropriately change the playback time (playback time, playback position) of the business negotiation video by sliding the slider provided on the seek bar left or right using the operation unit 35 of the terminal device 3. Furthermore, the terminal device 3 according to this embodiment displays, below the seek bar on the playback screen of the business negotiation video, an utterance timing bar indicating the speech timing of users who participated in the online business negotiation. In the example shown in FIG. 6, five utterance timing bars corresponding to five users who participated in the online business negotiation are displayed one above the other. The seek bar and each utterance timing bar are arranged to extend left and right with approximately the same length, and the playback time of the business negotiation video indicated by the seek bar corresponds to the speech timing indicated by the utterance timing bar.

[0074] The terminal device 3 displays the user name, etc. of the user corresponding to each speech timing bar in the upper left of the bar, and displays the time the user spoke relative to the total time of the online business negotiation as a percentage from 0% to 100% in the upper right. Each speech timing bar is a light-colored bar extending left and right, with dark-colored areas indicating the timing at which the user spoke and the duration of the speech. It can be seen that the more dark-colored areas a user has in their speech timing bar, the more they spoke in the online business negotiation, and for how long. Each speech timing bar is also associated with a seek bar, and a user watching the business negotiation video can display a scene in which the desired user speaks by moving the slider of the seek bar to the position corresponding to the dark-colored area in the desired user's speech timing bar.

[0075] When the "Text" button on the playback screen is selected, the terminal device 3 displays the text display screen shown in FIG. 7 on the display unit 34. On the text display screen, the terminal device 3 displays text converted from the audio of the business negotiation video, arranged vertically in chronological order, in the area where the business negotiation video was displayed on the playback screen of FIG. 6. The terminal device 3 also displays a reduced version of the business negotiation video next to the text display area. The terminal device 3 scrolls the text of the spoken content displayed on the text display screen vertically in synchronization with the playback of the business negotiation video. As a result, on the text display screen, the content of what the user is saying in the played business negotiation video is displayed as text, and the displayed text changes as the business negotiation video progresses.

[0076] The terminal device 3 displays on the text display screen the text of each user's utterance, along with the timing of the utterance and the user name of the user who made the utterance. In the illustrated example, the text "Let's try it for a week or two..." uttered by "User A" at "01:57" is displayed, the text "Yes, it's fine. I think it's easy to understand" uttered by "User B" at "02:11" is displayed, and the text "I thought I'd try it for a week or two..." uttered by "User A" at "02:19" is displayed. The information displayed by the terminal device 3 is recorded in the business-negotiation video DB 22b of the business-negotiation recording server device 2 in association with the business-negotiation video. When transmitting the business-negotiation video to the terminal device 3 for display, the business-negotiation recording server device 2 reads the associated text information, utterance timing, and speaker information from the business-negotiation video DB 22b and transmits them to the terminal device 3.

[0077] <Sharing video of business meetings> In the information processing system according to this embodiment, after the online business negotiation is completed, the business negotiation video recorded in the business negotiation video DB 22b by the business negotiation recording server device 2 can be shared among multiple users. In this embodiment, sharing the business negotiation video means that multiple users can view the business negotiation video, and each user may also be able to leave comments on the business negotiation video. The business negotiation video does not necessarily have to be stored in each user's terminal device 3 (i.e., stored in the terminal device 3); it is sufficient that each user can access the business negotiation recording server device 2 and view the business negotiation video.

[0078] In the information processing system according to this embodiment, after an online business meeting is completed, for example, the user who hosted the online business meeting obtains information for sharing the business meeting video from the business meeting recording server device 2 and transmits this sharing information to other users, thereby realizing the sharing of the business meeting video. The acquisition and transmission of information for sharing the business meeting video is not limited to the user who hosted the online business meeting, but may also be performed by a user other than the host. Furthermore, the sharing of the business meeting video may be limited to users who participated in the online business meeting, or any user may be able to share the business meeting video regardless of whether they participated in the online business meeting. Access permissions for the business meeting video recorded by the business meeting recording server device 2 may be set as appropriate.

[0079] FIG. 8 is a schematic diagram illustrating the sharing of business negotiation videos. For example, after the online business negotiation ends, a user who hosts the online business negotiation can directly access the business negotiation recording server device 2 on the terminal device 3 to view the business negotiation video of the online business negotiation. At this time, the terminal device 3 displays the playback screen shown in FIG. 6 on the display unit 34. The user can generate link information for accessing the displayed business negotiation video by performing a predetermined operation while the playback screen of the business negotiation video is displayed. When a predetermined operation is performed on the playback screen, the terminal device 3 displays a dialog box for generating this link information superimposed on the playback screen, as shown in FIG. 8.

[0080] The terminal device 3 displays the title string "Share Video" at the top of the dialog box, and below it, three options, "Share Current Playback Time," "Share Video," and "Share by Specifying Playback Time," arranged vertically. The terminal device 3 provides a radio button for each of the three options, and accepts selection of one of the three options using these radio buttons. The terminal device 3 also displays a button labeled "Copy Link" at the bottom right of the dialog box. When a user uses the operation unit 35 of the terminal device 3 to select one of the options and operate the "Copy Link" button, the terminal device 3 generates link information for multiple users to share the business negotiation video being played on the playback screen, i.e., information such as a URL for accessing the business negotiation video recorded in the business negotiation recording server device 2.

[0081] The generated link information is copied to a clipboard of the terminal device 3, which is used for so-called copy and paste. By performing a paste operation, the user can paste the link information copied to the clipboard into an email or the like and send it to a user with whom he or she wants to share the business negotiation video. A user who has obtained the link information by receiving an email or the like can use his or her own terminal device 3 to access the business negotiation recording server device 2 based on the link information, thereby playing back the desired business negotiation video on his or her own terminal device 3. When the business negotiation video is accessed based on the link information, the terminal device 3 displays the playback screen shown in FIG. 6 and plays back the business negotiation video.

[0082] "Share current playback time" is an option for sharing the business negotiation video at the playback time of the business negotiation video being played on the playback screen. When this option is selected, information regarding the current playback time of the business negotiation video is embedded in the link information. When the business negotiation video is accessed and played via this link information, the terminal device 3 starts playing the business negotiation video from the playback time embedded in the link information. "Share video" is an option for sharing the business negotiation video by generating link information that does not include information regarding the playback time. When the business negotiation video is accessed and played via this link information, the terminal device 3 starts playing from the beginning of the business negotiation video. "Share by specifying playback time" is an option for sharing the business negotiation video by specifying an arbitrary playback time by the user, rather than the playback time of the business negotiation video being played on the playback screen. When this option is selected, the terminal device 3 displays a screen (not shown) for specifying the playback time and accepts the user's specification of an arbitrary time within the playback time of the business negotiation video. Information regarding the playback time specified by the user is embedded in the link information.

[0083] When the "Copy link" button is clicked or touched, the terminal device 3 transmits information such as the sharing method selected by the user and the specified playback time to the negotiation recording server device 2, requesting the generation of link information. The negotiation recording server device 2 receives the request to generate link information from the terminal device 3, generates link information for accessing the requested negotiation video and starting playback from the specified time, and transmits it to the requesting terminal device 3. The terminal device 3 receives the link information from the negotiation recording server device 2, copies the received link information to the clipboard, etc., and provides it to the user.

[0084] 9 is a flowchart showing the procedure of the business negotiation video sharing process performed by the business negotiation recording server device 2 according to this embodiment. The processing unit 21 of the business negotiation recording server device 2 according to this embodiment causes the terminal device 3 to display the playback screen shown in FIG. 6 or 7 (step S21), and plays back and displays the business negotiation image desired by the user. The sharing processing unit 21d of the processing unit 21 determines whether a sharing operation for sharing the business negotiation image has been performed on the terminal device 3, based on whether a predetermined operation, such as a menu item selection operation, an icon operation, or a shortcut operation, has been performed on the playback screen of the terminal device 3 (step S22). If no sharing operation has been performed (S22: NO), the processing unit 21 causes the terminal device 3 to continue displaying the playback screen.

[0085] If a sharing operation is performed (S22: YES), the sharing processing unit 21d displays the dialog shown in FIG. 8 on the terminal device 3 (step S23) and accepts the selection of a sharing method for the business negotiation video via the terminal device 3 (step S24). Based on the selected sharing method, the sharing processing unit 21d generates link information for accessing the business negotiation video and starting playback from the specified playback time (step S25), and returns the process to step S21. The link information may include, for example, information such as a URL indicating the location where the business negotiation video is stored and information about the playback time. Note that in the flowchart in this figure, the business negotiation recording server device 2 performs processes such as displaying the dialog and selecting the sharing method via the terminal device 3, but this is not limiting. The terminal device 3 may perform these processes independently and send the processing results to the business negotiation recording server device 2.

[0086] Furthermore, in the information processing system according to this embodiment, users can add comments to business negotiation videos that are played back and displayed on the terminal device 3. Comments in the information processing system according to this embodiment are recorded in the business negotiation video DB 22b in association with specific playback times of the business negotiation videos, and comments added by one user to the business negotiation videos are shared with other users who share this business negotiation video.

[0087] FIG. 10 is a schematic diagram illustrating the comment function. When a business negotiation video with a comment is played back on a playback screen that plays back and displays the business negotiation video, the terminal device 3 displays, for example, a speech bubble-shaped icon above the seek bar to notify the user that a comment exists. The comment icon is displayed at the playback time position associated with the comment. In response to a click or touch operation on the comment icon, the terminal device 3 plays back and displays the business negotiation video from the playback time of the comment and also displays the comment. At this time, the terminal device 3 obtains information about one or more comments stored in association with the business negotiation video from the business negotiation recording server device 2, and displays the comments added to the business negotiation video.

[0088] In the information processing system according to this embodiment, the terminal device 3 displays a comment area on the right side of the playback screen. The comment area is a rectangular area extending vertically, with a title string "Comment" displayed at the top, and one or more comments displayed vertically in chronological order below this title string. For each comment, the terminal device 3 displays information such as the username of the user who entered the comment, the corresponding playback time, and the text of the comment, enclosed in a rectangular frame. When a user selects a comment displayed in the comment area, the terminal device 3 starts playback of the business negotiation video from the playback time associated with the selected comment. In the illustrated example, user A adds the comment "The hypothetical setting is...", and user B responds with the comment "The hearing was also conducted from the angle of XX...". User A also adds the comment "This way of communicating about XX...".

[0089] The terminal device 3 has, below the comment area, a text box for entering a comment, a time setting section for specifying a time, and two buttons, "Send" and "Cancel." The time setting section displays the playback time of the business negotiation video being played on the playback screen as an initial value, and the user can increase or decrease this playback time to set any time. When the "Send" button is pressed, the terminal device 3 registers information about the comment in the business negotiation video DB 22b by transmitting the comment text entered in the text box and the playback time set in the time setting section to the business negotiation recording server device 2. When the business negotiation recording server device 2 receives information about the comment text and playback time from the terminal device 3, it records this information in the business negotiation video DB 22b in association with the business negotiation video being played. When transmitting business negotiation video data to the terminal device 3 for playback, the business negotiation recording server device 2 checks whether a comment associated with the business negotiation video DB 22b is recorded. If a comment is recorded, it reads the information and transmits it to the terminal device 3 together with the business negotiation video.

[0090] 11 is a flowchart showing the comment processing procedure performed by the negotiation recording server device 2 according to this embodiment. When a predetermined operation is performed while the terminal device 3 is displaying the playback screen, the comment processing unit 21e of the processing unit 21 of the negotiation recording server device 2 according to this embodiment displays a comment area on the right side of the playback screen (step S31). The comment processing unit 21e also acquires comment information added to the negotiation video being played on the playback screen from the negotiation video DB 22b and transmits it to the terminal device 3, thereby displaying one or more comments in the comment area (step S32).

[0091] The comment processor 21e determines whether or not a user comment has been entered in the comment area via the terminal device 3 (step S33). If a comment has not been entered (S33: NO), the comment processor 21e returns the process to step S31. If a comment has been entered (S33: YES), the comment processor 21e acquires the comment entered by the user from the terminal device 3, associates the comment information with the business negotiation video, and records the comment information in the business negotiation video DB 22b (step S34), and ends the process.

[0092] <Search processing for business negotiation videos> In the information processing system according to this embodiment, as described above, the business negotiation recording server device 2 converts the voices included in the business negotiation video into text, and records the text information of the participants' speeches together with the business negotiation video in the business negotiation video DB 22b. In the information processing system according to this embodiment, it is possible to search for business negotiation videos using the text information associated with the business negotiation videos.

[0093] 12 is a schematic diagram showing an example of a search screen for business negotiation videos. The terminal device 3 displays the search screen on the display unit 34 in response to a predetermined operation such as a menu item selection operation, an icon operation, or a shortcut operation, and accepts input of search conditions for the business negotiation video from the user. The search screen has a condition input area on the left side for the user to input various search conditions. The search screen shown in the figure allows the user to input search conditions such as "meeting host name" and "keyword search," as well as "basic information" such as "conversation title," "conference participants," and "date," and input sections such as text boxes, combo boxes, or pull-down menus for inputting each condition are arranged vertically within the condition input area.

[0094] The terminal device 3 also displays, in a list in the right area of ​​the search screen, information about one or more business negotiation videos that meet the conditions set by the user in the condition input area, in a vertical order, for example, in the order of the dates of the online business negotiations. In the illustrated example, the display order is shown as "sort order: date," and this display order can be changed by the user. The information about each business negotiation video displayed in the list may include a thumbnail image of the business negotiation video, the date and time of the online business negotiation, the user names of the participants in the online business negotiation, and part of the information obtained by converting the audio of the business negotiation video into text. The text information included in each piece of displayed information is, for example, text information containing keywords entered by the user as conditions for a keyword search, and the corresponding keywords are highlighted by enlarging or changing the color, etc. In the example shown, a thumbnail image and text such as "And the people who will use it..." are displayed first for "Online Business Negotiation A" whose "Participants" are "User A, User B, User C," a thumbnail image and text such as "There is some manual work involved..." are displayed second for "Online Business Negotiation B" whose "Participants" are "User D, User E, User F," and a thumbnail image and text such as "And regarding the scope of disclosure..." are displayed third for "Online Business Negotiation C" whose "Participants" are "User G, User H."

[0095] When the terminal device 3 displaying the search screen receives input of search conditions in any of the search condition input sections provided in the condition input area, it transmits the received search conditions to the business negotiation recording server device 2 and requests a search for business negotiation videos. In response to this request, the business negotiation recording server device 2 finds one or more business negotiation videos that match the search conditions from among the business negotiation videos recorded in the business negotiation video DB 22b, and transmits information about the corresponding business negotiation videos as search results to the requesting terminal device 3. At this time, the business negotiation recording server device 2 transmits information about the business negotiation videos that match the search conditions, such as thumbnail images, the date and time of the event, participants, and text information, to the terminal device 3. The terminal device 3 receives the search results from the business negotiation recording server device 2 and displays a list of the search results on the search screen.

[0096] For example, when a meeting host name is set as a search condition, the business negotiation recording server device 2 can extract, from the business negotiation videos recorded in the business negotiation video DB 22b, those in which the user name registered first as a participant matches the search condition, as the search result. For example, when a predetermined character string is set as a search condition for a keyword search, the business negotiation recording server device 2 can extract, from the utterance text recorded in the business negotiation video DB 22b, those containing the keyword character string, and extract the business negotiation video associated with this utterance text, as the search result.

[0097] For example, the business negotiation recording server device 2 can search for business negotiation videos using the title of the business negotiation video as a search criterion. Although not shown in FIG. 3, the title of the business negotiation video may be set by the user (the organizer) before the online business negotiation begins and recorded in the business negotiation video DB 22b along with the business negotiation video. The business negotiation recording server device 2 can acquire a character string set as a title search criterion and extract business negotiation videos containing this character string from the business negotiation video DB 22b as search results. For example, when a participant's username is set as a search criterion, the business negotiation recording server device 2 can extract business negotiation videos of online business negotiations attended by users with the set username based on the participant information recorded in the business negotiation video DB 22b as search results. For example, when a date search criterion is set, the business negotiation recording server device 2 can similarly extract the relevant business negotiation video based on the date information recorded together with the business negotiation video in the business negotiation video DB 22b.

[0098] 13 is a flowchart showing the procedure of the business negotiation video search process performed by the business negotiation recording server device 2 according to this embodiment. The search processing unit 21c of the processing unit 21 of the business negotiation recording server device 2 according to this embodiment accepts search conditions such as keywords or participants entered by the user via the terminal device 3 (step S41). The search processing unit 21c extracts business negotiation videos having information corresponding to the accepted search conditions from among the business negotiation videos recorded in the business negotiation video DB 22b, based on various information such as text information or user names associated with the business negotiation videos and recorded in the business negotiation video DB 22b (step S42).

[0099] Next, the search processing unit 21c acquires various pieces of information recorded in the business negotiation video DB 22b in association with the extracted one or more business negotiation videos (step S43). The search processing unit 21c transmits the information related to the business negotiation videos acquired from the business negotiation video DB 22b to the terminal device 3 (step S44), displays this information as search results on the terminal device 3, and ends the search process.

[0100] Furthermore, the information processing system according to this embodiment provides a function for searching for the content of utterances made by participants in a single business negotiation video, in addition to the search function for multiple business negotiation videos recorded in the business negotiation video DB 22b as described above. FIG. 14 is a schematic diagram illustrating the search function for utterances. For example, when a business negotiation video is being played on the playback screen shown in FIG. 6, the terminal device 3 displays a search area on the left side of the playback screen for searching for text information about utterances made in the business negotiation video being played, in response to a predetermined operation such as a menu item selection operation, an icon operation, or a shortcut operation. A title string "Utterance Search" is displayed above the search area, and a dialog box for entering keywords as search criteria is provided below the title string. Below this dialog box, one or more pieces of text information are displayed in a list arranged vertically as search results. The information displayed as a list of search results may include the user name of the user who made the corresponding utterance, the playback time when the utterance was made, and text information obtained by converting the utterance into text. The terminal device 3 highlights the keywords of the search criteria included in the text information displayed as search results.

[0101] The terminal device 3, which displays a search area on the left side of the playback screen, acquires keywords entered in the dialog box of the search area. The terminal device 3 transmits information indicating which business negotiation video is being played back and the entered keywords to the business negotiation recording server device 2, and requests a search for the utterance content. In response to this request, the business negotiation recording server device 2 extracts utterance text containing the entered keywords from the text information recorded in the business negotiation video DB 22b in association with the target business negotiation video. The business negotiation recording server device 2 transmits the utterance text containing the keywords and information such as the associated speaker as search results to the terminal device 3 that requested the search. Based on the search results received from the business negotiation recording server device 2, the terminal device 3 displays a list of text information of the utterance content containing the keywords entered as search conditions, for example, in order of playback time. The example shown in the figure is for when "release" is entered as the keyword. The search results show the spoken text of "User A," "First of all, thank you so much for your hard work on the 'release'...," the spoken text of "User B," "That's true, but you won't know until you try the 'release'...," and the spoken text of "User C," "Thank you, but these are the numbers for the 'release'...." The search keyword "release" is highlighted in the spoken text of the search results.

[0102] In this embodiment, the search process for the utterance content is performed by the negotiation recording server device 2, but this is not limiting and the search process may be performed by a terminal device. In this case, for example, when the terminal device 3 obtains the negotiation video to be played from the negotiation recording server device 2, it obtains and stores text information associated with the negotiation video. The terminal device 3 can extract text information containing the keywords of the input search criteria from the stored text information and display it as a search result.

[0103] After displaying the list of search results, the terminal device 3 accepts a selection operation of any one of the listed text information. When the selection operation is accepted, the terminal device 3 acquires a playback time associated with the selected text information, and starts playing back the business negotiation video on the playback screen from this playback time.

[0104] <Analysis and processing of business negotiation videos> The information processing system according to this embodiment provides a function for analyzing various pieces of information related to online business negotiations based on business negotiation videos and various pieces of information related thereto, which are recorded in the business negotiation video DB 22b by the business negotiation recording server device 2. For example, in the playback screen shown in FIG. 6, the terminal device 3 displays speech timing bars indicating the speech timings of users who participated in the online business negotiations, alongside a seek bar indicating the playback time of the business negotiation video, below the display area of ​​the played-back business negotiation video. The user's speech timing indicated in each speech timing bar is calculated by aggregating the speech timings of the text information recorded in the business negotiation video DB 22b of the business negotiation recording server device 2. The terminal device 3 also displays each user's speech ratio as a numerical value ranging from 0% to 100% near the right end of each user's speech timing bar. The speech ratio is calculated by calculating the ratio of each user's speech time to the total speech time of all participants in the online business negotiation.

[0105] In this embodiment, the business negotiation recording server device 2 generates information such as each user's speech timing and speech time ratio based on the information recorded in the business negotiation video DB 22b and transmits it to the terminal device 3 that plays and displays the business negotiation video. However, the business negotiation recording server device 2 may transmit the information recorded in the business negotiation video DB 22b to the terminal device 3, and the terminal device 3 that receives this information may generate and display information such as the speech timing and speech time ratio.

[0106] The information such as speech timing and speech duration ratio shown in FIG. 6 is obtained by analyzing information related to an online business negotiation recorded in a single business negotiation video. The information processing system according to this embodiment can analyze information related not only to a single business negotiation video but also to multiple business negotiation videos recorded in the business negotiation video DB 22b, and provide the analysis results to the user. The business negotiation recording server device 2 performs this information analysis processing based on the information recorded in the business negotiation video DB 22b, and transmits the processing results to the terminal device 3. The terminal device 3 receives the analysis results from the business negotiation recording server device 2 and displays them on the display unit 34.

[0107] 15 is a schematic diagram showing an example of a display screen of analysis results. A user who uses the information analysis function provided by the information processing system according to this embodiment can register one or more users to be analyzed as a team in the negotiation recording server device 2, and can then instruct the negotiation recording server device 2 to perform analysis processing from the terminal device 3, thereby obtaining the analysis results from the negotiation recording server device 2 and displaying them on the terminal device 3. In the example shown, the negotiation recording server device 2 analyzes six analysis items for multiple pre-registered users: "average conversation time," "number of conversations per week," "weekly conversation time," "total number of conversations," "total conversation time," and "number of times participants in conversations," and the terminal device 3 displays the analysis results.

[0108] The business negotiation recording server device 2 extracts information about online business negotiations in which registered users participated for a predetermined period, such as one week, one month, or one year, from the business negotiation video DB 22b, and calculates numerical values ​​for the six analysis items mentioned above for each user. The predetermined period for analysis can be set appropriately by the user. "Average conversation time" is the average time a user spent conversing (speaking) in one online business negotiation. "Number of conversations per week" is the average number of times a user participated in online business negotiations in one week. "Weekly conversation time" is the average total time a user spent conversing in online business negotiations in one week. "Total number of conversations" is the number of times a user conversed in online business negotiations in a predetermined period. "Total conversation time" is the amount of time a user conversed in online business negotiations in a predetermined period. "Number of times a user participated in conversations" is the number of times a user participated in online business negotiations in a predetermined period.

[0109] On the analysis result display screen, the terminal device 3 switches and displays the analysis results of each of the above six analysis items, for example, in response to the selection of so-called tabs. In the example shown in FIG. 15, the tab "average conversation time" is selected, and the analysis results of this analysis item are displayed. The terminal device 3 also displays, on the tab used to switch between analysis items, a character string indicating the analysis item along with a numerical value related to this analysis item. The numerical value displayed on the tab may be, for example, the average value, maximum value, or minimum value for multiple users (team members) included in a registered team. In the example shown, the average value is used.

[0110] As the analysis result of the analysis item "average conversation time," the terminal device 3 displays the user names, etc. of multiple users included in the team in a vertical list, and also displays the numerical values ​​related to the analysis item calculated for each user in a horizontal bar graph, corresponding to the user's user name, etc. The multiple users displayed are sorted, for example, in ascending or descending order of the numerical values ​​of the analysis results. The terminal device 3 also displays the average value for the entire team as a vertical line against the horizontal bar graph. Note that display examples for the five analysis items other than "average conversation time" are omitted, but the terminal device 3 can provide the analysis results to the user in the same display method as "average conversation time."

[0111] FIG. 16 is a schematic diagram showing another example of the display screen for the analysis results. In the example shown in FIG. 16, the terminal device 3 displays the analysis results for three analysis items: "proportion of conversations," "time spent talking alone," and "time spent by a customer talking alone." The "proportion of conversations" is the proportion of conversations that a user engaged in during online business negotiations that the user participated in during a predetermined period. The "time spent talking alone" is the maximum time spent talking alone by the user during online business negotiations that the user participated in during a predetermined period. The time spent talking alone is the time spent talking alone by the user alone, without any other users talking. Note that even if a conversation between only the user is continuing, if there is a period of silence exceeding a predetermined time, the user's conversation may be treated as having been temporarily interrupted.

[0112] The "time a customer continues talking alone" is the maximum time that a user (customer) other than the user continues talking alone during an online business negotiation in which the user participated. If multiple customers participate in the online business negotiation, the maximum time that each customer continues talking alone can be calculated, and the maximum time for all customers can be used as the analysis result. Furthermore, determining which of the multiple users participating in the online business negotiation is a customer can be done, for example, by considering all users other than the user being analyzed as customers, or by considering users other than users registered as a team as customers, or by accepting registration of users to be considered customers in advance. When accepting customer registration in advance, for example, the business negotiation recording server device 2 accepts, via the terminal device 3, a setting as to whether or not each user participating in the online business negotiation is a customer from the user who organizes the online business negotiation or a user requesting an analysis of the business negotiation, and records information indicating whether or not each user is a customer in the business negotiation video DB 22b according to the accepted setting.

[0113] As the analysis result of the analysis item "proportion of conversations," the terminal device 3 displays a list of the user names, etc. of multiple users included in the team in a vertical direction, and also displays the numerical values ​​related to the analysis item calculated for each user as a horizontal bar graph in association with the user's user name, etc. As shown in Fig. 16, the terminal device 3 can display the analysis results of the "proportion of conversations," etc. in the same manner and manner as the analysis result shown in Fig. 15.

[0114] 17 is a flowchart showing the procedure of the analysis process performed by the negotiation recording server device 2 according to this embodiment. The analysis processing unit 21f of the processing unit 21 of the negotiation recording server device 2 according to this embodiment receives a request to perform analysis process on the online negotiation from the terminal device 3 (step S51) and starts the analysis process. The analysis processing unit 21f acquires one or more user names included in the team to be analyzed based on information about the team registered in advance (step S52). Based on the acquired user names, the analysis processing unit 21f reads information about the online negotiation in which the user participated from the negotiation video DB 22b (step S53).

[0115] Based on the information read from the business negotiation video DB 22b, the analysis processing unit 21f calculates values ​​for each analysis item, such as "average conversation time," "number of conversations per week," "weekly conversation time," "total number of conversations," "total conversation time," "number of times participating in conversations," "percentage of conversations," "time spent talking alone," and "time spent talking alone by a customer," for each user included in the team (step S54). Based on the calculation results for the values ​​for each analysis item for each user, the analysis processing unit 21f calculates the average values ​​for each analysis item for the team including these users (step S55). The analysis processing unit 21f transmits the analysis results, including information such as the values ​​for each analysis item for each user and the average values ​​for the team, to the terminal device 3 that requested the analysis processing (step S56), and ends the processing.

[0116] <Other features> (1) Library function In the information processing system according to this embodiment, a user who watches business negotiation videos on the terminal device 3 can create a library of business negotiation videos that he or she needs. A user who accesses business negotiation videos recorded in the business negotiation video DB 22b of the business negotiation recording server device 2 using the business negotiation video sharing function described above can play and watch the business negotiation videos on the terminal device 3 and can register these business negotiation videos in his or her own library. For example, when a predetermined operation is performed on the playback screen shown in FIG. 6, the terminal device 3 registers the displayed business negotiation video in the user's library. The terminal device 3 displays a list of business negotiation videos registered in the library in response to the user's predetermined operation, and also accepts the selection of one business negotiation video from the listed business negotiation videos, and plays and displays the selected business negotiation video.

[0117] In this embodiment, each user's library is managed as information that collects link information to business negotiation videos, for example. The management of library information may be performed by the business negotiation recording server device 2 or by the terminal device 3. The information processing system may also provide an automatic library registration function that automatically registers business negotiation videos of online business negotiations in which a user has participated in this user's library, or automatically registers business negotiation videos of online business negotiations in which a preset user has participated or in which preset keywords are included in the conversations of participants.

[0118] (2) Topic function In the information processing system according to this embodiment, as described above, the business negotiation recording server device 2 performs topic classification on text information obtained by converting the audio of business negotiation videos into text. When a user performs a predetermined operation on the terminal device 3, such as selecting a menu item, operating an icon, or operating a shortcut, the business negotiation recording server device 2 transmits information on the results of the topic classification to the terminal device 3 and causes the terminal device 3 to display the topic classification results.

[0119] FIG. 18 is a schematic diagram showing an example of a display of a topic classification result. The illustrated example is an example of a topic classification result displayed by the terminal device 3 when a user performs an operation to display the topic classification result on the screen that displays the text of the audio of the business negotiation video shown in FIG. 7. In the information processing system according to this embodiment, the terminal device 3 displays labels associated with topics included in the text information of the user's utterance near the position where this text information is displayed. In the illustrated example, labels with the numbers "1" and "2" written in an upside-down teardrop-shaped or waterdrop-shaped speech bubble are displayed near the text information. For example, text information labeled "1" indicates that it has been classified into class 1 by topic classification.

[0120] Furthermore, in the information processing system according to this embodiment, the user can set any label name for the numeric label displayed as the topic classification result. For example, the user can select one of one or more displayed labels and set any label name for the selected label by inputting any character string. The terminal device 3 acquires the label name set by the user and stores the correspondence between the original numeric label and the label set by the user. When subsequently displaying the topic classification label, the terminal device 3 converts the numeric label to the set label name based on the stored correspondence, and displays a speech bubble with the set label name near the text information.

[0121] Note that a label name set by a user may be treated as a label name valid only for that user, or may be shared among multiple users, such as other users registered in the same team as that user. When a label name is shared among multiple users, information regarding the correspondence between the label numerical value and the label name is stored in the negotiation recording server device 2. When a label name is reflected only for the user who set it, information regarding the correspondence between the label numerical value and the label name may be stored only in the terminal device 3 used by that user, or may be stored in the negotiation recording server device 2.

[0122] <Summary> In the information processing system according to this embodiment, the negotiation recording server device 2 acquires a recorded video of an online negotiation via the online negotiation server device 1, and converts the audio information related to the participants' speech into text information based on the acquired video. For example, when the terminal device 3 displays the video of the negotiation, the negotiation recording server device 2 transmits the converted text information to the terminal device 3 along with the video, causing the terminal device 3 to display the text information. By converting the audio of the video of the negotiation into text information, the user can confirm the speech content of the participants in the online negotiation in text format, which is expected to support the investigation or analysis of the video of the negotiation recorded online.

[0123] Furthermore, in the information processing system according to this embodiment, the business negotiation recording server device 2 records business negotiation videos in the business negotiation video DB 22b, accepts conditions for sharing the business negotiation videos from users via the terminal device 3, and generates link information and the like for accessing the business negotiation videos recorded in the business negotiation video DB 22b. Conditions for sharing the business negotiation videos can be, for example, "share current playback time," "share video," and "share by specifying playback time," which are conditions for specifying the time point at which playback of the business negotiation videos should start. As a result, by one user providing other users with the link information generated by the business negotiation recording server device 2, multiple users can access and view the business negotiation videos, thereby realizing the sharing of business negotiation videos.

[0124] The information processing system according to this embodiment also provides a search function for text information in business negotiation videos using search keywords, or a search function for business negotiation videos based on users who participated in online business negotiations, allowing users to easily find and view a desired business negotiation video from among the multiple business negotiation videos recorded by the business negotiation recording server device 2.

[0125] Furthermore, in the information processing system according to this embodiment, the business negotiation recording server device 2 accepts input of comment information from users who have viewed the business negotiation video, associates the accepted comment information with the business negotiation video, and stores the associated comment information in the business negotiation video DB 22b. When the terminal device 3 displays the business negotiation video, the business negotiation recording server device 2 transmits the associated comment information together with the business negotiation video to the terminal device 3, and displays the comment information together with the business negotiation video on the terminal device 3. This allows other users to check the comments entered by one user together with the business negotiation video.

[0126] Furthermore, in the information processing system according to this embodiment, the business negotiation recording server device 2 stores the comment information entered by the user in association with the playback time (the display point relative to the playback time) of the business negotiation video. When the terminal device 3 plays back and displays the business negotiation video, it displays a seek bar indicating the playback time (playback point) relative to the playback time of the business negotiation video, and also displays an indicator on this seek bar indicating the display point of the comment information. This allows the user to easily understand to which point in the business negotiation video other users have added comment information.

[0127] Furthermore, in the information processing system according to this embodiment, when the terminal device 3 receives a predetermined operation (e.g., a click operation or a touch operation) from the user on the comment information displayed, playback of the business negotiation video starts from the playback time (display time) associated with the comment information. This allows the user to easily check the business negotiation video at the time the comment information was added.

[0128] Furthermore, in the information processing system according to this embodiment, when the terminal device 3 displays a business negotiation video, it displays, for each user who participated in the online business negotiation related to the business negotiation video, the timing of speech (time of speech) relative to the playback time of the business negotiation video in chronological order. For example, the terminal device 3 displays a speech timing bar for each user alongside a seek bar indicating the playback time of the business negotiation video, thereby displaying the speech timing for each user. This allows users watching the business negotiation video to easily understand the timing at which the users who participated in the online business negotiation spoke.

[0129] Furthermore, in the information processing system according to this embodiment, the business negotiation recording server device 2 analyzes the proportion of speech (proportion of conversations) of users who participated in the online business negotiation, the duration of continuous solo speech (the duration of solo conversation), and other factors based on the business negotiation video and related information recorded in the business negotiation video DB 22b, and displays the analysis results on the terminal device 3. The business negotiation recording server device 2 also performs these analyses on multiple users, and displays the analysis results of the multiple users in comparison on the terminal device 3. This allows users to perform detailed analysis of the characteristics of each user related to the online business negotiation based on the business negotiation video recorded in the business negotiation video DB 22b.

[0130] Furthermore, in the information processing system according to this embodiment, the negotiation recording server device 2 acquires negotiation video containing recorded images of users who participated in the online negotiation by having a bot that records the negotiation video participate in the online negotiation conducted by the online negotiation server device 1. As a result, even if there are multiple types of online negotiation server devices 1, the negotiation recording server device 2 can easily acquire negotiation video by having a bot participate, which is expected to enable compatibility with a variety of online negotiation systems.

[0131] In the information processing system according to this embodiment, the negotiation recording server device 2 receives consent from users participating in online negotiations regarding the recording of the negotiation video, and records the consent in the negotiation video DB 22b. This is expected to prevent problems related to the recording of the negotiation video.

[0132] The embodiments disclosed herein are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims.

[0133] <Additional Notes> (Appendix 1) The information processing device Obtaining video recordings of business meetings, converting audio information relating to speeches of participants in the business negotiation into text information based on the acquired business negotiation video; Displaying the converted text information. Information processing methods. (Appendix 2) The information processing device, Record the video of the business negotiation, A plurality of participants in the business negotiation accept conditions for sharing the business negotiation video; generating information for accessing the business negotiation video based on the received conditions; 1. The information processing method described in Appendix 1. (Appendix 3) the condition is a condition that specifies a time point at which playback of the business negotiation video should start when the business negotiation video is played back; 1. The information processing method described in Appendix 2. (Appendix 4) The information processing device, accepting search keywords for the business negotiation video; extracting the business negotiation video corresponding to the test information including the received search keyword from the plurality of recorded business negotiation videos; 10. An information processing method according to any one of claims 1 to 3. (Appendix 5) The information processing device, Accepting information relating to participants who participated in the business negotiation; extracting, from the plurality of recorded business negotiation videos, the business negotiation video in which the participant corresponding to the received information participated; 10. An information processing method according to any one of claims 1 to 4. (Appendix 6) The information processing device, Accepting input of comment information regarding the business negotiation video; storing the received comment information in association with the business negotiation video; Displaying the comment information. 10. An information processing method according to any one of claims 1 to 5. (Appendix 7) The information processing device, storing the comment information in association with a display time point relative to the playback time of the business negotiation video; When the business negotiation video is played back, a seek bar indicating a playback point relative to the playback time of the business negotiation video is displayed; an indicator indicating a display time point of the comment information is displayed on the seek bar; 1. The information processing method described in Appendix 6. (Appendix 8) the information processing device accepts an operation on the displayed comment information and plays back the business negotiation video associated with the comment information from a display point associated with the comment information. 7. The information processing method according to claim 7. (Appendix 9) the information processing device displays, for each participant who participated in the business negotiation related to the business negotiation video, a time point of an utterance relative to a playback time of the business negotiation video in chronological order. 10. An information processing method according to any one of appendices 1 to 8. (Appendix 10) The information processing device, Calculating the proportion of speeches made during the business negotiation for participants who participated in the business negotiation video; Display information about the calculated percentage; 10. An information processing method according to any one of claims 1 to 9. (Appendix 11) The information processing device, Calculating the duration of time that a participant who participated in the business negotiation related to the business negotiation video continued speaking independently during the business negotiation; Display information about the calculated time, 11. The information processing method according to claim 10. (Appendix 12) The information processing device, Calculating the ratio and the time for each of the participants who participated in the multiple business negotiations; and comparing and displaying the calculation results for the plurality of participants. 12. The information processing method according to claim 11. (Appendix 13) the information processing device causes the bot that records the business negotiation video to participate in the business negotiation as a participant; 13. An information processing method according to any one of claims 1 to 12. (Appendix 14) The information processing device, receiving consent from participants in the business negotiation regarding the recording of the business negotiation video; Record information regarding consent received; 14. An information processing method according to any one of claims 1 to 13. (Appendix 15) On the computer, Obtaining video recordings of business meetings, converting audio information relating to speeches of participants in the business negotiation into text information based on the acquired business negotiation video; Display the converted text information A computer program that executes a process. (Appendix 16) an acquisition unit that acquires a video of a business negotiation recorded on the video recording unit; a conversion unit that converts audio information related to speeches of participants in the business negotiation into text information based on the acquired business negotiation video; a display processing unit that performs processing to display the converted text information on a display unit; An information processing device comprising: [Explanation of symbols]

[0134] 1 Online business negotiation server device 2. Business negotiation record server device 3 Terminal Devices 21 Processing section 21a Business Negotiation Video Acquisition Department 21b Text processing section 21c Search processing section 21d Shared Processing Section 21e Comment processing section 21f Analysis processing section 21g Consent Processing Unit 22 Memory section 22a Server program 22b Business negotiation video DB 23 Communications Department 31 Processing section 31a Online Business Negotiations Processing Department 31b Business negotiation video processing section 32 Storage section 32a Program 33 Communications Department 34 Display section 35 Control section 36 Camera 37. Mike 98,99 Recording media N Network

Claims

1. A server device having a communication unit for communicating with a terminal device, receiving a recorded video of the business negotiation from the terminal device; converting audio information relating to speeches of participants in the business negotiation into text information based on the received business negotiation video; Transmitting the converted text information to the terminal device; receiving, from the terminal device, comment information that has been input in response to the business negotiation video and accepted by the terminal device; storing the received comment information in association with a display time point relative to the playback time of the business negotiation video; displaying a seek bar indicating a playback time point relative to the playback time of the business negotiation video, and transmitting information to the terminal device for displaying an indicator indicating a display time point associated with comment information inputted to the business negotiation video in association with the seek bar; Information processing methods.

2. The terminal device Acquire text information output by a server device that converts voice information relating to speeches of participants in a business negotiation into text information based on a business negotiation video recording of the business negotiation; accepting input of comment information on the business negotiation video and transmitting the comment information to the server device; a seek bar indicating a playback time point relative to the playback time of the business negotiation video is displayed based on the display information output by the server device, and an indicator indicating a display time point associated with comment information inputted to the business negotiation video is displayed in association with the seek bar; Information processing methods.

3. A server device having a communication unit for communicating with a terminal device, receiving a recorded video of the business negotiation from the terminal device; converting audio information relating to speeches of participants in the business negotiation into text information based on the received business negotiation video; Transmitting the converted text information to the terminal device; transmitting to the terminal device, for each participant who participated in the business negotiation related to the business negotiation video, information for displaying in chronological order the time points of utterances relative to the playback time of the business negotiation video; Information processing methods.

4. The terminal device Acquire text information output by a server device that converts voice information relating to speeches of participants in a business negotiation into text information based on a business negotiation video recording of the business negotiation; based on the display information output by the server device, displaying, for each participant who participated in the business negotiation related to the business negotiation video, the time points of the utterances relative to the playback time of the business negotiation video in chronological order; Information processing methods.

5. A server device having a communication unit for communicating with a terminal device, receiving information regarding consent to the participation of a bot that records the business negotiation from the terminal device used by a participant of the business negotiation; Record the consent information received, If consent is obtained from the participant, the bot is allowed to participate in the business negotiation as a participant, and a recorded video of the business negotiation is received from the terminal device; converting audio information relating to speeches of participants in the business negotiation into text information based on the received business negotiation video; Transmitting the converted text information to the terminal device; Disallowing the bot from participating in the business meeting if consent is not obtained from the participant; Information processing methods.

6. A server computer having a communication unit for communicating with a terminal device, receiving a recorded video of the business negotiation from the terminal device; converting audio information relating to speeches of participants in the business negotiation into text information based on the received business negotiation video; Transmitting the converted text information to the terminal device; receiving comment information inputted to the business negotiation video from the terminal device; storing the received comment information in association with a display time point relative to the playback time of the business negotiation video; A seek bar indicating a playback time point relative to the playback time of the business negotiation video is displayed, and information for displaying an indicator indicating a display time point associated with comment information inputted to the business negotiation video in association with the seek bar is transmitted to the terminal device. A computer program that executes a process.

7. On the computer, Acquire text information output by a server device that converts voice information relating to speeches of participants in a business negotiation into text information based on a business negotiation video recording of the business negotiation; accepting input of comment information on the business negotiation video and transmitting the comment information to the server device; A seek bar indicating a playback time point relative to the playback time of the business negotiation video is displayed based on the information for display output by the server device, and an indicator indicating a display time point associated with comment information inputted to the business negotiation video is displayed in association with the seek bar. A computer program that executes a process.

8. A server computer having a communication unit for communicating with a terminal device, receiving a recorded video of the business negotiation from the terminal device; converting audio information relating to speeches of participants in the business negotiation into text information based on the received business negotiation video; Transmitting the converted text information to the terminal device; Transmitting information to the terminal device for displaying, for each participant who participated in the business negotiation related to the business negotiation video, the time point of speech relative to the playback time of the business negotiation video in chronological order. A computer program that executes a process.

9. On the computer, Acquire text information output by a server device that converts voice information relating to speeches of participants in a business negotiation into text information based on a business negotiation video recording of the business negotiation; Based on the information for display output by the server device, the time points of speeches with respect to the playback time of the business negotiation video are displayed in chronological order for each participant who participated in the business negotiation related to the business negotiation video. A computer program that executes a process.

10. A server computer having a communication unit for communicating with a terminal device, receiving information regarding consent to the participation of a bot that records the business negotiation from the terminal device used by a participant of the business negotiation; Record the consent information received, If consent is obtained from the participant, the bot is allowed to participate in the business negotiation as a participant, and a recorded video of the business negotiation is received from the terminal device; converting audio information relating to speeches of participants in the business negotiation into text information based on the received business negotiation video; Transmitting the converted text information to the terminal device; Disallowing the bot from participating in the business meeting if consent is not obtained from the participant A computer program that executes a process.

11. a first acquisition unit that acquires a business negotiation video that is a video recording of the business negotiation; a conversion unit that converts audio information related to speeches of participants in the business negotiation into text information based on the acquired business negotiation video; a first output unit that outputs the converted text information; a second acquisition unit that acquires comment information inputted to the business negotiation video; a storage processing unit that performs processing to store the acquired comment information in a storage unit in association with a display time point relative to the playback time of the business negotiation video; a second output unit that displays a seek bar indicating a playback time point relative to the playback time of the business negotiation video, and outputs information for displaying an indicator indicating a display time point associated with comment information input to the business negotiation video in association with the seek bar; A server device comprising:

12. an acquisition unit that acquires text information output by a server device that converts voice information related to speeches of participants in a business negotiation into text information based on a business negotiation video that has been recorded; a transmitting unit that receives input of comment information on the business negotiation video and transmits the comment information to the server device; a display processing unit that displays a seek bar indicating a playback time point relative to the playback time of the business negotiation video based on the display information output by the server device, and that displays an indicator indicating a display time point associated with comment information inputted to the business negotiation video on the display unit in association with the seek bar; A terminal device comprising:

13. an acquisition unit that acquires a video of a business negotiation recorded on the video recording unit; a conversion unit that converts audio information related to speeches of participants in the business negotiation into text information based on the acquired business negotiation video; a first output unit that outputs the converted text information; a second output unit that outputs information for displaying, for each participant who participated in the business negotiation related to the business negotiation video, the time point of the speech relative to the playback time of the business negotiation video in chronological order; A server device comprising:

14. an acquisition unit that acquires text information output by a server device that converts voice information related to speeches of participants in a business negotiation into text information based on a business negotiation video that has been recorded; a display processing unit that performs processing to display, on a display unit, the time points of speech relative to the playback time of the business negotiation video for each participant who participated in the business negotiation related to the business negotiation video, based on the display information output by the server device; A terminal device comprising:

15. a reception unit that receives consent from a participant of the business negotiation to participate in the bot that records the business negotiation; a recording unit that records information related to the received consent; an acquisition unit that allows the bot to participate in the business negotiation as a participant when consent is obtained from the participant, and acquires a recorded business negotiation video of the business negotiation; a conversion unit that converts audio information related to speeches of participants in the business negotiation into text information based on the acquired business negotiation video; an output unit that outputs the converted text information; Equipped with Disallowing the bot from participating in the business meeting if consent is not obtained from the participant; Server device.

Images