Meeting evaluation device, meeting evaluation program, and meeting evaluation method

Abstract

To provide a conference evaluation device, a conference evaluation program, and a conference evaluation method for evaluating a conference and supporting improvement of the conference.SOLUTION: In an evaluation system in which a server device and a user terminal are communicably connected via a communication network, the server device 1 that is a conference evaluation device for evaluating a conference includes: a basic information acquisition unit for acquiring basic information including at least an agenda of the conference and information on participants from a user; a classification unit for classifying a portion of text information associated with the participant who speaks based on voice information in the conference into an agenda of discussion performed in the portion of the text information and properties of the discussion; and an evaluation unit for evaluating the participant based on information on a speech amount of the participant in the portion of the text information related to a specific agenda or properties.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a meeting evaluation device, a meeting evaluation program, and a meeting evaluation method. [Background technology]

[0002] Techniques for evaluating meetings are disclosed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6872821 Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 discloses that a questionnaire about a meeting is conducted, the meeting is evaluated based on the responses, and items for improving the meeting are presented to the user. However, this technology evaluates the meeting based on the user's subjective responses to the questionnaire, and therefore it is not possible to present improvement items based on an objective evaluation of the meeting. Furthermore, it is not possible to evaluate each participant in the meeting and present improvement items aimed at improving the meeting.

[0005] The present invention has been made in view of the above background, and aims to provide a technique for providing objectivity in evaluation of meetings and supporting improvement of meetings. [Means for solving the problem]

[0006] In order to solve the above problems, the conference evaluation device disclosed herein, which evaluates conferences, includes a basic information acquisition unit that acquires basic information from a user, including at least the agenda of the conference and information about the participants; a classification unit that classifies portions of text information linked to the participants who spoke, based on audio information from the conference, into the agenda of the discussion that took place in that portion and the nature of the discussion; and an evaluation unit that evaluates the participants based on information about the amount of speech made by the participants in the portions of the text information related to a specific agenda or the nature.

[0007] Other problems and solutions disclosed in this application will be made clear in the section on preferred embodiments of the invention and the drawings. [Effects of the Invention]

[0008] According to the present invention, it is possible to evaluate a meeting and support improvement of the meeting. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of an evaluation system according to an embodiment of the present invention. [Figure 2] 2 is a diagram illustrating an example of a hardware configuration of a server device 1 according to the embodiment. FIG. [Figure 3] 2 is a diagram illustrating an example of a functional configuration of a server device 1 according to the embodiment. FIG. [Figure 4] 10 is a diagram showing an example of basic information stored in a basic information storage unit 131. FIG. [Figure 5] 10 is a diagram showing an example of basic information stored in a conference information storage unit 132. FIG. [Figure 6] FIG. 10 is a diagram illustrating an example of processing performed by the server device 1 according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Summary of the Invention> [Item 1] A meeting evaluation device for evaluating a meeting, a basic information acquisition unit that acquires basic information including at least an agenda and participant information of the conference from a user; A classification unit that classifies a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation unit that evaluates the participants based on information about the amount of speech of the participants in the portion of the text information related to the specific topic or the property; A meeting evaluation device comprising: [Item 2] the evaluation unit further divides the portion into predetermined sections and evaluates the participants based on information on the amount of speech of the participants in each section; Item 1. A meeting evaluation device according to item 1. [Item 3] A meeting evaluation device for evaluating a meeting, a basic information acquisition unit that acquires basic information including at least the agenda and information of participants of the meeting; A classification unit that classifies a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation department that evaluates the meeting based on the degree to which the agenda satisfies the basic agenda items included in the Corporate Governance Code; A meeting evaluation device comprising: [Item 4] the evaluation unit evaluates the conference based on information on the amount of speech of the participants in a portion of the text information related to a specific agenda item; Item 4. The meeting evaluation device according to item 3, [Item 5] an improvement proposal presenting unit that presents to the user an agenda item that is included in the general agenda but not included in the agenda item as an agenda item for the next meeting; 5. The meeting evaluation device according to item 3 or 4, comprising: [Item 6] A meeting evaluation program for evaluating meetings, The processor a basic information acquisition step of acquiring basic information including at least an agenda and participant information of the meeting from a user; A classification step of classifying a portion of text information associated with the participant who spoke based on the audio information in the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation step of evaluating the participants based on information on the amount of speech of the participants in the portion of the text information related to the specific topic or the property; A meeting evaluation program that implements the following: [Item 7] A meeting evaluation method for evaluating a meeting, comprising: The processor: a basic information acquisition step of acquiring basic information including at least an agenda and participant information of the meeting from a user; A classification step of classifying a portion of text information associated with the participant who spoke based on the audio information in the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation step of evaluating the participants based on information on the amount of speech of the participants in the portion of the text information related to the specific topic or the property; Implement a meeting evaluation program.

[0011] 1 is a diagram showing an example of the overall configuration of a meeting evaluation system according to one embodiment of the present invention. The meeting evaluation system of this embodiment includes a server device 1. The server device 1 is communicably connected to a user terminal 3 via a communication network 2. The communication network 2 is, for example, the Internet, and is constructed using a public telephone network, a mobile phone network, a wireless communication path, Ethernet (registered trademark), or the like.

[0012] ==Server device 1== The server device 1 may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing. In this embodiment, for convenience of explanation, one server device is illustrated as an example, but this is not limited to this and multiple servers may be used.

[0013] ==User terminal 3== The user terminal 3 is a computer operated by a user who uses the device according to the present disclosure. For example, it is a smartphone, a tablet computer, a personal computer, etc. The user can access the server device 1 using, for example, an application or a web browser running on the user terminal 3.

[0014] FIG. 2 is a diagram illustrating an example of the hardware configuration of the server device 1. Note that the illustrated configuration is an example, and other configurations may also be used. The server device 1 includes a CPU 101, a memory 102, a storage device 103, a communication interface 104, an input device 105, and an output device 106. The storage device 103 stores various data and programs, and is, for example, a hard disk drive, a solid state drive, or a flash memory. The communication interface 104 is an interface for connecting to the communication network 2, and is, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, a USB (Universal Serial Bus) connector or an RS232C connector for serial communication, etc. The input device 105 is, for example, a keyboard, a mouse, a touch panel, a button, a microphone, etc. for inputting data. The output device 106 is, for example, a display, a printer, a speaker, etc. for outputting data. Each functional unit of the server device 1, which will be described later, is realized by the CPU 101 reading a program stored in the storage device 103 into the memory 102 and executing it, and each storage unit of the server device 10 is realized as part of the storage area provided by the memory 102 and the storage device 103.

[0015] Fig. 3 shows the functional configuration of the server device 1. As shown in Fig. 3, the server device 1 includes storage units, namely, a basic information storage unit 131 and a conference information storage unit 132, and processing units, namely, a basic information acquisition unit 111, a conference information acquisition unit 112, a voice analysis unit 113, a classification unit 114, an evaluation unit 115, and an improvement measure presentation unit 116.

[0016] The basic information storage unit 131 and the conference information storage unit 132 will be described below.

[0017] The basic information storage unit 131 stores basic information about a conference, as shown in Fig. 4. The basic information includes, for example, a questionnaire, an interview, an outline (date, time, participants, location, agenda, etc.), conference materials, advance preparation information (person in charge, required time), etc.

[0018] The conference information storage unit 132 stores information during a conference, as shown in Fig. 5. The conference information includes, for example, the audio of the conference, video including the audio, minutes, text information obtained by converting the audio information into text, the time the conference was held, and other information.

[0019] The processing units of the basic information acquisition unit 111, the conference information acquisition unit 112, the voice analysis unit 113, the classification unit 114, the evaluation unit 115, and the improvement measure presentation unit 116 will be described below.

[0020] As an example, the basic information acquisition unit 111 acquires basic information from the user terminal 3 via the network 2 and stores it in the basic information storage unit 131. The communication in the transmission and reception may be either wired or wireless, and any communication protocol may be used as long as the communication between the two devices is possible.

[0021] For example, the conference information acquisition unit 112 acquires conference information from the user terminal 3 via the network 2 and stores it in the conference information storage unit 132. The communication in the transmission and reception may be either wired or wireless, and any communication protocol may be used as long as the communication between the two parties is possible.

[0022] As an example, the voice analysis unit 113 analyzes an electronic file containing voice stored in the conference information storage unit 132, converts it into text information, and stores it in the conference information storage unit 132. The voice information can be converted into text using existing voice recognition technology, and details thereof will be omitted.

[0023] In addition, a voice recognition technology that converts input voice into text in real time may be used. In this case, the voice analysis unit 113 accepts input of voice information, converts it into text, and stores it in the conference information storage unit 132.

[0024] The voice analysis unit 113 may associate participants with text information and also store which text information was spoken by which participant. Existing technology may be used to identify the speaker. The voice analysis unit 113 may also identify that a different participant has spoken for each piece of text, present the identified participant on the user terminal 3, and accept input from the user as to which participant each speaker corresponds to, thereby associating the participants with the text information.

[0025] The classification unit 114 classifies the text information of the above-mentioned conference voice according to a predetermined rule. The classification unit 114 classifies the text information along at least the following two axes, and stores the result in the classified information storage unit 133. The classification unit 114 may also extract parts of the text information and classify each part.

[0026] The first axis along which the classification unit 114 classifies is the subject of discussion, and for example, the classification unit 114 analyzes text information and analyzes and classifies it to which category of management issues such as organization, performance, finance, SDGs, succession planning, business execution, group governance, and stakeholders the text information belongs to. Note that the classification unit 114 may also acquire information on which of the issues each of the pre-prepared agenda items belongs to, divide the text information into parts based on text information that indicates the beginning of an agenda item, such as "We will begin agenda item 1," or text information that indicates the end of an agenda item, such as "We will conclude agenda item 1," and classify each part of the text information by determining which of the agenda items it belongs to.

[0027] The other axis along which the classification unit 114 classifies is the nature of the discussion, which is classified into, for example, matters to be reported, matters to be resolved, matters to be discussed, and casual conversation.

[0028] The classification unit 114 may classify text information using, for example, natural language processing. The classification unit 114 may use, for example, a method called k-nearest neighbor classification, which collects texts similar in content to the text to be classified and classifies the category to which many of the collected texts belong as the category of the text to be classified. Alternatively, the classification unit 114 may find words with high discriminative ability for each text in each category by calculating the occurrence probability of words contained in texts belonging to each category and the occurrence probability of words in the text to be analyzed, and then classify the text into each category based on information such as the number of occurrences of the words. Alternatively, the classification unit 114 may generate a category prediction model using machine learning using text information and information on which category the text was manually classified as training data, input the text to be classified as input information to the prediction model, and output a category. While an example of the classification method of the classification unit 114 has been described above, the classification method is not limited to the above-described method.

[0029] The evaluation unit 115 evaluates the participants of the conference. The evaluation unit 115 evaluates the participants based on, for example, the amount of speech each participant makes. As an example, the evaluation unit 115 evaluates the amount of speech each participant makes in the text information, and highly evaluates participants who make a large, small, or average amount of speech. The evaluation unit 115 may count the number of characters in the text information in which a speaker is identified, and evaluate the participants using the number of characters as the amount of speech. Alternatively, the evaluation unit 115 may identify speakers from the original audio information by audio analysis, calculate the speaking time by adding up the speaking time for each speaker, and evaluate the participants based on the information on the speaking time.

[0030] Furthermore, the evaluation unit 115 may evaluate the participants of the conference based on the text information classified by the classification unit 114 according to the nature of the discussion. For example, the evaluation unit 115 evaluates the participants based on the amount of speech a participant makes in a discussion classified into a specific nature. For example, the evaluation unit 115 may highly evaluate a participant who makes a large amount of speech in the part of the text information classified by the classification unit 114 as "resolutions."

[0031] Furthermore, for example, in a discussion classified as having a specific nature, the evaluation unit 115 may divide the discussion into time periods (which may be any unit that divides the overall length into any time periods, such as the first half, the second half, or the beginning, middle, and end), and evaluate the participants based on the amount of speech that each participant makes during a given time period. The evaluation unit 115 may highly evaluate a participant who makes a lot of speech during the first half of a discussion in the portion of text information classified by the classification unit 114 as "matters to be discussed." The evaluation unit 115 may highly evaluate a participant who makes a lot of speech during the final portion of text information classified by the classification unit 114 as "matters to be resolved."

[0032] Furthermore, the evaluation unit 115 may evaluate a participant who has influenced the amount of speech made by other participants after the participant's own speech. If the number of speeches made by other participants increases or decreases after participant A's speech, the evaluation unit 115 may highly evaluate participant A.

[0033] The evaluation unit 115 may evaluate the discussion. Based on the text information, the evaluation unit 115 may evaluate the discussion highly if there are no participants who are not expressive or who speak less than a predetermined amount. The evaluation target may be the entire conference, each agenda item, or the nature of the discussion (resolutions, etc.), but is not limited to these.

[0034] The evaluation unit 115 may also evaluate a discussion based on whether the discussion classified under a specific topic lasted for a predetermined length. For example, if the discussion classified under a certain topic is less than a predetermined length, such as less than three minutes (the number of text characters is, for example, 200 characters or less), the evaluation unit 115 may evaluate the discussion low.

[0035] The evaluation unit 115 may evaluate the meeting based on the degree of deviation from the principles set forth in the Corporate Governance Code. The Corporate Governance Code in this disclosure is a code published by the Tokyo Stock Exchange, Inc. as "a system for companies to make transparent, fair, prompt, and decisive decisions while taking into account the positions of shareholders, customers, employees, local communities, etc." For details, please refer to the company's website, etc.

[0036] The Corporate Governance Code discloses principles as the roles and responsibilities of the board of directors. For example, the Corporate Governance Code lists the basic agenda items to be discussed at board meetings. The evaluation unit 115 compares the agenda information included in the basic information with the basic agenda items, and if there is an agenda item that is included in the basic agenda items but not included in the agenda, it can evaluate the meeting low.

[0037] The evaluation unit 115 may evaluate a meeting low if, based on text information included in the meeting information, the agenda includes a principle topic, but the discussion time is shorter than a predetermined time, or the number of speakers during that topic is less than a predetermined number, etc. Conversely, the evaluation unit 115 may evaluate a meeting high if the discussion time for that topic exceeds a predetermined time, or the number of speakers during that topic is more than a predetermined number, etc.

[0038] The improvement measure presentation unit 116 presents an improvement measure for the next meeting based on the evaluation performed by the evaluation unit 115. For example, the improvement measure presentation unit 116 may present to the user the names of participants who have made few comments. The improvement measure presentation unit 116 may also present to the user agenda items on which few people have spoken. The improvement measure presentation unit 116 may also present to the user agenda items on which the discussion time was shorter than a predetermined time.

[0039] Furthermore, the improvement measure presenting unit 116 may present to the user, as an agenda item for the next meeting, an agenda item that is not on the agenda of the current meeting among the agenda items included in the principle agenda items of the Corporate Governance Code.

[0040] FIG. 6 is a diagram illustrating an example of the processing of the meeting evaluation device of this embodiment.

[0041] The server device 1 acquires basic information from the user (1001). The server device 1 acquires conference information (conference information) (1002). The server device 1 analyzes the audio information and converts it into text information (1003). The server device 1 classifies the text information (1004). The server device 1 evaluates the conference (1005). The server device 1 presents measures to improve the conference (1006).

[0042] Although the preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical idea described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0043] The devices described in this specification may be realized as a single device, or may be realized by a plurality of devices (e.g., cloud servers) partly or entirely connected via a network. For example, the CPU and storage device of the server device 1 may be realized by different servers connected to each other via a network.

[0044] The series of processes performed by the device described herein may be implemented using software, hardware, or a combination of software and hardware. A computer program for implementing each function of the server device 1 according to this embodiment may be created and installed on a PC or the like. A computer-readable recording medium storing such a computer program may also be provided. Examples of the recording medium include a magnetic disk, an optical disk, a magneto-optical disk, and a flash memory. The computer program may also be distributed, for example, via a network, without using a recording medium.

[0045] Additionally, the processes described herein do not necessarily have to be performed in the order described, some process steps may be performed in parallel, additional process steps may be employed, and some process steps may be omitted.

[0046] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects. [Explanation of symbols]

[0047] 1. Server device 2 Network 3. User terminal 101 CPU 102 memory 103 Storage device 104 Communication Interface 105 Input Device 106 Output Device 111 Basic information acquisition department 112 Conference Information Acquisition Unit 113 Audio Analysis Unit 114 Classification Department 115 Evaluation Department 116 Improvement plan presentation department 131 Basic information storage section 132 Conference information storage unit

Claims

1. A meeting evaluation device for evaluating a meeting, a basic information acquisition unit that acquires basic information including at least an agenda and participant information of the conference from a user; A classification unit that classifies a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation unit that evaluates the participants based on information about the amount of speech of the participants in the portion of the text information related to the specific topic or the property; Equipped with the evaluation unit evaluates the participant based on a change in the amount of speech made by other participants after the participant makes a statement, and further divides the portion into time segments and evaluates the participant based on the amount of speech made in different time segments depending on the nature of the discussion; Meeting evaluation device.

2. the evaluation unit evaluates the participants by placing emphasis on the volume of comments in the first half of the time period in the portion classified as an agenda item, and by placing emphasis on the volume of comments in the final half of the time period in the portion classified as a resolution item. The meeting evaluation device according to claim 1 .

3. A meeting evaluation device for evaluating a meeting, a basic information acquisition unit that acquires basic information including at least the agenda and information of participants of the meeting; A classification unit that classifies a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation department that evaluates the meeting based on the degree to which the agenda items to be discussed at the board of directors, as set forth in the Corporate Governance Code, are met; Equipped with the evaluation unit evaluates the participant based on a change in the amount of speech made by other participants after the participant makes a statement related to the topic, and further divides the part into time segments and evaluates the participant based on the amount of speech made in different time segments depending on the nature of the discussion; Meeting evaluation device.

4. an improvement proposal presentation unit that presents, to the user who has acquired the basic information, a topic that is included in the agenda to be discussed at the board of directors meeting but is not included in the agenda, as an agenda for the next meeting; The meeting evaluation device of claim 3 , comprising:

5. A meeting evaluation program for evaluating meetings, The processor a basic information acquisition step of acquiring basic information including at least an agenda and participant information of the meeting from a user; A classification step of classifying a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation step of evaluating the participants based on information on the amount of speech of the participants in the portion of the text information related to the specific topic or the property; Equipped with the evaluation step evaluates the participant based on a change in the amount of speech made by other participants after the participant's speech, and further divides the part into time segments and evaluates the participant based on the amount of speech made in different time segments depending on the nature of the discussion; Conference Evaluation Program.

6. A meeting evaluation method for evaluating a meeting, comprising: The processor: a basic information acquisition step of acquiring basic information including at least an agenda and participant information of the meeting from a user; A classification step of classifying a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation step of evaluating the participants based on information on the amount of speech of the participants in the portion of the text information related to the specific topic or the property; Equipped with the evaluation step evaluates the participant based on a change in the amount of speech made by other participants after the participant's speech, and further divides the part into time segments and evaluates the participant based on the amount of speech made in different time segments depending on the nature of the discussion; Meeting evaluation methods.

7. A meeting evaluation program for evaluating meetings, The processor a basic information acquisition step of acquiring basic information including at least an agenda and information of participants of the meeting; A classification step of classifying a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation step of evaluating the meeting based on the degree to which the agenda items covered by the Corporate Governance Code are to be discussed at the board of directors meeting; Execute The evaluation step evaluates the participant based on a change in the amount of speech made by other participants after the participant makes a statement related to the topic, and further divides the part into time segments and evaluates the participant based on the amount of speech made in different time segments depending on the nature of the discussion. Conference Evaluation Program.

8. A meeting evaluation method for evaluating a meeting, comprising: The processor: a basic information acquisition step of acquiring basic information including at least an agenda and information of participants of the meeting; A classification step of classifying a portion of text information associated with the participant who spoke based on the audio information of the conference into the topic of the discussion held in the portion and the nature of the discussion; an evaluation step of evaluating the meeting based on the degree to which the agenda items covered by the Corporate Governance Code are to be discussed at the board of directors meeting; Run The evaluation step evaluates the participant based on a change in the amount of speech made by other participants after the participant makes a statement related to the topic, and further divides the part into time segments and evaluates the participant based on the amount of speech made in different time segments depending on the nature of the discussion. Meeting evaluation methods.

Images