Meeting evaluation device, meeting evaluation program, and meeting evaluation method

Abstract

To make an evaluation on a conference.SOLUTION: A conference evaluation system configured to make an evaluation on a conference includes: a basic information acquisition unit for acquiring basic information including at least an agenda of the conference and information on participants from a user; a classification unit for classifying a portion of text information associated with the participant who speaks based on voice information in the conference into an agenda of discussion performed in the portion of the text information and properties of the discussion; and an evaluation unit for evaluating the participant based on information on the amount of speech of the participant in the portion of the text information related to a specific agenda or properties.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a meeting evaluation device, a meeting evaluation program, and a meeting evaluation method. [Background technology]

[0002] Techniques for evaluating meetings are disclosed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6872821 Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, a questionnaire about a meeting is conducted, and the meeting is evaluated based on the responses. It is said that it can present items for improving meetings to users. This technology evaluates meetings based on users' subjective responses to a questionnaire, so In addition, the meeting participants were not able to evaluate each other and provide improvement items based on an objective evaluation of the participants. They have not been able to evaluate the meetings and present any improvement items aimed at improving them.

[0005] The present invention has been made in view of the above background, and aims to provide objectivity to evaluations of meetings. The aim is to provide technology that will help improve meetings. [Means for solving the problem]

[0006] In order to solve the above problem, a meeting evaluation device according to the present disclosure for evaluating meetings includes: A method for acquiring basic information including at least the agenda and participant information of the meeting from a user. This information acquisition unit and the participant who spoke based on the voice information in the conference are linked. the portion of text information that has been collected, according to the topic of the discussion that took place in the portion and the nature of the discussion. a classification unit for classifying a portion of the text information relating to a particular topic or property; and an evaluation unit that evaluates the participants based on information about the amount of speech of the participants in the meeting.

[0007] Other problems and solutions disclosed in this application are described in the embodiments and drawings. will be more clearly revealed. [Effects of the Invention]

[0008] According to the present invention, it is possible to evaluate a meeting and support improvement of the meeting. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of an evaluation system according to an embodiment of the present invention. [Figure 2] 2 is a diagram illustrating an example of a hardware configuration of a server device 1 according to the embodiment. FIG. [Figure 3] 2 is a diagram illustrating an example of a functional configuration of a server device 1 according to the embodiment. FIG. [Figure 4] 10 is a diagram showing an example of basic information stored in a basic information storage unit 131. FIG. [Figure 5] 10 is a diagram showing an example of basic information stored in a conference information storage unit 132. FIG. [Figure 6] FIG. 10 is a diagram illustrating an example of processing performed by the server device 1 according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Summary of the Invention> [Item 1] A meeting evaluation device for evaluating a meeting, Obtain basic information from the user, including at least the agenda and participant information for the meeting. a basic information acquisition unit; Text information linked to the participants who spoke based on the audio information from the meeting a classification section for classifying the sections into the topic of the discussion held in the section and the nature of the discussion; and, the participants' names in the portions of the text information that relate to the particular topic or nature of the meeting; an evaluation unit that evaluates the participants based on information about the amount of comments; A meeting evaluation device comprising: [Item 2] The evaluation unit further divides the part into predetermined sections, and evaluates the comments of the participants in the sections. evaluating the participant based on the amount of information; Item 1. A meeting evaluation device according to item 1. [Item 3] A meeting evaluation device for evaluating a meeting, A basic information acquisition method for acquiring basic information including at least an agenda and information of participants of the meeting. Tokube and Text information linked to the participants who spoke based on the audio information from the meeting a classification section for classifying the sections into the topic of the discussion held in the section and the nature of the discussion; and, Based on the degree to which the above agenda items fulfill the basic agenda items included in the Corporate Governance Code, an evaluation department that evaluates the meeting; A meeting evaluation device comprising: [Item 4] The evaluation unit evaluates the participants' opinions in the part of the text information related to the particular topic. Evaluating the meeting based on information on the amount of speech; Item 4. The meeting evaluation device according to item 3, [Item 5] The topics that are included in the general agenda but are not included in the agenda will be displayed to the user at the next meeting. A section that presents improvement proposals as meeting agenda items; 5. The meeting evaluation device according to item 3 or 4, comprising: [Item 6] A meeting evaluation program for evaluating meetings, The processor Obtain basic information from the user, including at least the agenda and participant information for the meeting. Basic information acquisition step, Text information linked to the participants who spoke based on the audio information from the meeting a classification scheme for classifying the sections into the topic of discussion held in the section and the nature of the discussion; Tep and the participants' names in the portions of the text information that relate to the particular topic or nature of the meeting; an evaluation step of evaluating the participants based on information on the amount of speech; A meeting evaluation program that implements the following: [Item 7] A meeting evaluation method for evaluating a meeting, comprising: The processor: Obtain basic information from the user, including at least the agenda and participant information for the meeting. Basic information acquisition step, Text information linked to the participants who spoke based on the audio information from the meeting a classification scheme for classifying the sections into the topic of discussion held in the section and the nature of the discussion; Tep and the participants' names in the portions of the text information that relate to the particular topic or nature of the meeting; an evaluation step of evaluating the participants based on information on the amount of speech; Implement a meeting evaluation program.

[0011] FIG. 1 is a diagram showing an example of the overall configuration of a meeting evaluation system according to an embodiment of the present invention. The meeting evaluation system of the embodiment includes a server device 1. The server device 1 The communication network 2 is connected to the user terminal 3 so as to be able to communicate with the user terminal 3. For example, the Internet is a public telephone network, a mobile phone network, a wireless communication channel, It is constructed using technologies such as Ethernet (registered trademark).

[0012] ==Server device 1== The server device 1 is a general-purpose computer such as a workstation or a personal computer. It can be implemented as a computer or logically through cloud computing. In this embodiment, for the sake of convenience, one device is illustrated, but the number of devices is not limited to this. The number of the devices is not limited, and multiple devices may be used.

[0013] ==User terminal 3== The user terminal 3 is a computer operated by a user who uses the device according to the present disclosure. For example, smartphones, tablet computers, personal computers, etc. The user may use an application or a web browser running on the user terminal 3. The server device 1 can be accessed.

[0014] FIG. 2 is a diagram illustrating an example of the hardware configuration of the server device 1. The illustrated configuration is This is just an example, and the server device 1 may have other configurations. 102, storage device 103, communication interface 104, input device 105, output device 10 The storage device 103 stores various data and programs. These include disk drives, solid state drives, and flash memory. The interface 104 is an interface for connecting to the communication network 2, for example. Adapter for connecting to Ethernet (registered trademark), adapter for connecting to the public telephone line network Modem, wireless communication device for wireless communication, USB (Universal Serial Bus) for serial communication Serial Bus (RS232C) connectors and RS232C connectors. 105 is a device for inputting data, such as a keyboard, mouse, touch panel, button, microphone, etc. The output device 106 is a device that outputs data, such as a display or a processor. The various functional units of the server device 1, which will be described later, are controlled by the CPU 101. The program stored in the storage device 103 is read into the memory 102 and executed. Each storage unit of the server device 10 is realized by the memory 102 and the storage device 103. It is implemented as part of the storage area.

[0015] 3 shows the functional configuration of the server device 1. As shown in FIG. , the basic information storage unit 131, the conference information storage unit 132, and the basic information acquisition unit 1 11, a conference information acquisition unit 112, a voice analysis unit 113, a classification unit 114, and an evaluation unit 115. and an improvement measure presentation unit 116.

[0016] The basic information storage unit 131 and the conference information storage unit 132 will be described below.

[0017] The basic information storage unit 131 stores basic information about a conference, as shown in an example in FIG. Basic information includes, for example, questionnaires, interviews, and summaries (date, time, participants, location, etc.) This includes information such as the meeting schedule, agenda, meeting materials, and advance preparation information (person in charge, required time).

[0018] The conference information storage unit 132 stores information during a conference, as shown in an example in FIG. For example, the information may include audio from a meeting, video containing audio, minutes, and text that has been converted from audio information. This includes information such as the text information, the time the meeting took place, etc.

[0019] The following describes a basic information acquisition unit 111, a conference information acquisition unit 112, a voice analysis unit 113, and a classification unit. The processing units of the processing unit 114, the evaluation unit 115, and the improvement measure suggestion unit 116 will be described below.

[0020] As an example, the basic information acquisition unit 111 receives the following from the user terminal 3 via the network 2: The basic information is acquired and stored in the basic information storage unit 131. The communication for the transmission and reception is performed by wired communication. Any communication protocol can be used as long as communication between the two parties is possible. A protocol may be used.

[0021] For example, the conference information acquisition unit 112 receives the following from the user terminal 3 via the network 2: The conference information is acquired and stored in the conference information storage unit 132. The communication for the transmission and reception is performed by wired communication. Any communication protocol can be used as long as communication between the two parties is possible. A protocol may be used.

[0022] For example, the audio analysis unit 113 analyzes the telephone call including the audio stored in the conference information storage unit 132. The child file is analyzed, converted into text information, and stored in the conference information storage unit 132. The text can be generated using existing voice recognition technology, and details are omitted here.

[0023] In addition, voice recognition technology may be used to convert voice input into text in real time. In this case, the voice analysis unit 113 receives input of voice information, converts it into text, and then outputs the conference information. The information may be stored in the information storage unit 132.

[0024] The voice analysis unit 113 associates the participants with text information and determines which text information It may also be possible to store whether the message was spoken by a participant. Furthermore, the voice analysis unit 113 can analyze the speech of different participants for each text. After identifying which participants will be speaking, the information is presented to the user terminal 3, and the user can then select which participant will be speaking. It is also possible to accept input as to whether the text information corresponds to the participant.

[0025] The classification unit 114 classifies the above-mentioned text information of the conference voice according to a predetermined rule. The unit 114 classifies the text information along at least the following two axes, and stores the classification information in the classification information storage unit 133 In addition, the classification unit 114 may extract parts of the text information and classify them. good.

[0026] The first axis that the classification unit 114 classifies is the subject of discussion, for example, the interpretation of text information. The text information is analyzed and analyzed on the organization, performance, finance, SDGs, succession planning, business execution, and group Analyze and classify the category of management issues such as governance and stakeholders The classification unit 114 classifies each of the prepared topics into which the topic belongs. It also acquires information about whether the agenda will be started or not, and indicates the beginning of the agenda, such as "We will start with the first agenda item." Text information indicating the end of the agenda, such as "The first agenda item is now closed." From the information, divide the text information into parts, and each part of the text information is related to which part of the topic. It is also possible to classify the product by determining whether it falls under any of the above categories.

[0027] Another axis that the classification unit 114 uses to classify is the nature of the discussion. For example, They are classified into categories such as matters for resolution, matters for discussion, and casual conversation.

[0028] The classification unit 114 may classify the text information using, for example, natural language processing. 14 is a method called k-nearest neighbor method, which is used to classify texts whose contents are similar to those of the text to be classified. Similar texts are collected, and the categories to which many of the collected texts belong are identified as the target texts. The classification unit 114 may classify the data into the category of the target data. For example, the probability of occurrence of words contained in text belonging to each category and the probability of occurrence of words in the text to be analyzed are By calculating the probability of occurrence of words and calculating their ratio, it is possible to identify each text belonging to each category. It finds words with different abilities and classifies them into categories based on information such as the number of occurrences of the words. The classification unit 114 may also store text information and a category into which a person would like to classify the text. Using the classified information as training data, a category prediction model is generated by machine learning, and the relevant The text to be classified is input as input information to the prediction model, and the category is output. An example of the classification method of the classification unit 114 has been described above, but the classification method is the same as that described above. The present invention is not limited to the above-mentioned methods.

[0029] The evaluation unit 115 evaluates the participants of the conference. For example, the evaluation unit 115 evaluates the comments of each participant. The evaluation unit 115 evaluates the participants based on the amount of The participants were evaluated for their speaking volume and were ranked as high, low, or average. The evaluation unit 115 evaluates the text information in which the speaker is specified. The number of characters in the comment information can be counted and the participants can be evaluated based on the number of characters. The evaluation unit 115 identifies the speaker from the original voice information by voice analysis, and The time is calculated by adding the time spent speaking and the time spent speaking. , and evaluate the participants.

[0030] Furthermore, the evaluation unit 115 evaluates the following based on the text information classified by the classification unit 114 according to the nature of the discussion: The participants of the conference may be rated. For example, the rating unit 115 may rate the participants of the conference based on the discussions categorized into specific characteristics. The evaluation unit 115 evaluates the participants based on the amount of comments made by the participants. In the part of the text information that the classification unit 114 classifies as "resolution matters," Participants should be highly rated.

[0031] In addition, the evaluation unit 115 may, for example, evaluate the discussions classified into specific characteristics. Intervals (the total length of time can be divided into arbitrary periods, such as the first half, second half, opening, middle, and closing The participants are divided into groups based on the amount of speech they made during a given time period. The evaluation unit 115 may evaluate the participants in the discussions. In the text information section, participants who speak a lot in the first half of the discussion may be given a higher evaluation. In addition, the evaluation unit 115 may, for example, classify the text information classified as "resolution items" by the classification unit 114. In the presentation section, participants who speak a lot towards the end should be highly evaluated.

[0032] Furthermore, the evaluation unit 115 may be configured to, for example, determine whether or not a comment affects the amount of comments made by other participants after the comment made by the user. After Participant A spoke, other participants spoke more or less. If this is the case, participant A may be given a high rating.

[0033] The evaluation unit 115 may evaluate the discussion. If there are no participants who do not speak or who speak less than the required amount, the discussion will be highly evaluated. The evaluation can be done for the entire meeting, for each agenda item, or for the nature of the discussion (resolutions, etc.). It may be, but is not limited to these.

[0034] The evaluation unit 115 also determines whether a discussion classified into a specific topic has been held for a predetermined length of time. For example, if a topic is categorized as a topic and the discussion is within 3 minutes (text), Discussions may be downgraded if they do not meet a certain length, such as 200 characters or less. stomach.

[0035] The evaluation department 115 will evaluate the company based on the degree of deviation from the principles set out in the Corporate Governance Code. The Corporate Governance Code in this disclosure refers to the Corporate Governance Code established by Tokyo Stock Exchange Co., Ltd. The stock exchange states that "a company should take into consideration the positions of shareholders, customers, employees, local communities, etc., This is a mechanism for transparent, fair, swift and decisive decision-making. For details, please refer to the company's website.

[0036] The Corporate Governance Code discloses the principles of the roles and responsibilities of the Board of Directors. For example, corporate governance includes the principles of agenda items to be discussed at board meetings. The evaluation unit 115 evaluates the agenda information included in the basic information and the principle agenda. If there are any items that are included in the agenda but are not included in the general agenda, Just rate the meeting poorly.

[0037] The evaluation unit 115 determines whether the agenda includes a general topic from the text information included in the meeting information. Even if a topic is included in the agenda, if the discussion time falls below the allotted time, or if a topic is raised during the discussion, If the number of speakers is less than a predetermined number, the meeting can be rated low. 15. If the discussion time for the topic exceeds the allotted time, or if the speaker during the topic If the number of participants is greater than the predetermined number, the meeting can be rated highly.

[0038] The improvement plan presentation section 116 proposes improvements for the next meeting based on the evaluation made by the evaluation section 115. For example, the improvement measure presenting unit 116 presents the names of participants who have made fewer comments to the user. The improvement plan presenting unit 116 may present the topic with few speakers to the user. In addition, the improvement proposal proposal unit 116 may propose a method for proposing an improvement proposal if the discussion time is shorter than a predetermined time. An agenda may be presented to the user.

[0039] In addition, the improvement plan presentation unit 116 is responsible for the matters included in the principle agenda of the Corporate Governance Code. Among the topics, the topics that are not on the agenda of the current meeting can be proposed to the user as topics for the next meeting. It may be shown.

[0040] FIG. 6 is a diagram illustrating an example of the processing of the meeting evaluation device of this embodiment.

[0041] The server device 1 acquires basic information from the user (1001). The server device 1 acquires information (meeting information) (1002). The server device 1 analyzes the voice information and The server device 1 classifies the text information (1004). The server device 1 evaluates the conference (1005). The server device 1 proposes measures to improve the conference. (1006).

[0042] The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings. The technical scope of the disclosure is not limited to such examples. Any person who wishes to make such a modification may make various modifications within the scope of the technical idea described in the claims. It is apparent that various modifications and variations are possible, which are within the scope of the present disclosure. It is understood to be within the scope of science.

[0043] The devices described herein may be implemented as stand-alone devices, or may be implemented in part or in whole as The part is realized by multiple devices (e.g., cloud servers) connected via a network. For example, the CPU and the storage device of the server device 1 are connected to each other via a network. The server may be implemented by different servers.

[0044] The series of processes performed by the apparatus described in this specification may be implemented by software, hardware, and This implementation may be implemented using either software or a combination of software and hardware. A computer program for realizing each function of the server device 1 according to the embodiment is created, and It is possible to implement it in C, etc. Also, such a computer program can be stored In addition, a computer-readable recording medium can also be provided. Examples include magnetic disks, optical disks, magneto-optical disks, flash memory, etc. The computer program is distributed, for example, via a network, without using a recording medium. This may be done.

[0045] Additionally, the processes described herein do not necessarily have to be performed in the order described. Some processing steps may be performed in parallel, and additional processing steps may be performed in parallel. A step may be adopted, and some processing steps may be omitted.

[0046] Furthermore, the effects described in this specification are merely illustrative or exemplary and are not limiting. In other words, the technology according to the present disclosure has the above-mentioned effects in addition to or instead of the above-mentioned effects. In addition, other effects that will be apparent to those skilled in the art from the description of this specification may be achieved. [Explanation of symbols]

[0047] 1. Server device 2 Network 3. User terminal 101 CPU 102 memory 103 Storage device 104 Communication Interface 105 Input Device 106 Output Device 111 Basic information acquisition department 112 Conference Information Acquisition Unit 113 Audio Analysis Unit 114 Classification Department 115 Evaluation Department 116 Improvement plan presentation department 131 Basic information storage section 132 Conference information storage unit

Claims

1. A meeting evaluation device for evaluating a meeting, an evaluation unit that evaluates the participants based on information about the amount of speech of the participants acquired based on audio information in the conference; an improvement proposal unit that identifies the participant whose speech volume is below a predetermined standard in the evaluation by the evaluation unit and proposes an improvement proposal for the next conference; Equipped with the evaluation unit classifies text information based on the voice information according to the nature of the discussion, and evaluates the participants by placing emphasis on the amount of speech in different time segments according to the classified nature. Meeting evaluation device.

2. The evaluation unit emphasizes the amount of speech in the first half of a discussion classified as an agenda item, and emphasizes the amount of speech in the final half of a discussion classified as a resolution item. The meeting evaluation device according to claim 1 .

3. The evaluation unit acquires information on the amount of speech of the participant based on the number of characters in text information in which the speaker is identified or the duration of speech, which is based on the audio information. The meeting evaluation device according to claim 1 or 2.

4. The evaluation unit gives a low rating to a discussion that is less than a predetermined length or has less than a predetermined number of participants. The meeting evaluation device according to claim 1 or 2.

5. the improvement measure presentation unit presents at least one of the names of participants who have made few comments, agenda items on which few people have made comments, and agenda items on which the discussion time has been shorter than a predetermined time; The meeting evaluation device according to claim 1 .

6. the evaluation unit evaluates the conference based on at least one of the discussion time for each agenda item, the number of speakers for each agenda item, and the amount of speech for each participant; The meeting evaluation device according to claim 1 .

7. The evaluation unit evaluates the discussion time and the number of speakers as low when the values ​​are below a predetermined standard, and as high when the values ​​are above a predetermined standard. The meeting evaluation device according to claim 6 .

8. A meeting evaluation program for evaluating meetings, The processor an evaluation step of evaluating the participants based on information on the amount of speech of the participants based on audio information in the conference; an improvement measure suggesting step of identifying the participant whose speech volume is below a predetermined standard in the evaluation by the evaluation step and suggesting an improvement measure for the next conference; Execute The evaluation step classifies text information based on the voice information according to the nature of the discussion, and evaluates the participants by emphasizing the amount of speech in different time segments according to the classified nature. Conference Evaluation Program.

9. A meeting evaluation method for evaluating a meeting, comprising: The processor: an evaluation step of evaluating the participants based on information on the amount of speech of the participants based on audio information in the conference; an improvement measure suggesting step of identifying the participant whose speech volume is below a predetermined standard in the evaluation by the evaluation step and suggesting an improvement measure for the next conference; Run The evaluation step classifies text information based on the voice information according to the nature of the discussion, and evaluates the participants by emphasizing the amount of speech in different time segments according to the classified nature. Meeting evaluation methods.

Images