Video meeting evaluation system and video meeting evaluation server

Abstract

[Problem] To evaluate moving images acquired during a video meeting, thereby evaluating the video meeting itself. To allow analysis results to be advantageously used. [Solution] A video meeting evaluation system according to the present disclosure comprises a video meeting service terminal that stores moving images acquired during a video meeting, and an evaluation terminal that implements an evaluation related to the video meeting, wherein the video meeting service terminal generates URL information for identifying the moving images stored, and the evaluation terminal acquires the moving images from the video meeting service terminal on the basis of the URL information provided, determines, once every predetermined number of frames, at least face images included in moving images of interest, and calculates an evaluation value related to the face images.

Description

[Technical field]

[0001] The present disclosure relates to a video meeting rating system and a video meeting rating server. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a system for teaching some knowledge online or for providing an explanation or the like (see, for example, Patent Document 1).

[0003] As a method for measuring the effectiveness of such online video meetings, for example, a method of conducting a questionnaire after the video meeting has been proposed (see, for example, Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-58625 A Summary of the Invention [Problem to be solved by the invention]

[0005] The above-mentioned method of measuring effectiveness through questionnaires tends to be subjective, and is insufficient as a method for objectively measuring the effectiveness of the content of video meetings.

[0006] Another option would be to have a third party monitor the video meeting and obtain an objective evaluation from the third party, but this would be too time-consuming and laborious to be practical.

[0007] Therefore, an object of the present invention is to objectively evaluate a video meeting, particularly with regard to its content. [Means for solving the problem]

[0008] According to the present invention, A video meeting evaluation system including: a video meeting service terminal that provides a video meeting to at least the first user terminal and the second user terminal and stores moving images acquired during the video meeting; and an evaluation terminal that evaluates the video meeting, the video meeting service terminal generates URL information for identifying the stored video image and provides the URL information to at least the first user terminal; the evaluation terminal acquires the moving image from the video meeting service terminal based on the URL information provided by the first user terminal, identifies at least a facial image included in the moving image for each predetermined frame, and calculates an evaluation value for the facial image; A video meeting evaluation system is obtained. Effect of the Invention

[0009] According to the present disclosure, by evaluating the video images of a video meeting, evaluation, particularly regarding the content, can be performed objectively. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an overall system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating a configuration example of a terminal according to the present embodiment. [Diagram 3] FIG. 2 is an example of a functional block diagram of an evaluation terminal according to the present embodiment. [Figure 4] FIG. 2 is a functional block diagram according to the present embodiment. [Diagram 5] FIG. 2 is a functional block diagram according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The contents of the embodiments of the present disclosure will be described below. The present disclosure has the following configuration. [Item 1] A video meeting evaluation system including: a video meeting service terminal that provides a video meeting to at least the first user terminal and the second user terminal and stores moving images acquired during the video meeting; and an evaluation terminal that evaluates the video meeting, the video meeting service terminal generates URL information for identifying the stored video image and provides the URL information to at least the first user terminal; the evaluation terminal acquires the moving image from the video meeting service terminal based on the URL information provided by the first user terminal, identifies at least a facial image included in the moving image for each predetermined frame, and calculates an evaluation value for the facial image; Video meeting evaluation system. [Item 2] Item 1. A video meeting evaluation system according to item 1, The evaluation terminal provides graph information of the evaluation value in time series. Video meeting evaluation system. [Item 3] The video meeting evaluation system according to item 1 or 2, the evaluation terminal calculates a plurality of evaluation values ​​by evaluating the face image from a plurality of different viewpoints; Video meeting evaluation system. [Item 4] A video meeting evaluation system according to any one of items 1 to 3, The evaluation terminal calculates the evaluation value together with the audio included in the moving image. Video meeting evaluation system. [Item 5] A video meeting evaluation system according to any one of items 1 to 4, the evaluation terminal calculates the evaluation value together with an object other than the face image included in the moving image; Video meeting evaluation system. [Item 6] A video meeting evaluation server that provides a video meeting to at least the first user terminal and the second user terminal and is communicably connected to a video meeting service terminal that stores a video image acquired by at least a first camera unit of the first user terminal or a second camera unit of the second user terminal, means for acquiring the moving image; A means for identifying at least a face image included in the moving image for each predetermined frame; means for calculating an evaluation value for the face image; A video meeting evaluation server comprising:

[0012] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.

[0013] <Basic functions>

[0014] The emotion analysis system of this embodiment is a system that analyzes the specific emotions (feelings caused by one's own or others' words or actions, such as pleasant or unpleasant, or the degree of such feelings) of an analysis target person among multiple people in an environment where the person is holding a video conference (hereinafter, both one-way and two-way sessions are referred to as online sessions) that differ from those of the other people.

[0015] An online session is, for example, an online conference, an online class, or an online chat, in which terminals installed in multiple locations are connected to a server via a communication network such as the Internet, allowing video images to be exchanged between the multiple terminals through the server.

[0016] The video handled in the online session includes facial images and voices of users using the terminals. The video also includes images of documents shared and viewed by multiple users. It is possible to switch between facial images and document images on the screen of each terminal and display only one of them, or to divide the display area and display both facial images and document images simultaneously. It is also possible to display an image of one of multiple users on the full screen, or to split the images of some or all users into small screens and display them.

[0017] It is possible to specify one or more of the multiple users who participate in the online session using a terminal as the analysis target. For example, the leader, facilitator, or manager of the online session (hereinafter collectively referred to as the organizer) specifies one of the users as the analysis target. The organizer of the online session may be, for example, a lecturer of an online class, a chairperson or facilitator of an online conference, or a coach of a session for coaching purposes. The organizer of the online session is usually one of the multiple users who participate in the online session, but may be a different person who does not participate in the online session. Note that it is also possible to use all participants as the analysis target without specifying an analysis target.

[0018] Also, the leader, facilitator, or manager (hereinafter collectively referred to as the organizer) of the online session can specify any user as the subject of analysis. The organizer of the online session can be, for example, a lecturer of an online class, a chairperson or facilitator of an online conference, or a coach of a session for coaching purposes. The organizer of the online session is usually one of multiple users who participate in the online session, but can also be a different person who does not participate in the online session.

[0019] As shown in FIG. 1, the video meeting evaluation system according to this embodiment includes user terminals 10 and 20 having at least an input unit such as a camera unit and a microphone unit, a display unit such as a display, and an output unit such as a speaker, a video meeting service terminal 30 that provides two-way video meetings to the user terminals 10 and 20, and an evaluation terminal 40 that evaluates the video meeting.

[0020] <Hardware configuration example> 2 is a diagram showing an example of the hardware configuration of a computer that realizes each of the terminals 10 to 40 according to this embodiment. The computer includes at least a control unit 11, a memory 12, a storage 13, a communication unit 14, and an input / output unit 15. These are electrically connected to each other via a bus 16.

[0021] The control unit 11 is a computing device that controls the overall operation of each terminal, controls the transmission and reception of data between each element, and performs information processing necessary for application execution and authentication processing, etc. For example, the control unit 11 is a processor such as a CPU, and executes programs stored in the storage 13 and deployed in the memory 12 to perform each information processing.

[0022] The memory 12 includes a main memory configured with a volatile storage device such as a DRAM, and an auxiliary memory configured with a non-volatile storage device such as a flash memory or a HDD. The memory 12 is used as a work area for the control unit 11, and also stores a BIOS executed when the information sharing support device 10 is started up, various setting information, and the like.

[0023] The storage 13 stores various programs such as application programs. A database storing data used for each process may be constructed in the storage 13. In particular, the video meeting service terminal 30 may record video images during an online session and store them in the storage 13. The evaluation terminal 40 may acquire video images and store them together with the analysis results (evaluation results) in the storage 13 managed by the evaluation terminal 40.

[0024] The communication unit 14 connects the information sharing support device 10 to a network. The communication unit 14 communicates with an external device directly or via a network access point, for example, by a method such as wired LAN, wireless LAN, Wi-Fi (registered trademark), infrared communication, Bluetooth (registered trademark), short-distance or non-contact communication.

[0025] The input / output unit 15 is, for example, an information input device such as a keyboard, a mouse, a touch panel, etc., and an output device such as a display.

[0026] A bus 16 is commonly connected to all of the above elements, and transmits, for example, address signals, data signals and various control signals.

[0027] In particular, the evaluation terminal according to this embodiment acquires moving images from a video meeting service terminal, identifies at least facial images contained in the moving images for each predetermined frame unit, and calculates an evaluation value for the facial images (details will be described later).

[0028] <How to get the video> As shown in Fig. 3, the video meeting service provided by the video meeting service terminal (hereinafter sometimes simply referred to as "this service") enables two-way communication with user terminals 10 and 20 using images and audio. This service allows video images captured by the camera unit of the other user terminal to be displayed on the display of the user terminal, and audio captured by the microphone unit of the other user terminal to be output from the speaker.

[0029] This service is also configured to enable the recording of video and audio (collectively referred to as "video, etc.") by both or either of the user terminals. The recorded information Vs1, Vs2 (hereinafter referred to as "recorded information") is temporarily cached in the user terminal that initiated the recording, and is recorded either on the video meeting service terminal side, or locally on one of the user terminals, or both. Users can view the recorded information themselves, share it with others, etc., within the scope of their use of this service.

[0030] The evaluation terminal 40 acquires the recorded information and performs analysis and evaluation as described below. The recorded information may be acquired, for example, by making a direct download request or by accessing the recorded information via a predetermined URL.

[0031] In particular, as shown in Fig. 3, according to this embodiment, the video meeting service terminal 30 generates URL information for identifying at least the stored video image in response to a URL information generation request from at least the first user terminal 10 or the second user terminal 20. The URL information is shared from the first user terminal 10 or the second user terminal 20 to the evaluation terminal 40. The evaluation terminal 40 is able to access the video image in the video meeting service terminal based on the URL information, and the video image is acquired.

[0032] The evaluation terminal 40 evaluates the moving image acquired as described above by the following analysis.

[0033] <Example 1> An embodiment of the present invention will be described below with reference to the drawings. Fig. 4 is a block diagram showing an example of the configuration according to this embodiment. As shown in Fig. 4, the video meeting evaluation system of this embodiment includes, as its functional configuration, a video image acquisition unit 11, a biological reaction analysis unit 12, a peculiar determination unit 13, a related event identification unit 14, a clustering unit 15, and an analysis result notification unit 16.

[0034] Each of the functional blocks 11 to 16 can be configured by, for example, hardware, a DSP (Digital Signal Processor), or software provided in the evaluation terminal 40. For example, when configured by software, each of the functional blocks 11 to 16 is actually configured with a CPU, RAM, ROM, etc. of a computer, and is realized by the operation of a program stored in a recording medium such as the RAM, ROM, hard disk, or semiconductor memory.

[0035] The video acquisition unit 11 acquires from each terminal video images obtained by photographing multiple people (multiple users) with a camera provided in each terminal during an online session. The video images acquired from each terminal may or may not be set to be displayed on the screen of each terminal. In other words, the video acquisition unit 11 acquires video images from each terminal, including video images being displayed and video images not being displayed on each terminal.

[0036] The biological reaction analysis unit 12 analyzes changes in biological reactions for each of the multiple people based on the moving images (whether or not they are being displayed on the screen) acquired by the moving image acquisition unit 11. In this embodiment, the biological reaction analysis unit 12 separates the moving images acquired by the moving image acquisition unit 11 into a set of images (a collection of frame images) and audio, and analyzes changes in biological reactions from each of them.

[0037] For example, the biological reaction analysis unit 12 analyzes a change in a biological reaction related to at least one of facial expression, gaze, pulse rate, and facial movement by analyzing a facial image of the user using frame images separated from the video acquired by the video acquisition unit 11. In addition, the biological reaction analysis unit 12 analyzes a change in a biological reaction related to at least one of the user's remarks and voice quality by analyzing a sound separated from the video acquired by the video acquisition unit 11.

[0038] When a person's emotions change, this is reflected in changes in biological reactions such as facial expressions, gaze, pulse rate, facial movements, speech, and voice quality. In this embodiment, the change in the user's emotions is analyzed by analyzing the change in the user's biological reactions. In this embodiment, the emotion analyzed is, for example, the degree of comfort / discomfort. In this embodiment, the biological reaction analysis unit 12 quantifies the change in the biological reaction according to a predetermined standard, thereby calculating a biological reaction index value that reflects the content of the change in the biological reaction.

[0039] The analysis of changes in facial expression is performed, for example, as follows. That is, for each frame image, a facial region is identified from within the frame image, and the identified facial expressions are classified into a plurality of categories according to an image analysis model that has been trained by machine learning in advance. Then, based on the classification results, it is analyzed whether a positive or negative facial expression change has occurred between consecutive frame images, and to what extent the facial expression change has occurred, and a facial expression change index value according to the analysis results is output.

[0040] The analysis of the change in the line of sight is performed, for example, as follows. That is, for each frame image, the eye area is identified from within the frame image, and the direction of both eyes is analyzed to analyze where the user is looking. For example, it is analyzed whether the user is looking at the face of the speaker being displayed, the shared material being displayed, or looking outside the screen. It may also be analyzed whether the movement of the line of sight is large or small, and whether the movement is frequent or infrequent. The change in the line of sight is also related to the concentration level of the user. The biological reaction analysis unit 12 outputs a line of sight change index value according to the analysis result of the change in the line of sight.

[0041] The analysis of changes in pulse rate is performed, for example, as follows. That is, for each frame image, a facial area is identified from within the frame image. Then, using a trained image analysis model that captures the numerical value of facial color information (G of RGB), changes in G color on the face surface are analyzed. The results are arranged along the time axis to form a waveform that represents changes in color information, and the pulse rate is identified from this waveform. When a person is nervous, their pulse rate increases, and when they feel calm, their pulse rate decreases. The biological response analysis unit 12 outputs a pulse rate change index value according to the analysis result of the changes in pulse rate.

[0042] The analysis of the change in facial movement is performed, for example, as follows. That is, for each frame image, the facial area is identified from within the frame image, and the facial direction is analyzed to analyze where the user is looking. For example, it is analyzed whether the user is looking at the face of the speaker being displayed, the shared material being displayed, or looking outside the screen. It is also possible to analyze whether the facial movement is large or small, and whether the frequency of the movement is high or low. It is also possible to analyze the facial movement together with the eye movement. For example, it is also possible to analyze whether the user is looking straight at the speaker being displayed, looking up or down, or looking at an angle. The biological reaction analysis unit 12 outputs a facial direction change index value according to the analysis result of the change in the facial direction.

[0043] The analysis of the utterance contents is performed, for example, as follows. That is, the biological response analysis unit 12 converts the voice into a character string by performing a known voice recognition process on the voice for a specified time (for example, about 30 to 150 seconds), and removes words such as particles and articles that are unnecessary for expressing the conversation by performing a morphological analysis of the character string. Then, it vectorizes the remaining words, analyzes whether a positive or negative emotional change has occurred, and the extent of the emotional change, and outputs a utterance content index value according to the analysis result.

[0044] The voice quality is analyzed, for example, as follows. That is, the biological response analysis unit 12 identifies the acoustic features of the voice by performing a known voice analysis process on the voice for a specified time (for example, about 30 to 150 seconds). Then, based on the acoustic features, it analyzes whether a positive or negative voice quality change has occurred and to what extent the voice quality change has occurred, and outputs a voice quality change index value according to the analysis result.

[0045] The biological reaction analysis unit 12 calculates a biological reaction index value using at least one of the facial expression change index value, eye gaze change index value, pulse rate change index value, face direction change index value, statement content index value, and voice quality change index value calculated as described above. For example, the biological reaction index value is calculated by weighting the facial expression change index value, eye gaze change index value, pulse rate change index value, face direction change index value, statement content index value, and voice quality change index value.

[0046] The unique determination unit 13 determines whether or not the change in the biological reaction analyzed for the subject of analysis is unique compared to the change in the biological reaction analyzed for other people other than the subject of analysis. In this embodiment, the unique determination unit 13 determines whether or not the change in the biological reaction analyzed for the subject of analysis is unique compared to other people based on the biological reaction index value calculated for each of the multiple users by the biological reaction analysis unit 12.

[0047] For example, the unique judgment unit 13 calculates the variance of the biological reaction index values ​​calculated for each of multiple individuals by the biological reaction analysis unit 12, and by comparing the biological reaction index value calculated for the subject of analysis with the variance, judges whether or not the changes in the biological reactions analyzed for the subject of analysis are unique compared to others.

[0048] There are three possible cases where the changes in the analyzed biological reactions of the subject are unique compared to others. The first is when no particularly significant changes in biological reactions occur in others, but a relatively large change in biological reactions occurs in the subject. The second is when no particularly significant changes in biological reactions occur in the subject, but a relatively large change in biological reactions occurs in others. The third is when a relatively large change in biological reactions occurs in both the subject and others, but the content of the change differs between the subject and others.

[0049] The associated event identification unit 14 identifies an event occurring with respect to at least one of the subject to be analyzed, other people, and the environment when a change in the biological reaction determined to be unique by the unique determination unit 13 occurs. For example, the associated event identification unit 14 identifies the behavior of the subject to be analyzed himself / herself from a video when a unique change in the biological reaction occurs in the subject to be analyzed. The associated event identification unit 14 also identifies the behavior of other people from the video when a unique change in the biological reaction occurs in the subject to be analyzed. The associated event identification unit 14 also identifies the environment when a unique change in the biological reaction occurs in the subject to be analyzed from the video. The environment is, for example, a shared document being displayed on the screen, something that appears in the background of the subject to be analyzed, etc.

[0050] The clustering unit 15 analyzes the degree of correlation between a change in biological reaction determined to be unique by the unique determination unit 13 (for example, one or more combinations of eye contact, pulse rate, facial movement, speech content, and voice quality) and an event occurring when the unique change in biological reaction occurs (an event identified by the related event identification unit 14), and if the correlation is determined to be at a certain level or above, the clustering unit 15 clusters the person or event being analyzed based on the results of the correlation analysis.

[0051] For example, if a specific change in biological reaction corresponds to a negative emotional change, and the event occurring when the specific change in biological reaction occurs is also a negative event, a correlation of a certain level or higher is detected. The clustering unit 15 clusters the analysis subject or event into one of a plurality of pre-segmented classifications according to the content of the event, the degree of negativity, the magnitude of correlation, etc.

[0052] Similarly, if a specific change in biological reaction corresponds to a positive emotional change, and the event occurring when the specific change in biological reaction occurs is also a positive event, a correlation of a certain level or higher is detected. The clustering unit 15 clusters the analysis subject or event into one of a plurality of pre-segmented classifications according to the content of the event, the degree of positivity, the magnitude of correlation, etc.

[0053] The analysis result notification unit 16 notifies the person designating the analysis subject (the analysis subject or the organizer of the online session) of at least one of the changes in biological reactions determined to be specific by the unique determination unit 13, the events identified by the related event identification unit 14, and the classifications clustered by the clustering unit 15.

[0054] For example, the analysis result notification unit 16 notifies the analysis subject of his / her own words and actions as an event occurring when a unique change in biological reaction occurs in the analysis subject that differs from that of others (any of the three patterns described above; the same applies below). This allows the analysis subject to understand that when he / she behaves in a certain way, he / she has different feelings from others. At this time, the analysis subject may also be notified of the unique changes in biological reaction identified for the analysis subject. Furthermore, the analysis subject may be further notified of the changes in biological reaction of others for comparison.

[0055] For example, when the emotion received by others for the words and actions of the analysis subject unconsciously performed with normal emotions, or the words and actions of the analysis subject performed with particular consciousness accompanied by a certain emotion differs from the emotion felt by the analysis subject himself at the time of the words and actions, the analysis subject is notified of the words and actions of the analysis subject at that time. This makes it possible to discover words and actions that are well received by others or words and actions that are not well received by others, despite one's own awareness.

[0056] In addition, the analysis result notification unit 16 notifies the host of the online session of events that occur when a unique change in the biological reaction of the analysis subject occurs that is different from that of others, together with the unique change in the biological reaction. This allows the host of the online session to know what events are influencing what emotional changes as a phenomenon unique to the specified analysis subject. Then, it becomes possible to take appropriate measures for the analysis subject according to the content thus understood.

[0057] In addition, the analysis result notification unit 16 notifies the organizer of the online session of events occurring when a change in a specific biological reaction occurs in the analysis subject that is different from that of others, or the clustering results of the analysis subject. This allows the organizer of the online session to grasp the behavioral tendencies specific to the analysis subject and predict possible future behaviors and conditions, etc., depending on which classification the specified analysis subject is clustered into. Then, it becomes possible to take appropriate measures for the analysis subject.

[0058] In the above embodiment, a biological reaction index value is calculated by quantifying the change in biological reaction according to a predetermined standard, and based on the biological reaction index value calculated for each of a plurality of people, it is determined whether or not the change in biological reaction analyzed for the subject of analysis is unique compared to others, but the present invention is not limited to this example. For example, the following may be used.

[0059] That is, the biological reaction analysis unit 12 analyzes the eye movement of each of the multiple people to generate a heat map showing the eye direction. The uniqueness determination unit 13 compares the heat map generated by the biological reaction analysis unit 12 for the analysis subject with the heat map generated for the other person to determine whether the change in the biological reaction analyzed for the analysis subject is unique compared to the change in the biological reaction analyzed for the other person.

[0060] <Example 2> Hereinafter, a description will be given based on Example 2 of the present invention. Fig. 5 is a block diagram showing a configuration example according to this embodiment. As shown in Fig. 1, the video meeting evaluation system of this embodiment includes, as functional components, a video image acquisition unit 11, a biological reaction analysis unit 12, and a reaction information presentation unit 13a.

[0061] The reaction information presenting unit 13a presents information indicating changes in biological reactions analyzed by the biological reaction analysis unit 12a, including participants not displayed on the screen. For example, the reaction information presenting unit 13a presents information indicating changes in biological reactions to a leader, facilitator, or manager (hereinafter collectively referred to as a host) of an online session. The host of an online session may be, for example, a lecturer of an online class, a chairperson or facilitator of an online conference, or a coach of a session for coaching purposes. The host of an online session is usually one of multiple users participating in the online session, but may also be a different person who does not participate in the online session.

[0062] In this way, the host of an online session can grasp the status of participants who are not displayed on the screen in an environment where an online session is being held by multiple people.

[0063] Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.

[0064] The device described in this specification may be realized as a single device, or may be realized by a plurality of devices (e.g., cloud servers) partially or entirely connected via a network. For example, the control unit 11 and the storage 13 of the information sharing support device 10 may be realized by different servers connected to each other via a network.

[0065] The series of processes performed by the device described in this specification may be realized using any of software, hardware, and a combination of software and hardware. It is possible to create a computer program for realizing each function of the information sharing support device 10 according to this embodiment and install it in a PC or the like. It is also possible to provide a computer-readable recording medium in which such a computer program is stored. The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, etc. The above computer program may also be distributed, for example, via a network, without using a recording medium.

[0066] In addition, the processes described herein using flowchart diagrams do not necessarily have to be performed in the order shown. Some process steps may be performed in parallel. Additional process steps may be employed, and some process steps may be omitted.

[0067] In addition, the effects described in this specification are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.

[0068] The present invention may also include the following configurations. <Configuration 1> A video meeting evaluation system that analyzes the unique emotions of a person being analyzed among multiple people in an online session, which emotions differ from those of others. <Configuration 2> a video acquisition unit that acquires a video obtained by photographing the plurality of people during the online session; A biological reaction analysis unit that analyzes a change in a biological reaction of each of the plurality of people based on the moving image acquired by the moving image acquisition unit; a uniqueness determination unit that determines whether the change in the biological reaction analyzed for the subject of analysis is unique as compared with the change in the biological reaction analyzed for another person other than the subject of analysis. A video meeting evaluation system comprising: <Configuration 3> The video meeting evaluation system according to configuration 2, wherein the biological reaction analysis unit analyzes changes in biological reactions related to at least one of facial expression, eye line, pulse rate, and facial movement by analyzing facial images in the video images acquired by the video image acquisition unit. <Configuration 4> The video meeting evaluation system according to configuration 2 or 3, wherein the biological reaction analysis unit analyzes changes in biological reactions related to at least one of the content of remarks and voice quality by analyzing the audio in the video images acquired by the video image acquisition unit. <Component 5> The biological reaction analysis unit calculates a biological reaction index value by quantifying the change in the biological reaction according to a predetermined standard, The uniqueness determination unit determines whether or not the change in the biological reaction analyzed for the analysis subject is unique compared to the change in the biological reaction analyzed for another person other than the analysis subject, based on the biological reaction index value calculated for each of the plurality of people by the biological reaction analysis unit. 5. The video meeting evaluation system according to any one of configurations 2 to 4, characterized in that: <Component 6> The video meeting evaluation system of configuration 5, characterized in that the unique determination unit calculates the variance of the biological reaction index value calculated for each of the multiple people by the biological reaction analysis unit, and determines whether the change in the biological reaction analyzed for the analysis subject is unique compared to the change in the biological reaction analyzed for the other person by comparing the biological reaction index value calculated for the analysis subject with the variance. <Component 7> The biological reaction analysis unit analyzes the eye movement of each of the plurality of people to generate a heat map indicating the direction of the eye movement, The unique determination unit compares the heat map generated by the biological reaction analysis unit for the analysis subject with the heat map generated for the other person to determine whether or not the change in the biological reaction analyzed for the analysis subject is unique compared to the change in the biological reaction analyzed for the other person. 4. The video meeting evaluation system according to configuration 3. <Component 8> The video meeting evaluation system according to any one of configurations 2 to 7, further comprising a related event identification unit that identifies an event occurring with respect to at least one of the subject of analysis, the other person, and the environment when a change in a biological reaction determined to be specific by the specificity determination unit occurs. <Component 9> The video meeting evaluation system according to configuration 8, further comprising a clustering unit that analyzes the degree of correlation between the change in biological reaction determined to be specific by the specific determination unit and an event occurring when the specific change in biological reaction occurs, and when it is determined that the correlation is at a certain level or higher, clusters the analysis subjects or the event based on the analysis result of the correlation. <Component 10> 9. The video meeting evaluation system according to configuration 8, further comprising an analysis result notifying unit that notifies the subject of analysis or a host of the online session of at least one of the change in the biological reaction determined to be specific by the specific determination unit and the event identified by the related event identification unit. <Component 11> 10. The video meeting evaluation system according to claim 9, further comprising an analysis result notification unit that notifies the subject of analysis or a host of the online session of at least one of the changes in biological reactions determined to be specific by the specificity determination unit, the events identified by the related event identification unit, and the classifications clustered by the clustering unit. <Component 12> A reaction analysis system that, in an environment where an online session is held with a plurality of participants, analyzes the reactions of the participants based on video images obtained by photographing the participants, regardless of whether the participants are displayed on a screen during the online session, and presents the analysis results. <Component 13> a video capture unit for capturing video of the participants during the online session; a biological reaction analysis unit that analyzes changes in biological reactions of the participant based on the moving image acquired by the moving image acquisition unit; a reaction information presentation unit that presents information indicating changes in the biological reactions analyzed by the biological reaction analysis unit, including participants not displayed on the screen; 13. The reaction analysis system according to item 12, <Component 14> The reaction analysis system described in item 13 is characterized in that the biological reaction analysis unit analyzes changes in biological reactions related to at least one of facial expression, eye movement, pulse rate, and facial movement by analyzing facial images in the video acquired by the video acquisition unit. <Component 15> The reaction analysis system described in item 13 or 14, wherein the biological reaction analysis unit analyzes changes in biological reactions related to at least one of the content of the speech and the voice quality by analyzing the audio in the video acquired by the video acquisition unit. <Component 16> The reaction analysis system described in item 13, characterized in that the biological reaction analysis unit analyzes where participants who are not displayed on the screen are looking at the shared materials displayed on the screen. <Component 17> The reaction analysis system described in item 13, wherein the biological reaction analysis unit analyzes at what point during the online session a participant not displayed on the screen made a sound. <Component 18> 18. The reaction analysis system according to any one of claims 13 to 17, wherein the reaction information presentation unit presents information indicating changes in the biological reaction to a host of the online session. [Explanation of symbols]

[0069] 10, 20 user terminals 30 Video Meeting Service Terminals 40 Evaluation Devices

Claims

1. 1. A video meeting evaluation system comprising: a video meeting service terminal that provides a video meeting to at least a first user terminal and a second user terminal and stores moving images acquired during the video meeting; and an evaluation terminal that evaluates the video meeting, the video meeting service terminal generates URL information for identifying the stored video image and provides the URL information to at least the first user terminal; the evaluation terminal acquires the moving image from the video meeting service terminal based on the URL information provided by the first user terminal, identifies at least a facial image included in the moving image for each predetermined frame, and calculates an evaluation value for the facial image. Video meeting evaluation system.

2. 2. The video meeting evaluation system of claim 1, The evaluation terminal provides graph information of the evaluation value in time series. Video meeting evaluation system.

3. 3. The video meeting evaluation system according to claim 1, further comprising: the evaluation terminal calculates a plurality of evaluation values ​​by evaluating the face image from a plurality of different viewpoints; Video meeting evaluation system.

4. A video meeting evaluation system according to any one of claims 1 to 3, The evaluation terminal calculates the evaluation value together with the audio included in the moving image. Video meeting evaluation system.

5. A video meeting evaluation system according to any one of claims 1 to 4, the evaluation terminal calculates the evaluation value together with an object other than the face image included in the moving image; Video meeting evaluation system.

Images