Event Atmosphere Detection System and Method

Abstract

This invention provides an event atmosphere detection system and method that generate indicators to judge the feelings and atmosphere of participants in events such as meetings and seminars, and enables the verification of the event's success. [Solution] An event atmosphere detection device for analyzing and detecting the atmosphere of the event, comprising: a data input means for inputting at least one of audio and video data of the location; and a feature detection means for detecting the characteristics of the emotional responses of the participants from the input data. The system includes visualization means for visualizing and displaying the detected features.

Description

[Technical Field]

[0001] The present invention relates to an event atmosphere detection system and an event atmosphere detection method. [Background Art]

[0002] There are various indicators such as indicators replacing customer satisfaction including Net Promoter Score, and indicators for customer experience. [Prior Art Literature] [Patent Literature]

[0003] [Patent Literature 1] Publication [Outline of the Invention] [Problem to be Solved by the Invention]

[0004] Conventionally, the success degree of meetings and seminars and the satisfaction degree of participants have depended on subjective evaluation, and evaluation based on specific data has been difficult. Furthermore, there has been no mechanism for accurately measuring emotional reactions such as laughter and utilizing the measurement results.

[0005] The present invention has been made in view of the above-mentioned problems of the prior art, and an object of the present invention is to provide an event atmosphere detection system and an event atmosphere detection method that generate an index for determining the mood and atmosphere of participants in an event such as a meeting or a seminar, and enable verification of the outcome of the event. [Means for Solving the Problem]

[0006] The present invention provides an event atmosphere detection system which is an event atmosphere detection apparatus that collects and analyzes in real time at least one data of laughter, speech frequency, voice tone, and applause of event participants to detect the atmosphere of the event, comprising: data input means for inputting at least one of audio data and video data of the event venue; feature detection means for detecting features of emotional reactions of the participants from the input data; and visualization means for visualizing and displaying the detected features.

[0007] Preferably, the data input means inputs audio data (laughter, applause, speech) and video data (facial expressions, gestures) using at least one of a microphone, sensor, or camera installed at the event venue.

[0008] Preferably, the feature detection means quantifies the loudness, length, frequency, and tone of laughter using a predetermined speech analysis algorithm.

[0009] Preferably, the feature detection means identifies changes in the participant's facial expressions (such as joy or confusion) through video analysis.

[0010] Preferably, the feature detection means integrates audio and video data and scores the overall atmosphere of the event.

[0011] Preferably, the visualization means displays data such as laughter intensity, conversation activity, and silence time in graphs or dashboards.

[0012] Preferably, an analysis and reporting means that performs analysis of the participants' emotions based on the detected characteristics and processes the creation of a report of the results of the analysis. It also possesses.

[0013] Preferably, the analysis and reporting means statistically processes the data to evaluate the atmosphere of the place using indicators such as "positivity" and "concentration."

[0014] Preferably, the system further includes an improvement proposal generation means that generates improvement proposals for the event based on the results of the analysis.

[0015] Preferably, the improvement proposal generation means uses machine learning to generate specific improvement proposals based on the atmosphere of the situation. Preferably, the event is a seminar, and the feature detection means detects the characteristics of the participants' emotional responses to each statement made by the seminar's instructor.

[0016] The present invention is an event atmosphere detection method for detecting the atmosphere of an event by collecting and analyzing, in real time, at least one piece of data selected from laughter, speech frequency, voice tone and applause of event participants, the method being executed by a computer, comprising: a data input step of inputting at least one of audio data and video data of the venue; a feature detection step of detecting features of emotional reactions of the participants from the input data; and a visualization step of visualizing and displaying the detected features.

Effects of the Invention

[0017] According to the present invention, it is possible to provide an event atmosphere detection system and an event atmosphere detection method that generate an index for determining the mood and atmosphere of participants in an event such as a conference or a seminar, and enable verification of the outcome of the event.

Brief Description of Drawings

[0018] [Figure 1] Figure 1 is a diagram for explaining a venue 9 to which an embodiment of the present invention is applied. [Figure 2] Figure 2 is a functional block diagram of the event atmosphere detection device 11 shown in Figure 1. [Figure 3] Figure 3 is a flowchart for explaining processing of the event atmosphere detection device 11 according to an embodiment of the present invention. [Figure 4] Figure 4 is a configuration diagram of the event atmosphere detection device 11 shown in Figure 1.

Mode for Carrying Out the Invention

[0019] Hereinafter, an event atmosphere detection system and an event atmosphere detection method according to an embodiment of the present invention will be described. The present embodiment provides material for determining the effect and significance of events such as conferences and seminars.

[0020] Furthermore, in the present embodiment, data such as participants' laughter, speech frequency, voice tone, and applause at a venue (place) such as a conference or seminar is collected and analyzed in real time, and the atmosphere of the venue is quantified and visualized.

[0021] Figure 1 is a diagram for explaining a venue 9 to which an embodiment of the present invention is applied. As shown in Figure 1, the venue 9 of the present embodiment is provided with a microphone 21 and a camera 23. Furthermore, the event atmosphere detection device 11 receives audio data input from the microphone 21 and video data input from the camera 23.

[0022] Figure 2 is a functional block diagram of the event atmosphere detection device 11 shown in Figure 1. As shown in Figure 2, the event atmosphere detection device 11 includes, for example, a data input unit 31, a feature detection unit 33, a visualization unit 35, an analysis / report generation unit 37, and an improvement plan generation unit 39.

[0023] The data input unit 31 receives audio data input from the microphone 21 and video data input from the camera 23. The data input unit 31 inputs audio data (laughter, applause, speech) and video data (facial expressions, gestures) using at least one of a microphone, a sensor, and a camera installed at the event venue

[0024] The feature detection unit 33 detects features of emotional reactions of event participants from the data input by the data input unit 31. The feature detection unit 33 quantifies the volume, length, frequency, and tone of laughter using a predetermined voice analysis algorithm. For example, questions are posed on a 0 to 10 scale. The feature detection unit 33 trains a machine learning model using a large amount of laughter data to learn patterns for detecting laughter.

[0025] The feature detection unit 33 identifies changes in participants' facial expressions (such as joy and confusion) through video analysis to detect features. The feature detection unit 33 analyzes video data to detect laughter from a person's facial expressions and movements. This includes facial feature point detection, facial expression recognition, and motion analysis. The feature detection unit 33 trains a machine learning model using a large amount of facial expression change data from participants to learn patterns for detecting smiles and the like. The feature detection unit 33 integrates audio and video data from the venue and scores the overall atmosphere of the event. The feature detection unit 33, for example, if the event is a seminar, detects the characteristics of the emotional responses of the participants to each statement made by the seminar's lecturer.

[0026] The visualization unit 35 displays data such as laughter intensity, conversation activity, and silence time in graphs and dashboards.

[0027] The analysis and report generation unit 37 analyzes the emotions of the participants and generates a report of the results of the analysis, based on the features detected by the feature detection unit 33. The Analysis and Reporting Department 37 statistically processes data to evaluate the atmosphere of a place using indicators such as "positivity" and "concentration." The evaluation results can also be shared in PDF format or via the cloud.

[0028] The improvement plan generation unit 39 generates improvement plans for the event based on the results of the above analysis. Furthermore, the improvement proposal generation unit 39 uses machine learning to generate specific improvement suggestions based on the atmosphere of the situation. At this time, the improvement proposal generation unit 39 refers to past data and presents successful examples of similar situations.

[0029] The following describes the processing of the event atmosphere detection device 11 according to an embodiment of the present invention. Figure 3 is a flowchart illustrating the processing of the event atmosphere detection device 11 according to an embodiment of the present invention. Let's explain each step. Step ST11: At event venue 9, the event's sound is captured by microphone 21 during the event, and the event scene is filmed by camera 23.

[0030] Step ST12: The data input unit 31 receives audio data from the microphone 21 and video data from the camera 23.

[0031] Step ST13: The feature detection unit 33 detects the characteristics of the emotional responses of event participants from the data input unit 31. The feature detection unit 33 quantifies the loudness, length, frequency, and tone of laughter using a predetermined voice analysis algorithm. The feature detection unit 33 identifies and detects features by analyzing the participants' facial expressions (such as joy or confusion). The feature detection unit 33 analyzes video data to detect laughter from a person's facial expressions and movements. This includes facial feature point detection, facial expression recognition, and motion analysis.

[0032] Step ST14: The visualization unit 35 displays data such as laughter intensity, conversation activity, and silence time in graphs and dashboards.

[0033] Step ST15: The analysis and report generation unit 37 analyzes the emotions of the participants and generates a report of the results of the analysis, based on the features detected by the feature detection unit 33.

[0034] Step ST16: The improvement plan generation unit 39 generates improvement plans for the event based on the results of the above analysis. Furthermore, the improvement proposal generation unit 39 uses machine learning to generate specific improvement suggestions based on the atmosphere of the situation. At this time, the improvement proposal generation unit 39 refers to past data and presents successful examples of similar situations.

[0035] Figure 4 is a diagram showing the configuration of the event atmosphere detection device 11 shown in Figure 1. As shown in Figure 4, the event atmosphere detection device 11 includes, for example, a display 51, an operation / input unit 54, a communication unit 55, a memory 59, and a processing unit 61.

[0036] The display 51 displays an image based on the signal from the processing unit 61. The communication unit 55 communicates with the microphone 21 and camera 23, as well as with other devices via the network. The operation / input unit 54 is an operating means such as a touch panel, keyboard, or mouse. Memory 59 stores the program that the processing unit 61 will execute. The processing unit 61 executes the program PRG stored in the memory 59 to perform the processing of the event atmosphere detection device 11 as defined in this embodiment.

[0037] As explained above, the event atmosphere detection device 11 generates indicators to judge the feelings and atmosphere of participants in events such as meetings and seminars, making it possible to verify the results of the event. In other words, the event atmosphere detection device 11 collects and analyzes data such as laughter, frequency of speech, voice tone, and applause from participants in meetings, seminars, and other similar settings in real time, quantifying and visualizing the atmosphere of the setting. This allows for a quantitative evaluation of the smoothness of meetings, the effectiveness of seminars, and participant engagement.

[0038] The event atmosphere detection device 11 can objectively measure the results of meetings and seminars in this way. This allows for the digitization of participants' emotional responses and clarifies areas for improvement. Therefore, the data can be used for business analysis and marketing strategies.

[0039] The present invention is not limited to the embodiments described above. In other words, those skilled in the art may make various modifications, combinations, subcombinations, and substitutions with respect to the components of the embodiments described above, within the technical scope of the present invention or its equivalents. [Industrial applicability]

[0040] This invention is applicable to event atmosphere detection systems. [Explanation of symbols]

[0041] 9…Event venue 11…Event atmosphere detection device 21... Mike 23... Camera 31...Data entry 33…Feature detection unit 35...Visualization part 37…Analysis and Report Creation Department 39…Improvement proposal generation department

Claims

1. An event atmosphere detection device that collects and analyzes at least one piece of data in real time regarding laughter, frequency of speech, voice tone, and applause of event participants to detect the atmosphere of the event, A data input means for inputting at least one of the audio and video data of the aforementioned event, A feature detection means for detecting the characteristics of the participant's emotional response from the input data, A visualization means for visualizing and displaying the detected features, An event atmosphere detection system having the following features.

2. The data input means uses at least one of the microphones, sensors, and cameras installed at the event venue to input audio data (laughter, applause, speech) and video data (facial expressions, gestures). The event atmosphere detection system according to claim 1.

3. The feature detection means is A predetermined voice analysis algorithm quantifies the loudness, length, frequency, and tone of laughter. The event atmosphere detection system according to claim 1.

4. The feature detection means identifies changes in the participant's facial expressions (joy, confusion, etc.) through video analysis. The event atmosphere detection system according to claim 1.

5. The feature detection means is The audio and video data are integrated to score the overall atmosphere of the event. The event atmosphere detection system according to claim 1.

6. The visualization means displays data such as laughter intensity, conversation activity, and silence time in graphs and dashboards. The event atmosphere detection system according to claim 1.

7. Based on the detected features, an analysis and reporting means performs an analysis of the participants' emotions and generates a report of the results of the analysis. It further possesses The event atmosphere detection system according to claim 1.

8. The aforementioned analysis and reporting method statistically processes data to evaluate the atmosphere of the place using indicators such as "positivity" and "concentration." The event atmosphere detection system according to claim 6.

9. Improvement proposal generation means that generates improvement proposals for the event based on the results of the above analysis. It further possesses The event atmosphere detection system according to claim 1.

10. The aforementioned improvement proposal generation means uses machine learning to generate specific improvement proposals based on the atmosphere of the situation. The event atmosphere detection system according to claim 9.

11. The aforementioned event is a seminar, The feature detection means detects the characteristics of the participants' emotional responses to each statement made by the seminar instructor. The event atmosphere detection system according to claim 1.

12. An event atmosphere detection method that collects and analyzes at least one data point of event participants—laughter, frequency of speech, voice tone, and applause—in real time to detect the atmosphere of the event, A data input step of inputting at least one of audio and video data from the aforementioned location, A feature detection step for detecting the characteristics of the participant's emotional response from the input data, A visualization step is performed to visualize and display the detected features, A computer-based method for detecting event atmospheres.

Images