Information processing device and information processing method

JP2025021012APending Publication Date: 2025-02-13JVC KENWOOD CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023124689
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-31
Publication Date
2025-02-13

AI Technical Summary

Benefits of technology

【0008】 本発明によれば、オンライン会議において、参加者が資料以外を見ている場合に、参加者の資料に対する集中度を算出することができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025021012000001_ABST
    Figure 2025021012000001_ABST
Patent Text Reader

Abstract

To determine a concentration degree on a material of a participant in an online conference.SOLUTION: An information processing device comprises: a detection unit which detects the position that a participant of an online conference is paying attention to in a display unit which displays a shared screen shared by callers in the online conference and applications other than the shared screen; a determination unit which determines whether the position detected by the detection unit is outside the shared screen; and a calculation unit which calculates a concentration degree of the online conference on the basis of the status of a position outside the shared screen that the participant is paying attention to when the position that the participant is paying attention to is outside the shared screen.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] In recent years, online meetings and online training have become widespread. For example, Patent Document 1 describes a technique for calculating a concentration level of a viewer based on whether or not the viewer's line of sight matches a target area. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-98825 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with technology such as that disclosed in Patent Document 1, when a document is being shared in an online conference, the speaker cannot calculate the degree of concentration of the participants on the document if the participants are looking at something other than the document.

[0005] The present invention has an object to provide an information processing device and an information processing method capable of calculating the degree of concentration of a participant on a document in an online conference when the participant is looking at something other than the document. [Means for solving the problem]

[0006] The information processing device of the present invention comprises a detection unit that detects a position at which a participant of an online conference is gazing on a display unit that displays a shared screen shared by a speaker in the online conference and applications other than the shared screen, a determination unit that determines whether the position detected by the detection unit is outside the shared screen, and a calculation unit that calculates a level of concentration of the online conference based on the state of the position outside the shared screen at which the participant is gazing when the position at which the participant is gazing is outside the shared screen.

[0007] The information processing method of the present invention includes the steps of detecting a position at which a participant of an online conference is gazing on a display unit that displays a shared screen shared by a speaker in the online conference and an application other than the shared screen, determining whether the detected position is outside the shared screen, and, if the position at which the participant is gazing is outside the shared screen, calculating a level of concentration of the online conference based on the state of the position outside the shared screen at which the participant is gazing. Effect of the Invention

[0008] According to the present invention, when a participant in an online conference is looking at something other than the document, the degree of concentration of the participant on the document can be calculated. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of the configuration of a terminal device according to the first embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the first embodiment. [Figure 4] FIG. 4 is a flowchart showing the flow of the concentration level calculation process according to the first embodiment. [Diagram 5]FIG. 5 is a diagram for explaining a method for detecting the gaze positions of participants in an online conference according to the first embodiment. [Figure 6] FIG. 6 is a block diagram showing an example of the configuration of an information processing device according to the second embodiment. [Figure 7] FIG. 7 is a flowchart showing the concentration level calculation process according to the second embodiment. [Figure 8] FIG. 8 is a diagram for explaining a method of displaying the gaze degree according to the second embodiment. [Figure 9] FIG. 9 is a block diagram illustrating an example of the configuration of an information processing device according to the third embodiment. [Figure 10] FIG. 10 is a flowchart showing the flow of the concentration level display process according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to this embodiment, and in the following embodiments, the same components are designated by the same reference numerals, and duplicated explanations will be omitted.

[0011] [First embodiment] (Information Processing System) An example of the configuration of an information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of an information processing system according to the first embodiment.

[0012] The information processing system 1 includes a plurality of terminal devices 10 and an information processing device 100. The terminal devices 10 and the information processing device 100 are communicatively connected via a wired or wireless network N. The number of terminal devices 10 and information processing devices 100 included in the information processing system 1 may be any number. The information processing system 1 is an online conference system in which a plurality of users can hold an online conference using each of the terminal devices 10. In the online conference, the information processing system 1 determines the concentration level of participants participating in the online conference.

[0013] (Terminal Device) An example of the configuration of a terminal device according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of a terminal device according to the first embodiment.

[0014] The terminal device 10 is a device used by a user to participate in an online conference. The terminal device 10 is, for example, a notebook PC (Personal Computer), a desktop PC, a tablet terminal, a smartphone, an HMD (Head Mounted Display), a HUD (Head Up Display), etc., but is not limited thereto.

[0015] As shown in FIG. 2, the terminal device 10 includes a sensor 12, an input unit 14, an audio input unit 16, a display unit 18, an audio output unit 20, a communication unit 22, a storage unit 24, and a control unit .

[0016] The sensor 12 detects sensor information indicating various states of the user using the terminal device 10. The sensor 12 is provided, for example, on the same surface as the surface on which the display unit 18 is provided. The sensor 12 includes, for example, a sensor for detecting the direction of the line of sight of the user using the terminal device 10. Specifically, the sensor 12 may be, for example, a sensor that detects the direction of the user's line of sight by a corneal reflex method. For example, the sensor 12 includes a pair of infrared cameras and an infrared light irradiating unit configured with a group of infrared LEDs. In this case, the infrared light irradiating unit irradiates infrared light in the direction of the user's face and captures the image with the pair of infrared cameras. The sensor 12 detects the user's line of sight based on the positions of the passenger's pupil and corneal reflex from the image captured by the infrared camera. The sensor 12 may have other configurations having similar functions. For example, the sensor 12 may use a visible light camera to detect the line of sight based on the inner corner of the eye and the iris.

[0017] The sensor 12 may be, for example, a camera configured separately from the terminal device 10. In this case, the sensor 12 may be provided, for example, in smart glasses or a headset worn by a user who uses the terminal device 10, so as to capture an image of the display screen of the display unit 18 of the terminal device 10 from the line of sight of the user. The sensor 12 may include multiple types of sensors.

[0018] The input unit 14 accepts various operations for the terminal device 10. The input unit 14 is realized by various input devices such as a keyboard, a mouse, a switch, a button, and a touch panel.

[0019] The voice input unit 16 detects the voice of the user who is using the terminal device 10. The voice input unit 16 converts the detected voice into a voice signal. The voice input unit 16 is realized by a microphone.

[0020] The display unit 18 has a display surface that displays various information. The display unit 18 displays, for example, explanatory materials shared in an online conference. The shared explanatory materials are also called a shared screen. The display unit 18 displays, for example, various applications. The display unit 18 displays, for example, a text input application as an application. The display unit 18 is realized, for example, by an LED (Light Emitting Diode) display or an organic EL (Electro-Luminescence) display. When the input unit 14 is a touch panel, the input unit 14 and the display unit 18 are integrally configured. Here, when the terminal device 10 is a device that displays image information by projecting or projecting, such as a HUD, the display unit 18 does not need to have a display surface.

[0021] The audio output unit 20 is a speaker that outputs various types of audio. For example, the audio output unit 20 outputs the audio of users of other terminal devices 10 participating in the online conference.

[0022] The communication unit 22 is a communication interface that performs communication between the terminal device 10 and an external device. The communication unit 22 executes communication between the terminal device 10 and the information processing device 100, for example. The communication unit 22 is realized by, for example, a wireless LAN (Local Area Network), a wired LAN, Wi-Fi (registered trademark), or the like.

[0023] The storage unit 24 stores various types of information. The storage unit 24 stores information such as the contents of calculations performed by the control unit 26 and programs. The storage unit 24 includes at least one of a RAM (Random Access Memory), a main storage device such as a ROM (Read Only Memory), and an external storage device such as an HDD (Hard Disk Drive).

[0024] The control unit 26 controls each unit of the terminal device 10. The control unit 26 has, for example, an information processing device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM or a ROM. The control unit 26 executes a program that controls the operation of the terminal device 10 according to the present invention. The control unit 26 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 26 may be realized by a combination of hardware and software.

[0025] The control unit 26 detects the gaze of the user of the terminal device 10 based on, for example, gaze detection data by the sensor 12, and generates gaze information indicating the gaze detection result. The control unit 26 outputs the generated gaze information to the information processing device 100 via the communication unit 22.

[0026] The control unit 26 generates, for example, screen information related to the display screen displayed by the display unit 18. The screen information may include information such as the application displayed by the display unit 18, the content displayed by the application, and the position and size of the application window. The screen information may also include other information. The control unit 26 outputs the generated screen information to the information processing device 100 via the communication unit 22.

[0027] (Information processing device) An example of the configuration of the information processing device according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the information processing device according to the first embodiment.

[0028] The information processing device 100 determines the overall concentration level of an online conference. The information processing device 100 is, for example, a server device. For example, the information processing device 100 may be realized in a terminal device 10 of a host, a speaker, or a participant of an online conference. The information processing device 100 may be realized in both the server device and the terminal device 10. In this case, specifically, for example, the processes of a detection unit 110 and a determination unit 112 described later are realized in the terminal device 10, and the processes of a calculation unit 114 described later are realized in the server device.

[0029] As shown in FIG. 3, the information processing device 100 includes a communication unit 102, a storage unit 104, and a control unit 106.

[0030] The communication unit 102 is a communication interface that performs communication between the information processing device 100 and an external device. The communication unit 102 executes communication between the information processing device 100 and the terminal device 10, for example. The communication unit 102 is realized by, for example, a wireless LAN or a wired LAN.

[0031] The storage unit 104 stores various types of information. The storage unit 104 stores information such as the contents of calculations performed by the control unit 106 and programs. The storage unit 104 includes at least one of a RAM, a main storage device such as a ROM, and an external storage device such as a HDD.

[0032] The control unit 106 controls each unit of the information processing device 100. The control unit 106 has, for example, an information processing device such as a CPU or an MPU, and a storage device such as a RAM or a ROM. The control unit 106 executes a program that controls the operation of the information processing device 100 according to the present invention. The control unit 106 may be realized by an integrated circuit such as an ASIC or an FPGA. The control unit 106 may be realized by a combination of hardware and software.

[0033] The control unit 106 includes a detection unit 110 , a determination unit 112 , and a calculation unit 114 .

[0034] The detection unit 110 detects the position where the participant of the online conference is gazing at using the terminal device 10. In this embodiment, among the users participating in the online conference, the user who is speaking may be called the speaker, and the user who is listening to the speaker's remark may be called the participant. The detection unit 110 detects, for example, the position where the participant of the online conference is gazing at on the display unit 18 that displays the shared screen shared by the speaker in the online conference and an application other than the shared screen. The detection unit 110 detects, for example, the coordinates of the place where the participant of the online conference is gazing at on the display unit 18 based on the gaze information of the participant acquired from the terminal device 10.

[0035] The determination unit 112 determines whether or not the position detected by the detection unit 110 is outside the shared explanatory material displayed on the display unit 18. For example, based on the detection result of the detection unit 110 and screen information acquired from the terminal device 10, the determination unit 112 determines whether or not the position detected by the detection unit 110 is outside the shared explanatory material displayed on the display unit 18. Here, even if the position detected by the detection unit 110 is outside the display unit 18 itself, the determination unit 112 determines that the position detected by the detection unit 110 is outside the shared explanatory material displayed on the display unit 18.

[0036] The calculation unit 114 calculates the concentration level of the online conference. More specifically, the calculation unit 114 calculates the concentration level of multiple participants participating in the online conference. In the following description, the concentration level of multiple participants participating in the online conference may be referred to as the overall concentration level of the online conference. Here, the calculation unit 114 may calculate the concentration level of all participants participating in the online conference, or may calculate the concentration level of an arbitrary percentage or more of participants participating in the online conference. For example, when a participant is gazing at an explanatory material displayed on the display unit 18, the calculation unit 114 increases the overall concentration level of the online conference.

[0037] When the participant's gaze position is out of the explanatory material displayed on the display unit 18, the calculation unit 114 calculates the concentration level of the online conference based on the state of the participant's gaze position. For example, when the participant's gaze position is out of the explanatory material displayed on the display unit 18 and an application is displayed on the display unit 18, the calculation unit 114 calculates the concentration level of the entire online conference based on the display mode of the application. In this case, when the relevance indicating the relevance between the content displayed on the application and the explanatory material is equal to or greater than a predetermined level, the calculation unit 114 increases the overall concentration level of the online conference. When the relevance between the content displayed on the application and the explanatory material is less than a predetermined level, the calculation unit 114 does not reflect it in the overall concentration level of the online conference.

[0038] When the participant's gaze position is out of the explanatory material displayed on the display unit 18 and also out of the display unit 18, the calculation unit 114 calculates the concentration level of the entire online conference based on the display state of the participant's gaze position. For example, when the participant is gazing at a device having a display screen other than the terminal device 10, such as a smartphone or tablet terminal, the calculation unit 114 calculates the concentration level based on the display state of the display screen other than the terminal device 10. For example, when the participant is gazing at something other than the display screen, such as a notebook or memo, the calculation unit 114 may calculate the concentration level based on an image captured by a sensor 12 provided on a headset worn by a user of the terminal device 10.

[0039] (Concentration calculation process) The concentration level calculation process according to the first embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of the concentration level calculation process according to the first embodiment.

[0040] The detection unit 110 detects the gaze position of the participant of the online conference (step S10). FIG. 5 is a diagram for explaining a method for detecting the gaze position of the participant of the online conference according to the first embodiment. In the example shown in FIG. 5, the display unit 18 displays an explanatory material 181 shared in the online conference and a display range based on an application such as a text editor. In the following description, the display range based on the application may be referred to as an application 182. The application 182 is not limited to a text editor. For example, the detection unit 110 detects the coordinates of a place on the display unit 18 where the participant of the online conference is gazing, based on gaze information indicating the direction of the gaze detected by the sensor 12 of the terminal device 10. Then, the process proceeds to step S12.

[0041] The determination unit 112 determines whether the gaze position of the online conference participant is within the range in which the shared explanatory material is displayed on the display unit 18 (step S12). Specifically, it determines whether the coordinates of the gaze position of the online conference participant on the display unit 18 are included in the range in which the explanatory material is displayed. In the example shown in FIG. 5, the determination unit 112 determines whether the gaze position of the online conference participant is within the explanatory material 181. If it is determined that the gaze position of the online conference participant is within the shared explanatory material displayed on the display unit 18 (step S12; Yes), the process proceeds to step S14. If it is not determined that the gaze position of the online conference participant is within the shared explanatory material displayed on the display unit 18 (step S12; No), the process proceeds to step S16.

[0042] If it is determined as Yes in step S12, the calculation unit 114 reflects the detection result of the gaze position in the overall concentration level of the online conference (step S14). Specifically, the calculation unit 114 increases the overall concentration level of the online conference. For example, the calculation unit 114 increments the overall concentration level of the online conference by "+1". Then, the process proceeds to step S24.

[0043] If it is determined No in step S12, the determination unit 112 determines whether or not the gaze position of the participant of the online conference is in the application 182 displayed on the display unit 18 (step S16). In the example shown in FIG. 5, the determination unit 112 determines whether or not the gaze position of the participant of the online conference is in the application 182. If it is determined that the gaze position of the participant of the online conference is in the application 182 displayed on the display unit 18 (step S16; Yes), the process proceeds to step S18. If it is not determined that the gaze position of the participant of the online conference is in the application 182 displayed on the display unit 18 (step S16; No), the process proceeds to step S22.

[0044] If the result of the determination in step S18 is Yes, the calculation unit 114 determines whether the information indicated by the gaze positions of the participants of the online conference is related to the online conference (step S18). For example, when the degree of relevance indicating the relevance between the information indicated by the gaze positions of the participants of the online conference and the online conference is equal to or greater than a predetermined value, the calculation unit 114 determines that the information indicated by the gaze positions of the participants of the online conference is related to the online conference. For example, in the example shown in FIG. 5, the calculation unit 114 compares the contents described in the explanatory material 181 with the contents described in the application 182, and determines that the degree of relevance is equal to or greater than a predetermined value when the degree of match between the contents is equal to or greater than a predetermined value. In this case, the calculation unit 114 may determine the degree of match between the contents described in the explanatory material 181 and the contents described in the application 182 based on an image of the explanatory material 181 displayed on the display unit 18 and the application 182 captured by a sensor 12 provided on a headset or the like worn by a user using the terminal device 10. For example, when a participant inputs characters into the application 182 using the input unit 14, the calculation unit 114 may compare the input information input into the input unit 14 with the contents described in the explanatory material 181 to determine the degree of agreement between the contents described in the explanatory material 181 and the contents input into the application 182. For example, the calculation unit 114 may determine whether or not the degree of association indicating the relevance between the information indicated by the gaze position of the participant of the online conference and the online conference is equal to or greater than a predetermined level, based on the voice of the speaker. In this case, the calculation unit 114 may recognize, for example, voice information spoken by the speaker, compare the voice information with the contents described in the application 182, and determine that the degree of association is equal to or greater than a predetermined level when the degree of agreement between the contents is equal to or greater than a predetermined level.

[0045] The calculation unit 114 may obtain information such as a character string or an image displayed by the application 182 from the application 182, and determine whether or not information indicated by the gaze positions of the participants of the online conference is related to the online conference. In this case, consent may be obtained in advance from the user of the terminal device 10 so that information can be transmitted and received between the information processing device 100 and the application 182 of the terminal device 10.

[0046] If it is determined that the information indicated by the gaze positions of the online conference participants is related to the online conference (step S18; Yes), proceed to step S20. If it is determined that the information indicated by the gaze positions of the online conference participants is not related to the online conference (step S18; No), proceed to step S22.

[0047] If it is determined as Yes in step S18, the calculation unit 114 reflects the detection result of the gaze position in the overall concentration level of the online conference (step S20). Specifically, the calculation unit 114 increases the overall concentration level of the online conference. For example, the calculation unit 114 increases the overall concentration level of the online conference by "+1". The calculation unit 114 may weight the value to be added to the overall concentration level of the online conference according to the degree of relevance, and may set the value to be added to the overall concentration level of the online conference to be smaller than "+1". For example, the calculation unit 114 may set the overall concentration level of the online conference to "+0.1", "+0.2", "+0.3", "+0.4", "+0.5", "+0.6", "+0.7", "+0.8", or "+0.9" according to the degree of relevance. Then, the process proceeds to step S24.

[0048] If it is determined No in step S16 or No in step S18, the calculation unit 114 excludes it from the calculation of the overall concentration degree of the online conference (step S22). In step S22, the calculation unit 114 may lower the concentration degree instead of excluding it from the overall concentration degree of the online conference. For example, the calculation unit 114 sets the overall concentration degree of the online conference to "-1". Then, the process proceeds to step S24.

[0049] The control unit 106 determines whether or not the processing of all the participants in the online conference has been completed (step S24). If it is determined that the processing of all the participants in the online conference has been completed (step S24; Yes), the process proceeds to step S26. If it is determined that the processing of all the participants in the online conference has not been completed (step S24; No), the process proceeds to step S10. That is, the control unit 106 repeats the processes from step S10 to step S24 until the processing of all the participants in the online conference has been completed.

[0050] If the answer is Yes in step S24, the calculation unit 114 calculates the overall concentration level of the online conference (step S26). For example, assume that 10 participants are listening to one speaker's speech in an online conference. For example, if the number of participants who are judged as Yes in step S12 is 5 and the number of participants who are judged as Yes in step S18 is 3, the calculation unit 114 calculates the overall concentration level of the online conference as "+8". In this case, the calculation unit 114 may weight the concentration levels of the three participants who are judged as Yes in step S18, and calculate the overall concentration level of the online conference as a value smaller than "+8". Then, the process of FIG. 4 ends.

[0051] As described above, the first embodiment can calculate the concentration level of an online conference based on the line of sight of the participants in the online conference. As a result, the first embodiment can feed back the calculation result of the concentration level to the speaker, allowing the speaker to improve the explanation materials or explanation method so as to increase the concentration level of the participants.

[0052] [Second embodiment] An example of the configuration of an information processing device according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a block diagram showing an example of the configuration of an information processing device according to the second embodiment.

[0053] As shown in FIG. 6, an information processing device 100A according to the second embodiment differs from the information processing device 100 shown in FIG.

[0054] The attention degree display unit 116 displays the attention degree of the gaze of the participants on the display unit 18 of the terminal device 10 of the speaker. Specifically, the attention degree display unit 116 displays the attention degree indicating that the position of the gaze of the participants of the online conference is a position of interest of the participants of the online conference in a part of the explanatory material being viewed by the speaker that is determined by the calculation unit 114 to have a predetermined or higher relevance to the online conference.

[0055] (Concentration calculation process) The concentration level calculation process according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the concentration level calculation process according to the second embodiment.

[0056] The processes from step S30 to step S38 are the same as the processes from step S10 to step S18 shown in FIG. 4, respectively, and therefore will not be described.

[0057] If it is determined as Yes in step S32, the attention degree display unit 116 displays the attention degree of the online conference participant on the display unit 18 of the terminal device 10 of the speaker (step S39). FIG. 8 is a diagram for explaining a method of displaying an attention degree according to the second embodiment. As shown in FIG. 8, in an online conference, an explanatory material 181 is displayed on the display unit 18 of the terminal device 10 of the speaker. In step S39, the attention degree display unit 116 displays an attention degree indicating that the position of the gaze in the explanatory material 181 of the online conference participant acquired in step S10 is a position of interest of the participant. The attention degree display unit 116 displays, for example, a mark 1811 as the attention degree.

[0058] If the answer in step S38 is Yes, the attention display unit 116 displays the attention levels of the participants of the online conference on the display unit 18 of the speaker's terminal device 10 (step S40). In this case, the attention display unit 116 displays an attention level indicating that a location in the explanatory material 181 where the relevance level is equal to or higher than a predetermined level is a location of interest to the participants. The attention display unit 116 displays, for example, a mark 1812 as the attention level. Here, the marks 1811 and 1812 may be different marks or may be the same. The marks may be displayed overlapping each other, or a larger mark may be used when displaying the attention levels of multiple people at the same position. Then, the process proceeds to step S42.

[0059] The processes from step S42 to step S48 are the same as the processes from step S20 to step S26, respectively, and therefore will not be described.

[0060] As described above, in the second embodiment, in the explanatory materials shared in the online conference, information indicating the location of interest of the participants is displayed on the speaker's shared screen. This allows the speaker to properly grasp the location of interest of the participants in the second embodiment.

[0061] [Third embodiment] An example of the configuration of an information processing device according to the third embodiment will be described with reference to Fig. 9. Fig. 9 is a block diagram showing an example of the configuration of an information processing device according to the third embodiment.

[0062] As shown in FIG. 9, an information processing device 100B according to the third embodiment differs from the information processing device 100 shown in FIG.

[0063] The concentration level display unit 118 displays the overall concentration level of the online conference calculated by the calculation unit 114 on the display unit 18 of the terminal device 10 of the speaker.

[0064] (Concentration display processing) The concentration level display process according to the third embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the concentration level display process according to the third embodiment.

[0065] The processes from step S60 to step S76 are the same as the processes from step S10 to step S26 shown in FIG. 4, respectively, and therefore will not be described.

[0066] The concentration level display unit 118 displays the overall concentration level of the online conference calculated by the calculation unit 114 on the display unit 18 of the terminal device 10 of the speaker (step S78). For example, the concentration level display unit 118 may display the overall concentration level of the online conference calculated by the calculation unit 114 on the display unit 18 of the terminal device 10 of the speaker in real time, or may display it on the display unit 18 of the terminal device 10 of the speaker after the online conference ends. Specifically, the concentration level display unit 118 may display the concentration level as a numerical value, or as a graph such as a bar graph. When displayed as a graph, the concentration levels at any intervals may be displayed in chronological order. Then, the process of FIG. 10 ends.

[0067] As described above, the third embodiment displays the overall concentration level of the online conference on the display unit of the speaker's terminal device. This allows the speaker to improve the presentation materials or the presentation method so as to improve the concentration level of the participants.

[0068] Each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc. This distribution and integration configuration may be performed dynamically.

[0069] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. The above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments. [Explanation of symbols]

[0070] 1. Information Processing Systems 10 Terminal Equipment 12 Sensors 14 Input section 16 Audio input section 18 Display 20 Audio output section 22,102 Communications Department 24,104 storage section 26, 106, 106A, 106B Control section 100, 100A, 100B Information processing device 110 Detection unit 112 Judgment section 114 Calculation section 116 Gaze level display section 118 Concentration level display section

Claims

1. A detection unit that detects a position at which a participant of an online conference is gazing on a display unit that displays a shared screen shared by a speaker in the online conference and an application other than the shared screen; a determination unit that determines whether or not the position detected by the detection unit is outside the shared screen; a calculation unit that calculates a concentration level of the online conference based on a state of a position outside the shared screen that the participant is gazing at when the position that the participant is gazing at is outside the shared screen; An information processing device comprising:

2. the calculation unit calculates a concentration level of the online conference based on a display state of the application and a degree of association indicating an association between the application and the shared screen when the gaze position of the participant is off the shared screen. The information processing device according to claim 1 .

3. an attention level display unit that displays the attention level of the participant on a portion of the shared screen viewed by the speaker, the portion being determined by the calculation unit to have the relevance level equal to or higher than a predetermined level; The information processing device according to claim 2 .

4. A concentration level display unit is provided that displays the overall concentration level of the online conference on a display unit viewed by the speaker. The information processing device according to claim 1 .

5. Detecting a position at which a participant of an online conference is gazing on a display unit that displays a shared screen shared by a speaker in the online conference and an application other than the shared screen; determining whether the detected position is outside the shared screen; When the position where the participant is gazing is outside the shared screen, calculating a concentration level of the online conference based on a state of the position outside the shared screen where the participant is gazing; An information processing method comprising:

Citation Information

Patent Citations

  • Web conference system

    JP2022098825A