Information processing device, information processing method, and program

Abstract

An information processing device is provided with: a line-of-sight information acquisition unit that acquires line-of-sight information of a viewer with respect to a shared screen displayed on a display unit; and a line-of-sight guidance display determination unit that determines whether or not line-of-sight guidance display for guiding the line-of-sight of the viewers can be performed on the basis of the line-of-sight information of the plurality of viewers.

Description

Technical Field

[0001] The present technology relates to an information processing device, an information processing method, and a program, and particularly to a technology for online communication. Background Art

[0002] For example, PTL 1 describes a device that displays a guide image for guiding the participant's (viewer's) sight to the explainer's attention position when it is determined that the participant is not focusing on an image portion corresponding to the explainer's attention position explaining via a network.

[0003] [Citation list]

[0004] [Patent Document]

[0005] [PTL1] JP 2018-77417A Summary of the invention

[0006] [Technical issues]

[0007] In the aforementioned device, if the explainer does not continuously focus on the image portion being explained, the explainer's attention position may frequently deviate from the viewer's attention position, so that the guide image may be frequently displayed. In this case, the aforementioned device may confuse the viewer and fail to effectively guide the viewer's sight.

[0008] Therefore, the purpose of this technology is to effectively guide the viewer's sight.

[0009] [Solution to the problem]

[0010] An information processing device according to the present technology includes: a line of sight information acquisition unit that acquires line of sight information about a viewer to a shared screen displayed on a display unit; and a line of sight guide display determination unit that determines whether to display a line of sight guide for guiding the viewer's line of sight based on the line of sight information about the viewer.

[0011] Therefore, when the gaze point of the viewer is dispersed, the information processing device can display the sight line guide regardless of the gaze point of the explainer. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] [ Figure 1 ] Figure 1 It is an explanatory diagram of the configuration of the online communication system.

[0013] [ Figure 2 ] Figure 2 It is an explanatory diagram of the configuration of an information processing device.

[0014] [ Figure 3 ] Figure 3This is a diagram illustrating the functional configuration of the CPU.

[0015] [ Figure 4 ] Figure 4 This is an illustration of the shared screen displayed during online communication.

[0016] [ Figure 5 ] Figure 5 is an illustration of the viewer's gaze point when the moving pointer is displayed.

[0017] [ Figure 6 ] Figure 6 This is an explanatory diagram of the viewer's gaze point when the moving pointer is not displayed.

[0018] [ Figure 7 ] Figure 7 It is an explanatory diagram of the graph when the correlation value is high.

[0019] [ Figure 8 ] Figure 8 It is an explanatory diagram of the graph when the correlation value is low.

[0020] [ Fig. 9 ] Fig. 9 is an explanatory diagram of line of sight information used to calculate a correlation value when the display unit is oriented horizontally.

[0021] [ Fig.10 ] Fig.10 is an explanatory diagram of line of sight information used to calculate a correlation value when the display unit is oriented vertically.

[0022] [ Fig.11 ] Fig.11 It is an explanatory diagram of a method for calculating a correlation value when a plurality of devices are provided as a line-of-sight detector.

[0023] [ Fig.12 ] Fig.12 A heat map based on line of sight information is shown.

[0024] [ Fig.13 ] Fig.13 A heat map showing information about the viewer's line of sight.

[0025] [ Fig.14 ] Fig.14 is an explanatory diagram showing an example of a sight line guide display according to specific example 1.

[0026] [ Fig.15 ] Fig.15 is an explanatory diagram showing an example of a sight line guide display according to specific example 2.

[0027] [ Fig.16 ] Fig.16: is an explanatory diagram showing an example of a sight line guide display according to specific example 3.

[0028] [ Fig.17 ] Fig.17 is an explanatory diagram showing an example of a sight line guide display according to specific example 4.

[0029] [ Fig.18 ] Fig.18 This is a flowchart showing the flow of sight line guide display control. DETAILED DESCRIPTION

[0030] Hereinafter, the embodiments will be described in the following order.

[0031] <1. Configuration of Online Communication System 1>

[0032] <2. Configuration of Information Processing Device 2>

[0033] <3. Overview of online communication>

[0034] <4. Confirm the processing>

[0035] <5. Eye-Guidance Display Processing>

[0036] <6. Flow of sight guidance display control>

[0037] <7. Other Configuration Examples of Online Communication System 1>

[0038] <8. Overview of Implementation Methods>

[0039] <9. This technology>

[0040] <1. Configuration of Online Communication System 1>

[0041] First, the configuration of an online communication system 1 as an embodiment of the present technology will be described. Figure 1 It is an explanatory diagram of the configuration of the online communication system 1.

[0042] like Figure 1 As shown in , an online communication system 1 includes a plurality of information processing devices 2. The information processing devices 2 are connected via a network 3 such as the Internet, and can communicate with each other via the network 3.

[0043] The online communication system 1 realizes online communication such as an online conference and an online course by sharing display contents such as documents and images as a shared screen among a plurality of information processing apparatuses 2 .

[0044] Hereinafter, the information processing device 2 used by the explainer will be referred to as the explainer-side information processing device 2A, and the information processing device 2 used by the viewer will be referred to as the viewer-side information processing device 2B. When the explainer-side information processing device 2A and the viewer-side information processing device 2B are collectively described, these information processing devices will be simply referred to as the information processing device 2.

[0045] In the description, a "commentator" refers to a person who explains the content displayed as a shared screen.

[0046] Furthermore, a “viewer” refers to a person who views a shared screen and explanations made by an explainer.

[0047] In the online communication system 1, in principle, a single (one) explainer-side information processing device 2A is provided, and other information processing devices are used as viewer-side information processing devices 2B. Therefore, a plurality of viewer-side information processing devices 2B are provided in general. However, only a single (one) viewer-side information processing device 2B may be provided.

[0048] <2. Configuration of Information Processing Device 2>

[0049] Figure 2 2 is an explanatory diagram of the configuration of the information processing device 2. Figure 2 As shown in FIG, the information processing device 2 is a computer including a central processing unit (CPU) 10, a read only memory (ROM) 11, a random access memory (RAM) 12, and a storage unit 13. The information processing device 2 is, for example, a personal computer, a portable terminal device such as a smartphone, or a tablet computer.

[0050] The CPU 10 performs control on the information processing apparatus 2 by expanding and executing a program in the RAM 12 , the program being stored in the ROM 11 or the storage unit 13 .

[0051] The storage unit 13 is composed of a storage medium such as a solid-state memory, for example. For example, the storage unit 13 can store various information, which will be described later. In addition, the storage unit 13 can be used to store program data that allows the CPU 10 to perform various processes.

[0052] The information processing device 2 includes a display unit 14 , an operation unit 15 , a line of sight detector 16 , a communication unit 17 , a microphone 18 , a speaker 19 , and an imaging unit 20 , in addition to a CPU 10 , a ROM 11 , a RAM 12 , and a storage unit 13 .

[0053] The display unit 14 is, for example, a liquid crystal display or an organic light emitting diode (OLPD) display that displays various screens (images).

[0054] The operation unit 15 is an input device or operation device such as a keyboard, a mouse, a button, a dial, a touch pad, and a touch panel used by a user, for example, various operators. When a user operation is detected by the operation unit 15, a signal corresponding to the input operation is input to the CPU 10.

[0055] The sight line detector 16 is a device for detecting the sight line direction of the user. The sight line detector 16 detects the sight line direction of the user by a corneal reflection method or by detecting facial features.

[0056] When detecting the user's line of sight direction by the corneal reflection method, the line of sight detector 16 includes an infrared light source that emits infrared rays and an infrared camera device that receives infrared rays, and the line of sight detector 16 detects the user's line of sight direction based on an image obtained by the following method: receiving infrared rays by the infrared camera device after the infrared rays are emitted from the infrared light source and reflected by the user's pupil.

[0057] When detecting the gaze direction of the user by detecting facial features, the gaze detector 16 includes a visible light camera that receives visible light, and the gaze detector 16 detects the features by analyzing a facial image of the user captured by the visible light camera, and estimates the gaze direction of the user based on, for example, the orientation of the face and the position of the iris.

[0058] Furthermore, the visual line detector 16 detects the shared screen 31 displayed on the display unit 14 based on, for example, the detected visual line direction of the user and the positional relationship between the visual line detector 16 and the display unit 14 (see Figure 4 ), that is, the coordinates (X, Y) of the user's gaze point. X indicates the coordinate in the horizontal direction, and Y indicates the coordinate in the vertical direction.

[0059] In addition, in addition to or instead of the coordinates (X, Y) of the gaze point, the gaze detector 16 can detect the deflection and pitch of the user's pupil (collectively referred to as pupil rotation) based on changes in the user's gaze direction.

[0060] The line of sight detector 16 outputs line of sight information to the CPU 10, or sends the line of sight information to another information processing device 2 through the communication unit 17. The line of sight information includes at least the coordinates (X, Y) of the detected user's gaze point or the rotation (yaw, pitch) of the pupil.

[0061] If the coordinates (X, Y) of the user's gaze point and the rotation (yaw, pitch) of the pupil can be detected, the sight line detector 16 may be different from the aforementioned configuration. In addition, the sight line detector 16 may detect only one of the X coordinate and the Y coordinate of the coordinates (X, Y) of the gaze point. Similarly, the sight line detector 16 may detect only one of the yaw and pitch of the rotation (yaw, pitch) of the pupil.

[0062] The sight line detector 16 may detect sight line information about the user in cooperation with the CPU 10 .

[0063] The communication unit 17 communicates with another information processing device 2 via the network 3 .

[0064] The microphone 18 collects voice from the user.

[0065] The speaker 19 outputs sound to the user.

[0066] The imaging unit 20 is an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and captures an image of the user's face (upper body).

[0067] Figure 3 1 is an explanatory diagram of the functional configuration of the CPU 10. Figure 3 As shown in , the CPU 10 functions as a display control unit 21 , an explainer identification unit 22 , an operation information acquisition unit 23 , a line of sight information acquisition unit 24 , a correlation calculation unit 25 , and a line of sight guide display determination unit 26 .

[0068] The display control unit 21 performs control on screen display of the display unit 14 .

[0069] The presenter identifying unit 22 identifies one of the users of the information processing device 2 as the presenter based on the sound input to the microphone 18 or the sound transmitted from another information processing device 2. In other words, the presenter identifying unit 22 identifies the presenter-side information processing device 2A from among the plurality of information processing devices 2.

[0070] The operation information acquisition unit 23 acquires operation information about a pointing operation on the shared screen 31 from, for example, the presenter-side information processing device 2A.

[0071] The line-of-sight information acquisition unit 24 acquires line-of-sight information from the line-of-sight detector 16 , and acquires line-of-sight information from another information processing device 2 .

[0072] The correlation calculation unit 25 calculates the correlation of the line of sight information between the multiple viewers based on the line of sight information acquired by the line of sight information acquisition unit 24. In this case, the correlation is an index indicating the relationship of the line of sight information (fixation points) between the multiple viewers, for example, a correlation value (correlation coefficient) or a degree of dispersion.

[0073] The sight line guide display determination unit 26 determines whether to provide a sight line guide display for guiding the sight of the viewer based on the sight line information acquired by the sight line information acquisition unit 24 , more specifically, the correlation calculated by the correlation calculation unit 25 .

[0074] The details of the display control unit 21, the explainer identification unit 22, the operation information acquisition unit 23, the line of sight information acquisition unit 24, the relevance calculation unit 25, and the line of sight guide display determination unit 26 will be described later. The display control unit 21, the explainer identification unit 22, the operation information acquisition unit 23, the line of sight information acquisition unit 24, the relevance calculation unit 25, and the line of sight guide display determination unit 26 may partially not function depending on whether the information processing device 2 is the explainer-side information processing device 2A or the viewer-side information processing device 2B.

[0075] <3. Overview of online communication>

[0076] Figure 4 31 is an explanatory diagram of a shared screen 31 displayed during online communication. Figure 4 As shown in , the display control unit 21 displays a shared screen 31 showing content on the display unit 14 during online communication, the shared screen 31 being shared by the information processing apparatus 2 .

[0077] Furthermore, the display control unit 21 displays a character screen 32 including the user's face captured by the imaging unit 20 of the information processing device 2 , for example, in the lower portion of the shared screen 31 .

[0078] The shared screen 31 is shared by transmitting, for example, screen data of the shared screen 31 displayed on the display unit 14 of the explainer-side information processing device 2A from the explainer-side information processing device 2A to the viewer-side information processing device 2B.

[0079] Therefore, in all the information processing devices 2 participating in the online communication, the shared screen 31 and the character screen 32 are displayed on the display unit 14 .

[0080] In addition, the display unit 14 displays a pointer 33 that moves in response to, for example, a pointing operation on the shared screen 31 of the explainer-side information processing device 2A. In the explainer-side information processing device 2A, the position (coordinates) of the pointer 33 that moves on the shared screen 31 in response to the operation of the operation unit 15 is detected by the CPU 10, and operation information about the position is sent to the viewer-side information processing device 2B. The display control unit 21 of the viewer-side information processing device 2B displays the moving pointer 33 based on the sent operation information.

[0081] Therefore, the pointer 33 is displayed at the same position on the shared screen 31 of the explainer-side information processing device 2A and the viewer-side information processing device 2B. However, the pointing operation is not necessarily performed in the explainer-side information processing device 2A, but may be performed in the viewer-side information processing device 2B. In this case, the viewer-side information processing device 2B that has detected the pointing operation sends the operation information to the explainer-side information processing device 2A and the other viewer-side information processing devices 2B.

[0082] The information processing device 2 (both the explainer-side information processing device 2A and the viewer-side information processing device 2B) then transmits the sound collected by the microphone 18 to other information processing devices 2, and outputs the sound transmitted from the other information processing devices 2 from the speaker 19. Therefore, the sound is also shared by all the information processing devices 2.

[0083] Furthermore, in the present embodiment, the information processing device 2 transmits the line of sight information detected by the line of sight detector 16 to another information processing device 2. The line of sight information acquiring unit 24 acquires the transmitted line of sight information.

[0084] Figure 5 3 is an explanatory diagram of a gaze point 34 of a viewer when a moving pointer 33 is displayed. Figure 6 3 is an explanatory diagram of the gaze point 34 of the viewer when the moving pointer 33 is not displayed.

[0085] When the moving pointer 33 is displayed in response to the explaining person's pointing operation, the viewer can recognize that the explaining person is indicating a point near the position of the pointer 33 , and thus the viewer moves the line of sight to follow the pointer 33 .

[0086] In other words, if Figure 5 As shown in FIG. 3 , gaze points 34 of a plurality of viewers are concentrated on or near the pointer 33 .

[0087] When the explainer does not perform a pointing operation, the moving pointer 33 is not displayed, so that it may be difficult for the viewer to recognize the point indicated by the explainer on the shared screen 31. Figure 6 As shown in , the gaze point 34 varies among multiple viewers.

[0088] The presenter identification unit 22 of all the information processing devices 2 first detects a speech segment of the sound input from the information processing device 2 with the microphone 18 turned on by using the sound segment detection technology. When the pointing operation is performed during the speech segment, the presenter identification unit 22 identifies the information processing device 2 that has transmitted the sound with the detected voice as the presenter-side information processing device 2A.

[0089] The explainer identification unit 22 may identify the explainer-side information processing device 2A according to any method other than the aforementioned method. For example, the information processing device 2 having the authority to perform the pointing operation may be identified as the explainer-side information processing device 2A.

[0090] Furthermore, it may be preset whether the information processing device 2 is the explainer-side information processing device 2A or the viewer-side information processing device 2B. In this case, the explainer identification unit 22 does not need to identify the explainer-side information processing device 2A.

[0091] When the moving pointer 33 is not displayed, the viewer-side information processing device 2B performs a line-of-sight guide display control for providing a line-of-sight guide display based on line-of-sight information about a plurality of viewers.

[0092] The sight line guide display control includes: a determination process for determining whether to display the sight line guide by calculating the correlation of the sight line information between a plurality of viewers; and a sight line guide display process for displaying the sight line guide.

[0093] The determination processing and the sight line guide display processing will be described below. In the description of the determination processing and the sight line guide display processing, the viewer using the viewer-side information processing device 2B that performs the processing is referred to as the relevant viewer, and the viewer using the other viewer-side information processing device 2B is referred to as the other viewer.

[0094] <4. Confirm the processing>

[0095] In the determination process, correlation of line-of-sight information between a plurality of viewers is calculated by the correlation calculation unit 25, and whether to display a line-of-sight guide is determined based on the correlation by the line-of-sight guide display determination unit 26. A specific example of the determination process will be described below.

[0096] [4.1. Specific example 1]

[0097] Figure 7 It is an explanatory diagram of the graph when the correlation value is high. Figure 8 is an explanatory diagram of a graph when the correlation value is low. In the specific example 1, the correlation calculation unit 25 calculates the correlation value as the correlation between a plurality of viewers.

[0098] The line of sight information acquisition unit 24 acquires the line of sight information about other viewers (hereinafter referred to as other viewer line of sight information) transmitted from the other viewer side information processing device 2B. The correlation calculation unit 25 calculates the correlation value between the acquired other viewer line of sight information and the line of sight information about the relevant viewer (hereinafter referred to as the relevant viewer line of sight information), which is detected by the line of sight detector 16. The correlation value is calculated for each piece of other viewer line of sight information by using, for example, Pearson's product-moment correlation coefficient.

[0099] In other words, the correlation calculation unit 25 calculates the correlation value of the line of sight information between the viewer and the other viewers for each of the other viewers. The correlation value thus calculated is, for example, any value in the range of -1 to 1. The correlation value tending toward 1 indicates that the correlation is stronger.

[0100] The correlation calculation unit 25 then calculates the average of the calculated correlation values ​​of the corresponding other viewers as the correlation value of the relevant viewer. When the correlation value of the relevant viewer is calculated, the correlation calculation unit 25 sends the correlation value of the relevant viewer to the other viewer-side information processing devices 2B. Therefore, all viewer-side information processing devices 2B can obtain the correlation values ​​of all viewers.

[0101] Figure 7 The upper curve and Figure 8 The upper graph shows the time variation of the X coordinates of five viewers. Figure 7 The lower graph shows Figure 7 The above graph shows the correlation values ​​of the five viewers, and Figure 8 The lower graph shows Figure 8 The above graph shows the correlation values ​​of the five viewers. Figure 7 and Figure 8 In the example of FIG. 1 , the value of the X coordinate is used as the line of sight information to calculate the correlation value.

[0102] like Figure 7 As shown in , when five viewers view almost the same position on the shared screen 31 , the five viewers have a high correlation value.

[0103] like Figure 8 As shown in , when five viewers watch different positions on the shared screen 31 , the five viewers have low correlation values.

[0104] As described above, when the viewer has a low correlation value, the viewer views a different position on the shared screen 31. It is estimated that the position indicated by the explainer is not recognized by the viewer.

[0105] Therefore, for example, when the ratio of the correlation value equal to or less than the predetermined threshold to the correlation values ​​of all viewers is equal to or greater than a predetermined value, the sight line guide display determination unit 26 determines that the sight line guide is to be displayed.

[0106] like Figure 7 and Figure 8 As shown in the example, assuming that Figure 7 and Figure 8The threshold value indicated by the dotted line in is set at 0.7, and the predetermined value is set at 60%. In this case, when the ratio of correlation values ​​of 0.7 or less is 60% (three-fifths) or more, that is, when three or more viewers have correlation values ​​of 0.7 or less, the sight line guide display determination unit 26 determines to display the sight line guide.

[0107] When only a single viewer-side information processing device 2B is provided, that is, when there is only one viewer, the correlation calculation unit 25 may calculate a correlation value between the line of sight information about the viewer concerned and the line of sight information of the explainer transmitted from the explainer-side information processing device 2A as a correlation value of the viewer concerned. Thereafter, when the correlation value of the viewer concerned is equal to or less than a threshold value, the line of sight guide display determination unit 26 may determine that a line of sight guide is to be displayed.

[0108] [4.2. Specific example 2]

[0109] Fig. 9 1 is an explanatory diagram of line-of-sight information used for calculating a correlation value when the display unit 14 is oriented horizontally. Fig.10 2 is an explanatory diagram of line-of-sight information used for calculating a correlation value when the display unit 14 is oriented vertically.

[0110] In Specific Example 2, if the line of sight information acquired from one of the information processing devices 2 includes a plurality of information items, the information item to be used for calculating the correlation value is switched according to the aspect ratio of the display unit 14 .

[0111] like Fig. 9 As shown in , when the display unit 14 is oriented horizontally, the viewer's line of sight moves largely in the lateral direction (horizontal direction), but hardly moves in the longitudinal direction (vertical direction). Therefore, when the display unit 14 is oriented horizontally, the correlation calculation unit 25 calculates the correlation value by using the X-coordinate value of the line of sight information.

[0112] like Fig.10 As shown in , when the display unit 14 is oriented vertically, the viewer's line of sight hardly moves in the lateral direction (horizontal direction), but moves in the longitudinal direction (vertical direction) to a large extent. Therefore, when the display unit 14 is oriented vertically, the correlation calculation unit 25 calculates the correlation value by using the Y coordinate value of the line of sight information.

[0113] As described above, the information items to be used for calculating the correlation value are switched according to the aspect ratio of the display unit 14 , thereby calculating the correlation value with high accuracy.

[0114] If the line of sight information includes a plurality of information items, the information item to be used for calculating the correlation value may be determined based on the aspect ratio of the content instead of the aspect ratio of the display unit 14 .

[0115] As in Specific Example 1, for example, when the ratio of the correlation value equal to or less than the predetermined threshold to the correlation values ​​of all viewers is equal to or greater than a predetermined value, the line of sight guide display determination unit 26 determines that the line of sight guide is to be displayed.

[0116] [4.3. Specific example 3]

[0117] In Specific Example 3, if the line-of-sight information acquired from one of the information processing devices 2 includes a plurality of information items, weights are assigned to the information items to calculate correlation values.

[0118] For example, when the values ​​of the X coordinate and the Y coordinate of the gaze point are included as the line of sight information, the correlation calculation unit 25 calculates the correlation value Cx of the value of the X coordinate and the correlation value Cy of the value of the Y coordinate. In addition, the correlation calculation unit 25 calculates the correlation value C using the preset weight wx for the X coordinate and the preset weight wy for the Y coordinate according to formula (1):

[0119] C=Cx·wx+Cy·wy (1)

[0120] As described above, calculating the correlation value by assigning weights to the information items makes it possible to calculate the correlation value with higher accuracy than calculating the correlation value using a single information item.

[0121] As in Specific Example 1, for example, when the ratio of the correlation value C equal to or less than the predetermined threshold to the correlation values ​​C of all viewers is equal to or greater than a predetermined value, the sight line guide display determination unit 26 determines that the sight line guide is to be displayed.

[0122] [4.4. Specific example 4]

[0123] Fig.11 is an explanatory diagram of a method for calculating a correlation value when a plurality of devices are provided as the line of sight detector 16. In the specific example 4, for example, when Fig.11 When the visible light camera device 16A and the infrared device 16B shown in FIG. 1 are provided as the line of sight detector 16 , the correlation calculation unit 25 calculates the correlation value using the detection result of the device having high reliability or stability.

[0124] In this configuration, the infrared device 16B includes an infrared camera and an infrared light source. The infrared device 16B can detect the user's line of sight information with higher accuracy than the visible light camera 16A, but has a narrower detection range.

[0125] On the other hand, the visible light imaging device A has lower accuracy but a wider detection range than the infrared device 16B.

[0126] Therefore, the viewer-side information processing device 2B sends one of the line of sight information detected by the visible light camera 16A and the line of sight information detected by the infrared device 16B to the other viewer-side information processing device 2B, so that the sent line of sight information has higher reliability or stability. Therefore, as in Specific Example 1, the correlation calculation unit 25 can calculate the correlation value by using the line of sight information with high reliability or stability.

[0127] As in Specific Example 1, for example, when the ratio of the correlation value equal to or less than the predetermined threshold to the correlation values ​​of all viewers is equal to or greater than a predetermined value, the line of sight guide display determination unit 26 determines that the line of sight guide is to be displayed.

[0128] In addition, the viewer-side information processing device 2B may transmit both the line of sight information detected using the visible light camera 16A and the line of sight information detected using the infrared device 16B to other viewer-side information processing devices 2B. In this case, the correlation calculation unit 25 of the other viewer-side information processing device 2B may calculate the correlation value by using the line of sight information having high reliability or stability.

[0129] Alternatively, as in Specific Example 3, the correlation calculation unit 25 may calculate the correlation value by assigning weights to the line of sight information detected using the visible light camera 16A and the line of sight information detected using the infrared camera 16B.

[0130] [4.5. Specific example 5]

[0131] Fig.12 A heat map 41 based on line of sight information is shown. Fig.12 The heat map 41 on the left side of FIG. 4 shows the focus points of multiple viewers. Fig.12 The heat map 41 on the right side shows the scattered gaze points of multiple viewers.

[0132] In Specific Example 5, a heat map 41 is generated as the correlation, and whether to display the sight line guide is determined based on the heat map 41 .

[0133] When the line of sight information is acquired by the line of sight information acquisition unit 24, the correlation calculation unit 25 counts the coordinates of the gaze points of the viewers on the shared screen 31 based on the acquired line of sight information about all viewers, so that a heat map 41 indicating the concentration (dispersion) of the line of sight information (gaze points) is generated. When the heat map 41 is generated, it is desirable to include the coordinates (X, Y) as the line of sight information.

[0134] like Fig.12As shown on the left side of , when the generated heat map 41 includes a concentrated area 42 having a predetermined value or a greater value - which assumes that the gaze points of multiple viewers are concentrated (the gaze points of multiple viewers are hardly dispersed), the line of sight guide display determination unit 26 determines not to display the line of sight guide.

[0135] like Fig.12 As shown on the right side of , when the generated heat map 41 does not include a concentrated area 42 having a predetermined value or more (the gaze points of multiple viewers are widely dispersed), the sight line guide display determination unit 26 determines to display the sight line guide.

[0136] [4.6. Other examples]

[0137] In the aforementioned specific examples 1 to 5, the correlation value or the heat map 41 is calculated (generated) as the correlation degree. The correlation degree may be a degree similarly obtained using dynamic time warping (DTW), for example.

[0138] Furthermore, the sight line guide display determination unit 26 may determine whether to display the sight line guide based on the sleepiness level or posture change of the viewer in addition to the correlation calculated by the correlation calculation unit 25 .

[0139] When the sleepiness level is used, for example, image analysis may be performed on the image captured by the imaging unit 20 to calculate the sleepiness level of the viewer, or the sleepiness level of the viewer may be calculated by a life sensor not shown. Thereafter, when the sleepiness level of the viewer is equal to or greater than a predetermined value, the sight line guide display determination unit 26 determines to display the sight line guide.

[0140] When using gesture changes, for example, the sight line guide display determination unit 26 detects whether the viewer tilts the head by performing image analysis on the image captured by the imaging unit 20. If tilting of the viewer's head is detected, the sight line guide display determination unit 26 determines to display the sight line guide.

[0141] Furthermore, the sight guide display determination unit 26 may determine not to display the sight guide until a predetermined period of time has passed since the content on the shared screen 31 was switched. This is because the viewer watches the entire shared screen 31 immediately after the content is switched and thus may have a low relevance.

[0142] Furthermore, the line of sight guide display determination unit 26 may determine whether to display the line of sight guide in response to an instruction transmitted from the explainer-side information processing device 2A, that is, an instruction from the explainer.

[0143] In addition, when the content on the shared screen 31 is identified as including only a short sentence such as “Thank you for your attention” or an image of only a single small graphic, that is, when the viewer's line of sight is likely to be focused at the same time, the line of sight guide display determination unit 26 can determine not to display the line of sight guide.

[0144] Furthermore, when the content on the shared screen 31 is identified as including only blanks or only solid-filled images, a sight line guide is not necessary, and thus the sight line guide display determination unit 26 may determine not to display a sight line guide.

[0145] When the content includes sentences, the relevance calculation unit 25 may perform image analysis on the content on the shared screen 31 and determine information used in the calculation of the relevance value according to the orientation of the sentence (character). For example, in the case of a horizontally written sentence, the relevance calculation unit 25 calculates the relevance value using the X-coordinate value of the line of sight information, and in the case of a vertically written sentence, the relevance calculation unit 25 calculates the relevance value by using the Y-coordinate value of the line of sight information.

[0146] When the content includes sentences, the relevance calculation unit 25 may calculate the relevance according to the reciprocating pattern of the viewer's line of sight based on the line of sight information.

[0147] <5. Eye-Guidance Display Processing>

[0148] In the sight line guide display process, when the sight line guide display determination unit 26 determines that the sight line guide is to be displayed, the sight line guide is displayed by the display control unit 21 .

[0149] Fig.13 The heat map 51 about the view information of the speaker is shown. The display control unit 21 counts the coordinates of the view point of the speaker on the shared screen 31 based on the view information sent from the speaker-side information processing device 2A, so as to generate a heat map 51 as shown in FIG. Fig.13 A heat map 51 indicating the degree of concentration of the line of sight information about the explainer is shown in FIG.

[0150] The display control unit 21 then specifies the coordinates most frequently viewed by the explainer on the shared screen 31 as the highest frequency position 52 based on the generated heat map 51. The highest frequency position is the position (coordinates) most frequently viewed by the explainer on the shared screen 31, assuming that the highest frequency position is located in the area explained by the explainer on the shared screen 31.

[0151] Therefore, when the highest frequency position 52 is specified, the display control unit 21 displays a sight line guide to move the sight line of the viewer to the highest frequency position 52. A specific example of the sight line guide display process will be described below.

[0152] [5.1. Specific example 1]

[0153] Fig.14 is an explanatory diagram showing an example of a sight line guide display according to Specific Example 1. In Specific Example 1, as Fig.14As shown in , the display control unit 21 displays the area 53 having a predetermined width in the horizontal direction for the highest frequency position 52 and the blurred area 54 other than the area 53 on the shared screen 31 as they are.

[0154] However, in the specific example 1, the sight line guide display determination unit 26 may display the area having a predetermined width in the vertical direction for the highest frequency position 52 and the blurred area other than the area on the shared screen 31 as it is.

[0155] In other words, in the specific example 1, the sight line guide display determination unit 26 displays the area within the predetermined range for the highest frequency position 52 and the blurred area other than the area as it is on the shared screen 31. In particular, when the shared screen 31 shows a graph, it is preferable to display the area having a predetermined width perpendicular to (horizontally or vertically) the extending direction of the graph as it is.

[0156] Therefore, the blurred area 54 becomes less visible, causing viewers to naturally move their sights to the area 53 displayed as it is.

[0157] [5.2. Specific example 2]

[0158] Fig.15 is an explanatory diagram showing an example of a sight line guide display according to Specific Example 2. In Specific Example 2, the display control unit 21 specifies the highest frequency position 52 as in Specific Example 1. Fig.15 As shown in FIG. 1 , the display control unit 21 displays a mark 55 in a predetermined shape, for example, a circle, for the highest frequency position 52 .

[0159] Therefore, the viewer can recognize that the area surrounded by the mark 55 is the area indicated by the explainer, so that the viewer's sight moves to the area surrounded by the mark 55 .

[0160] [5.3. Specific example 3]

[0161] Fig.16 is an explanatory diagram showing an example of a sight line guide display according to Specific Example 3. In Specific Example 3, the display control unit 21 specifies the highest frequency position 52 as in Specific Example 1. Fig.16 As shown in FIG. 1 , the display control unit 21 displays the pointer 33, which is oriented at the highest frequency position 52 as shown in FIG. Fig.16 The circular form indicated by the arrow moves.

[0162] Therefore, the viewer can recognize that the area in the movement range of the pointer 33 is the area indicated by the explainer, so that the viewer's line of sight moves to the area in the movement range of the pointer 33 .

[0163] [5.4. Specific example 4]

[0164] Fig.17 4 is an explanatory diagram showing an example of a sight line guide display according to Specific Example 4. In Specific Example 4, the display control unit 21 specifies the highest frequency position 52 as in Specific Example 1. Fig.17 As shown in , the display control unit 21 provides a sight line guiding animation which displays the pointer 33 moving from the gaze point 56 of the relevant viewer to the highest frequency position 52 .

[0165] Therefore, the viewers move their sight lines according to the movement of the pointer 33 so that the sight lines move to the area indicated by the explainer.

[0166] [5.5. Other examples]

[0167] An example of the sight line guide display is described in Specific Examples 1 to 4. If the sight line of the viewer can be moved to the highest frequency position 52, the display control unit 21 can provide another sight line guide display.

[0168] Alternatively, the display control unit 21 may switch one of the specific examples 1 to 4 or another sight line guide display according to the content displayed on the shared screen 31. For example, when the content is a chart, the display control unit 21 may provide a sight line guide display according to the specific example 1, or when a small object is displayed at the highest frequency position 52, provide a sight line guide display according to the specific example 3.

[0169] Furthermore, when the viewer does not move their sight within a predetermined time after the sight line guide is displayed according to, for example, one of Specific Examples 1 to 4, the display control unit 21 may provide another sight line guide display.

[0170] In Specific Examples 1 to 4, the sight line guide is displayed to guide the sight line of the viewer to the highest frequency position 52. However, the sight line guide may be displayed to move the sight line to the current gaze point of the explainer.

[0171] <6. Flow of sight guidance display control>

[0172] Fig.18 is a flowchart showing the flow of sight line guide display control. In the viewer side information processing device 2B, according to Fig.18 Flowchart of executing sight line guide display control.

[0173] In step S1, the sight line guide display determination unit 26 determines whether the speaker is speaking by sound analysis of the sound sent from the speaker-side information processing device 2A. When the speaker is speaking (yes in step S1), in step S2, the sight line guide display determination unit 26 determines whether the pointing operation has been inactive for a certain period of time or longer based on, for example, the operation information sent from the speaker-side information processing device 2A. If the pointing operation has been inactive for a certain period of time or longer (yes in step S2), in step S3, the correlation calculation unit 25 calculates the correlation (correlation value or heat map) as described above. In step S4, the sight line guide display determination unit 26 performs a determination process for determining whether to display the sight line guide based on the calculated correlation.

[0174] In step S5, the display control unit 21 determines whether it has been determined in the determination process to provide the sight line guide display. If it has been determined to provide the sight line guide display (yes in step S5), in step S6, the display control unit 21 resets the sight line guide display off timer. In step S7, the display control unit 21 displays the sight line guide and returns the process to step S1.

[0175] If the speaker has not spoken (No in step S1), the pointing operation has been performed within a certain period of time (No in step S2), and it has not been determined to provide the sight line guide display (No in step S5), the display control unit 21 determines in step S8 whether the sight line guide display off timer has passed. If the sight line guide display off timer has passed (Yes in step S8), in step S9, the display control unit 21 terminates the sight line guide display and returns the processing to step S1. As described above, the sight line guide display off timer is set, and even if it is determined that the sight line guide display is not required, the sight line guide display is terminated after the sight line guide display off timer has passed. This can prevent the sight line guide display from being repeatedly provided and interrupted due to a temporary change in the relevance.

[0176] <7. Other Configuration Examples of Online Communication System 1>

[0177] The embodiment is not limited to the foregoing specific example, and may be configured as various modifications.

[0178] In the embodiment, all viewer-side information processing devices 2B are configured to perform sightline guidance display control. However, the viewer-side information processing device 2B or the explainer-side information processing device 2A and one of the other information processing devices may perform sightline guidance display control and send the result to all viewer-side information processing devices 2B.

[0179] In an embodiment, when a pointing operation is not performed, a sight line guide is displayed. However, in the case of a low correlation when a pointing operation is performed, a sight line guide may be displayed because the viewer may not be able to recognize the indicated area.

[0180] <8. Overview of Implementation Methods>

[0181] As described above, the information processing device 2 of the present embodiment includes a line of sight information acquisition unit 24 and a line of sight guide display determination unit 26, wherein the line of sight information acquisition unit 24 acquires line of sight information about the viewer to the shared screen 31 displayed on the display unit 14, and the line of sight guide display determination unit 26 determines whether to display a line of sight guide for guiding the viewer's line of sight based on the line of sight information about the viewer.

[0182] Therefore, regardless of the explanation's gaze point, the information processing device 2 can display the sight line guide when the viewer's gaze point is dispersed. In other words, when the viewer may not be able to recognize the area indicated by the explanation, the information processing device 2 can display the sight line guide.

[0183] Therefore, the information processing device 2 can effectively guide the viewer's line of sight.

[0184] The information processing apparatus 2 further includes an operation information acquisition unit 23 that acquires operation information about a pointing operation performed by the explainer on the shared screen 31. When a pointing operation is not performed, the sight line guide display determination unit 26 determines whether to display a sight line guide.

[0185] Therefore, the information processing device 2 can display the sight line guide when the area indicated by the lecturer is difficult for the viewer to recognize without the pointing operation.

[0186] Furthermore, the correlation calculation unit 25 is provided to calculate the correlation of line-of-sight information between a plurality of viewers, and the line-of-sight guide display determination unit 26 determines whether to display a line-of-sight guide based on the correlation.

[0187] Therefore, when the correlation between the gaze points of the viewer is low, the information processing device 2 can display the sight line guide on the assumption that the viewer does not recognize the area indicated by the explainer.

[0188] Furthermore, the correlation calculation unit 25 calculates correlation values ​​of line-of-sight information between a plurality of viewers, and the line-of-sight guide display determination unit 26 determines whether to display a line-of-sight guide based on the correlation values.

[0189] Therefore, when the gaze point of the viewer has a low correlation value, the information processing device 2 can display the sight line guide on the assumption that the viewer does not recognize the area indicated by the explainer.

[0190] Furthermore, the correlation calculation unit 25 calculates the degree of dispersion of the line of sight information about the viewer, and the line of sight guide display determination unit 26 determines whether to display the line of sight guide based on the degree of dispersion.

[0191] Therefore, when the gaze points of the viewer have a large degree of dispersion, the information processing device 2 can display the sight line guide on the assumption that the viewer does not recognize the area indicated by the explainer.

[0192] Furthermore, the line of sight information includes the coordinates of the viewer's gaze point on the shared screen 31 .

[0193] Therefore, the information processing device 2 can determine whether to display the line of sight guide based on the coordinates of the viewer's gaze point on the shared screen 31 .

[0194] Furthermore, the line of sight information includes a plurality of information items about the line of sight of the viewer, and the relevance calculation unit 25 calculates the relevance based on the information corresponding to the orientation of the characters displayed on the shared screen 31 .

[0195] Therefore, the correlation is calculated based on the line-of-sight information about the direction in which the viewers are likely to largely move their lines of sight, so that the correlation can be calculated with high accuracy.

[0196] Furthermore, the line of sight information includes a plurality of information items about the line of sight of the viewer, and the correlation calculation unit 25 calculates the correlation based on the information corresponding to the aspect ratio of the display unit 14 .

[0197] Therefore, the correlation is calculated based on the line-of-sight information about the direction in which the viewers are likely to largely move their lines of sight, so that the correlation can be calculated with high accuracy.

[0198] The line of sight information includes rotation information about the pupil of the viewer.

[0199] Therefore, even if the coordinates of the viewer's gaze point cannot be detected on the shared screen 31 , the information processing device 2 can determine whether to display the line of sight guide.

[0200] The line of sight information includes a plurality of information items regarding the line of sight of the viewer, and the relevance calculation unit 25 calculates the relevance by assigning weights to the plurality of information items included in the line of sight information.

[0201] Therefore, the information processing device 2 can accurately calculate the degree of correlation by using a plurality of information items.

[0202] The display control unit 21 is configured to display the sight line guide when determining that the sight line guide is to be displayed.

[0203] Therefore, the information processing device 2 can guide the viewer's line of sight to the area indicated by the explainer.

[0204] The display control unit 21 displays a blurred area outside a predetermined range for the lecturer's gaze point on the shared screen 31 as a sight line guide display.

[0205] Therefore, the information processing device 2 can guide the viewer's line of sight to the clear area.

[0206] The display control unit 21 displays a mark 55 for the point of gaze of the lecturer on the shared screen 31 as a sight line guide display.

[0207] Therefore, the information processing device 2 can guide the viewer's line of sight to the area inside the mark 55 .

[0208] The display control unit 21 displays a moving icon (pointer 33 ) for the point of gaze of the explainer on the shared screen 31 as a line guide display.

[0209] Therefore, the information processing device 2 can guide the viewer's line of sight to the vicinity of the icon that moves as the guide display.

[0210] The display control unit 21 displays a sight line guide animation from the gaze point of the viewer to the gaze point of the explainer on the shared screen 31 as a sight line guide display.

[0211] Therefore, the information processing device 2 can move the viewer's line of sight from the current gaze point to the area indicated by the explainer.

[0212] The sight line guide display determination unit 26 switches whether to display the sight line guide in response to the instruction of the instructor.

[0213] Therefore, if the explainer does not intend to move the viewer's line of sight to the predetermined area, the information processing device 2 may determine not to display the line of sight guide.

[0214] Furthermore, the sight line guide display determination unit 26 determines not to display the sight line guide for a predetermined period of time after the shared screen 31 is switched.

[0215] Therefore, when the viewer views the entire shared screen 31 immediately after switching the shared screen 31 , the information processing device 2 can skip the line of sight guide display.

[0216] When the display unit 14 displays the shared screen 31 on which the gaze point of the viewer is focused, the sight line guide display determination unit 26 determines not to display the sight line guide.

[0217] Therefore, when the viewer can easily identify the gaze point, the information processing device 2 can skip the sight line guide display.

[0218] The information processing device according to claim 1.

[0219] As described above, the information processing method of this embodiment enables the information processing device 2 to obtain the viewer's line of sight information on the shared screen 31 displayed on the display unit 14, and determine whether to display a line of sight guide for guiding the viewer's line of sight based on the viewer's line of sight information.

[0220] As described above, the program of the present embodiment causes the information processing device 2 to execute the following processing: acquire the viewer's line of sight information on the shared screen 31 displayed on the display unit 14, and determine whether to display the line of sight guide for guiding the viewer's line of sight based on the viewer's line of sight information.

[0221] The program may be recorded in advance in a HDD serving as a recording medium embedded in a device such as a computer device or a ROM or the like in a microcomputer including a CPU.

[0222] Alternatively, the program may be temporarily or permanently stored (recorded) on a removable recording medium such as a floppy disk, a compact disk read-only memory (CD-ROM), a magneto-optical (MO) disk, a digital versatile disk (DVD), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, or a memory card. The removable recording medium may be provided as so-called packaged software.

[0223] The program can be installed from a removable recording medium to a personal computer or the like, and can also be downloaded from a download site via a network such as a local area network (LAN) or the Internet.

[0224] Note that the advantageous effects described in this specification are merely exemplary and not restrictive, and other advantageous effects may be obtained.

[0225] <9. This technology>

[0226] This technology can also be configured as follows:

[0227] (1) An information processing device comprising:

[0228] a line of sight information acquisition unit that acquires line of sight information about a viewer to a shared screen displayed on a display unit; and

[0229] A sight line guide display determination unit determines whether to display a sight line guide for guiding the sight line of the viewer based on the sight line information about the viewer.

[0230] (2) The information processing device according to (1), further comprising:

[0231] an operation information acquisition unit that acquires operation information about a pointing operation performed by an explainer on the shared screen,

[0232] Wherein, when the pointing operation is not performed, the sight line guide display determination unit determines whether to display the sight line guide.

[0233] (3) The information processing device according to (1) or (2), further comprising:

[0234] a correlation calculation unit, which calculates the correlation of the sight line information between the viewers,

[0235] The sight line guide display determination unit determines whether to display the sight line guide based on the correlation.

[0236] (4) The information processing device according to (3), wherein:

[0237] The correlation calculation unit calculates a correlation value of the line of sight information between the viewers, and

[0238] The sight line guide display determination unit determines whether to display the sight line guide based on the correlation value.

[0239] (5) The information processing device according to (3) or (4), wherein:

[0240] The correlation calculation unit calculates the degree of dispersion of the line of sight information about the viewer, and

[0241] The sight line guide display determination unit determines whether to display the sight line guide based on the degree of dispersion.

[0242] (6) The information processing device according to any one of (3) to (5), wherein:

[0243] The sight line information includes the coordinates of the viewer's gaze point on the shared screen.

[0244] (7) The information processing device according to (6), wherein:

[0245] The line of sight information includes a plurality of information items about the line of sight of the viewer, and

[0246] The relevance calculation unit calculates the relevance based on information corresponding to the orientation of the characters displayed on the shared screen.

[0247] (8) The information processing device according to (6) or (7), wherein:

[0248] The line of sight information includes a plurality of information items about the line of sight of the viewer, and

[0249] The correlation calculation unit calculates the correlation based on information corresponding to the aspect ratio of the display unit.

[0250] (9) The information processing device according to any one of (1) to (8), wherein:

[0251] The line of sight information includes rotation information about a pupil of the viewer.

[0252] (10) The information processing device according to any one of (3) to (8), wherein:

[0253] The line of sight information includes a plurality of information items about the line of sight of the viewer, and

[0254] The correlation calculation unit calculates the correlation by assigning weights to a plurality of information items included in the line of sight information.

[0255] (11) The information processing device according to any one of (1) to (10), further comprising:

[0256] The display control unit displays the sight line guide when it is determined that the sight line guide is to be displayed.

[0257] (12) The information processing device according to (11), wherein:

[0258] The display control unit displays a blurred area outside a predetermined range with respect to the gaze point of the explainer on the shared screen as a sight line guide display.

[0259] (13) The information processing device according to (11) or (12), wherein:

[0260] The display control unit displays a mark for a gaze point of the explainer on the shared screen as a sight line guide display.

[0261] (14) The information processing device according to any one of (11) to (13), wherein:

[0262] The display control unit displays a moving icon for a gaze point of the explainer on the shared screen as a sight line guide display.

[0263] (15) The information processing device according to any one of (11) to (14), wherein:

[0264] The display control unit displays, on the shared screen, a sight line guide animation from a gaze point of the viewer to a gaze point of the explainer as a sight line guide display.

[0265] (16) The information processing device according to any one of (1) to (15), wherein:

[0266] The sight line guide display determination unit switches whether to display the sight line guide in response to an instruction from an instructor.

[0267] (17) The information processing device according to any one of (1) to (16), wherein:

[0268] The sight line guide display determination unit determines not to display the sight line guide within a predetermined period of time after the shared screen is switched.

[0269] (18) The information processing device according to any one of (1) to (17), wherein:

[0270] When the display unit displays a shared screen on which the gaze point of the viewer is focused, the sight line guide display determination unit determines not to display the sight line guide.

[0271] (19) An information processing method, which causes an information processing device to perform the following operations:

[0272] Acquiring information about a viewer's line of sight to a shared screen displayed on a display unit; and

[0273] Based on the line of sight information about the viewer, it is determined whether to display a line of sight guide for guiding the line of sight of the viewer.

[0274] (20) A program causing an information processing device to execute a process including the following operations:

[0275] Acquiring information about a viewer's line of sight to a shared screen displayed on a display unit; and

[0276] Based on the line of sight information about the viewer, it is determined whether to display a line of sight guide for guiding the line of sight of the viewer.

[0277] [reference numerals list]

[0278] 1 Online communication system

[0279] 2 Information processing device

[0280] 10 CPU

[0281] 21 Display control unit

[0282] 22. Explainer detection unit

[0283] 23 Operation information acquisition unit

[0284] 24. Line of sight information acquisition unit

[0285] 25 Correlation calculation unit

[0286] 26 Sight Guidance Determination Unit

Claims

1. An information processing device, comprising: a sight line information acquisition unit, which acquires sight line information about a viewer to a shared screen displayed on a display unit; as well as A sight line guide display determination unit determines whether to display a sight line guide for guiding the sight line of the viewer based on the sight line information about the viewer.

2. The information processing device according to claim 1, further comprising: an operation information acquisition unit that acquires operation information about a pointing operation performed by an explainer on the shared screen, Wherein, when the pointing operation is not performed, the sight line guide display determination unit determines to display the sight line guide.

3. The information processing device according to claim 1, further comprising: a correlation calculation unit, which calculates the correlation of the sight line information between the viewers, The sight line guide display determination unit determines whether to display the sight line guide based on the correlation.

4. The information processing device according to claim 3, wherein: The correlation calculation unit calculates a correlation value of the line of sight information between the viewers, and The sight line guide display determination unit determines whether to display the sight line guide based on the correlation value.

5. The information processing device according to claim 3, wherein: The correlation calculation unit calculates the degree of dispersion of the line of sight information about the viewer, and The sight line guide display determination unit determines whether to display the sight line guide based on the degree of dispersion.

6. The information processing device according to claim 3, wherein: The sight line information includes the coordinates of the viewer's gaze point on the shared screen.

7. The information processing device according to claim 6, wherein: The line of sight information includes a plurality of information items about the line of sight of the viewer, and The relevance calculation unit calculates the relevance based on information corresponding to the orientation of the characters displayed on the shared screen.

8. The information processing device according to claim 6, wherein: The line of sight information includes a plurality of information items about the line of sight of the viewer, and The correlation calculation unit calculates the correlation based on information corresponding to the aspect ratio of the display unit.

9. The information processing device according to claim 1, wherein: The line of sight information includes rotation information about a pupil of the viewer.

10. The information processing device according to claim 3, wherein: The line of sight information includes a plurality of information items about the line of sight of the viewer, and The correlation calculation unit calculates the correlation by assigning weights to a plurality of information items included in the line of sight information.

11. The information processing device according to claim 1, further comprising: The display control unit displays the sight line guide when it is determined that the sight line guide is to be displayed.

12. The information processing device according to claim 11, wherein: The display control unit displays a blurred area outside a predetermined range with respect to the gaze point of the explainer on the shared screen as a sight line guide display.

13. The information processing device according to claim 11, wherein: The display control unit displays a mark for a gaze point of the explainer on the shared screen as a sight line guide display.

14. The information processing device according to claim 11, wherein: The display control unit displays a moving icon for a gaze point of the explainer on the shared screen as a sight line guide display.

15. The information processing device according to claim 11, wherein: The display control unit displays, on the shared screen, a sight line guide animation from a gaze point of the viewer to a gaze point of the explainer as a sight line guide display.

16. The information processing device according to claim 1, wherein: The sight line guide display determination unit switches whether to display the sight line guide in response to an instruction from an instructor.

17. The information processing device according to claim 1, wherein: The sight line guide display determination unit determines not to display the sight line guide within a predetermined period of time after the shared screen is switched.

18. The information processing device according to claim 1, wherein: When the display unit displays a shared screen on which the gaze point of the viewer is focused, the sight line guide display determination unit determines not to display the sight line guide.

19. An information processing method, which causes an information processing device to perform the following operations: Acquiring information about a viewer's line of sight to a shared screen displayed on a display unit; and Based on the line of sight information about the viewer, it is determined whether to display a line of sight guide for guiding the line of sight of the viewer.

20. A program causing an information processing device to execute a process including the following operations: Acquiring information about a viewer's line of sight to a shared screen displayed on a display unit; and Based on the line of sight information about the viewer, it is determined whether to display a line of sight guide for guiding the line of sight of the viewer.

Images