Information providing device and information providing method

Abstract

To make it possible to assist, in a situation where information is provided in real time, with the elimination of a gap in awareness or cognition among participants encountering the information.SOLUTION: An information provision device 100 is configured to include a communication device 105 that performs data communication with another device and a computation device 104 that executes: processing for acquiring, from an observation unit that observes the explanation status of information from an information provider, information regarding an explanation location in the information from the provider; processing for acquiring, from a gaze analysis unit that estimates a gaze direction of a recipient receiving the explanation of the information, information regarding a gaze location of the recipient; and processing for identifying and outputting a gap in information transfer between the provider and the recipient based on the information regarding the explanation location and the gaze location.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information providing device and an information providing method. [Background technology]

[0002] In situations where information is transmitted in real time, such as in classes or meetings at schools or companies, Therefore, the sender of the information wants to send it at an appropriate pace that he or she thinks is appropriate. On the other hand, the recipients of the information tend to want to receive the information at a pace that suits them. In other words, there is a fundamental difference in awareness between the sender and receiver of information, creating a gap. There is a high possibility that this will happen. For example, as a conventional technology related to communication via such information, Provision system, provision method, provision device, and the like for supporting smooth communication between users and a computer program (see Patent Document 1).

[0003] This system captures the voice of a second user who is listening to the voice of a first user who is speaking. a video acquisition unit for acquiring a video of the second user obtained by and determining at least one of the emotion and the concentration level of the second user based on the video of the second user. a providing unit that provides a result of the determination by the determining unit to the first user. This is related to the [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2021-111239 Summary of the Invention [Problem to be solved by the invention]

[0005] The gap in awareness between the sender and receiver of information in the above-mentioned classes and meetings is As information continues to be transmitted in real time, the difference between the part the sender is explaining and the part the receiver is recognizing is expanding. In addition to the discrepancy between the information and the intended part, there is a large difference between the recipients in terms of the progress and depth of their understanding of the information. It's also easy to create differences. This leads to communication discord between the sender and receiver of information, and This led to a gap in information comprehension among students, and the results of the classes and conferences were not what was initially expected. It is especially difficult for the recipient to understand the information presented one after another, and it is difficult to gain appropriate knowledge and Not only will you not gain any knowledge, but you will only end up accumulating dissatisfaction.

[0006] Therefore, an object of the present invention is to provide a system for providing real-time information to a user. To provide technology that can help eliminate gaps in awareness and recognition among those involved in the information is located. [Means for solving the problem]

[0007] The information providing device of the present invention, which solves the above problem, is a communication device that performs data communication with other devices. An observation unit that observes the explanation status of the information by the information provider a process of acquiring information on the explanation position in the information, and a process of providing the information to a recipient who receives an explanation of the information. The gaze analysis unit estimates the gaze direction of the recipient, and the gaze position information of the recipient is obtained. and a process of acquiring the information on the explanation position and the gaze position, and a computing device that executes a process to identify and output gaps in information exchange between users. It is characterized by the following. The information providing method of the present invention is also directed to a communication device for performing data communication with another device, in which an information processing device an observation unit that observes the explanation of the information by the information provider, A process of acquiring information on the explanation position in the information provided by the provider, and receiving an explanation of the information A gaze analysis unit that estimates the gaze direction of a recipient receives the gaze position of the recipient. and a process of acquiring information on the explanation position and the gaze position, and a process of identifying and outputting a gap in information exchange between the sender and the recipient. It is characterized by the following. [Effects of the Invention]

[0008] According to the present invention, in a situation where information is provided in real time, This will help to eliminate the gap in awareness and recognition among the parties involved. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating a network configuration including an information providing device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information providing device according to the present embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of the hardware configuration of a provider terminal according to the present embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the hardware configuration of a receiver terminal according to the present embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of the configuration of a content DB according to the present embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of the configuration of a management DB according to the present embodiment. [Figure 7] FIG. 4 is a diagram illustrating an example of the configuration of a determination table in the present embodiment. [Figure 8] FIG. 2 is a diagram illustrating an example of the configuration of a user management DB according to the present embodiment. [Figure 9] FIG. 2 is a diagram showing an example of the flow of an information providing method according to the present embodiment. [Figure 10] FIG. 1 is a diagram illustrating a conceptual example according to the present embodiment. [Figure 11] FIG. 10 is a diagram showing an example of a screen in this embodiment. [Figure 12] FIG. 10 is a diagram showing an example of a screen in this embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] <Network configuration> Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. 1 is a diagram illustrating a network configuration including an information providing device 100. The information providing device 100 shown in FIG. In a situation where information is provided in real time, This is a computer that can help eliminate gaps in awareness and recognition.

[0011] As shown in FIG. 1, the information providing device 100 of this embodiment is connected to a LAN (LAN) such as the Internet. via an appropriate network 1 such as a Public Area Network (PAC), 200 and the receiver terminal 300 are communicably connected. It may also be an information providing system 10.

[0012] The information providing device 100 of this embodiment is used for lectures at educational institutions, seminars at companies, etc. In the event of a conference or other event where information is transmitted based on various content, the information provider and recipient It can be said that this is a service providing device that aims to bridge the gap between

[0013] On the other hand, the provider terminal 200 uses the above-mentioned content to provide information to students, lecturers, and conference participants. It is a terminal operated by a person who transmits information to a lecturer, etc. A personal computer, tablet, etc. that stores the content and outputs it appropriately to the students, etc. Examples of such devices include wireless devices and smartphones.

[0014] On the other hand, the receiver terminal 300 recognizes the information sent by the provider and receives the information from the receiver (a person who performs learning, etc.). Specifically, the content distributed from the provider terminal 200 is personal computers, tablets, smartphones, etc., to display and provide the Examples of such devices include smartphones. <Hardware configuration> The hardware configuration of the information providing device 100 of this embodiment is as shown in FIG. That is, the information providing device 100 includes a storage device 101, a memory 103, a computing device 104, and a communication device 105.

[0015] The storage device 101 is a solid state drive (SSD) or a hard disk. It is made up of an appropriate non-volatile storage element such as a disk drive.

[0016] The memory 103 is a memory such as a RAM (Random Access Memory). It is composed of photo-sensitive memory elements.

[0017] The arithmetic unit 104 also reads the program 102 stored in the storage device 101 and stores it in the memory 10. 3 and executes it to perform overall control of the device itself, as well as various judgments, calculations and controls. It is the CPU that performs the processing.

[0018] The above-mentioned program 102 preferably includes a machine learning engine 1021. The machine learning engine 1021 is an engine for estimating the emotion and concentration of the recipient. The gaze analysis unit 308 and the emotion analysis unit 309 of the receiver terminal 300 Based on the sensing data obtained from the system, the emotions and concentration of the recipient are automatically determined. Such a function may be provided in the receiver terminal 300).

[0019] The communication device 105 is connected to the network 1 and communicates with the provider terminal 200 and the recipient terminal 3. It is assumed that the network interface card will be responsible for communication processing with 00.

[0020] The storage device 101 also includes the functions required for the information providing device of this embodiment. In addition to the program 102 for the content database 125, the management database 126, and the judgment table At least the user management DB 127 and the user management DB 128 are stored. The base and other components will be described in detail later.

[0021] Next, FIG. 3 shows an example of the hardware configuration of the provider terminal 200 in this embodiment. The provider terminal 200 of this embodiment includes a storage device 201, a memory 203, and a computing device 204. , an input device 205, an output device 206, a communication device 207, and an observation unit 208. .

[0022] The storage device 201 is a solid state drive (SSD) or a hard disk. It is made up of an appropriate non-volatile storage element such as a disk drive.

[0023] The memory 203 is a memory such as a RAM (Random Access Memory). It is composed of photo-sensitive memory elements.

[0024] The arithmetic unit 204 also reads the program 202 stored in the storage unit 201 from the memory 20 3 and executes it to perform overall control of the device itself, as well as various judgments, calculations and controls. It is the CPU that performs the processing.

[0025] The input device 205 includes a keyboard, a mouse, and the like that accept input operations from the provider. It becomes a user interface device such as a microphone.

[0026] The output device 206 is a display or screen that outputs the processing results of the arithmetic unit 204. It becomes a user interface device such as a speaker.

[0027] The communication device 207 is connected to the network 1 and communicates with the information providing device 100 and the recipient terminal. A network interface card or the like that handles communication processing with 300 is assumed.

[0028] The storage device 201 also includes the functions required for the provider terminal 200 of this embodiment. In addition to the program 202 for However, details about this content DB 225 will be described later.

[0029] Next, FIG. 4 shows an example of the hardware configuration of the receiver terminal 300 in this embodiment. The receiver terminal 300 of this embodiment includes a storage device 301, a memory 303, and a computing device 304. , input device 305, output device 306, communication device 307, gaze analysis unit 308, emotion analysis analysis unit 309 and posture analysis unit 310.

[0030] The storage device 301 is a solid state drive (SSD) or a hard disk. It is made up of an appropriate non-volatile storage element such as a disk drive.

[0031] The memory 303 is a memory such as a RAM (Random Access Memory). It is composed of photo-sensitive memory elements.

[0032] The arithmetic unit 304 also reads the program 302 stored in the storage unit 301 and stores it in the memory 30. 3 and executes it to perform overall control of the device itself, as well as various judgments, calculations and controls. It is the CPU that performs the processing.

[0033] The input device 305 includes a keyboard, a mouse, and the like that accept input operations from the recipient. It becomes a user interface device such as a microphone.

[0034] The output device 306 is a display or screen that outputs the processing results of the arithmetic unit 304. It becomes a user interface device such as a speaker.

[0035] The communication device 307 is connected to the network 1 to communicate with the information providing device 100 and the provider terminal. A network interface card or the like is assumed to be responsible for communication processing with 200.

[0036] The gaze analysis unit 308 also analyzes the information presented by the provider that the recipient is viewing. A unit that estimates the location of the vehicle based on appropriate inputs such as gaze sensors and facial image data. This gaze analysis unit 308 appropriately analyzes various products implemented by existing technologies. Just adopt it.

[0037] The sentiment analysis unit 309 also analyzes how the recipient feels when presented with information by the provider. A unit that estimates whether a person has come into contact with the information based on appropriate input such as facial image data. This emotion analysis unit 309 appropriately analyzes various products implemented by existing technologies. It should be adopted as such.

[0038] The posture analysis unit 310 also captures a facial image of the recipient and calculates the facial area shown in the facial image. By detecting changes in the center of gravity of the face, the distance the center of gravity of the face has moved over the past second can be calculated, for example. If this movement distance is equal to or greater than a threshold, it is determined that the recipient's posture has changed. The analysis unit can employ existing technology that appropriately uses facial images, sensors, etc. as input. <Data structure example> Next, various types of information used by the information providing device 100 of this embodiment will be described. 1 shows an example of the content DB 125 in this embodiment.

[0039] The content DB 125 of this embodiment stores the contents of the provider acquired from the provider terminal 200. This is a database that stores electronic data such as materials used in lectures and seminars.

[0040] This content DB 125 uses, for example, a provider ID that uniquely identifies a provider as a key. The record that associates each value such as content ID, content content, and target of provision The records that make up this content DB 125 are stored in the provider terminal 20. 0 is stored in the content DB 225. This is the data provided.

[0041] Next, an example of the management DB 126 of this embodiment is shown in FIG. 6. What kind of content did the provider use and to whom did the explanation etc. As a result, the situation of the person receiving the explanation, i.e., the recipient of the information (eyes, emotions, It is a database that manages the changes in gaze and posture.

[0042] This management DB 126 uses the provider ID as a key to store the content ID used by the provider. D, the date and time when the content was used, the explanation position at that date and time, the explanation target, the explanation target The gaze position, emotion, gaze change, posture change, and gaps in the content of the whole elephant It is a collection of records that associate values ​​such as

[0043] The "explanation subject" managed by this management DB 126 is, for example, the affiliation of the students who are the subject of the lecture. The recipients are grouped by department, company of seminar participants, etc. The values ​​of emotion (average), gaze change (average), posture change (average), and gap are also This is the average or median of the observed values, estimated values, etc. for each member of the recipient group. The concept of obtaining and calculating each value held in the management DB 126 will be described later.

[0044] Next, an example of the decision table 127 is shown in FIG. 7. The decision table 127 of this embodiment is A gap that has arisen between the provider of content or other information and the recipient of that information. It defines the types of gaps and provides advice to providers and recipients to close those gaps. It's a table.

[0045] This judgment table 127 uses, for example, the gap as a key, and calculates the emotion and concentration of the recipient. It is a collection of records that associate values ​​such as advice target and advice content. It is.

[0046] In the example of Figure 7, the part of the content being explained by the provider is closer to the part being viewed by the recipient. In the case of "Former," the gap is already there, and the recipient's feelings Regardless of whether it is good or bad or the level of concentration, advice to providers is to provide detailed explanations and explanations quickly. The advice provided to encourage a reduction in the level of snoring is specified.

[0047] In addition, the part of the content being explained by the provider may be delayed from the part being viewed by the recipient. In the case of "Later," which is a gap where the recipient has already completed the work, the advice given to the recipient is The document provides advice to the recipient requesting that they set up a record of any questions, etc.

[0048] In addition, the part of the content being explained by the provider and the part being viewed by the recipient must match. If the recipient's sentiment is "Negative," the content will be Advice for content providers on "improving communication and reviewing content" Of course, the conditions and contents of these regulations are just examples, and the judgment test This does not limit the contents of Table 127.

[0049] Next, an example of the user management DB 128 of this embodiment is shown in FIG. The management DB 128 stores the attributes of each user, such as the provider and recipient, and the contents. The provider terminal 200 and the receiver terminal 300 send corresponding values ​​regarding the usage form and situation of the It is a database that acquires and manages data.

[0050] This user management DB 128 uses user IDs as keys to distinguish between providers and recipients, ,usage content, date and time of use, description position, gaze position, emotion, gaze change, posture change, and It is a collection of records that correspond to values ​​such as gaps. The values ​​of gaze position, emotion, gaze change, posture change, and gap are stored in this user management DB1. This is a compilation of the values ​​of corresponding users in 28. <Flow example> The actual procedure of the information providing method according to this embodiment will be described below with reference to the drawings. The various operations corresponding to the information providing method described in the section 1 are read out by the information providing device 100 into a memory or the like. This is realized by a program that executes the following: It consists of code to perform various operations that are executed.

[0051] FIG. 9 is a diagram showing an example of the flow of an information providing method according to this embodiment. The provider operates his / her own provider terminal 200 and gives an explanation based on predetermined content. In addition, this explanation by the provider is given to recipients with certain attributes. The recipients can download the content to the provider terminal 200 (or the information provider terminal 201). The content is acquired from the provider device 100 and displayed on the recipient terminal 300, and while browsing the content, It is assumed that the provider's explanation has been heard.

[0052] In this case, the information providing device 100 receives the relevant information from the observation unit 208 of the provider terminal 200. The information on the explanation position in the content provided by the provider is obtained (s1). For example, the location of the cursor or laser pointer in the content provided by the provider, This value indicates the part of the text that the speaker read aloud.

[0053] The observation unit 208 may, for example, display the cursor position on the screen of the provider terminal 200. The information displayed at the specified location is used as the explanation location. The unit 208 acquires the audio data of the provider reading the content aloud and converts it into audio data. Identified using analysis technology, keywords and sentences spoken at that time are used in the content The corresponding position is identified and used as the explanation position.

[0054] Next, the information providing device 100 receives the gaze analysis unit 308 of the receiver terminal 300. The position where the recipient is looking down in the content that the recipient is supposed to be viewing, that is, The gaze position information is acquired (s2). The gaze position is detected by the gaze analysis unit 308. , it is sufficient to adopt existing technologies appropriately and implement them.

[0055] Next, the information providing device 100 transmits the information on the change in emotion of the recipient to the recipient terminal. The sentiment analysis unit 309 of the 300 acquires the sentiment (s3). The information on the emotional changes in the recipient can be obtained, for example, by analyzing facial expressions of the recipient's face taken by a camera. Identify emotions (anger, sadness, joy, etc.) by running If you are not emotionally stable, your mind will be stable and your concentration will be high, but if you are not emotionally stable, your mind will be unstable and your concentration will be low. is judged to be low.

[0056] In addition, from the viewpoint of concentration, if the above-mentioned gaze position is not maintained for a certain period of time, the concentration level is low. If the gaze position is continuous, it can be determined that the level of concentration is high.

[0057] The information providing device 100 also analyzes the posture of the recipient terminal 300 by the posture analysis unit 310. The operation of the posture analysis unit 310 to acquire information on the change in posture of the recipient (s4) and its output The values ​​are as already mentioned.

[0058] Next, the information providing device 100 uses the attitude, emotion, and The complex situation of the time change of the gaze and the gaze is judged (s5). The concept of overlapping time changes is shown in Figure 10. In this concept, the number of emotions that are triggered is insufficient. If a stable time period overlaps with a time period in which the gaze changes discontinuously, This period is judged as a time period of low concentration (time period when posture changes frequently occur). (Overlaps are also taken into consideration.) In addition to the above-mentioned overlap determination, there are other methods for determining complex situations. It is also possible to adopt a method of weighting emotions and making judgments, and there is no particular limitation. stomach.

[0059] Next, the information providing device 100 sends a notification to the recipient based on the result of the determination in s5. The degree of concentration is estimated for the time periods where the above overlap is confirmed (s6). It is estimated that the concentration is high during other times.

[0060] Next, the information providing device 100 calculates the position of the explanation by the provider and the gaze position of the recipient based on the information. Based on this, the gap in information exchange between the provider and the recipient is identified (s7). As already mentioned, the gap is divided into "Former", "Later", and "Neutral" However, this classification of the gap is just an example, and It is also possible to adopt a more detailed or simplified classification system as appropriate.

[0061] Furthermore, the information providing device 100 determines the explanation position and the gaze position in the gap identified in s7. A table that judges the combination of the order relationship between the 127 (Fig. 7) and generate advice (s8). The recipient can be either the sender or the recipient.

[0062] For example, if the explanation by the provider is difficult for the recipient to understand or is too fast, the recipient may In that case, a gap occurs when the learner is slow to understand the content. Advice requesting a more detailed explanation can be identified in the decision table 127.

[0063] Also, if the explanation given by the provider is too simple for the recipient or too slow, The recipient will have to read ahead beyond the provider's explanation, creating a gap in the content. In this case, the recipient is asked to set up the system so that they can notify the provider later if they have any questions. The advice to be given can be identified in the decision table 127.

[0064] The information providing device 100 provides the advice generated in s8 (see FIG. 11) to the target person. The information is then distributed to the terminal of the provider or recipient (s9), and the process is completed. Additionally, the time-varying emotions and concentration levels of all recipients and statistical information may be displayed. For example, When the above advice is delivered to the recipient and the recipient responds (see Figure 12). The information providing device 100 receives a flag setting for a predetermined part in the content, and (The information will be linked to the content and provider and managed separately), and the provider's explanation level When the device approaches a designated location in the content (a location set by the recipient), The information providing device 100 notifies the recipient that there is a need for an explanation about the part. It shall be.

[0065] The best mode for carrying out the present invention has been specifically described above. It is not limited to this, and various modifications are possible without departing from the spirit of the invention.

[0066] According to this embodiment, in a situation where information is provided in real time, This will help to eliminate the gap in awareness and recognition among those involved in the information.

[0067] The description of this specification makes clear at least the following: In the information providing device, the computing device calculates information on the change in emotion of the recipient by a predetermined The emotion analysis unit acquires the state of the emotion change and the gaze time indicated by the gaze direction information. Based on the situation of the change in emotion over time and the combined situation of the change in emotion and the change in gaze over time, a process of estimating a concentration level of the recipient; and generating advice directed to at least one of the provider and the recipient, and The device further includes a process of notifying a terminal of at least one of the provider and the recipient of the device. It may also be stated that the purpose is to carry out the

[0068] According to this, there are specific opportunities for information providers to take action to eliminate the gap. In the situation where information is provided in real time, This will enable more accurate support in eliminating the gap in awareness and recognition among those involved in the information. become.

[0069] In the information providing device of this embodiment, the calculation device calculates the posture change of the recipient. Information is acquired from a predetermined posture analysis unit, and the status of the posture change, the status of the emotion change, The situation of the change in the line of sight over time, and the combination of the change in posture, the change in emotion, and the change in the line of sight over time The estimate of concentration at the recipient may be based on the overall circumstances of the stomach.

[0070] This allows the recipient's concentration to be estimated with higher accuracy. In a situation where information is provided through a system, there is a difference in awareness and recognition among those involved in the information. This will enable more efficient support in closing the gap.

[0071] In the information providing device of this embodiment, the calculation device calculates the distance between the gap and the target position. The relationship between the explanation position and the gaze position or the presence or absence of the relationship, the recipient's emotions, and The advice may be generated according to a combination of the level of concentration. stomach.

[0072] According to this, although people receive information with positive feelings, their concentration is reduced. Or, conversely, those who receive information with negative feelings but maintain concentration. It responds appropriately to various situations, such as those with disabilities, and generates advice to close the gap. In addition, in a situation where information is provided in real time, This makes it possible to more accurately support bridging the gap in awareness and recognition among the people involved who come into contact with the information.

[0073] In the information providing device of this embodiment, the arithmetic device As advice, a request to resolve the gap is generated and notified to the provider's terminal. It may also be said that there is.

[0074] According to this, explicit information will be provided to providers to eliminate the gap. In addition, in a situation where information is provided in real time, This will enable more accurate support in closing gaps in awareness and perceptions between donors.

[0075] In the information providing device of this embodiment, the calculation device is configured to The situation where the gaze position of the receiver in the information is ahead of the explanation position of the provider If the information is provided, the information provided must be in a form that is understandable to the recipient and that is in accordance with the instructions of the provider. The recipient is advised to carry out a specified operation for the insufficient part of the solution. When the explanation position of the provider approaches the part of the information that has been subjected to the designation operation, In this case, the recipient is notified that there is a need for explanation on the relevant part. It may also be possible to use the following.

[0076] According to this, it is possible to close the gap efficiently while respecting the situation of the recipient of the information. This will enable accurate and accurate information provision. In this case, it will be possible to more accurately support bridging the gap in awareness and recognition among those involved in the information. It becomes Noh.

[0077] In the information providing method of this embodiment, the information processing device Information on emotional changes is acquired from a predetermined emotion analysis unit, and the situation of the emotional changes, the gaze direction, The situation of the change in gaze over time indicated by the direction information, and the combined effect of the change in emotion and the change in gaze over time a process for estimating a concentration level at the recipient based on the gap and the previous situation; Based on the concentration, advice is provided to at least one of the provider and the recipient. and transmits the advice to at least one of the terminals of the provider and the recipient. A notification process may also be executed.

[0078] In the information providing method of this embodiment, the information processing device detects a change in posture of the recipient. The information on the change in posture is acquired from a predetermined posture analysis unit, and the state of the change in posture and the state of the change in emotion are analyzed. situation, the situation of the change in the line of sight over time, the change in the posture, the change in the emotion, and the change in the line of sight over time The degree of concentration of the recipient may be estimated based on a combination of the above.

[0079] In the information providing method of this embodiment, the information processing device the precedence or the absence of the precedence relationship between the explanation position and the gaze position, and the emotion of the recipient. The advice may be generated according to a combination of the level of the concentration.

[0080] In the information providing method of the present embodiment, the information processing device generating a request to resolve the gap as the advice and notifying the provider's terminal; It may also be possible to use the following.

[0081] In the information providing method of this embodiment, the information processing device determines whether the gap is In the state where the gaze position of the recipient in the information precedes the explanation position of the provider, If the information indicates a situation where the information is in a state that is not relevant to the recipient and is not relevant to the provider, Advice to the recipient to perform the specified specified operations for the parts that they do not fully understand. and the explanation position of the provider is close to the part of the information that has been subjected to the designation operation. In this case, the recipient will be notified that there is a need for explanation on the relevant part. Good too. [Explanation of symbols]

[0082] 1 Network 10 Information provision system 100 Information provision device 101 Storage device 102 Programs 1021 Machine Learning Engine 103 memory 104 Arithmetic equipment 105 Communication equipment 125 Content DB 126 Management DB 127 Decision Table 128 User Management DB 200 Provider Terminal 201 Storage device 202 Program 203 memory 204 Arithmetic equipment 205 Input Device 206 Output Device 207 Communication Equipment 208 Observation Unit 225 Content DB 300 Recipient terminal 301 Storage device 302 Program 303 Memory 304 Arithmetic equipment 305 Input Device 306 Output Device 307 Communication Equipment 308 Gaze Analysis Unit 309 Sentiment Analysis Unit 310 Posture Analysis Unit

Claims

1. a communication device that performs data communication with another device; The observation unit observes the explanation of the information by the information provider. a process of acquiring information on the explanation position in the information, and a process of providing the information to a recipient who receives an explanation of the information. The gaze analysis unit estimates the gaze direction of the recipient, and the gaze position information of the recipient is obtained. and a process of acquiring the information on the explanation position and the gaze position, a computing device that executes a process of identifying and outputting gaps in information exchange between users; An information providing device comprising:

2. The computing device information on the recipient's emotional change is obtained from a predetermined emotion analysis unit; the state of the emotion, the state of the gaze change over time indicated by the gaze direction information, and the state of the emotion change and the gaze A process of estimating the concentration level of the recipient based on a complex situation of time-varying changes in the line; 、 Based on the gap and the concentration, at least one of the provider and the recipient and generating advice directed to at least one of the provider and the recipient, and further executes a process of notifying either of the terminals.

2. The information providing device according to claim 1.

3. The computing device The information on the change in posture of the recipient is acquired from a predetermined posture analysis unit, and the state of the change in posture is analyzed. the situation, the situation of the emotion change, the situation of the gaze change over time, and the posture change and the emotion change and a combined situation of the time change of the gaze, and the degree of concentration of the recipient is estimated based on the ... It is something that 3. The information providing device according to claim 2.

4. The computing device The relationship between the explanation position and the gaze position in the gap, or the presence or absence of the relationship The advice is generated according to a combination of the recipient's emotion and the level of concentration. It is something that 4. The information providing device according to claim 3.

5. The computing device A request for elimination of the gap is generated as the advice to the provider. The notification is sent to the user's terminal.

3. The information providing device according to claim 2.

6. The computing device The gap is a gap between the gaze position of the recipient and the explanation position of the provider. If the information indicates a situation that precedes the information provided by the provider, Furthermore, the recipient is instructed to perform a predetermined designation operation for any part that is insufficiently understood by the recipient. Generate advice for the user, When the explanation position of the provider approaches the part of the information that has been subjected to the designation operation, This notifies the recipient that there is a need for clarification on the relevant part.

3. The information providing device according to claim 2.

7. The information processing device A communication device for performing data communication with other devices is provided, The observation unit observes the explanation of the information by the information provider. a process of acquiring information on the explanation position in the information, and a process of providing the information to a recipient who receives an explanation of the information. The gaze analysis unit estimates the gaze direction of the recipient, and the gaze position information of the recipient is obtained. and a process of acquiring the information on the explanation position and the gaze position, A process for identifying and outputting gaps in information exchange between the parties; An information providing method characterized by executing the above.

8. The information processing device, information on the recipient's emotional change is obtained from a predetermined emotion analysis unit; the state of the emotion, the state of the gaze change over time indicated by the gaze direction information, and the state of the emotion change and the gaze A process of estimating the concentration level of the recipient based on a complex situation of time-varying changes in the line; 、 Based on the gap and the concentration, at least one of the provider and the recipient and generating advice directed to at least one of the provider and the recipient, and further executes a process of notifying either of the terminals.

8. The information providing method according to claim 7,

9. The information processing device, The information on the change in posture of the recipient is acquired from a predetermined posture analysis unit, and the state of the change in posture is analyzed. the situation, the situation of the emotion change, the situation of the gaze change over time, and the posture change and the emotion change and a combined situation of the time change of the gaze, and the degree of concentration of the recipient is estimated based on the ... Ru, 9. The information providing method according to claim 8.

10. The information processing device, The relationship between the explanation position and the gaze position in the gap, or the presence or absence of the relationship The advice is generated according to a combination of the recipient's emotion and the level of concentration. Ru, 10. The information providing method according to claim 9.

11. The information processing device, A request for elimination of the gap is generated as the advice to the provider. notify the user's device, 9. The information providing method according to claim 8.

12. The information processing device, The gap is a gap between the gaze position of the recipient and the explanation position of the provider. If the information indicates a situation that precedes the information provided by the provider, Furthermore, the recipient is instructed to perform a predetermined designation operation for any part that is insufficiently understood by the recipient. Generate advice for the user, When the explanation position of the provider approaches the part of the information that has been subjected to the designation operation, Notify the recipient that there is a need for clarification on the relevant part; 9. The information providing method according to claim 8.

Images