Information display system

Abstract

To enhance sense of reality when displaying an image indicating a user on an electronic device of another user.SOLUTION: An information display system includes a plurality of electronic devices connected with each other via a communication network. The electronic devices include a first electronic device used by a first user, and a second electronic device used by a second user. The first electronic device detects a gazing point of the first user on the basis of an image of the first user photographed by a camera. Then the first electronic device transmits first user gazing information containing information on a first user gazing point to the second electronic device. The second electronic device acquires a first user image representing the first user. Then the second electronic device executes, on the basis of the first user gazing information, a gazing enhancement display process for displaying the first user image on the display of the second electronic device such that it looks like the first user is gazing the gazing point.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to information display technology using electronic devices. [Background technology]

[0002] Patent Document 1 discloses a communication support system in which user objects corresponding to a plurality of users are arranged in a two-dimensional or three-dimensional virtual space. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7150114 Summary of the Invention [Problem to be solved by the invention]

[0004] Considering information display technology using multiple electronic devices that can communicate with each other, there is a need for technology that can enhance the sense of realism when displaying an image representing a user on an electronic device of another user. [Means for solving the problem]

[0005] One aspect of the present disclosure relates to an information display system. The information display system includes a plurality of electronic devices connected to each other via a communication network, the plurality of electronic devices including a first electronic device used by a first user and a second electronic device used by a second user. The first electronic device detects a gaze point of the first user based on an image of the first user captured by the camera, and then transmits first user gaze information including information about the gaze point of the first user to the second electronic device. The second electronic device acquires a first user image representing the first user, and then performs a gaze highlighting process based on the first user gaze information to display the first user image on a display of the second electronic device so that the first user appears to be gazing at the gaze point. [Effects of the Invention]

[0006] According to the present disclosure, a first user image representing a first user is displayed on a second electronic device of a second user U-2. At this time, a gaze highlighting process is executed so that the first user appears to be gazing at a gaze point. The second user can visually grasp what the first user is gazing at. This enhances the realism and sense of presence. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a conceptual diagram for explaining an overview of an information display system. [Figure 2] FIG. 1 is a block diagram illustrating an example of the configuration of an electronic device. [Figure 3] FIG. 2 is a block diagram illustrating an example of the functional configuration of a controller of the electronic device. [Figure 4] FIG. 1 is a conceptual diagram showing the relative positional relationship between the left and right eyes of a user and a display surface. [Figure 5] FIG. 10 is a conceptual diagram illustrating an example of gaze emphasis display processing. [Figure 6] FIG. 10 is a conceptual diagram illustrating an example of gaze emphasis display processing. DETAILED DESCRIPTION OF THE INVENTION

[0008] Embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0009] 1. Overview of the information display system FIG. 1 is a conceptual diagram for explaining an overview of an information display system 1 according to this embodiment. The information display system 1 includes a plurality of electronic devices 100. Examples of the electronic devices 100 include a personal computer, a tablet, a dedicated terminal, and the like. The plurality of electronic devices 100 are used by a plurality of users U, respectively. In the example shown in FIG. 1, electronic devices 100-A, 100-B, 100-C, and 100-D and their respective users UA, UB, UC, and UD are shown. However, the number of electronic devices 100 and the number of users U are arbitrary.

[0010] The electronic devices 100 are connected to each other via a communication network and can communicate with each other. The communication network may be a wireless communication network or a wired communication network. The electronic devices 100 may be connected to a server 10 and communicate with each other via the server 10.

[0011] Each of the electronic devices 100 includes a camera (image capture device) and a display (display device). The camera is installed so as to be able to capture an image of the user U. Typically, the camera is installed so as to be able to capture an image of the user U's face.

[0012] An electronic device 100-i (i = A, B, C, D, etc.) acquires an image IMG-i of a user Ui captured by a camera. The image IMG-i includes at least the face of the user Ui. The electronic device 100-i transmits the image IMG-i to another electronic device 100-j (j ≠ i). The electronic device 100-i may extract feature parameters of the user Ui based on the image IMG-i and transmit information about the feature parameters of the user Ui to the other electronic device 100-j. Examples of feature parameters include gaze information, a gaze point, facial expression parameters, and posture parameters of the user Ui. Typically, the electronic device 100-i transmits at least one of the image IMG-i and the feature parameters to the other electronic device 100-j in real time.

[0013] The electronic device 100-j receives information transmitted from the electronic device 100-i. The electronic device 100-j acquires a user image UIMG-i representing the user Ui based on at least one of the image IMG-i and the feature parameters. The user image UIMG-i may be the original image IMG-i or an avatar image. The avatar image is generated, for example, by applying at least one of the original image IMG-i and the feature parameters to a predetermined human model. The electronic device 100-j displays the user image UIMG-i representing the user Ui on a display. A user Uj of the electronic device 100-j can view the user image UIMG-i displayed on the display. In other words, the electronic device 100-j displays the user image UIMG-i representing the user Ui of the other electronic device 100-i with whom it is communicating, and the user Uj can view the user image UIMG-i representing the other user Ui with whom it is communicating.

[0014] The information display system 1 according to the present embodiment is applicable to, for example, online learning, online classes, online meetings, etc. In these cases, the information display system 1 can also be called an online learning system, an online class system, an online meeting system, etc.

[0015] 2. Example of electronic device configuration 2 is a block diagram showing a configuration example of the electronic device 100. In the example shown in FIG. 2, the electronic device 100 includes a display 110, one or more cameras 120 (hereinafter simply referred to as cameras 120), a user interface 130, a communication interface 140, and a controller 150.

[0016] The display 110 is configured to display various types of information. Examples of the display 110 include a liquid crystal display, an organic EL display, and a head-up display (HUD). The display 110 has a display surface (display unit) 111. Typically, a user U of the electronic device 100 faces the display surface 111 of the display 110 when using the electronic device 100.

[0017] The camera 120 is installed so as to be able to capture an image of the user U of the electronic device 100. Typically, the camera 120 is installed so as to be able to capture an image of the face of the user U of the electronic device 100. For example, the camera 120 is provided around the display surface 111 of the display 110.

[0018] The user interface 130 includes an input device that accepts input of various information from the user U. Examples of the input device include a touch panel, a keyboard, a mouse, a microphone, etc. The user interface 130 may also include an output device such as a speaker.

[0019] The communication interface 140 is connected to a communication network and communicates with the outside of the electronic device 100. The communication network may be a wireless communication network or a wired communication network. For example, the communication interface 140 communicates with the server 10 or another electronic device 100.

[0020] The controller 150 performs various information processing operations. The controller 150 may also be called a processing circuitry. A processing circuit is hardware that is programmed to realize a function or hardware that executes a function.

[0021] For example, the controller 150 includes one or more processors 151 (hereinafter simply referred to as processors 151) and one or more memories 152 (hereinafter simply referred to as memories 152). The processor 151 performs various types of information processing. Examples of the processor 151 include a general-purpose processor, a special-purpose processor, a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), an integrated circuit, a conventional circuit, and / or a combination thereof. The memory 152 stores various types of information. Examples of the memory 152 include a volatile memory, a non-volatile memory, a hard disk drive (HDD), a solid-state drive (SSD), etc. A control program is a computer program executed by the processor 151. The processor 151 executing the control program and the memory 152 may cooperate to realize the functions of the controller 150. The control program is stored in the memory 152. Alternatively, the control program may be recorded on a computer-readable recording medium.

[0022] Fig. 3 is a block diagram showing an example of the functional configuration of the controller 150. In the example shown in Fig. 3, the controller 150 includes, as functional blocks, a face / eye extraction unit 161, a positional relationship calculation unit 162, a feature extraction unit 163, a transmission unit 164, a reception unit 171, a rendering unit 172, and a display processing unit 173.

[0023] The face and eye extraction unit 161 acquires an image IMG of the user U captured by the camera 120. The image IMG includes at least the face of the user U. Typically, the face and eye extraction unit 161 acquires the image IMG in real time. Then, the face and eye extraction unit 161 extracts a facial image of the face portion of the user U from the image IMG. Furthermore, the face and eye extraction unit 161 may extract images of the left and right eyes of the user U from the image IMG or the facial image. The extraction of the face and eye images is performed, for example, by using a machine learning model generated in advance through machine learning.

[0024] The positional relationship calculation unit 162 calculates the relative positional relationship between the left and right eyes of the user U and the display surface 111 (display unit) of the display 110. More specifically, the positional relationship calculation unit 162 acquires an image IMG of the user U captured by the camera 120. Furthermore, the positional relationship calculation unit 162 determines the position and size of the user U's face and the positions of the left and right eyes in the image IMG based on the extraction result by the face / eye extraction unit 161. The installation position, installation orientation, and angle of view of the camera 120 are known information. The size of a typical user U's face is also known information. The positional relationship calculation unit 162 calculates (estimates) the relative positional relationship between the camera 120 and the left and right eyes of the user U based on this known information, the position and size of the user U's face, and the positions of the left and right eyes in the image IMG. As another example, the distance between the camera 120 and the user U may be calculated based on the blur state of the image IMG. The relative positional relationship between the camera 120 and the display surface 111 of the display 110 is also known information. The positional relationship calculation unit 162 calculates the relative positional relationship between the left and right eyes of the user U and the display surface 111 by combining the relative positional relationship between the camera 120 and the left and right eyes of the user U and the relative positional relationship between the camera 120 and the display surface 111 of the display 110.

[0025] 4 is a conceptual diagram showing the relative positional relationship between the left and right eyes of the user U and the display surface 111 of the display 110. The relative positional relationship includes at least the distance Dl between the left eye and the display surface 111 and the distance Dr between the right eye and the display surface 111. The relative positional relationship may also include the distance Dw between the left eye and the right eye.

[0026] The feature extraction unit 163 extracts feature parameters of the user U. Examples of the feature parameters include gaze information, gaze point, facial expression parameters, and posture parameters of the user U. The feature extraction unit 163 extracts the feature parameters of the user U based on images of the left and right eyes and a facial image of the user U.

[0027] For example, the feature extraction unit 163 recognizes the position and rotation angle of the pupil (black part of the eye) of each eye based on images of the left and right eyes of the user U. Then, the feature extraction unit 163 recognizes the gaze direction of each eye based on the position and rotation angle of the pupil of each eye. The gaze information includes the gaze direction of each eye. The feature extraction unit 163 may calculate coordinate information of the point where the gaze intersects with the display surface 111, taking into account a coordinate system on the display surface 111. The coordinate information of the point where the gaze intersects with the display surface 111 may be provided as the gaze information of the user U.

[0028] The feature extraction unit 163 may calculate the point where the line of sight of the left eye and the line of sight of the right eye of the user U intersect. The point where the line of sight of the left eye and the line of sight of the right eye intersect is also called the focal point. When the pupil moves inward, the focal point becomes closer, and when the pupil moves outward, the focal point becomes farther. This focal point corresponds to the "point of gaze" at which the user U is gazing. Note that not only real-time information on the point of gaze but also statistical information on the point of gaze within a certain period may be used.

[0029] The feature extraction unit 163 may extract facial expression parameters representing facial expressions of the user U based on the facial image of the user U. The extraction of the facial expression parameters is performed, for example, by using a machine learning model that has been generated in advance through machine learning.

[0030] The feature extraction unit 163 may extract posture parameters representing the posture (face angle, etc.) of the user U based on the face image or image IMG of the user U. The posture parameters are extracted, for example, by using a machine learning model generated in advance through machine learning.

[0031] The transmitting unit 164 transmits information about the user U to the other electronic device 100 via the communication interface 140. Typically, the transmitting unit 164 transmits real-time information about the user U to the other electronic device 100. The transmitted information includes at least one of an image IMG of the user U, a facial image, and at least a portion of the feature parameters.

[0032] The receiving unit 171 receives information about another user U (for convenience, referred to as user Ui) from another electronic device 100 via the communication interface 140. The received information includes at least one of an image IMG-i, a facial image, and at least a portion of feature parameters of the user Ui.

[0033] The rendering unit 172 acquires the received information from the receiving unit 171. The rendering unit 172 performs rendering processing based on the received information to acquire a user image UIMG-i representing the user Ui. The user image UIMG-i may be a three-dimensional image. For example, the user image UIMG-i is an avatar image. A predetermined three-dimensional human model is prepared in advance. The rendering unit 172 acquires an avatar image representing the user Ui by applying a facial image or feature parameters (facial expression, posture) of the user Ui to the predetermined three-dimensional human model and performing rendering processing.

[0034] The display processing unit 173 displays a user image UIMG-i representing the user Ui on the display 110 (display surface 111). The user U of the electronic device 100 can see the displayed user image UIMG-i.

[0035] The display processing unit 173 may display the user image UIMG-i on the display 110 (display surface 111) so that the user Ui appears to be floating above the display surface 111. This processing is hereinafter referred to as "stereoscopic display processing." The display processing unit 173 executes the stereoscopic display processing as necessary. More specifically, the display processing unit 173 acquires information on the relative positional relationship between the left and right eyes of the user U and the display surface 111 from the positional relationship calculation unit 162. Then, the display processing unit 173 executes the stereoscopic display processing based on the relative positional relationship between the left and right eyes of the user U and the display surface 111.

[0036] For example, in FIG. 4, position X on the display surface 111 is a position corresponding to the midpoint between the left and right eyes of the user U. A range RNG on the display surface 111 is a range corresponding to the area between the left and right eyes of the user U and includes position X. The display processing unit 173 can recognize position X and range RNG based on the relative positional relationship between the left and right eyes of the user U and the display surface 111. Then, the display processing unit 173 displays the user image UIMG-i on the display surface 111 so that it fits within range RNG. In other words, the display processing unit 173 displays the user image UIMG-i between the left and right eyes of the user U. As a result, when viewed from the user U, the user Ui appears to float above the display surface 111.

[0037] The stereoscopic display process may be realized by other methods. For example, the stereoscopic display process may be realized by a lenticular method using a lenticular lens. In the case of the lenticular method, a target image for the left eye and a target image for the right eye are prepared separately and displayed separately on the display surface 111 so that the targets appear to float above the display surface 111.

[0038] Note that the stereoscopic display process is not essential, and the user Ui does not have to appear floating above the display surface 111.

[0039] 3. Gaze highlighting processing 5 conceptually illustrates an example of stereoscopic display processing in the electronic device 100-B used by the user UB. The stereoscopic display processing is executed so that multiple users UA, UC, and UD other than the user UB appear to float above the display surface 111. Typically, the stereoscopic display processing is executed so that the apparent positions of the users UA, UC, and UD are on a line connecting the left and right eyes of the user UB and the display surface 111.

[0040] Here, if user UB can visually grasp what other users are gazing at, the reality and the sense of presence will be further increased. For example, user UD of electronic device 100-D is gazing at user UA (user image UIMG-A) displayed through display 110 of electronic device 100-D. Also, user UC of electronic device 100-C is gazing at user UB (user image UIMG-B) displayed through display 110 of electronic device 100-C. If user UB can visually grasp such gaze states of other users, the reality and the sense of presence will be further increased.

[0041] The process of displaying information so that the gaze status of other users can be visually grasped is hereinafter referred to as "gaze emphasis display process." According to this embodiment, information on each user's "point of gaze" is used to realize the gaze emphasis display process. The "point of gaze" is not simply a line of sight, but is a concept that also includes depth and profundity. The gaze emphasis display process is performed so that each user's "point of gaze" is reflected in their appearance.

[0042] 3-1.Specific examples For the purposes of explanation, consider a first electronic device 100-1 used by a first user U-1 and a second electronic device 100-2 used by a second user U-2.

[0043] As described above, the controller 150 (feature extraction unit 163) of the first electronic device 100-1 detects (recognizes) the line of sight and point of gaze of the first user U-1 based on the image IMG-1 of the first user U-1 captured by the camera 120. For example, if the first user U-1 is user UD, the electronic device 100-D can detect (recognize) the line of sight and point of gaze of the user UD based on the image IMG-D of the user UD.

[0044] The information on the line of sight direction of the first user U-1 includes, for example, coordinate information of the point where the line of sight of the first user U-1 intersects with the display surface 111 of the display 110. The information on the point of gaze of the first user U-1 includes, for example, the distance (depth) between the line of sight of the first user U-1 and the display surface 111 of the display 110. As another example, the information on the point of gaze of the first user U-1 may include position information of the point of gaze on the line of sight of the first user U-1 (that is, the positional relationship between the left and right eyes of the first user U-1, the display surface 111, and the point of gaze).

[0045] The controller 150 (feature extraction unit 163) of the first electronic device 100-1 may recognize that the first user U-1 is looking at a "first target" displayed on the display 110 of the first electronic device 100-1, based on the gaze point and gaze direction of the first user U-1. The first target may be another user or a predetermined object. For example, if the first user U-1 is user UD, the electronic device 100-D recognizes that the user UD is looking at user UA (user image UIMG-A) displayed on the display 110 of the electronic device 100-D, based on the gaze point and gaze direction of user UD. In this case, user UA is identified as the first target for user UD. Information about the gaze point of the first user U-1 may include information about the first target that the first user U-1 is looking at.

[0046] The "first user gaze information" includes information on the gaze direction and gaze point of the first user U-1 obtained in this manner. The first user gaze information may include information on the first target that the first user U-1 is looking at as gaze point information. The controller 150 of the first electronic device 100-1 transmits the first user gaze information to the second electronic device 100-2.

[0047] The controller 150 of the second electronic device 100-2 acquires first user gaze information transmitted from the first electronic device 100-1. Furthermore, as described above, the controller 150 of the second electronic device 100-2 acquires a first user image UIMG-1 representing the first user U-1. Based on the first user gaze information, the controller 150 (display processing unit 173) of the second electronic device 100-2 displays the first user image UIMG-1 on the display 110 of the second electronic device 100-2 so that the first user U-1 appears to be gazing at the gaze point. That is, the controller 150 of the second electronic device 100-2 executes gaze highlighting processing based on the first user gaze information. For example, the first user gaze information includes position information of the gaze point on the line of sight of the first user U-1. Therefore, the controller 150 of the second electronic device 100-2 can display the first user image UIMG-1 based on the first user gaze information so that the first user U-1 appears to be gazing at the gaze point.

[0048] The first user gaze information may include information about a first target that the first user U-1 is looking at as gaze point information. The controller 150 of the second electronic device 100-2 acquires a first user image UIMG-1 representing the first user U-1 and a first target image representing the first target. Based on the first user gaze information, the controller 150 (display processing unit 173) of the second electronic device 100-2 displays the first user image UIMG-1 and the first target image on the display 110 of the second electronic device 100-2 so that the first user U-1 appears to be gazing at the first target. For example, if the first user U-1 is user UD, the first target is user UA, and the second user U-2 is user UB, the electronic device 100-B displays user image UIMG-D and user image UIMG-A on the display 110 of the second electronic device 100-2 so that the user UD appears to be gazing at user UA.

[0049] Various examples of the gaze highlighting process are possible. A first example of the gaze highlighting process includes displaying an arrow image (arrow object) indicating the direction from the first user image UIMG-1 to the gaze point on the display 110 of the second electronic device 100-2. In the example shown in Fig. 5, an arrow image (arrow object) indicating the direction from the user image UIMG-D of user UD to the user image UIMG-A of user UA is displayed on the display 110 of the electronic device 100-B of user UB.

[0050] A second example of the gaze highlighting process includes adjusting the orientation of the first user image UIMG-1 (three-dimensional image) so that the first user U-1 appears to be facing the gaze point. In the example shown in Figure 5, the orientation of the user image UIMG-D (three-dimensional image) is adjusted so that the user UD appears to be facing the user UA. A combination of the first and second examples is also possible.

[0051] Fig. 6 shows an example of how the user UA sees the screen. The situation is the same as that shown in Fig. 5. In the example shown in Fig. 6, the electronic device 100-A of the user UA is an electronic terminal such as a smartphone or a tablet. It can be seen that the users UB and UD are gazing at the user UA, and the user UC is gazing at the user UB.

[0052] As described above, according to this embodiment, the first user image UIMG-1 representing the first user U-1 is displayed on the display 110 of the second electronic device 100-2 of the second user U-2. At this time, a gaze highlighting display process is executed so that the first user U-1 appears to be gazing at the gaze point. The second user U-2 can visually grasp what the first user U-1 is gazing at. This enhances the sense of reality and presence. According to this embodiment, it can be said that information about the gaze points of each user U is effectively shared between the users U.

[0053] 3-2.Gaze emphasis display processing taking into account gaze level As described above, the controller 150 of the first electronic device 100-1 can recognize that the first user U-1 is looking at the first target based on the gaze point and line of sight of the first user U-1. However, the gaze point of the first user U-1 and the display position of the first target image (the "apparent position" that appears to emerge from the display surface 111) do not necessarily match perfectly. The closer the gaze point of the first user U-1 and the display position of the first target image are, the more closely the first user U-1 is gazing at the first target. Conversely, if the gaze point of the first user U-1 and the display position of the first target image are far apart, the first user U-1 is looking at the first target vaguely.

[0054] The manner of the gaze highlighting display process may change depending on whether the first user U-1 is gazing intently at the first target or gazing absentmindedly. To this end, a "gaze degree" indicating the degree to which the first user U-1 is gazing at the first target may be introduced.

[0055] For example, as shown in FIG. 3, the controller 150 may include a gaze degree calculation unit 180 that calculates a gaze degree. The gaze degree calculation unit 180 of the controller 150 of the first electronic device 100-1 acquires position information of the gaze point of the first user U-1 from the feature extraction unit 163. The gaze degree calculation unit 180 also acquires information on the display position of the first target image (the “apparent position” that appears to emerge from the display surface 111) from the display processing unit 173. The gaze degree calculation unit 180 calculates the distance between the gaze point of the first user U-1 and the display position of the first target image as the deviation degree. Alternatively, the gaze degree calculation unit 180 calculates a first distance between the gaze point of the first user U-1 and the display surface 111 and a second distance between the display position of the first target image and the display surface 111, and calculates the difference between the first distance and the second distance as the deviation degree. Then, the gaze degree calculation unit 180 calculates the gaze degree indicating the degree to which the first user U-1 is gazing at the first target according to the deviation degree. Specifically, the gaze degree is calculated to be higher as the deviation degree is lower, and conversely, the gaze degree is calculated to be lower as the deviation degree is higher.

[0056] The first user gaze information may include information about the gaze degree of the first user U-1. The controller 150 of the first electronic device 100-1 transmits the first user gaze information including the information about the gaze degree of the first user U-1 to the second electronic device 100-2. The controller 150 of the second electronic device 100-2 performs the gaze highlighting display process taking into account the gaze degree of the first user U-1. More specifically, the controller 150 of the second electronic device 100-2 performs the gaze highlighting display process so that the fact that the first user U-1 is gazing at the first target is more emphasized as the gaze degree of the first user U-1 increases.

[0057] A first example of the gaze emphasis display process includes displaying an arrow image (arrow object) indicating the direction from the first user image UIMG-1 to the first target image on the display 110 of the second electronic device 100-2. In this case, the size of the arrow image increases as the gaze level of the first user U-1 increases. Here, the size of the arrow image includes at least one of the length and thickness of the arrow image. In this way, the size of the arrow image changes in conjunction with the gaze level of the first user U-1, allowing the second user U-2 to visually grasp the gaze level of the first user U-1.

[0058] A second example of the gaze emphasis display process includes adjusting the orientation of the first user image UIMG-1 (three-dimensional image) so that the first user U-1 appears to be facing the first target. In this case, as the gaze level of the first user U-1 increases, the orientation of the first user U-1 approaches the direction of the first target. In this way, the orientation of the first user image UIMG-1 changes in conjunction with the gaze level of the first user U-1, allowing the second user U-2 to visually grasp the gaze level of the first user U-1.

[0059] 3-3.Other examples The controller 150 (display processing unit 173) of the first electronic device 100-1 of the first user U-1 may three-dimensionally display a gaze point object representing the gaze point of the first user U-1 himself / herself so that it appears to float above the display surface 111. For example, the controller 150 (display processing unit 173) of the electronic device 100-B of the user UB may three-dimensionally display a gaze point object representing the gaze point of the user UB so that it appears to float above the display surface 111. Position information of the gaze point of the user UB is obtained from the feature extraction unit 163. The gaze point object has, for example, a spherical shape. [Explanation of symbols]

[0060] 1 Information display system 10 Servers 100 Electronic equipment 110 Display 111 Display surface 120 Camera 150 Controller 151 processors 152 memory

Claims

1. a plurality of electronic devices connected to each other via a communications network; the plurality of electronic devices includes a first electronic device used by a first user and a second electronic device used by a second user; The first electronic device is Detecting a gaze point of the first user based on an image of the first user captured by a camera; transmitting first user gaze information including information about the gaze point of the first user to the second electronic device; It is configured as follows: The second electronic device is obtaining a first user image representing the first user; Based on the first user gaze information, a gaze highlighting display process is performed to display the first user image on the display of the second electronic device so that the first user appears to be gazing at the gaze point. It was configured as Information display system.

2. 2. The information display system according to claim 1, The gaze emphasis display process includes: displaying an arrow image on the display of the second electronic device, the arrow image representing a direction from the first user image to the gaze point; adjusting the orientation of the first user image so that the first user appears to be facing the point of regard; Contains at least one of Information display system.

3. 2. The information display system according to claim 1, The first electronic device further comprises: Recognizing that the first user is looking at a first target displayed on a display of the first electronic device based on the gaze point and gaze direction of the first user; transmitting the first user's gaze information, which includes information about the first target as information about the gaze point, to the second electronic device; It is configured as follows: The second electronic device further comprises: acquiring a first target image representing the first target; In the gaze highlighting display process, the first user image and the first target image are displayed on the display of the second electronic device based on the first user gaze information so that it appears as if the first user is gazing at the first target. It was configured as Information display system.

4. 4. The information display system according to claim 3, The first electronic device is calculating a gaze degree indicating a degree to which the first user gazes at the first target according to a distance between the gaze point of the first user and a display position of the first target image; transmitting the first user's gaze information including the gaze degree information to the second electronic device; It is configured as follows: The second electronic device performs the gaze highlighting display process so that it is more emphasized that the first user is gazing at the first target as the gaze degree increases. Information display system.

5. 5. The information display system according to claim 4, The gaze emphasis display process includes: displaying an arrow image on the display of the second electronic device, the arrow image representing a direction from the first user image to the first target image; increasing at least one of the length and thickness of the arrow image as the gaze degree increases; Contains Information display system.

Images