Information display system

Abstract

The purpose of the present invention is to further improve the sense of reality when displaying an image representing a certain user on an electronic device of another user. An information display system includes a plurality of electronic devices connected to each other via a communication network. The plurality of electronic devices include a first electronic device used by a first user and a second electronic device used by a second user. The first electronic device detects a gaze point of a first user on the basis of an image of the first user captured by a camera. The first electronic device transmits, to the second electronic device, first user gaze information including information on the gaze point of the first user. The second electronic device acquires a first user image indicating a first user. Furthermore, the second electronic device executes a gaze emphasis display process for displaying the first user image on the display of the second electronic device such that the first user appears to gaze the gaze point on the basis of the first user gaze information.

Description

Technical Field

[0001] The present disclosure relates to information display technology using an electronic device. Background Art

[0002] Patent Document 1 discloses an AC assistance system. The AC assistance system arranges user objects corresponding to multiple users in a two-dimensional or three-dimensional virtual space.

[0003] Patent Document 1: Japanese Patent No. 7150114 Gazette

[0004] Consider information display technology using multiple electronic devices capable of communicating with each other. A technology is desired that can further enhance the sense of reality when displaying an image of a certain user on the electronic device of another user. Summary of the Invention

[0005] One aspect of the present disclosure relates to an information display system.

[0006] The information display system includes multiple electronic devices interconnected via a communication network. The multiple electronic devices include a first electronic device used by a first user and a second electronic device used by a second user.

[0007] The first electronic device detects the gaze point of the first user based on an image of the first user captured by a camera. Moreover, the first electronic device transmits first user gaze information including information on the gaze point of the first user to the second electronic device.

[0008] The second electronic device acquires a first user image representing the first user. Moreover, the second electronic device performs a gaze emphasis display process of displaying the first user image on the display of the second electronic device in such a way that it appears that the first user is gazing at the gaze point based on the first user gaze information.

[0009] According to the present disclosure, the first user image representing the first user is displayed on the second electronic device of the second user U-2. At this time, the gaze emphasis display process is performed in such a way that it appears that the first user is gazing at the gaze point. The second user can visually grasp what the first user is gazing at. As a result, the sense of reality and authenticity are enhanced. Brief Description of the Drawings

[0010] Figure 1 It is a schematic diagram for explaining the outline of the information display system.

[0011] Figure 2 It is a block diagram showing a structural example of an electronic device.

[0012] Figure 3 It is a block diagram showing a functional structural example of the controller of the electronic device.

[0013] Figure 4 It is a schematic diagram showing the relative positional relationship between the left and right eyes of the user and the display surface.

[0014] Figure 5 (a) and (b) of Figure 5 are schematic diagrams for explaining examples of the fixation emphasis display process.

[0015] Figure 6 It is a schematic diagram for explaining an example of the fixation emphasis display process.

[0016] Explanation of reference numerals

[0017] 1... Information display system; 10... Server; 100... Electronic device; 110... Display; 111... Display surface; 120... Camera; 150... Controller; 151... Processor; 152... Memory. Detailed implementation mode

[0018] With reference to the accompanying drawings, the implementation modes of the present disclosure will be described.

[0019] 1. Outline of the information display system

[0020] Figure 1 It is a schematic diagram for explaining the outline of the information display system 1 according to the present embodiment. The information display system 1 includes a plurality of electronic devices 100. As the electronic device 100, a personal computer, a tablet, a dedicated terminal, etc. are exemplified. The plurality of electronic devices 100 are respectively used by a plurality of users U. In Figure 1 In the example shown, the electronic devices 100-A, 100-B, 100-C, and 100-D and the respective users U-A, U-B, U-C, and U-D are shown. Among them, the number of the electronic devices 100 and the number of the users U are arbitrary.

[0021] The plurality of electronic devices 100 are connected to each other via a communication network and can communicate with each other. The communication network can be a wireless communication network or a wired communication network. The plurality of electronic devices 100 can also be connected to the server 10 and communicate with each other via the server 10.

[0022] In addition, each of the plurality of electronic devices 100 is provided with a camera (imaging device) and a display (display device). The camera is set to be able to image the user U. Typically, the camera is set to be able to image the face of the user U.

[0023] An electronic device 100-i (i = A, B, C, D ···) acquires an image IMG-i of a user U-i captured by a camera. The image IMG-i includes at least the face of the user U-i. The electronic device 100-i sends the image IMG-i to another electronic device 100-j (j ≠ i). The electronic device 100-i may also extract feature parameters of the user U-i based on the image IMG-i and send information on the feature parameters of the user U-i to another electronic device 100-j. As the feature parameters, examples include the line-of-sight information, fixation point, expression parameters, and posture parameters of the user U-i. Typically, the electronic device 100-i sends at least one of the image IMG-i and the feature parameters to another electronic device 100-j in real time.

[0024] The electronic device 100-j receives the information sent from the electronic device 100-i. The electronic device 100-j acquires a user image UIMG-i representing the user U-i based on at least one of the image IMG-i and the feature parameters. The user image UIMG-i may be the original image IMG-i or an avatar image. The avatar image is generated, for example, by applying at least one of the original image IMG-i and the feature parameters to a predetermined character model. The electronic device 100-j displays the user image UIMG-i representing the user U-i on a display. The user U-j of the electronic device 100-j can observe the user image UIMG-i displayed on the display. That is, the electronic device 100-j displays the user image UIMG-i of the user U-i of another electronic device 100-i that is the communication partner, and the user U-j can see the user image UIMG-i of the other user U-i that is the communication partner.

[0025] The information display system 1 according to the present embodiment can be applied, for example, to online learning, online teaching, online conferencing, etc. In these cases, the information display system 1 can also be referred to as an online learning system, an online teaching system, an online conferencing system, etc.

[0026] 2. Structural example of an electronic device

[0027] Figure 2 is a block diagram showing a structural example of the electronic device 100. In Figure 2 the example shown, the electronic device 100 includes a display 110, one or more cameras 120 (hereinafter simply referred to as the camera 120), a user interface 130, a communication interface 140, and a controller 150.

[0028] The display 110 is configured to display various types of information. Examples of the display 110 include a liquid crystal display, an organic EL display, a head-up display (HUD), etc. The display 110 has a display surface (display unit) 111. Typically, the user U of the electronic device 100 uses the electronic device 100 with the display surface 111 of the display 110 facing each other.

[0029] The camera 120 is arranged to be able to photograph the user U of the electronic device 100. Typically, the camera 120 is arranged to be able to photograph the face of the user U of the electronic device 100. For example, the camera 120 is arranged around the display surface 111 of the display 110.

[0030] The user interface 130 includes an input device that receives input of various types of information from the user U. Examples of the input device include a touch panel, a keyboard, a mouse, a microphone, etc. The user interface 130 may also include an output device such as a speaker.

[0031] The communication interface 140 is connected to a communication network and communicates with the outside of the electronic device 100. The communication network may be a wireless communication network or a wired communication network. For example, the communication interface 140 communicates with the server 10 and other electronic devices 100.

[0032] The controller 150 performs various types of information processing. The controller 150 can also be referred to as a processing circuitry. The processing circuitry is hardware that is programmed to implement a function or hardware that executes a function.

[0033] For example, the controller 150 includes one or more processors 151 (hereinafter simply referred to as the processor 151) and one or more memories 152 (hereinafter simply referred to as the memory 152). The processor 151 performs various information processing. Examples of the processor 151 include a general-purpose processor, a dedicated-purpose processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), an integrated circuit, a conventional circuit, and / or a combination thereof. The memory 152 stores various information. Examples of the memory 152 include a volatile memory, a non-volatile memory, an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc. The control program is a computer program executed by the processor 151. The functions of the controller 150 can also be implemented by the cooperation of the processor 151 that executes the control program and the memory 152. The control program is stored in the memory 152. Alternatively, the control program can also be recorded on a computer-readable recording medium.

[0034] Figure 3 is a block diagram showing an example of the functional structure of the controller 150. In Figure 3 the example shown, the controller 150 includes a face / eye extraction unit 161, a positional relationship calculation unit 162, a feature extraction unit 163, a transmission unit 164, a reception unit 171, a rendering unit 172, and a display processing unit 173 as functional modules.

[0035] The face / eye extraction unit 161 acquires an image IMG of the user U captured by the camera 120. The image IMG includes at least the face of the user U. Typically, the face / eye extraction unit 161 acquires the image IMG in real time. Moreover, the face / eye extraction unit 161 extracts a face image of the face portion of the user U from the image IMG. And the face / eye extraction unit 161 can also extract images of the left and right eyes of the user U from the image IMG and the face image. The extraction of the images of the face and eyes is performed, for example, by using a machine learning model pre-generated through machine learning.

[0036] The position relationship calculation unit 162 calculates the relative position relationship between the left and right eyes of the user U and the display surface 111 (display unit) of the display 110. More specifically, the position relationship calculation unit 162 acquires the image IMG of the user U captured by the camera 120. In addition, the position relationship calculation unit 162 grasps the position and size of the face of the user U in the image IMG and the positions of the left and right eyes based on the extraction results of the face-eye extraction unit 161. The installation position, installation orientation, and viewing angle of the camera 120 are known information. The size of the face of the general user U is also known information. The position relationship calculation unit 162 calculates (infers) the relative position relationship between the camera 120 and the left and right eyes of the user U based on these known information, the position and size of the face of the user U in the image IMG, and the positions of the left and right eyes. As another example, the distance between the camera 120 and the user U can also be calculated based on the blurring state of the image IMG. In addition, the relative position relationship between the camera 120 and the display surface 111 of the display 110 is also known information. The position relationship calculation unit 162 calculates the relative position relationship between the left and right eyes of the user U and the display surface 111 by combining the relative position relationship between the camera 120 and the left and right eyes of the user U and the relative position relationship between the camera 120 and the display surface 111 of the display 110.

[0037] Figure 4 It is a schematic diagram showing the relative position relationship between the left and right eyes of the user U and the display surface 111 of the display 110. The relative position relationship at least includes the distance Dl between the left eye and the display surface 111 and the distance Dr between the right eye and the display surface 111. The relative position relationship may also include the distance Dw between the left eye and the right eye.

[0038] The feature extraction unit 163 extracts the feature parameters of the user U. As the feature parameters, examples include the gaze information, fixation point, expression parameters, posture parameters, etc. of the user U. The feature extraction unit 163 extracts the feature parameters of the user U based on the images of the left and right eyes and the face image of the user U.

[0039] For example, the feature extraction unit 163 identifies the positions and rotation angles of the pupils (black eyeballs) of each eye based on the images of the left and right eyes of the user U. Moreover, the feature extraction unit 163 identifies the gaze directions of each eye based on the positions and rotation angles of the pupils of each eye. The gaze information includes the gaze directions of each eye. The feature extraction unit 163 may also calculate the coordinate information of the point where the gaze intersects the display surface 111 in consideration of the coordinate system on the display surface 111. As the gaze information of the user U, the coordinate information of the point where the gaze intersects the display surface 111 may also be given.

[0040] The feature extraction unit 163 may also calculate the point where the line of sight of the user U's left eye intersects with the line of sight of the right eye. The point where the line of sight of the left eye intersects with the line of sight of the right eye is also referred to as the focus point. If the pupil approaches the inside, the focus point gets closer, and if the pupil approaches the outside, the focus point gets farther. This focus point corresponds to the "gaze point" at which the user U is looking. In addition, not only the real-time information of the gaze point is used, but also the statistical information of the gaze point within a certain period can be used.

[0041] The feature extraction unit 163 may also extract an expression parameter representing the expression of the user U based on the face image of the user U. The extraction of the expression parameter is performed, for example, by using a machine learning model pre-generated through machine learning.

[0042] The feature extraction unit 163 may also extract a pose parameter (such as the angle of the face, etc.) representing the pose of the user U based on the face image of the user U or the image IMG. The extraction of the pose parameter is performed, for example, by using a machine learning model pre-generated through machine learning.

[0043] The sending unit 164 sends information related to the user U to other electronic devices 100 via the communication interface 140. Typically, the sending unit 164 sends real-time information related to the user U to other electronic devices 100. The sent information includes at least one of at least a part of the image IMG, face image, and feature parameters of the user U.

[0044] The receiving unit 171 receives information related to other users U (for convenience, referred to as user U-i) from other electronic devices 100 via the communication interface 140. The received information includes at least one of at least a part of the image IMG-i, face image, and feature parameters of the user U-i.

[0045] The rendering unit 172 obtains the received information from the receiving unit 171. The rendering unit 172 obtains a user image UIMG-i representing the user U-i by performing a rendering process based on the received information. The user image UIMG-i may also be a three-dimensional image. For example, the user image UIMG-i is a virtual image. A prescribed three-dimensional character model is prepared in advance. The rendering unit 172 performs a rendering process by applying the face image or feature parameters (expression, pose) of the user U-i to the prescribed three-dimensional character model, thereby obtaining a virtual image representing the user U-i.

[0046] The display processing unit 173 displays the user image UIMG-i representing the user U-i on the display 110 (display surface 111). The user U of the electronic device 100 can see the displayed user image UIMG-i.

[0047] The display processing unit 173 may also display the user image UIMG-i on the display 110 (display surface 111) in such a way that it appears as if the user U-i emerges from the display surface 111. Hereinafter, this processing will be referred to as "stereoscopic display processing". The display processing unit 173 performs stereoscopic display processing as needed. More specifically, the display processing unit 173 obtains information on the relative positional relationship between the left and right eyes of the user U and the display surface 111 from the above-mentioned positional relationship calculation unit 162. Moreover, the display processing unit 173 may perform stereoscopic display processing based on the relative positional relationship between the left and right eyes of the user U and the display surface 111.

[0048] For example, in Figure 4 , the position X on the display surface 111 is a position corresponding to the intermediate position between the left and right eyes of the user U. The range RNG on the display surface 111 is a range corresponding to the range between the left and right eyes of the user U and includes the position X. Based on the relative positional relationship between the left and right eyes of the user U and the display surface 111, the display processing unit 173 can identify the position X and the range RNG. Moreover, the display processing unit 173 displays the user image UIMG-i on the display surface 111 in such a way that it is accommodated within the range RNG. That is, the display processing unit 173 displays the user image UIMG-i between the left and right eyes of the user U. Thus, when viewed from the user U, the user U-i appears to emerge from the display surface 111.

[0049] In addition, the stereoscopic display processing may also be implemented by other means. For example, the stereoscopic display processing may be implemented by the lenticular lens method using lenticular lenses. In the case of the lenticular lens method, a target image for the left eye and a target image for the right eye are prepared in such a way that the target appears to emerge from the display surface 111 and are respectively displayed on the display surface 111.

[0050] In addition, the stereoscopic display processing is not essential. The user U-i may not emerge from the display surface 111.

[0051] 3. Fixation Emphasis Display Processing

[0052] Figure 5 Figures (a) and (b) schematically show an example of stereoscopic display processing in the electronic device 100-B used by the user U-B. The stereoscopic display processing is performed in such a way that a plurality of users U-A, U-C, U-D other than the user U-B appear to emerge from the display surface 111. Typically, the stereoscopic display processing is performed in such a way that the apparent positions of the users U-A, U-C, U-D are on the line connecting the left and right eyes of the user U-B and the display surface 111.

[0053] Here, as long as user U-B can visually grasp what other users are looking at, the sense of reality and authenticity will be further enhanced. For example, user U-D of the electronic device 100-D is looking at user U-A (user image UIMG-A) displayed on the display 110 of the electronic device 100-D. In addition, user U-C of the electronic device 100-C is looking at user U-B (user image UIMG-B) displayed on the display 110 of the electronic device 100-C. As long as user U-B can visually grasp the gaze status of such other users, the sense of reality and authenticity will be further enhanced.

[0054] Hereinafter, the process of performing display in such a way as to visually grasp the gaze status of other users is referred to as "gaze emphasis display process". According to the present embodiment, in order to implement the gaze emphasis display process, the information of the "gaze point" of each user is used. The "gaze point" is different from the simple line-of-sight direction and is a concept that also includes depth. The gaze emphasis display process is performed in such a way as to reflect the "gaze point" of each user on the appearance.

[0055] 3-1. Specific Example

[0056] Hereinafter, for the sake of illustration, consider the first electronic device 100-1 used by the first user U-1 and the second electronic device 100-2 used by the second user U-2.

[0057] As described above, the controller 150 (feature extraction unit 163) of the first electronic device 100-1 detects (identifies) the line-of-sight direction and gaze point of the first user U-1 based on the image IMG-1 of the first user U-1 captured by the camera 120. For example, when the first user U-1 is user U-D, the electronic device 100-D can detect (identify) the line-of-sight direction and gaze point of user U-D based on the image IMG-D of user U-D.

[0058] The information of the line-of-sight direction of the first user U-1 includes, for example, the coordinate information of the point where the line of sight of the first user U-1 intersects the display surface 111 of the display 110. The information of the gaze point of the first user U-1 includes, for example, the distance (depth) between the gaze point of the first user U-1 and the display surface 111 of the display 110. As another example, the information of the gaze point of the first user U-1 may also include the position information of the gaze point on the line of sight of the first user U-1 (i.e., the positional relationship between the left and right eyes of the first user U-1, the display surface 111, and the gaze point).

[0059] The controller 150 (feature extraction unit 163) of the first electronic device 100-1 may also identify the "first target" that the first user U-1 is observing on the display 110 of the first electronic device 100-1 based on the fixation point and line of sight direction of the first user U-1. The first target may be another user or a specified object. For example, when the first user U-1 is the user U-D, the electronic device 100-D identifies the user U-A (user image UIMG-A) that the user U-D is observing on the display 110 of the electronic device 100-D based on the fixation point and fixation direction of the user U-D. In this case, the user U-A is determined as the first target for the user U-D. The information on the fixation point of the first user U-1 may also include the information on the first target that the first user U-1 is observing.

[0060] The "first user fixation information" includes the line of sight direction and fixation point information of the first user U-1 obtained in this way. The first user fixation information may also include the information on the first target that the first user U-1 is observing as the fixation point information. The controller 150 of the first electronic device 100-1 sends the first user fixation information to the second electronic device 100-2.

[0061] The controller 150 of the second electronic device 100-2 acquires the first user fixation information sent from the first electronic device 100-1. In addition, as described above, the controller 150 of the second electronic device 100-2 acquires the first user image UIMG-1 representing the first user U-1. The controller 150 (display processing unit 173) of the second electronic device 100-2 displays the first user image UIMG-1 on the display 110 of the second electronic device 100-2 in such a way that it appears that the first user U-1 is looking at the fixation point based on the first user fixation information. That is, the controller 150 of the second electronic device 100-2 performs fixation emphasis display processing based on the first user fixation information. For example, the first user fixation information includes the position information of the fixation point on the line of sight of the first user U-1. Therefore, the controller 150 of the second electronic device 100-2 can display the first user image UIMG-1 in such a way that it appears that the first user U-1 is looking at the fixation point based on the first user fixation information.

[0062] The first user's gaze information may also include information about the first target that the first user U-1 is observing as the information of the fixation point. The controller 150 of the second electronic device 100-2 acquires the first user image UIMG-1 representing the first user U-1 and the first target image representing the first target. The controller 150 (display processing unit 173) of the second electronic device 100-2 displays the first user image UIMG-1 and the first target image on the display 110 of the second electronic device 100-2 in such a way that it appears that the first user U-1 is gazing at the first target based on the first user's gaze information. For example, when the first user U-1 is the user U-D, the first target is the user U-A, and the second user U-2 is the user U-B, the electronic device 100-B displays the user image UIMG-D and the user image UIMG-A on the display 110 of the second electronic device 100-2 in such a way that it appears that the user U-D is gazing at the user U-A.

[0063] As a method of fixation emphasis display processing, various examples are considered. The first example of fixation emphasis display processing includes: displaying an arrow image (arrow object) indicating the direction from the first user image UIMG-1 to the fixation point on the display 110 of the second electronic device 100-2. In Figure 5 the example shown, an arrow image (arrow object) indicating the direction from the user image UIMG-D of the user U-D to the user image UIMG-A of the user U-A is displayed on the display 110 of the electronic device 100-B of the user U-B.

[0064] The second example of fixation emphasis display processing includes: adjusting the orientation of the first user image UIMG-1 (3D image) in such a way that it appears that the first user U-1 is facing the fixation point. In Figure 5 the example shown, the orientation of the user image UIMG-D (3D image) is adjusted in such a way that it appears that the user U-D is facing the user U-A. The first example and the second example can also be combined.

[0065] Figure 6 An example of viewing from the user U-A is shown. The situation is the same as that in Figure 5 shown. In Figure 6 the example shown, the electronic device 100-A of the user U-A is an electronic terminal such as a smartphone or a tablet. It can be seen that the user U-B and the user U-D are gazing at the user U-A, and the user U-C is gazing at the user U-B.

[0066] As described above, according to this embodiment, the first user image UIMG-1 representing the first user U-1 is displayed on the display 110 of the second electronic device 100-2 of the second user U-2. At this time, the gaze emphasis display process is performed in such a way that it appears that the first user U-1 is looking at the fixation point. The second user U-2 can visually grasp what the first user U-1 is looking at. As a result, the sense of reality and authenticity is improved. According to this embodiment, it can be said that the information on the fixation points of each user U is effectively shared among the users U.

[0067] 3-2. Gaze Emphasis Display Process Considering Gaze Degree

[0068] As described above, the controller 150 of the first electronic device 100-1 can identify that the first user U-1 is observing the first target based on the fixation point and the line-of-sight direction of the first user U-1. Among them, the fixation point of the first user U-1 does not necessarily exactly coincide with the display position of the first target image (the "apparent position" emerging from the display surface 111). It can be said that the closer the fixation point of the first user U-1 is to the display position of the first target image, the more closely the first user U-1 is looking at the first target. On the contrary, when the fixation point of the first user U-1 is far from the display position of the first target image, it can be said that the first user U-1 is observing the first target vaguely.

[0069] The manner of the gaze emphasis display process can also vary depending on whether the first user U-1 is closely looking at the first target or observing the first target vaguely. For this purpose, a "gaze degree" indicating the degree to which the first user U-1 is looking at the first target can also be introduced.

[0070] For example, as Figure 3 shown, the controller 150 may also include a gaze degree calculation unit 180 that calculates the gaze degree. The gaze degree calculation unit 180 of the controller 150 of the first electronic device 100-1 obtains the position information of the fixation point of the first user U-1 from the feature extraction unit 163. In addition, the gaze degree calculation unit 180 obtains the information on the display position (the "apparent position" emerging from the display surface 111) of the first target image from the display processing unit 173. The gaze degree calculation unit 180 calculates the distance between the fixation point of the first user U-1 and the display position of the first target image as the deviation degree. Alternatively, the gaze degree calculation unit 180 calculates the first distance between the fixation point of the first user U-1 and the display surface 11, and the second distance between the display position of the first target image and the display surface 111, and calculates the difference between the first distance and the second distance as the deviation degree. Moreover, the gaze degree calculation unit 180 calculates the gaze degree indicating the degree to which the first user U-1 is looking at the first target based on the deviation degree. Specifically, the lower the deviation degree, the higher the gaze degree is calculated, and on the contrary, the higher the deviation degree, the lower the gaze degree is calculated.

[0071] The first user gaze information may also include information on the gaze degree of the first user U-1. The controller 150 of the first electronic device 100-1 sends the first user gaze information including the information on the gaze degree of the first user U-1 to the second electronic device 100-2. The controller 150 of the second electronic device 100-2 also performs a gaze emphasis display process taking into account the gaze degree of the first user U-1. In more detail, the controller 150 of the second electronic device 100-2 performs a gaze emphasis display process so that as the gaze degree of the first user U-1 increases, it is further emphasized that the first user U-1 is looking at the first target.

[0072] The first example of the gaze emphasis display process includes: displaying an arrow image (arrow object) indicating the direction from the first user image UIMG-1 to the first target image on the display 110 of the second electronic device 100-2. In this case, as the gaze of the first user U-1 increases, the size of the arrow image increases. Here, the size of the arrow image includes at least one of the length and thickness of the arrow image. In this way, the size of the arrow image also changes in conjunction with the gaze of the first user U-1, so that the second user U-2 can also visually grasp the gaze of the first user U-1.

[0073] A second example of gaze-emphasized display processing involves adjusting the orientation of the first user image UIMG-1 (3D image) so that the first user U-1 appears to be looking toward the first target. In this case, as the first user U-1's gaze increases, the orientation of the first user U-1 moves closer to the first target. By adjusting the orientation of the first user image UIMG-1 in conjunction with the first user U-1's gaze, the second user U-2 can also visually grasp the first user U-1's gaze.

[0074] 3-3. Other examples

[0075] The controller 150 (display processing unit 173) of the first electronic device 100-1 of the first user U-1 may also three-dimensionally display a gaze point object representing the gaze point of the first user U-1 in a manner that emerges from the display surface 111. For example, the controller 150 (display processing unit 173) of the electronic device 100-B of the user UB may also three-dimensionally display a gaze point object representing the gaze point of the user UB in a manner that emerges from the display surface 111. The position information of the gaze point of the user UB is obtained from the feature extraction unit 163. The gaze point object has, for example, a spherical shape.

Claims

1. An information display system, wherein, it includes a plurality of electronic devices interconnected via a communication network, the plurality of electronic devices include a first electronic device used by a first user and a second electronic device used by a second user, the first electronic device is configured to: detect the gaze point of the first user based on an image of the first user captured by a camera, send first user gaze information including the information of the gaze point of the first user to the second electronic device, the second electronic device is configured to: acquire a first user image representing the first user, based on the first user gaze information, perform the following gaze emphasis display process, that is: display the first user image on the display of the second electronic device in a manner that it appears that the first user is gazing at the gaze point.

2. The information display system according to claim 1, wherein, the gaze emphasis display process includes at least one of the following processes: display an arrow image indicating the direction from the first user image to the gaze point on the display of the second electronic device; and adjust the orientation of the first user image in a manner that it appears that the first user is facing the gaze point.

3. The information display system according to claim 1, wherein, the first electronic device is further configured to: identify a first target displayed on the display of the first electronic device based on the gaze point and the line-of-sight direction of the first user, send the first user gaze information including the information of the first target as the information of the gaze point to the second electronic device, the second electronic device is further configured to: acquire a first target image representing the first target, in the gaze emphasis display process, based on the first user gaze information, display the first user image and the first target image on the display of the second electronic device in a manner that it appears that the first user is gazing at the first target.

4. The information display system according to claim 3, wherein, the first electronic device is configured to: calculate a gaze degree representing the degree to which the first user gazes at the first target according to the distance between the gaze point of the first user and the display position of the first target image, send the first user gaze information including the information of the gaze degree to the second electronic device, the second electronic device performs the gaze emphasis display process so that as the gaze degree becomes higher, it more emphasizes that the first user is gazing at the first target.

5. The information display system according to claim 4, wherein, the gaze emphasis display process includes: display an arrow image indicating the direction from the first user image to the first target image on the display of the second electronic device; and as the gaze degree becomes higher, increase at least one of the length and thickness of the arrow image.

Images