Electronic device

Abstract

To reduce processing burden necessary for displaying information in an electronic device.SOLUTION: An electronic device displays information to at least one first user. The electronic device comprises a display and a controller. The controller generates a second user image representing a second user, who is a user of a second electronic device communicating with the electronic device, and displays the second user image on the display. Based on an image of the first user captured by a camera, the controller detects the gaze point of the first user. The controller dynamically modifies the frame rate at which the second user image is generated, in response to the gaze point of the first user.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to information display technology using electronic devices. [Background technology]

[0002] Patent Document 1 discloses a communication system for communicating data between a first and a second terminal. The first terminal displays data transmitted from the second terminal on a display unit. When the user of the first terminal is not watching the display unit, the communication system reduces the communication speed of the data transmitted from the second terminal. In the case of image data, the communication system reduces the transmission frame rate of the image data transmitted from the second terminal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-110312 Summary of the Invention [Problem to be solved by the invention]

[0004] Considering information display technology using multiple electronic devices that can communicate with each other, there is a need for technology that can reduce the processing load required to display information in the electronic devices. [Means for solving the problem]

[0005] A first aspect relates to an electronic device for displaying information to at least one first user. The electronic device includes a display and a controller. The controller generates a second user image representing a second user of a second electronic device in communication with the electronic device, and displays the second user image on the display. The controller detects the gaze point of the first user based on an image of the first user captured by the camera. The controller dynamically changes the frame rate at which the second user's image is generated in accordance with the first user's gaze point.

[0006] The second aspect relates to an information display system. The information display system comprises a plurality of electronic devices connected to each other via a communication network. The plurality of electronic devices includes a first electronic device used by at least one first user and a second electronic device used by a second user. Each of the plurality of electronic devices includes a display and a controller. The controller of the first electronic device generates a second user image representing the second user and displays the second user image on the display. The controller of the first electronic device detects the gaze point of the first user based on an image of the first user captured by the camera. The controller of the first electronic device dynamically changes the frame rate at which the second user's image is generated in response to the first user's point of gaze. [Effects of the Invention]

[0007] According to the present disclosure, a second user image representing a second user is generated in an electronic device of a first user, and the second user image is displayed on a display. The frame rate at which the second user image is generated is dynamically changed according to the gaze point of the first user U-1. This reduces the processing load on the electronic device of the first user. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a conceptual diagram for explaining an overview of an information display system. [Figure 2] FIG. 1 is a block diagram illustrating an example of the configuration of an electronic device. [Figure 3] FIG. 2 is a block diagram illustrating an example of the functional configuration of a controller of the electronic device. [Figure 4] FIG. 1 is a conceptual diagram showing the relative positional relationship between the left and right eyes of a user and a display surface. [Figure 5] FIG. 10 is a conceptual diagram for explaining an example of a stereoscopic display process. [Figure 6] FIG. 10 is a block diagram showing another example of the functional configuration of the controller of the electronic device. DETAILED DESCRIPTION OF THE INVENTION

[0009] Embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0010] 1. Overview of the information display system FIG. 1 is a conceptual diagram for explaining an overview of an information display system 1 according to this embodiment. The information display system 1 includes a plurality of electronic devices 100. Examples of the electronic devices 100 include a personal computer, a tablet, a dedicated terminal, and the like. The plurality of electronic devices 100 are used by a plurality of users U, respectively. In the example shown in FIG. 1, electronic devices 100-A, 100-B, 100-C, and 100-D and their respective users UA, UB, UC, and UD are shown. However, the number of electronic devices 100 and the number of users U are arbitrary.

[0011] The electronic devices 100 are connected to each other via a communication network and can communicate with each other. The communication network may be a wireless communication network or a wired communication network. The electronic devices 100 may be connected to a server 10 and communicate with each other via the server 10.

[0012] Each of the electronic devices 100 includes a camera (image capture device) and a display (display device). The camera is installed so as to be able to capture an image of the user U. Typically, the camera is installed so as to be able to capture an image of the user U's face.

[0013] An electronic device 100-i (i = A, B, C, D, etc.) acquires an image IMG-i of a user Ui captured by a camera. The image IMG-i includes at least the face of the user Ui. The electronic device 100-i transmits the image IMG-i to another electronic device 100-j (j ≠ i). The electronic device 100-i may extract feature parameters of the user Ui based on the image IMG-i and transmit information about the feature parameters of the user Ui to the other electronic device 100-j. Examples of feature parameters include gaze information, a gaze point, facial expression parameters, and posture parameters of the user Ui. Typically, the electronic device 100-i transmits at least one of the image IMG-i and the feature parameters to the other electronic device 100-j in real time.

[0014] The electronic device 100-j receives information transmitted from the electronic device 100-i. The electronic device 100-j acquires a user image UIMG-i representing the user Ui based on at least one of the image IMG-i and the feature parameters. The user image UIMG-i may be the original image IMG-i or an avatar image. The avatar image is generated, for example, by applying at least one of the original image IMG-i and the feature parameters to a predetermined human model. The electronic device 100-j displays the user image UIMG-i representing the user Ui on a display. A user Uj of the electronic device 100-j can view the user image UIMG-i displayed on the display. In other words, the electronic device 100-j displays the user image UIMG-i representing the user Ui of the other electronic device 100-i with whom it is communicating, and the user Uj can view the user image UIMG-i representing the other user Ui with whom it is communicating.

[0015] The information display system 1 according to the present embodiment is applicable to, for example, online learning, online classes, online meetings, etc. In these cases, the information display system 1 can also be called an online learning system, an online class system, an online meeting system, etc.

[0016] 2. Example of electronic device configuration 2 is a block diagram showing a configuration example of the electronic device 100. In the example shown in FIG. 2, the electronic device 100 includes a display 110, one or more cameras 120 (hereinafter simply referred to as cameras 120), a user interface 130, a communication interface 140, and a controller 150.

[0017] The display 110 is configured to display various types of information. Examples of the display 110 include a liquid crystal display, an organic EL display, and a head-up display (HUD). The display 110 has a display surface (display unit) 111. Typically, a user U of the electronic device 100 faces the display surface 111 of the display 110 when using the electronic device 100.

[0018] The camera 120 is installed so as to be able to capture an image of the user U of the electronic device 100. Typically, the camera 120 is installed so as to be able to capture an image of the face of the user U of the electronic device 100. For example, the camera 120 is provided around the display surface 111 of the display 110.

[0019] The user interface 130 includes an input device that accepts input of various information from the user U. Examples of the input device include a touch panel, a keyboard, a mouse, a microphone, etc. The user interface 130 may also include an output device such as a speaker.

[0020] The communication interface 140 is connected to a communication network and communicates with the outside of the electronic device 100. The communication network may be a wireless communication network or a wired communication network. For example, the communication interface 140 communicates with the server 10 or another electronic device 100.

[0021] The controller 150 performs various information processing operations. The controller 150 may also be called a processing circuitry. A processing circuit is hardware that is programmed to realize a function or hardware that executes a function.

[0022] For example, the controller 150 includes one or more processors 151 (hereinafter simply referred to as processors 151) and one or more memories 152 (hereinafter simply referred to as memories 152). The processor 151 performs various types of information processing. Examples of the processor 151 include a general-purpose processor, a special-purpose processor, a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), an integrated circuit, a conventional circuit, and / or a combination thereof. The memory 152 stores various types of information. Examples of the memory 152 include a volatile memory, a non-volatile memory, a hard disk drive (HDD), a solid-state drive (SSD), etc. A control program is a computer program executed by the processor 151. The processor 151 executing the control program and the memory 152 may cooperate to realize the functions of the controller 150. The control program is stored in the memory 152. Alternatively, the control program may be recorded on a computer-readable recording medium.

[0023] Fig. 3 is a block diagram showing an example of the functional configuration of the controller 150. In the example shown in Fig. 3, the controller 150 includes, as functional blocks, a face / eye extraction unit 161, a positional relationship calculation unit 162, a feature extraction unit 163, a transmission unit 164, a reception unit 171, a rendering unit 172, and a display processing unit 173.

[0024] The face and eye extraction unit 161 acquires an image IMG of the user U captured by the camera 120. The image IMG includes at least the face of the user U. Typically, the face and eye extraction unit 161 acquires the image IMG in real time. Then, the face and eye extraction unit 161 extracts a facial image of the face portion of the user U from the image IMG. Furthermore, the face and eye extraction unit 161 may extract images of the left and right eyes of the user U from the image IMG or the facial image. The extraction of the face and eye images is performed, for example, by using a machine learning model generated in advance through machine learning.

[0025] The positional relationship calculation unit 162 calculates the relative positional relationship between the left and right eyes of the user U and the display surface 111 (display unit) of the display 110. More specifically, the positional relationship calculation unit 162 acquires an image IMG of the user U captured by the camera 120. Furthermore, the positional relationship calculation unit 162 determines the position and size of the user U's face and the positions of the left and right eyes in the image IMG based on the extraction result by the face / eye extraction unit 161. The installation position, installation orientation, and angle of view of the camera 120 are known information. The size of a typical user U's face is also known information. The positional relationship calculation unit 162 calculates (estimates) the relative positional relationship between the camera 120 and the left and right eyes of the user U based on this known information, the position and size of the user U's face, and the positions of the left and right eyes in the image IMG. As another example, the distance between the camera 120 and the user U may be calculated based on the blur state of the image IMG. The relative positional relationship between the camera 120 and the display surface 111 of the display 110 is also known information. The positional relationship calculation unit 162 calculates the relative positional relationship between the left and right eyes of the user U and the display surface 111 by combining the relative positional relationship between the camera 120 and the left and right eyes of the user U and the relative positional relationship between the camera 120 and the display surface 111 of the display 110.

[0026] 4 is a conceptual diagram showing the relative positional relationship between the left and right eyes of the user U and the display surface 111 of the display 110. The relative positional relationship includes at least the distance Dl between the left eye and the display surface 111 and the distance Dr between the right eye and the display surface 111. The relative positional relationship may also include the distance Dw between the left eye and the right eye.

[0027] The feature extraction unit 163 extracts feature parameters of the user U. Examples of the feature parameters include gaze information, gaze point, facial expression parameters, and posture parameters of the user U. The feature extraction unit 163 extracts the feature parameters of the user U based on images of the left and right eyes and a facial image of the user U.

[0028] For example, the feature extraction unit 163 recognizes the position and rotation angle of the pupil (black part of the eye) of each eye based on images of the left and right eyes of the user U. Then, the feature extraction unit 163 recognizes the gaze direction of each eye based on the position and rotation angle of the pupil of each eye. The gaze information includes the gaze direction of each eye. The feature extraction unit 163 may calculate coordinate information of the point where the gaze intersects with the display surface 111, taking into account a coordinate system on the display surface 111. The coordinate information of the point where the gaze intersects with the display surface 111 may be provided as the gaze information of the user U.

[0029] The feature extraction unit 163 may calculate the point where the line of sight of the left eye and the line of sight of the right eye of the user U intersect. The point where the line of sight of the left eye and the line of sight of the right eye intersect is also called the focal point. When the pupil moves inward, the focal point becomes closer, and when the pupil moves outward, the focal point becomes farther. This focal point corresponds to the "point of gaze" at which the user U is gazing. Note that not only real-time information on the point of gaze but also statistical information on the point of gaze within a certain period may be used.

[0030] The feature extraction unit 163 may extract facial expression parameters representing facial expressions of the user U based on the facial image of the user U. The extraction of the facial expression parameters is performed, for example, by using a machine learning model that has been generated in advance through machine learning.

[0031] The feature extraction unit 163 may extract posture parameters representing the posture (face angle, etc.) of the user U based on the face image or image IMG of the user U. The posture parameters are extracted, for example, by using a machine learning model generated in advance through machine learning.

[0032] The transmitting unit 164 transmits information about the user U to the other electronic device 100 via the communication interface 140. Typically, the transmitting unit 164 transmits real-time information about the user U to the other electronic device 100. The transmitted information includes at least one of an image IMG of the user U, a facial image, and at least a portion of the feature parameters.

[0033] The receiving unit 171 receives information about another user U (for convenience, referred to as user Ui) from another electronic device 100 via the communication interface 140. The received information includes at least one of an image IMG-i, a facial image, and at least a portion of feature parameters of the user Ui.

[0034] The rendering unit 172 acquires received information from the receiving unit 171. The rendering unit 172 generates (acquires) a user image UIMG-i representing the user Ui by performing rendering processing based on the received information. The user image UIMG-i may be a three-dimensional image. For example, the user image UIMG-i is an avatar image. A predetermined three-dimensional human model is prepared in advance. The rendering unit 172 generates an avatar image representing the user Ui by applying a facial image or feature parameters (facial expression, posture) of the user Ui to the predetermined three-dimensional human model and performing rendering processing. The rendering speed of the rendering processing corresponds to the frame rate.

[0035] The display processing unit 173 displays a user image UIMG-i representing the user Ui on the display 110 (display surface 111). The user U of the electronic device 100 can see the displayed user image UIMG-i.

[0036] The display processing unit 173 may display the user image UIMG-i on the display 110 (display surface 111) so that the user Ui appears to be floating above the display surface 111. This processing is hereinafter referred to as "stereoscopic display processing." The display processing unit 173 executes the stereoscopic display processing as necessary. More specifically, the display processing unit 173 acquires information on the relative positional relationship between the left and right eyes of the user U and the display surface 111 from the positional relationship calculation unit 162. Then, the display processing unit 173 executes the stereoscopic display processing based on the relative positional relationship between the left and right eyes of the user U and the display surface 111.

[0037] For example, in FIG. 4, position X on the display surface 111 is a position corresponding to the midpoint between the left and right eyes of the user U. A range RNG on the display surface 111 is a range corresponding to the area between the left and right eyes of the user U and includes position X. The display processing unit 173 can recognize position X and range RNG based on the relative positional relationship between the left and right eyes of the user U and the display surface 111. Then, the display processing unit 173 displays the user image UIMG-i on the display surface 111 so that it fits within range RNG. In other words, the display processing unit 173 displays the user image UIMG-i between the left and right eyes of the user U. As a result, when viewed from the user U, the user Ui appears to float above the display surface 111.

[0038] 5 conceptually illustrates an example of stereoscopic display processing in the electronic device 100-B used by the user UB. The stereoscopic display processing is executed so that multiple users UA, UC, and UD other than the user UB appear to float above the display surface 111. Typically, the stereoscopic display processing is executed so that the apparent positions of the users UA, UC, and UD are on a line connecting the left and right eyes of the user UB and the display surface 111.

[0039] The stereoscopic display process may be realized by other methods. For example, the stereoscopic display process may be realized by a lenticular method using a lenticular lens. In the case of the lenticular method, a target image for the left eye and a target image for the right eye are prepared separately and displayed separately on the display surface 111 so that the targets appear to float above the display surface 111.

[0040] Note that the stereoscopic display process is not essential, and the user Ui does not have to appear floating above the display surface 111.

[0041] 3. Reduction of processing load on the controller As described above, the controller 150 (rendering unit 172, display processing unit 173) generates a user image UIMG-i representing another user Ui and displays the user image UIMG-i on the display 110. A certain amount of processing load is required to generate and display the user image UIMG-i. This embodiment provides a technique that can reduce the processing load required for generating and displaying the user image UIMG-i in the controller 150 of the electronic device 100.

[0042] Below, we consider reducing the processing load on the first electronic device 100-1. The first electronic device 100-1 is used by a first user U-1 and displays information to the first user U-1. The second user U-2 is a user U other than the first user U-1. The second electronic device 100-2 is used by the second user U-2 and displays information to the second user U-2. The first electronic device 100-1 and the second electronic device 100-2 communicate with each other via a communication network.

[0043] The controller 150-1 (rendering unit 172) of the first electronic device 100-1 generates a second user image UIMG-2 representing the second user U-2 at a second frame rate (rendering speed), and the controller 150-1 (display processing unit 173) of the first electronic device 100-1 displays the generated second user image UIMG-2 on the display 110 at the second frame rate.

[0044] As described above, the controller 150-1 (feature extraction unit 163) of the first electronic device 100-1 detects (recognizes) the gaze direction and gaze point of the first user U-1 based on the image IMG-1 of the first user U-1 captured by the camera 120. The information on the gaze direction of the first user U-1 includes, for example, coordinate information of the point where the gaze of the first user U-1 intersects with the display surface 111 of the display 110. The information on the gaze point of the first user U-1 includes, for example, the distance (depth) between the gaze point of the first user U-1 and the display surface 111 of the display 110. As another example, the information on the gaze point of the first user U-1 may include position information of the gaze point on the gaze of the first user U-1 (that is, the positional relationship between the left and right eyes of the first user U-1, the display surface 111, and the gaze point).

[0045] The point of gaze of the first user U-1 is not simply a direction of gaze, but is a concept that also includes depth and perspective. According to this embodiment, the controller 150-1 of the first electronic device 100-1 dynamically changes (adjusts) the second frame rate for generating the second user image UIMG-2 in accordance with the point of gaze of the first user U-1. This reduces the processing load on the controller 150-1 of the first electronic device 100-1.

[0046] 3-1. First example In a first example, the controller 150-1 (feature extraction unit 163) determines whether the first user U-1 is looking at the second user image UIMG-2 based on the gaze point and gaze direction of the first user U-1. The controller 150-1 (rendering unit 172) dynamically changes the second frame rate at which the second user image UIMG-2 is generated based on whether the first user U-1 is looking at the second user image UIMG-2. More specifically, the controller 150-1 sets the second frame rate when the first user U-1 is not looking at the second user image UIMG-2 to a lower value than the second frame rate when the first user U-1 is looking at the second user image UIMG-2. For example, when the first user U-1 is looking at the second user image UIMG-2, the second frame rate is set to a default value, and when the first user U-1 is not looking at the second user image UIMG-2, the second frame rate is set to a value lower than the default value. As another example, when the first user U-1 is viewing the second user image UIMG-2, the second frame rate may be set to a value higher than the default value, and when the first user U-1 is not viewing the second user image UIMG-2, the second frame rate may be set to the default value.

[0047] As described above, according to the first example, the second frame rate when the first user U-1 is not looking at the second user image UIMG-2 is set lower than the second frame rate when the first user U-1 is looking at the second user image UIMG-2. Therefore, the processing load when the first user U-1 is not looking at the second user image UIMG-2 is reduced. At the same time, the sense of realism when the first user U-1 is looking at the second user image UIMG-2 is also ensured. In other words, according to the present embodiment, it is possible to effectively reduce the processing load on the controller 150-1 without impairing the sense of realism felt by the first user U-1.

[0048] 3-2. Second example As described above, the controller 150-1 of the first electronic device 100-1 can recognize that the first user U-1 is looking at the second user image UIMG-2 based on the first user U-1's gaze point and line of sight. However, the first user U-1's gaze point and the display position of the second user image UIMG-2 (the "apparent position" as it appears to emerge from the display surface 111) do not necessarily match perfectly. The closer the first user U-1's gaze point and the display position of the second user image UIMG-2 are, the more closely the first user U-1 is gazing at the second user image UIMG-2. Conversely, if the first user U-1's gaze point and the display position of the second user image UIMG-2 are far apart, the first user U-1 is looking at the second user image UIMG-2 absentmindedly.

[0049] In the second example, the second frame rate is dynamically changed depending on whether the first user U-1 is gazing intently at the second user image UIMG-2 or is gazing absentmindedly at the second user image UIMG-2. To this end, a "gaze degree" that indicates the degree to which the first user U-1 is gazing at the second user image UIMG-2 is introduced.

[0050] For example, as shown in FIG. 6, the feature extraction unit 163 may include a gaze degree calculation unit 165 that calculates a gaze degree. The gaze degree calculation unit 165 acquires position information of the gaze point of the first user U-1. The gaze degree calculation unit 165 also acquires information on the display position of the second user image UIMG-2 (the “apparent position” that appears to emerge from the display surface 111) from the display processing unit 173. The gaze degree calculation unit 165 calculates the distance between the gaze point of the first user U-1 and the display position of the second user image UIMG-2 as the deviation degree. Alternatively, the gaze degree calculation unit 165 calculates a first distance between the gaze point of the first user U-1 and the display surface 111 and a second distance between the display position of the second user image UIMG-2 and the display surface 111, and calculates the difference between the first distance and the second distance as the deviation degree. Then, the gaze degree calculation unit 165 calculates the gaze degree indicating the degree to which the first user U-1 is gazing at the second user image UIMG-2 according to the degree of deviation. Specifically, the gaze degree is calculated to be higher as the degree of deviation is lower, and conversely, the gaze degree is calculated to be lower as the degree of deviation is higher.

[0051] The controller 150-1 (rendering unit 172) of the first electronic device 100-1 dynamically changes the second frame rate at which the second user image UIMG-2 is generated, depending on the gaze level of the first user U-1. More specifically, the controller 150-1 sets the second frame rate when the gaze level is low to be lower than the second frame rate when the gaze level is high. For example, when the gaze level is equal to or higher than a certain level, the second frame rate is set to a default value, and when the gaze level falls below the certain level, the second frame rate is set to a value lower than the default value. As another example, when the gaze level is equal to or higher than a certain level, the second frame rate may be set to a value higher than the default value, and when the gaze level falls below the certain level, the second frame rate may be set to the default value. The second frame rate may change continuously or stepwise depending on the gaze level.

[0052] According to the second example, the same effects as those of the first example can be obtained. Furthermore, by taking into consideration the gaze level of the first user U-1, it becomes possible to adjust the second frame rate more precisely.

[0053] 3-3. Third Example A situation may be considered in which multiple first users U-1 simultaneously view the display 110 of the first electronic device 100-1. It is also possible that multiple first users U-1 simultaneously view the second user image UIMG-2. In this case, the second frame rate is adjusted based on the first user U-1 who is most gazing at the second user image UIMG-2 among the multiple first users U-1.

[0054] More specifically, the controller 150-1 (feature extraction unit 163) of the first electronic device 100-1 detects (recognizes) the gaze direction and point of gaze of each of the multiple first users U-1 based on the image IMG-1 of each of the multiple first users U-1 captured by one or more cameras 120. Furthermore, the controller 150-1 (attention calculation unit 165) calculates an attention level indicating the degree to which each first user U-1 is gazing at the second user image UIMG-2, depending on the distance between the point of gaze of each first user U-1 and the display position of the second user image UIMG-2. The controller 150-1 (feature extraction unit 163) selects one of the multiple first users U-1 with the highest attention level as the selected first user U-1S. Then, the controller 150-1 dynamically changes (adjusts) the second frame rate for generating the second user image UIMG-2, depending on the point of gaze of the selected first user U-1S. The adjustment of the second frame rate is as described in the first and second examples above.

[0055] It should be noted that when multiple first users U-1 are gazing at different targets, the controller 150-1 adjusts the frame rate for each target separately.

[0056] 3-4. Fourth Example The orientation (posture) of the second user image UIMG-2 displayed on the display 110 of the first electronic device 100-1 may be such that the face of the second user U-2 is not visible. In this case, even if the second frame rate of the second user image UIMG-2 is lowered, the appearance of the second user U-2 from the perspective of the first user U-1 does not change significantly. Therefore, in the fourth example, the second frame rate of the second user image UIMG-2 is dynamically changed (adjusted) depending on the orientation (posture) of the second user image UIMG-2.

[0057] More specifically, the controller 150-1 (rendering unit 172, display processing unit 173) of the first electronic device 100-1 determines whether the second user image UIMG-2 is displayed so that the face of the second user U-2 is visible. Then, the controller 150-1 (rendering unit 172) sets the second frame rate when the second user image UIMG-2 is displayed so that the face of the second user U-2 is not visible to a lower value than the second frame rate when the second user image UIMG-2 is displayed so that the face of the second user U-2 is visible. For example, when the second user image UIMG-2 is displayed so that the face of the second user U-2 is visible, the second frame rate is set to a default value, and when the second user image UIMG-2 is displayed so that the face of the second user U-2 is not visible, the second frame rate is set to a value lower than the default value.

[0058] As described above, according to the fourth example, the second frame rate when the face of the second user U-2 is not visible to the first user U-1 is set lower than the second frame rate when the face of the second user U-2 is visible to the first user U-1. Therefore, the processing load when the face of the second user U-2 is not visible to the first user U-1 is reduced. On the other hand, the sense of realism when the face of the second user U-2 is visible to the first user U-1 is also ensured. In other words, according to this embodiment, it is possible to effectively reduce the processing load on the controller 150-1 without impairing the sense of realism felt by the first user U-1. [Explanation of symbols]

[0059] 1 Information display system 10 Servers 100 Electronic equipment 110 Display 111 Display surface 120 Camera 150 Controller 151 processors 152 memory

Claims

1. 1. An electronic device for displaying information to at least one first user, comprising: The display and Controller and Equipped with The controller generating a second user image representing a second user who is a user of a second electronic device in communication with the electronic device; Displaying the second user image on the display; Detecting a gaze point of the first user based on an image of the first user captured by a camera; Dynamically changing a frame rate for generating the second user image according to the gaze point of the first user. It was configured as electronic equipment.

2. 10. The electronic device of claim 1, The controller further comprises: determining whether the first user is looking at the second user image based on the gaze point of the first user; The frame rate when the first user is not viewing the second user image is set lower than the frame rate when the first user is viewing the second user image. It was configured as electronic equipment.

3. 10. The electronic device of claim 1, The controller further comprises: calculating a gaze degree indicating a degree to which the first user is gazing at the second user image according to a distance between the gaze point of the first user and a display position of the second user image; The frame rate when the degree of gaze is low is set lower than the frame rate when the degree of gaze is high. It was configured as electronic equipment.

4. 10. The electronic device of claim 1, the at least one first user includes a plurality of first users; The controller further comprises: Detecting a gaze point of each of the first users based on an image of each of the first users captured by one or more cameras; calculating a gaze degree indicating a degree to which each of the first users is gazing at the second user image according to a distance between the gaze point of each of the first users and a display position of the second user image; selecting one of the first users with the highest degree of attention as a selected first user; Dynamically changing the frame rate according to the gaze point of the selected first user. It was configured as electronic equipment.

5. 5. An electronic device according to any one of claims 1 to 4, The controller further comprises: The frame rate when the second user image is displayed so that the face of the second user is not visible is set lower than the frame rate when the second user image is displayed so that the face of the second user is visible. It was configured as electronic equipment.

Images