Eye-gaze input device and program for eye-gaze input device

Abstract

To provide a sight line input device allowing for easily inputting characters, even when a user's sight line is hardly fixed.SOLUTION: A sight line input device allows a user's sight line to select and input a plurality of characters arranged on a virtual character board displayed on a screen. The sight line input device includes: a gaze point estimation section for estimating a position of the user's gaze point on the screen; and an input determination section for determining the input of the character based on the estimated position of the gaze point. While the gaze point roves among the plurality of characters, the input determination section measures and holds individually each gaze time being a time when the gaze point stays at each of the plurality of characters and determines an input of one character whose gaze time reaches a threshold at an earliest time.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to an eye-gaze input device that allows a user to select and input characters displayed on a screen by using their line of sight, and a program for the eye-gaze input device. [Background technology]

[0002] In recent years, eye-gaze input devices have been developed as a tool to assist patients who are unable to move their arms, legs, or mouths properly due to severe limb paralysis, etc., in communicating their intentions. These devices display a virtual dial on a screen and allow patients to select and input characters on the dial by using their gaze.

[0003] As an example of such an eye-gaze input device, Patent Document 1 discloses a device in which a virtual character board on which a plurality of characters are arranged is displayed on a screen, and a desired character can be selected and input by gaze. This eye-gaze input device is configured to detect the position of the user's gaze point on the screen using a camera or the like, and count the time (gaze time) that the gaze point remains on a character. When this gaze time reaches a predetermined threshold, the input of that character is decided, and the character is displayed in a separate window on the screen. A user can communicate their intentions to others by inputting characters one after another by gaze to create a message. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2018-195323 Summary of the Invention [Problem to be solved by the invention]

[0005] However, conventional eye-gaze input devices are configured so that if the gaze point moves away from a character while measuring the gaze time, the device determines that the character will not be selected and resets (sets to zero) the gaze time that had been measured up to that point. Therefore, for example, when selecting a character at the edge of the screen where the gaze point moves significantly relative to the rotation angle of the eyeball and where it is difficult to fix the gaze point, the gaze time is frequently reset as the gaze point moves away from the character, making it difficult to decide to input the character. In addition, if the user has severe nystagmus, the gaze point cannot be fixed on the character they want to input, making it difficult to decide to input the character.

[0006] The present invention has been made in consideration of such problems, and aims to provide an eye-gaze input device that allows a user to easily input characters even when the user has difficulty in fixing his or her line of sight. [Means for solving the problem]

[0007] That is, a gaze input device according to one aspect of the present invention allows a user to select and input multiple characters arranged on a virtual dial displayed on a screen by using their gaze, and is equipped with a gaze point estimation unit that estimates the position of the user's gaze point on the screen, and an input determination unit that determines the input of the character based on the estimated position of the gaze point, and is characterized in that the input determination unit individually measures and stores the gaze time, which is the time the gaze point remains on each of the multiple characters while the gaze point is fluctuating between the multiple characters, and determines the input of the one character whose gaze time reaches a threshold earliest.

[0008] With this type of device, while the gaze point is fluctuating between multiple characters, the gaze time for each character is measured and held, and the character for which the gaze time reaches a threshold value the earliest is decided to be input, so even if the position of the gaze point is not fixed on a single character, the gaze time for a single character that the user is consciously directing their gaze at continues to accumulate, and the input of this character can be decided. This allows the user to easily input characters even in situations where it is difficult to fix the gaze point on the character they want to input, such as when selecting a character on the edge of the screen or when the user has severe nystagmus.

[0009] In the eye-gaze input device, it is preferable that the input determination unit is configured to count up the gaze time while the gaze point is staying on the character, and to count down the gaze time while the gaze point is away from the character. In this way, the gaze time is counted down while the gaze point is off the character, so it is possible to increase the difference between the gaze time on the character that the user is intentionally directing their gaze and the gaze time on the character that the user is unintentionally directing their gaze, which makes it easier to avoid erroneously inputting unintended characters.

[0010] In order to allow the user to decide to input the desired character in a short time, it is preferable that the rate at which the gaze time is counted down is slower than the rate at which the gaze time is counted up.

[0011] In addition, in order to prevent unintentional input of another character after input of a character has been determined, it is preferable that the input determination unit resets the gaze time measured for each of the plurality of characters when input of the character has been determined.

[0012] In addition, an embodiment in which the effects of the present invention are particularly pronounced is one in which the characters are displayed one by one in multiple sections set adjacent to each other on the dial, and the input determination unit measures the gaze time on the character displayed in the section when the gaze point is located within the section.

[0013] It is preferable that a progress indicator indicating the remaining gaze time required until input is confirmed is displayed above each of the plurality of characters for which measurement of gaze time has started. This allows the user to more easily focus their gaze on the characters they wish to input.

[0014] In addition, an embodiment in which the effect of the present invention is particularly pronounced is one in which the dial is displayed so that the entire dial fits within the screen. In other words, when the entire character dial is displayed on the screen, the size of each character must be reduced, which makes it easier for the user to move their gaze away from the character they want to input. However, even in this case, with the eye-gaze input device of the present invention, the gaze time for the character that the user is most consciously directing their gaze towards accumulates the fastest, so they can decide to input that character.

[0015] Another aspect of the present invention is a gaze input device that allows a user to select and input multiple characters arranged on a virtual dial displayed on a screen using their gaze, and includes a gaze point estimation unit that estimates the position of the user's gaze point on the screen, a dial display control unit that moves the dial from the estimated position of the gaze point toward a predetermined selection position set on the screen, and an input determination unit that measures the gaze time, which is the time the gaze point stays on the character at the selection position, and when the gaze time reaches a threshold, determines to input one character at the selection position, and is characterized in that if the gaze point moves away from the character while measuring the gaze time, the input determination unit retains the measured gaze time without resetting it. With this type of eye-gaze input device, in which the dial moves according to the line of sight, even if the gaze point moves away from the character on the selected position while measuring the gaze time, the measured gaze time is maintained without being reset, so that the user can easily input characters even in a situation where it is difficult to fix the gaze point on the character to be input.

[0016] When the gaze point moves onto another character while measuring the gaze time, it is preferable that the dial display control unit keep the dial without moving if the distance between the gaze point and the selected position is less than a predetermined value. In this way, even if the point of gaze moves away from the character at the selected position, the dial will not move within a certain range, making it easier to return the point of gaze to the character for which gaze time is being measured. This makes it easier for users to input characters even in situations where it is difficult to determine the point of gaze.

[0017] Furthermore, if the distance between the gaze point and the selected position exceeds the predetermined value while the gaze time is being measured, it is preferable to move the dial while maintaining the measured gaze time. In this way, even if the user's gaze point unintentionally moves far away from the character at the selected position and the dial moves, the gaze time being measured is maintained without being reset, so when the user's gaze point returns to the character for which the gaze time is being measured, the measurement of the gaze time can be resumed from where it left off. This makes it easier for the user to input characters.

[0018] Furthermore, when a character other than the character for which gaze time is being measured is in the selected position and the gaze point remains on the other character for a predetermined period of time or longer, it is preferable to reset the gaze time being measured and start measuring the gaze time on the other character. In this way, the gaze time being measured will not be reset unless the user consciously gazes at another character, allowing the user to input characters more easily even in situations where it is difficult to determine the gaze point. [Effects of the Invention]

[0019] According to the present invention, it is possible to provide an eye-gaze input device that allows a user to easily input characters even when the user has difficulty in keeping his or her eye line steady. [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a diagram schematically showing the overall configuration of a gaze input device according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing the device configuration of a gaze input device according to a first embodiment. [Figure 3] FIG. 1 is a functional block diagram showing the device configuration of a gaze input device according to a first embodiment. [Figure 4] 3A to 3C are screen display diagrams illustrating the operation of the eye-gaze input device according to the first embodiment. [Figure 5] 4 is a flowchart showing the operation of the eye-gaze input device in the first embodiment. [Figure 6] 10A to 10C are diagrams illustrating screen display of the operation of the eye-gaze input device according to the second embodiment. [Figure 7] 10A to 10C are diagrams illustrating screen display of the operation of the eye-gaze input device according to the second embodiment. [Figure 8] 10 is a flowchart showing the operation of the eye-gaze input device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0021] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the eye-gaze input device of the present invention will be described below with reference to the accompanying drawings.

[0022] First Embodiment The eye-gaze input device 100 of the first embodiment is intended to assist people who have difficulty moving their limbs or mouths in communicating their intentions, and allows the user to select and input characters on a virtual character board (also called a keyboard) B displayed on a screen 31 of a personal computer or the like by using their line of sight.

[0023] Specifically, as shown in Fig. 1, this eye-gaze input device 100 includes an eye-gaze detection means 1 that detects the user's gaze, and a notebook computer C that integrally includes a computer main body 2 and a display 3. A virtual character board (hereinafter simply referred to as the character board) B on which a plurality of characters such as hiragana are arranged side by side, and a message panel M on which input characters are displayed are displayed on a screen 31 of the display 3. By continuing to gaze at the character that the user wants to input on the character board B, the user can decide to input the character, and the character can be displayed on the message panel M. By inputting a plurality of characters in this way, a message can be displayed on the message panel M, allowing the user to communicate his or her intentions.

[0024] The gaze detection means 1 detects the direction of the user's gaze directed toward the screen 31 of the display 3, and outputs the detection result as gaze data. Specifically, the gaze detection means 1 utilizes the corneal reflex method and includes a light source (not shown) that irradiates the user's eyeball with near-infrared light, a camera (not shown) that captures an image of the user's eyeball, and a gaze data output unit (not shown) that processes the image data output from the camera to detect the gaze direction, and outputs the detected image data as gaze data. Note that the gaze detection means 1 in this embodiment is a so-called attached type, and is attached to the bottom of the display 3 so that the light source and camera are directed toward the user's face.

[0025] Structurally, the computer main body 2 includes a CPU 201, a memory 202, an input / output interface 203, etc., as shown in Fig. 2. The computer main body 2 is configured to perform at least the functions of a gaze point estimation unit 21, a character data storage unit 22, a dial display control unit 23, an input determination unit 24, and an input character display control unit 25, as shown in Fig. 3, by the CPU 201 and its peripheral devices working together based on various application software (hereinafter referred to as programs) stored in the memory 202. Each unit will be described below.

[0026] The gaze point estimation unit 21 estimates the position of the user's gaze point on the screen 31 based on the detection result of the gaze detection means 1. Specifically, it receives a gaze signal from the gaze detection means 1 and estimates the position of the user's gaze point G on the screen 31 based on the gaze signal. It then outputs gaze point data indicating the estimated position of the gaze point G to the input determination unit 24 and the dial display control unit 23. In this embodiment, a pointer is displayed at the position of the estimated gaze point G, as shown in FIG. 1.

[0027] The character data storage unit 22 is set in a predetermined area of ​​the memory 202, and stores character data indicating the codes of various characters to be displayed on the dial B. Note that "characters" in this embodiment include, for example, hiragana, katakana, kanji, alphanumeric characters, Roman letters, symbols, pictograms, emoticons, and the like.

[0028] The dial display control unit 23 creates dial data representing a dial B on which a plurality of characters are arranged, by referring to the character data storage unit 22, and outputs this to the input determination unit 24 and the display 3. This dial data includes information regarding the display mode of the characters and their display positions on the screen.

[0029] As shown in FIG. 1, the dial display control unit 23 fixes and displays the entire dial B at a predetermined position within the screen 31. On this dial B, a plurality of characters (here, clear hiragana characters) are arranged in a matrix pattern at equal intervals. More specifically, on the dial B, a plurality of square-shaped character panels (corresponding to "sections" in the claims) P are displayed at equal intervals in a matrix pattern, and each character panel P displays one character (hiragana character). Here, adjacent character panels P are displayed side by side with no gaps between them. On each character panel P, each character is displayed so that its center position (center of gravity position) coincides with the center position of the character panel P. In this embodiment, the outer frame of each character panel P is displayed on the screen 31, but it may not be displayed.

[0030] The input determination unit 24 determines the input of characters one by one based on the position of the estimated gaze point G, and outputs this as input character data to the input character display control unit 25. Specifically, when the gaze point G comes onto a character (more specifically, onto the character panel P), the input determination unit 24 counts up the gaze time, which is the time during which the gaze point G stays on the character. Then, when the measured gaze time reaches a predetermined threshold (for example, 1 second), the input determination unit 24 determines the input of the character. In other words, the input determination unit 24 determines the input of the character that the user has been gazing at.

[0031] When the input determination unit 24 measures the gaze time, a progress indicator I indicating the remaining gaze time (also referred to as the remaining gaze time) required until the input is determined is displayed on the character (specifically, on the character panel P) during the measurement. The form of this progress indicator I changes depending on the length of the remaining gaze time. The progress indicator I of this embodiment is a so-called progress circle in which a bar extends clockwise as the gaze time increases, as shown in FIG. 1. The form of the progress indicator I is not limited to this, and may be any form, such as changing the color or size of the character or character panel P.

[0032] The input character display control unit 25 displays the message panel M on the screen 31, and also displays the characters selected by the input determination unit 24 in the message panel M as a character string arranged in the order of their input determination. As shown in FIG. 1, the character string input and determined by the input determination unit 24 is displayed horizontally, for example, centered, in the message panel M. Note that the displayed character string is not limited to centered, and may be left-justified or right-justified, etc. Furthermore, the input and determined character may be displayed in the center of the message panel M. In the message panel M, the character string may be displayed in a single horizontal line, or when the number of selected characters exceeds a predetermined value, a line break may be started or the character size may be reduced.

[0033] Therefore, in the eye-gaze input device 100 of the first embodiment, in order to enable the user to easily input characters even when the user's gaze is unstable, the input determination unit 24 is configured to measure and hold the gaze time for each of the multiple characters while the gaze point G is fluctuating (or moving) between the multiple character panels P, and to determine the input of one character whose gaze time reaches a threshold value earliest. That is, every time the gaze point G enters the character panel P, the input determination unit 24 adds up the gaze time for that character. Then, when the cumulative total of the gaze times for one character among the multiple characters for which the gaze times are being measured reaches a threshold value, the input of that character is determined.

[0034] Specifically, the input determination unit 24 is configured to count up the gaze time while the gaze point G remains within the character panel P, and to count down the measured gaze time while the gaze point G is out of the character panel P. Here, the speed at which the gaze time is counted down is configured to be slower (specifically, about 1 / 3) than the speed at which the gaze time is counted up.

[0035] While the gaze time is being measured for a plurality of characters, a progress indicator I is displayed in each character panel P corresponding to the plurality of characters. That is, while the gaze is wandering between the plurality of character panels P, a plurality of progress indicators I are displayed on the dial B. In this embodiment, the progress indicator I counting up the gaze time and the progress indicator I counting down the gaze time are displayed in different ways. Here, the displayed progress circle bars have different colors and thicknesses. Note that, because the gaze point G is outside the character panel P, the progress indicator I is hidden when the gaze time is counted down to 0.

[0036] When the input decision unit 24 decides to input a character whose measured gaze time has reached a threshold, it resets the gaze time (sets the gaze time to 0) for all characters for which it is measuring gaze time (including the character whose input has been decided). In this case, one or more progress indicators I that were displayed are simultaneously made invisible.

[0037] <Operation of the eye-gaze input device of the first embodiment> Next, the operation of the eye-gaze input device 100 of the first embodiment will be described below with reference to Figs. 4 and 5. Here, a character board B on which hiragana characters are arranged is fixedly displayed on the screen 31. The user selects and inputs the character "ki" from the character board B by guiding their gaze.

[0038] First, when the user directs his / her gaze onto the dial B, the gaze detection means 1 detects the user's gaze, and the gaze point estimation unit 21 estimates the position of the user's gaze point G on the screen 31 (step S11).

[0039] When the user directs their gaze to the character "ki" and the gaze point G enters the character panel P of "ki," measurement of the gaze time on the character "ki" begins (step S12). While the gaze point G is within the character panel P, the gaze time on the character "ki" is counted up, and accordingly, the progress circle I in the character panel P continues to grow, as shown in FIG. 4(a) (steps S13 and S14).

[0040] In this state, as shown in Figure 4(b), when the gaze point G moves away from the character panel P of "ki" and moves to the adjacent character panel P of "i", the gaze time for the character "ki" is counted down, and at the same time, measurement of the gaze time for the character "i" begins (step S15). Furthermore, as shown in Figure 4(c), when the gaze point G moves away from the character panel P of "i" and moves to the adjacent character panel P of "u", the gaze time for the characters "ki" and "i" is counted down, and at the same time, measurement of the gaze time for the character "u" begins.

[0041] Thereafter, as shown in FIG. 4(d), when the gaze point G returns to the character panel P of "ki", the gaze time on the character "ki" is counted up again (steps S13, S14). Then, when the gaze time on the character "ki" reaches a predetermined threshold (for example, 1 second), the input of the character "ki" is confirmed, and the character "ki" is displayed on the message panel M (steps S16, S17). When the input of the character is confirmed, the measured gaze time is reset for all characters, and the progress circles I displayed on the character panels P of "i", "u", and "ki" are hidden (step S18), as shown in FIG. 4(e).

[0042] <Effects of the eye-gaze input device of the first embodiment> According to the eye-gaze input device 100 of this embodiment configured as described above, while the gaze point G moves among the multiple character panels P, the gaze time for each character is measured and stored, and the character for which the gaze time reaches a threshold value first is determined as input. Therefore, even if the position of the gaze point G is not fixed, the gaze time for one character that the user is consciously directing their gaze at accumulates, and the input of this character can be determined. This allows the user to easily input characters even in situations where it is difficult to fix the gaze point G on the character they want to input, such as when selecting a character near the edge of the screen 31 or when the user has symptoms of nystagmus.

[0043] Second Embodiment Next, the eye-gaze input device 100 according to the second embodiment of the present invention will be described, focusing on the differences from the first embodiment. Explanation of the configuration common to the eye-gaze input device 100 of the first embodiment will be omitted.

[0044] The eye-gaze input device 100 of the second embodiment differs from the eye-gaze input device 100 of the first embodiment in that the dial B moves in accordance with the user's gaze. Specifically, in the eye-gaze input device 100 of the second embodiment, the user moves the dial B within the screen 31 by moving their gaze, and aligns the desired character with a selection position S set at a predetermined position within the screen 31, thereby allowing the input of the character to be determined. Note that in this embodiment, the coordinates of the selection position S are set to be the same as the center coordinates of the screen 31.

[0045] The clock face display control unit 23 of this embodiment moves the clock face B within the screen 31 based on the gaze point data acquired from the gaze point estimation unit 21. Specifically, the clock face display control unit 23 moves the clock face 311 so that the character closest to the gaze point G faces the selection position S. More specifically, the clock face display control unit 23 moves the clock face B so that the center position of the character panel P where the gaze point G is staying faces the selection position S. Then, when the center of the character panel P where the gaze point G is staying coincides with the selection position S, the movement of the clock face B is stopped.

[0046] For example, as shown in Fig. 6(a), when the user directs their gaze to the character "tsu", the character board B moves so that the center of the character panel P of "tsu" moves toward the selected position S. Then, when the user continues to gaze at the character "tsu" and the center position of the character panel P of "tsu" coincides with the selected position S as shown in Fig. 6(b), the movement of the character board B stops.

[0047] When a predetermined condition is satisfied, the input determination unit 24 determines to input the character located at the selection position S. Specifically, when the gaze point G is on the character located at the selection position S (specifically, within the character panel P), the input determination unit 24 measures the gaze time, which is the duration of the gaze, and when the gaze time reaches a threshold value (for example, 1 second), determines to input the character located at the selection position S.

[0048] Therefore, in the second embodiment of the eye-gaze input device 100, in order to enable the user to easily input characters even when the user's gaze is unstable, the input determination unit 24 is configured to retain the measured gaze time without resetting it if the gaze point G moves away from the character panel P on the selection position S while measuring the gaze time.

[0049] Specifically, when the gaze point G moves away from the character panel P on the selection position S and onto another character panel P during measurement of the gaze time, the input determination unit 24 temporarily stops counting up the gaze time. When the gaze point G returns to the character panel P on the selection position S, the input determination unit 24 resumes counting up the gaze time that was paused.

[0050] Here, the dial display control unit 23 is configured to keep the dial B stationary without moving it, even if the gaze point G moves away from the character panel P while measuring the gaze time on the character on the selection position S, as long as the distance between the gaze point G and the selection position S is equal to or less than a predetermined value. This predetermined value is preferably, for example, about the length of one character panel P.

[0051] When the distance between the gaze point G and the selection position S exceeds a predetermined value, the dial display control unit 23 moves the dial B so that the character closest to the gaze point G faces the selection position S. Even while the dial B is being moved, the input determination unit 24 is configured to maintain the measured gaze time without resetting it. That is, in this embodiment, when the line of sight deviates significantly while measuring the gaze time, the dial B is configured to move while maintaining the measured gaze time.

[0052] When a character other than the character for which the gaze time is being measured is in the selected position S and the gaze point G remains on the other character (within the character panel P) for a predetermined period of time or more, the input determination unit 24 resets the gaze time being measured and starts measuring the gaze time on the other character.

[0053] <Operation of the eye-gaze input device of the second embodiment> Next, the operation of the eye-gaze input device 100 of the second embodiment will be described below with reference to Figs. 7 and 8. Here, a movable character board B on which hiragana characters are arranged is displayed on the screen 31. The user selects and inputs the character "ki" from the character board B by guiding their gaze.

[0054] First, when the user directs his / her gaze onto the dial B, the gaze detection means 1 detects the user's gaze, and the gaze point estimation unit 21 estimates the position of the user's gaze point G on the screen 31 (step S21). When the user directs his / her gaze towards the character "ki" and the gaze point G enters the character panel P of "ki", the dial B moves so that the character panel P of "ki" moves towards the selection position S (step S22).

[0055] When the character panel P of "ki" is in the selection position S and the user continues to gaze at the character "ki", measurement of the gaze time on the character "ki" begins (step S23). While the gaze point G is within the character panel P, the gaze time on the character "ki" is counted up, and accordingly, the progress circle I within the character panel P extends as shown in Fig. 7(a) (steps S24, S25).

[0056] Then, as shown in FIG. 7(b), when the gaze point G moves away from the character panel P of "ki", the counting of the gaze time on the character "ki" is temporarily stopped (step S26). If the distance between the gaze point G and the selection position S is within a predetermined value (here, the distance from the selection position S to the center of the adjacent character panel P), the character board B is fixed in that position without moving (step S27). On the other hand, if the distance between the gaze point G and the selection position S exceeds the predetermined value, the character board B moves from the gaze point G toward the selection position S while maintaining the gaze time measured on the character "ki", as shown in FIG. 7(c) (step S22).

[0057] Here, when the gaze point G returns to the character panel P of "ki", as shown in FIG. 7(d), the character panel P of "ki" moves to the selection position S, and the counting of the gaze time on the character "ki" resumes (steps S24, S25). Then, as shown in FIG. 7(e), when the gaze time on the character "ki" reaches a predetermined threshold (e.g., 1 second), the input of the character "ki" is confirmed and the character "ki" is displayed on the message panel M (steps S28, S29). When the input of the character is confirmed, the measured gaze time is reset, and the progress circle I displayed on the character panel P of "ki" is hidden (step S30).

[0058] On the other hand, as shown in FIG. 7(f), when the character panel P for "I" has completely moved to the selected position S and the gaze point G remains within the character panel P for "I" in this state, the gaze time measured for the character "I" is reset, and measurement of the gaze time for the character "I" begins (steps S24, S25). At this time, the progress circle I displayed on the character panel P for "I" is hidden, and the progress circle I is displayed within the character panel P for "I". Then, as shown in FIG. 7(g), when the gaze time for the character "I" reaches a predetermined threshold, the input of the character "I" is confirmed, and the character "I" is displayed on the message panel M (steps S28, S29). When the input of the character is confirmed, the measured gaze time is reset, and the progress circle I displayed on the character panel P for "I" is hidden (step S30).

[0059] <Effects of the eye-gaze input device of the second embodiment> According to the eye-gaze input device 100 of this embodiment configured as described above, in the type in which the character dial B is moved on the screen 31, even if the gaze point G moves away from the character panel P on the selection position S while measuring the gaze time, the measured gaze time is maintained without being reset, so that the user can easily input characters even in a situation where it is difficult to fix the gaze point G on the character they want to input.

[0060] <Other Modified Embodiments> The present invention is not limited to the above-described embodiment.

[0061] The input determination unit 24 in the first embodiment is configured to count down the gaze time when the gaze point G moves away from the character panel P after starting to measure the gaze time, but this is not limited thereto. In other embodiments, the input determination unit 24 may be configured to fix the gaze time without counting down while the gaze point G moves away from the character panel P, and to resume counting up when the gaze point G returns.

[0062] In the first embodiment, the gaze time countdown speed is set to be slower than the gaze time countup speed, but this is not limited to this. The gaze time countdown speed and the countup speed may be set to be approximately the same, or the gaze time countdown speed may be set to be faster than the countup speed.

[0063] In the second embodiment, the gaze time being measured is held while the dial B is moving, but this is not limiting. In other embodiments, the held gaze time may be reset in accordance with the movement of the dial B.

[0064] In the above-described embodiments, the characters are displayed in a matrix pattern at equal intervals on the dial B, but this is not limiting. For example, multiple characters may be arranged radially or in a line.

[0065] Although the gaze detection means 1 in each of the above embodiments is of an attached type, it is not limited to this. In other embodiments, the gaze detection means 1 may be integrated with the display 3 or the computer main body 2, or may be a wearable type that is attached to the user's body. It may also be attached to any location, such as above the display 3.

[0066] In each of the above-described embodiments, the computer main body 2 realizes each function of the gaze point estimation unit 21, etc., based on a program stored in the memory 202. However, this is not limiting. In other embodiments, the computer main body 2 may access a cloud via a network such as the Internet, and realize each function of the gaze point estimation unit 21, etc., by the CPU 201 and its peripheral devices working together based on a program stored on the cloud.

[0067] In the above embodiments, the computer main body 2 and the display 3 are integrally provided in a notebook computer, but this is not limited to this. In other embodiments, they may be separate. The display 3 may also be configured with a projector and a projection screen. Furthermore, the device is not limited to a notebook computer, and may be a mobile device such as a smartphone or tablet, or a wearable device such as a head-mounted display.

[0068] Furthermore, the eye-gaze input device 100 of another embodiment may be used not only to assist people who have difficulty moving their limbs or mouths in communicating their intentions, but also to assist able-bodied people in inputting characters using their gaze.

[0069] Furthermore, the present invention is not limited to the above-described embodiments, and it goes without saying that various modifications are possible without departing from the spirit of the present invention. [Explanation of symbols]

[0070] 100 Eye-gaze input device 21. Gaze point estimation unit 24 Input determination unit 31 screens B...Dial G...Gaze point

Claims

1. A gaze input device that allows a user to select and input a plurality of characters arranged on a virtual dial displayed on a screen by using the user's gaze, a gaze point estimation unit that estimates the position of the gaze point of the user on the screen; a dial display control unit that moves the dial from the estimated position of the gaze point toward a predetermined selection position set on the screen; an input determination unit that measures a gaze time, which is a time during which the gaze point stays on the character at the selected position, and determines to input one character at the selected position when the gaze time reaches a threshold value; The eye-gaze input device, wherein the input determination unit holds the measured gaze time without resetting it when the gaze point moves away from the character during measurement of the gaze time.

2. 2. The eye-gaze input device according to claim 1, wherein the dial display control unit keeps the dial without moving if the gaze point moves onto another character while measuring the gaze time and the distance between the gaze point and the selected position is equal to or less than a predetermined value.

3. 3. The eye-gaze input device according to claim 2, wherein, when the distance between the gaze point and the selected position exceeds the predetermined value while the gaze time is being measured, the dial is moved while the measured gaze time is maintained.

4. 4. The eye-gaze input device according to claim 1, wherein, when a character other than the character for which gaze time is being measured is in the selected position and the gaze point stays on the other character for a predetermined period of time or more, the gaze time being measured is reset and measurement of the gaze time on the other character is started.

5. A program for an eye-gaze input device that allows a user to select and input a plurality of characters arranged on a virtual dial displayed on a screen by using the user's gaze, a function as a gaze point estimation unit that estimates the position of the gaze point of the user on the screen; a function as a dial display control unit that moves the dial from the estimated position of the gaze point toward a predetermined selection position set on the screen; a gaze time, which is the time that the gaze point stays on the character at the selected position, is measured, and when the gaze time reaches a threshold, the computer is caused to perform a function as an input determination unit that determines the input of one character at the selected position; A program for an eye-gaze input device, wherein the input determination unit holds the measured gaze time without resetting it if the gaze point moves away from the character while measuring the gaze time.

Images