Terminal device, program, and display method
By optimizing the arrangement of symbols and objects on the screen to maximize gaze direction accuracy and incorporating a screen control unit for mode switching, the system addresses erroneous inputs in terminal devices, improving line-of-sight input accuracy while maintaining a familiar interface.
Patent Information
- Application Number
- JP2021025977
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-02-22
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2041-02-22
AI Technical Summary
Existing terminal devices, such as ATMs, suffer from erroneous input when users attempt to input using their line of sight, as they may inadvertently select the wrong button despite directing their gaze to the correct one.
The system employs a display unit and line-of-sight detection to arrange symbols and objects on the screen in a manner that maximizes the distance between corresponding symbols, ensuring the user's gaze is accurately directed to the intended button, and includes a screen control unit to switch between input modes based on user preference.
This approach significantly reduces erroneous inputs by ensuring the user's gaze is accurately directed to the intended button, enhancing the accuracy of line-of-sight input and maintaining a familiar layout for users transitioning to gaze input mode.
Smart Images

Figure 0007585859000001 
Figure 0007585859000002 
Figure 0007585859000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a terminal device, a program, and a display method. [Background technology]
[0002] In recent years, there has been active development of technology that enables input to terminal devices such as automated teller machines (ATMs) by detecting the line of sight of the user. For example, Patent Document 1 discloses an automated teller machine that can input a PIN without using the user's hands by analyzing an image of the user's eyeballs. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2009-187443 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the conventional technology has a problem of erroneous input, in which even if a user directs his or her gaze to a desired button among the buttons displayed on the touch panel of a terminal device, a different button is input.
[0005] In view of the above circumstances, an object of the present invention is to prevent erroneous input in a terminal device that allows input by eye gaze. [Means for solving the problem]
[0006] In order to solve the above problem, the present invention provides a display device, a gaze detection device that detects the gaze of a user of a terminal device directed toward the display device, and a first screen Or a second screen different from the first screen on the display unit, wherein the first screen includes at least a first object having a first symbol arranged inside a first outer region and a second object having a second symbol arranged inside a second outer region, the second screen includes at least a third object having a third symbol arranged inside a third outer region at a position corresponding to the first outer region, and a fourth object having a fourth symbol arranged inside a fourth outer region at a position corresponding to the second outer region, and the screen control unit switches from the second screen to the first screen and displays them on the display unit in response to a predetermined trigger input to the terminal device; The first screen satisfies at least one of the following: the first symbol is arranged at a position opposite to the second object with respect to the center of the first outer region; and the second symbol is arranged at a position opposite to the first object with respect to the center of the second outer region. a distance between the first symbol and the second symbol is greater than a distance between the third symbol and the fourth symbol arranged on the second screen, the first screen is a screen on which the user operates the terminal device with his / her line of sight, and the second screen is a screen on which the user operates the terminal device with his / her fingers. It is a terminal device. The present invention also provides a terminal device comprising a display unit, a gaze detection unit which detects the gaze of a user of a terminal device directed toward the display unit, and a screen control unit which causes a first screen to be displayed on the display unit, wherein the first screen includes at least a first object having a first symbol arranged within a first outer region and a second object having a second symbol arranged within a second outer region, and wherein the first screen satisfies at least one of the following: the first symbol is arranged in a position opposite the second object with respect to the center of the first outer region, and the second symbol is arranged in a position opposite the first object with respect to the center of the second outer region, and the screen control unit causes a second screen different from the first screen to be displayed on the display unit, and switches from the second screen to the first screen and displays it on the display unit upon a predetermined trigger input to the terminal device, and the second screen includes a third object and a fourth object, and is arranged on the first screen, and the distance between the first object and the second object is greater than the distance between the third object and the fourth object arranged on the second screen.
[0007] The present invention also provides a computer terminal device having a display unit, the computer terminal device including a line-of-sight detection unit that detects a line of sight directed by a user of the terminal device toward the display unit, and a first screen Or a second screen different from the first screen on the display unit, wherein the first screen includes at least a first object having a first symbol arranged inside a first outer region and a second object having a second symbol arranged inside a second outer region; the second screen includes at least a third object having a third symbol arranged inside a third outer region at a position corresponding to the first outer region, and a fourth object having a fourth symbol arranged inside a fourth outer region at a position corresponding to the second outer region, and causing the screen control unit to switch from the second screen to the first screen and display the first screen on the display unit in response to a predetermined trigger input to the terminal device; The first screen satisfies at least one of the following: the first symbol is arranged at a position opposite to the second object with respect to the center of the first outer region; and the second symbol is arranged at a position opposite to the first object with respect to the center of the second outer region. a distance between the first symbol and the second symbol is greater than a distance between the third symbol and the fourth symbol arranged on the second screen, the first screen is a screen on which the user operates the terminal device with his / her line of sight, and the second screen is a screen on which the user operates the terminal device with his / her fingers. It is a program.
[0008] The present invention also provides a method for producing a method for manufacturing a semiconductor device comprising the steps of: The user of the terminal device A display method for displaying a screen for performing gaze input on a terminal device, the display method comprising: a first step in which a control unit of the terminal device acquires screen layout information including at least a first object having a first symbol arranged inside a first outer region and a second object having a second symbol arranged inside a second outer region; and a second step in which a first screen based on the screen layout information is displayed. a third step of displaying a second screen different from the first screen; and a fourth step of switching from the second screen to the first screen in response to a predetermined trigger input to the terminal device. and in the second step, the first symbol is arranged so as to be at least one of a position opposite the second object with respect to a center of the first outer region and a position opposite the first object with respect to a center of the second outer region. the second screen includes at least a third object having a third symbol arranged inside a third outer region at a position corresponding to the first outer region, and a fourth object having a fourth symbol arranged inside a fourth outer region at a position corresponding to the second outer region, a distance between the first symbol and the second symbol is greater than a distance between the third symbol and the fourth symbol arranged on the second screen, the first screen is a screen on which the user operates the terminal device with his / her line of sight, and the second screen is a screen on which the user operates the terminal device with his / her fingers. This is the display method. Effect of the Invention
[0009] According to the present invention, it is possible to prevent erroneous input on a terminal device that allows input by eye gaze. [Brief description of the drawings]
[0010] [Figure 1] FIG. 2 is a functional configuration diagram of a system including an ATM according to each embodiment. [Diagram 2] 13 is a screen example of a transaction selection screen in a normal mode. [Diagram 3] 13 is a screen example of a transaction selection screen in an eye-gaze input mode in the first embodiment. [Figure 4] FIG. 13 is an explanatory diagram of the position of characters when two buttons are arranged left and right. [Diagram 5] FIG. 13 is an explanatory diagram of the position of characters when two buttons are arranged one above the other. [Figure 6] FIG. 13 is an explanatory diagram of the position of characters when two buttons are arranged diagonally. [Figure 7] 13 is a screen example of a transaction selection screen in an eye-gaze input mode in the second embodiment. [Figure 8] 13 is a screen example of a gaze input guidance screen in the third embodiment. [Figure 9] 13 is a flowchart showing a process executed by the ATM. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] In each embodiment, an ATM (Automatic Teller Machine) is taken as an example of a terminal device.
[0012] [First embodiment] <Configuration> As shown in Fig. 1, the system of this embodiment includes an ATM 100 and a server 300. The ATM 100 and the server 300 are communicatively connected via a network 200. The network 200 may be, for example, a dedicated line, the Internet, or a LAN, but is not limited to these. Note that a plurality of ATMs (not shown) substantially equivalent to the ATM 100 are communicatively connected to the network 200.
[0013] The ATM 100 and the server 300 are configured as a computer having a CPU (Central Processing unit), a memory, a storage means (memory unit, storage device) such as a hard disk, and a network interface. Various functions of this computer are realized by the CPU executing programs loaded onto the memory.
[0014] The ATM 100 includes a control unit 101 , a touch panel 102 , a camera 103 , and a proximity sensor 104 . The control unit 101 controls various processes executed by the ATM 100 . The touch panel 102 functions as a display unit that displays a predetermined screen, and also functions as an input unit for a user of the ATM 100 to input predetermined information. The information input by the user includes, for example, a transaction selection such as deposit or withdrawal, and an amount, but is not limited to these.
[0015] The camera 103 captures the face of the user. The camera 103 has a resolution sufficient to recognize the line of sight of the user. The camera 103 can also be used for crime prevention purposes. The proximity sensor 104 detects when a user approaches the ATM 100. The proximity sensor 104 may be, for example, an infrared type, a capacitive type, or a magnetic type, but is not limited to these.
[0016] The control unit 101 includes a line-of-sight detection unit 105 and a screen control unit 106 . The gaze detection unit 105 detects the gaze of the user directed toward a predetermined location on the touch panel 102 from the face image of the user captured by the camera 103. The gaze detection unit 105 detects the gaze of the user by detecting, for example, the movement and direction of the user's eyeball from the face image. The movement and direction of the eyeball can be detected, for example, from the positional relationship of the inner corner and outer corner of the eye, the iris, the pupil, and the corneal reflex. The gaze detection unit 105 can also detect the gaze of the user from, for example, the movement and direction of the user's face from the face image. Note that the method by which the gaze detection unit 105 detects the movement of the user's eyeball is not limited, and other methods may be used, or several methods may be combined. The screen control unit 106 controls the screen display of the touch panel 102 . The control unit 101 is equipped with software (not shown) having an algorithm for tracking the movement of the line of sight from a face image.
[0017] The server 300 stores customer information 301. The customer information 301 includes, for example, information about a user's account and an automatic eye gaze input flag (details will be described later), but is not limited to these.
[0018] <Details on gaze input> When a user stands in front of the ATM 100, the proximity sensor 104 detects the user. In response to the detection of the user, the screen control unit 106 displays an initial screen on the touch panel 102. When the user inserts a cash card into a cash card insertion slot (not shown) of the ATM 100, the screen control unit 106 causes a transaction selection screen to be displayed on the touch panel 102. The transaction selection screen that is displayed is the screen that is displayed when the ATM 100 is in normal mode, and an example of this screen is shown in FIG. 2. In normal mode, the user can manually select various buttons.
[0019] 2, the transaction selection screen 10 in the normal mode displays, for example, a "Deposit" button 11, a "Withdrawal" button 12, a "Transfer" button 13, and a "Gaze Input" button 14. Note that the buttons displayed on the transaction selection screen 10 are not limited to these.
[0020] The "Deposit" button 11 is a button for starting a transaction to deposit a specified amount into the user's account. The "Withdraw" button 12 is a button for starting a transaction to withdraw a specified amount from the user's account. The "Transfer" button 13 is a button for starting a transaction to transfer a specified amount from the user's account to another account. The "gaze input" button 14 is a button for transitioning the ATM 100 from the normal mode to the gaze input mode.
[0021] The transaction selection screen 10 in the normal mode is a specific example of the "second screen" in the claims. The "Deposit" button 11, the "Withdrawal" button 12, and the "Transfer" button 13 are specific examples of the "third object" and "fourth object" in the claims. Pressing the "Gaze Input" button 14 is a specific example of the "predetermined trigger" in the claims.
[0022] When a user who wishes to use eye gaze input presses the "eye gaze input" button 14, the screen control unit 106 displays a transaction selection screen for eye gaze input mode on the touch panel 102. An example of this screen is shown in Figure 3. In the eye gaze input mode, the user can select a button to which he or she directs his or her gaze.
[0023] 3, the transaction selection screen 20 in the gaze input mode displays, for example, a "Deposit" button 21, a "Withdraw" button 22, a "Transfer" button 23, and a "Stop gaze input" button 24. Note that the buttons displayed on the transaction selection screen 20 are not limited to these.
[0024] The "Deposit" button 21, "Withdrawal" button 22, and "Transfer" button 23 respectively play the same role as the "Deposit" button 11, "Withdrawal" button 12, and "Transfer" button 13. A user can select one of the "Deposit" button 21, "Withdrawal" button 22, and "Transfer" button 23 by directing his / her gaze at that button, or by directing his / her gaze at that button and performing some action (for example, closing his / her eyes). The "Stop gaze input" button 24 is a button for transitioning the ATM 100 from the gaze input mode to the normal mode. A user can select the "Stop gaze input" button 24 by directing his / her gaze to the button. Note that even in the gaze input mode, manual input on the touch panel 102 may be enabled. That is, the user can manually input using the "Deposit" button 21, the "Withdraw" button 22, the "Transfer" button 23, and the "Stop gaze input" button 24.
[0025] The transaction selection screen 20 in the gaze input mode is a specific example of the "first screen" in the claims. The "Deposit" button 21, the "Withdrawal" button 22, and the "Transfer" button 23 are specific examples of the "first object" and "second object" in the claims. The words "Deposit", "Withdrawal", and "Transfer" displayed in the area of each button are specific examples of the "first symbol" and "second symbol" in the claims. The outer areas of the "Deposit" button 21, the "Withdrawal" button 22, and the "Transfer" button 23 (shown as a rectangle with rounded corners in FIG. 3) are specific examples of the "first outer area" and "second outer area" in the claims.
[0026] The transaction selection screen 20 (FIG. 3) has the following display changes compared to the transaction selection screen 10 (FIG. 2). (1) Since the “Deposit” button 21 is to the left of the “Withdrawal” button 22 and above the “Transfer” button 23, the word “Deposit” is aligned to the left and above the “Deposit” button 21. (2) Since the “Withdrawal” button 22 is located to the right of the “Deposit” button 21 and to the upper right of the “Transfer” button 23, the word “Withdrawal” is aligned to the right and above the “Withdrawal” button 22. (3) Since the “Transfer” button 23 is located below the “Deposit” button 21 and to the lower left of the “Withdrawal” button 22, the word “Transfer” is aligned to the left and bottom of the “Transfer” button 23. (4) The “Transfer” button 23 is located below the “Deposit” button 21 and to the lower left of the “Withdrawal” button 22, and since there is free space at the bottom of the transaction selection screen 20, the “Transfer” button 23 is placed in the lower left corner of the transaction selection screen 20.
[0027] When a user performs gaze input on the "DEPOSIT" button 21, the user tends to direct the gaze to the wording "DEPOSIT" that is aligned to the left and top of the "DEPOSIT" button 21. In other words, the user rarely directs the gaze to the blank area of the "DEPOSIT" button 21. In addition, when a user performs gaze input on the "Withdraw" button 22, the user tends to direct the gaze to the wording "Withdraw" which is aligned to the right and top of the "Withdraw" button 22. In other words, the user rarely directs the gaze to the blank area of the "Withdraw" button 22. In addition, when a user performs gaze input on the "Transfer" button 23, the user tends to direct the gaze to the wording "Transfer" that is aligned left and bottom of the "Transfer" button 23. In other words, the user rarely directs the gaze to the blank area of the "Transfer" button 23.
[0028] According to the display changes (1) to (3), the intervals between the display positions of the words "Deposit", "Withdrawal" and "Transfer" on the transaction selection screen 20 are large, and the difference in gaze when the user directs his / her gaze to each word is large. Therefore, a user who wants to input gaze input of the "Deposit" button 21 can reliably direct his / her gaze to the word "Deposit", and can avoid directing his / her gaze (flickering of the gaze) to the words "Withdrawal" or "Transfer". In other words, the accuracy of gaze input of the "Deposit" button 21 can be improved, and erroneous input of the "Withdrawal" button 22 or the "Transfer" button 23 can be suppressed. In addition, a user who wishes to input the "Withdraw" button 22 with their eyes can reliably direct their eyes to the words "Withdraw", and can avoid directing their eyes to the words "Transfer" or "Deposit". In other words, the accuracy of the eye-gaze input of the "Withdraw" button 22 can be improved, and erroneous input of the "Transfer" button 23 or the "Deposit" button 21 can be suppressed. In addition, a user who wishes to input the "Transfer" button 23 with their eyes can reliably direct their eyes to the wording "Transfer", and can avoid directing their eyes to the words "Deposit" or "Withdrawal". In other words, the accuracy of the eye-gaze input of the "Transfer" button 23 can be improved, and erroneous input of the "Deposit" button 21 or the "Withdrawal" button 22 can be suppressed.
[0029] According to the display change of (4), the positional relationship of the "Deposit" button 21, "Withdrawal" button 22, and "Transfer" button 23 on the transaction selection screen 20 can be made roughly the same as the positional relationship of the "Deposit" button 11, "Withdrawal" button 12, and "Transfer" button 13 on the transaction selection screen 10 without significantly changing the positional relationship of the "Deposit" button 11, "Withdrawal" button 12, and "Transfer" button 13 on the transaction selection screen 10, while increasing the line-of-sight difference between the "Deposit" button 21, "Withdrawal" button 22, and "Transfer" button 23. In other words, since the screen layout of the normal mode (the vertical and horizontal positional relationship and the layout order of each button) can be maintained in the gaze input mode, a user who switches to the gaze input mode can smoothly input gaze without being confused by the screen layout of the transaction selection screen 20. In addition, it is possible to improve gaze input to the desired button among the "Deposit" button 21, "Withdrawal" button 22, and "Transfer" button 23, and to prevent erroneous input to other buttons.
[0030] <Types of gaze differences> As shown in FIG. 4, the touch panel 102 displays a screen including a first object 31 and a second object 32. The first object 31 and the second object 32 are targets of gaze input by a user. The boundary of the first object 31 is a first external region 33, and the boundary of the second object 32 is a second external region 34. A first symbol 35 is disposed inside the first external region 33, and a second symbol 36 is disposed inside the second external region 34. The first symbol 35 and the second symbol 36 may be, for example, characters, figures, illustrations, but are not limited to these. The first symbol 35 and the second symbol 36 may be, for example, information that symbolizes, identifies, or describes the first object 31 or the second object 32.
[0031] 4, when the first object 31 and the second object 32 are arranged side by side, the screen control unit 106 can arrange the first symbol 35 to the left of the left-right center of the first outer shape area 33 (opposite the second object 32). The screen control unit 106 can also arrange the second symbol 36 to the right of the left-right center of the second outer shape area 34 (opposite the first object 31). Either one of these two types of arrangements may be used, or both may be used.
[0032] 5, when the first object 31 and the second object 32 are arranged vertically side by side, the screen control unit 106 can arrange the first symbol 35 upward (opposite the second object 32) with respect to the vertical center of the first outer shape region 33. The screen control unit 106 can arrange the second symbol 36 downward (opposite the first object 31) with respect to the vertical center of the second outer shape region 34. Either one of these two types of arrangements may be used, or both may be used.
[0033] Furthermore, as shown in FIG. 6, when the first object 31 and the second object 32 are arranged diagonally next to each other, the screen control unit 106 can arrange the first symbol 35 to the left and above the center of the first outer shape region 33 (opposite the second object 32). The screen control unit 106 can arrange the second symbol 36 to the right and below the center of the second outer shape region 34 (opposite the first object 31). Either one of these two arrangements or both may be used. The first symbol 35 may be arranged to the left or above the center of the first outer shape region 33. The second symbol 36 may be arranged to the right or below the center of the second outer shape region 34. Furthermore, by placing the first object 31 and the second object 32 at two diagonal corners of the four corners of the touch panel 102, respectively, the distance between the first object 31 and the second object 32 can be maximized, resulting in an extremely large line of sight difference.
[0034] 4 to 6, when there is a first object 31 and a second object 32, for any positional relationship between the first object 31 and the second object 32, the screen control unit 106 can place the first symbol 35 at a position opposite the second object with respect to the center of the first outer shape region 33. Also, the screen control unit 106 can place the second symbol 36 at a position opposite the first object 31 with respect to the center of the second outer shape region 34.
[0035] When three or more objects are displayed, the screen control unit 106 can configure a screen in which the above-mentioned line of sight difference is applied to two arbitrarily selected objects. At this time, it is preferable to shift the symbols arranged inside the outline regions of the two selected objects from the center of the outline regions so that they do not get close to the symbols of the remaining objects.
[0036] According to the first embodiment, there is a large difference in gaze between the words of the buttons displayed on the transaction selection screen 20 in the gaze input mode. Therefore, when the user directs his / her gaze to a desired button, the button can be reliably input, and erroneous input of a different button can be suppressed. In other words, when detecting the user's gaze from the face image, the gaze detection unit 105 can clearly distinguish and detect each of the gazes directed at each button. In other words, the accuracy of gaze input to a desired button can be improved, and erroneous input of the ATM 100 that allows input by gaze can be suppressed. In addition, by changing the button arrangement so as to maintain the layout of the transaction selection screen 20 in the gaze input mode compared to the normal mode, the user can smoothly perform gaze input without becoming confused by the screen layout of the transaction selection screen 20.
[0037] [Second embodiment] In describing the second embodiment, explanations that overlap with the first embodiment will be omitted, and only differences will be described. As shown in FIG. 7, the transaction selection screen 20 in the gaze input mode displays, for example, a “Deposit” button 21, a “Withdraw” button 22, a “Transfer” button 23, and a “Stop gaze input” button 24.
[0038] The transaction selection screen 20 (FIG. 7) has the following display changes compared to the transaction selection screen 10 (FIG. 2). (1) Since the “Deposit” button 21 is located to the left of the “Withdrawal” button 22, the mark 41 is placed to the left of the word “Deposit”. (2) Since the "Withdrawal" button 22 is located to the right of the "Deposit" button 21, the mark 42 is placed to the right of the word "Withdrawal." (3) Since the “Transfer” button 23 is located to the left of the “Withdrawal” button 22, the mark 43 is placed to the left of the word “Transfer.”
[0039] The marks 41 to 43 are specific examples of the "first visual guidance symbol" and the "second visual guidance symbol" in the claims.
[0040] When a user performs gaze input on the "Deposit" button 21, the user tends to direct the gaze to the mark 41. In other words, the user rarely directs the gaze to the wording "Deposit" or the blank area of the "Deposit" button 21. In addition, when a user performs gaze input on the "Withdraw" button 22, the user tends to direct the gaze to the mark 42. In other words, the user rarely directs the gaze to the wording "Withdraw" or the blank area of the "Withdraw" button 22. Furthermore, when a user performs gaze input on the "Transfer" button 23, the user tends to direct the gaze to the mark 43. In other words, the user rarely directs the gaze to the wording "Transfer" or the blank area of the "Transfer" button 23.
[0041] According to the display changes (1) to (3), the user's gaze can be guided to the marks 41 to 43, so that the difference in gaze between the "Deposit" button 21, the "Withdrawal" button 22, and the "Transfer" button 23 can be increased. Therefore, a user who wishes to input gaze on any of the "Deposit" button 21, the "Withdrawal" button 22, and the "Transfer" button 23 can reliably direct his / her gaze to any of the marks 41 to 43, and can avoid directing his / her gaze to other marks. In other words, when detecting the gaze of the user from the face image, the gaze detection unit 105 can clearly distinguish and detect each of the gazes directed to each button. In other words, the accuracy of gaze input on any of the "Deposit" button 21, the "Withdrawal" button 22, and the "Transfer" button 23 can be improved, and erroneous input of a different button can be suppressed.
[0042] In the second embodiment, the screen control unit 106 may blink the marks 41 to 43. This can more strongly guide the user's gaze to the marks 41 to 43. Therefore, the user can more reliably direct his / her gaze to any of the marks 41 to 43 and more reliably avoid directing his / her gaze to other marks.
[0043] 7, since the "Deposit" button 21 is above the "Transfer" button 23, the marks 41 may be arranged just above the "Deposit" button 21. Furthermore, since the "Withdraw" button 22 is above the "Transfer" button 23, the marks 42 may be arranged just above the "Withdraw" button 22. Furthermore, since the "Transfer" button 23 is below the "Deposit" button 21 and the "Withdraw" button 22, the marks 43 may be arranged just below the "Transfer" button 23.
[0044] 7, the "Transfer" button 23 is below the "Deposit" button 21 and to the lower left of the "Withdraw" button 22, and since there is free space at the bottom of the transaction selection screen 10, the "Transfer" button 23 may be located in the lower left corner of the transaction selection screen 20. This makes it possible to increase the line of sight difference between the mark 43 and the marks 41 and 42. In other words, the accuracy of line of sight input of either the "Transfer" button 23 can be improved, and erroneous input of the "Deposit" button 21 and the "Withdraw" button 22 can be suppressed.
[0045] In addition, the wording "Deposit" on the "Deposit" button 21, the wording "Withdrawal" on the "Withdrawal" button 22, and the wording "Transfer" on the "Transfer" button 23 can be appropriately changed in position relative to the marks 41 to 43. Each of the marks 41 to 43 can be placed at any position inside the "Deposit" button 21, the "Withdrawal" button 22, and the "Transfer" button 23.
[0046] According to the second embodiment, the same effects as those of the first embodiment can be obtained more effectively.
[0047] [Third embodiment] In describing the third embodiment, explanations that overlap with the first and second embodiments will be omitted, and only differences will be described. 8, after the user completes a transaction by gaze input on the transaction selection screen 20, the screen control unit 106 can display a gaze input guidance screen 50 on the touch panel 102. The gaze input guidance screen 50 is a screen for confirming whether or not to perform gaze input the next time the ATM 100 is used.
[0048] The gaze input guidance screen 50 displays, for example, a "Perform" button 51 and a "Do not perform" button 52. Note that the buttons displayed on the gaze input guidance screen 50 are not limited to these. In addition, the gaze input guidance screen 50 can display details of the gaze input guidance.
[0049] The "Perform" button 51 is a button for starting the next transaction at the ATM 100 by eye gaze input. The "Do Not Execute" button 52 is a button for starting the next transaction at the ATM 100 by manual input rather than eye-gaze input.
[0050] The eye-gaze input guide screen 50 is a specific example of the "third screen" in the claims. The "Perform" button 51 and the "Do not perform" button 52 are specific examples of the "first object" and "second object" in the claims.
[0051] Since the “Perform” button 51 is to the left of the “Don't perform” button 52, the word “Perform” is positioned just to the left of the “Perform” button 51. Since the “Do not perform” button 52 is located to the left of the “Perform” button 51, the wording “Do not perform” is positioned to the left of the “Do not perform” button 52. Therefore, since the difference in gaze between the words "do" and "don't do" is large, the accuracy of gaze input of the "do" button 51 and the "don't do" button 52 can be improved.
[0052] When the user selects the "Perform" button 51, the control unit 101 turns on the automatic gaze input flag for the user. The automatic gaze input flag is a flag that indicates whether or not the next transaction at the ATM 100 will be started by gaze input. When the automatic gaze input flag is on, it indicates that the next transaction at the ATM 100 will be started by gaze input. When the automatic gaze input flag is off, it indicates that the next transaction at the ATM 100 will be started by manual input rather than gaze input. The control unit 101 transmits the automatic gaze input flag that is on to the server via the network 200. The server 300 includes the received automatic gaze input flag in the customer information 301 of the user.
[0053] For example, when a user performs the next transaction at ATM 100, the user inserts the cash card into a cash card insertion slot (not shown) of ATM 100. Based on the user's account information recorded on the cash card, control unit 101 inquires of server 300 about the automatic gaze input flag. As a result of the inquiry, since the automatic gaze input flag is on, control unit 101 transitions to the gaze input mode. Screen control unit 106 displays transaction selection screen 20 (FIG. 3) in the gaze input mode on touch panel 102. Thereafter, the user can perform gaze input as already described.
[0054] If the user selects the "Stop gaze input" button 24 during a transaction in the gaze input mode, the control unit 101 transitions to the normal mode. The control unit 101 also turns off the automatic gaze input flag and transmits it to the server 300. The server 300 includes the received automatic gaze input flag in the customer information 301 of the user.
[0055] On the other hand, when the user selects the "Do not perform" button 52, the control unit 101 turns off the automatic gaze input flag for the user. The control unit 101 transmits the automatic gaze input flag that is turned off to the server 300 via the network 200. The server 300 includes the received automatic gaze input flag in the customer information 301 of the user.
[0056] For example, when a user performs the next transaction at ATM 100, the user inserts the cash card into a cash card insertion slot (not shown) of ATM 100. Based on the user's account information recorded on the cash card, control unit 101 inquires of server 300 about the automatic gaze input flag. As a result of the inquiry, the automatic gaze input flag is off, so control unit 101 transitions to normal mode. Screen control unit 106 displays transaction selection screen 10 (FIG. 2) in normal mode on touch panel 102. Thereafter, the user manually inputs information on transaction selection screen 10.
[0057] According to the third embodiment, a user can perform a transaction by eye gaze input from the start of the transaction without touching the touch panel 102. This can reliably avoid problems caused by touching the touch panel 102, such as the user being infected with pathogens or viruses present on the touch panel.
[0058] [process] The processing of the ATM 100 will be described with reference to FIG. First, the control unit 101 of the ATM 100 acquires screen layout information (step S01). The screen layout information is configuration information of a screen displayed by the touch panel 102. The screen layout information includes components such as the title of the screen, the shape of the buttons, and the text inside the buttons. The screen layout information may also include syntax data (e.g., HTML, XML) that defines the position information of these components. For example, the control unit 101 can acquire the screen layout information from the server 300 that generated the screen layout information. The control unit 101 may also acquire the screen layout information from a predetermined external device, or may acquire screen layout information generated by the ATM 100 itself.
[0059] When a user inserts a cash card into the insertion slot of the ATM 100, the control unit 101 acquires information on the cash card (user's account information) (step S02). Next, the control unit 101 queries the server 300 with the acquired information and determines whether the automatic gaze input flag included in the customer information 301 of the target user is on (step S03). If the automatic gaze input flag is not on (No in step S03), the automatic gaze input flag is off, and the screen control unit 106 displays the transaction selection screen 10 (FIG. 2) in the normal mode on the touch panel 102 (step S04).
[0060] If the user does not press the "eye gaze input" button 14 while the transaction selection screen 10 is displayed (No in step S05), the control unit 101 performs transaction processing (e.g., deposit, withdrawal, transfer) according to the input (manual input) from the user (step S06), and ends the processing in FIG. 9. On the other hand, if the user presses the "eye gaze input" button 14 while the transaction selection screen 10 is displayed (Yes in step S05), the screen control unit 106 switches to the transaction selection screen 20 (FIG. 3 or FIG. 7) in the eye gaze input mode and displays it on the touch panel 102 (step S07). Also, if the automatic eye gaze input flag is on (Yes in step S03), the screen control unit 106 displays the transaction selection screen 20 (FIG. 3 or FIG. 7) in the eye gaze input mode on the touch panel 102 from the beginning of the transaction (step S07).
[0061] If the user presses the "Stop gaze input" button 24 while the transaction selection screen 20 is displayed (Yes in step S08), the screen control unit 106 switches to the normal mode transaction selection screen 10 (FIG. 2) and displays it on the touch panel 102 (step S04). If the user does not press the "Stop gaze input" button 24 while the transaction selection screen 20 is displayed (No in step S08), the control unit 101 performs transaction processing according to the input (gaze input) from the user (step S09).
[0062] When the transaction process (step S09) is completed, the screen control unit 106 displays the eye-gaze input guide screen 50 (FIG. 8) on the touch panel 102 (step S10). If the user presses the "Execute" button 51 while the eye-gaze input guide screen 50 is displayed (Yes in step S11), the control unit 101 turns on the automatic eye-gaze input flag (step S12), and the process in FIG. 9 is completed. The automatic eye-gaze input flag that is on is transmitted to the server 300 and registered in the customer information 301.
[0063] On the other hand, if the user presses the "Do not perform" button 52 while the eye-gaze input guidance screen 50 is being displayed (No in step S11), the control unit 101 turns off the automatic eye-gaze input flag (step S13), and the process in Fig. 9 ends. The off automatic eye-gaze input flag is transmitted to the server 300 and registered in the customer information 301.
[0064] Regarding the screen layout information, the server 300 may prepare two types of screen layout information: screen layout information for the normal mode and screen layout information for the eye-gaze input mode. In this case, the ATM 100 acquires two types of screen layout information. When the "eye-gaze input" button 14 is pressed, the screen control unit 106 can present the transaction selection screen 20 (FIG. 3 or FIG. 7) for the eye-gaze input mode by switching the screen layout information.
[0065] Alternatively, the server 300 may prepare one type of screen layout information. In this case, the ATM 100 acquires one type of screen layout information. When the "gaze input" button 14 is pressed, the screen control unit 106 calculates the position of the button image and the text within the button, and reconstructs the acquired screen layout information, thereby presenting the transaction selection screen 20 (FIG. 3 or FIG. 7) in the gaze input mode.
[0066] <Modification> (a) The present invention is not limited to ATMs, but can also be applied to KIOSK (registered trademark) terminals, ticket vending machines, and other devices that have a screen and eye gaze input function. (b) After the transaction is completed using the transaction selection screen 10 in the normal mode, the eye-gaze input guidance screen 50 may be displayed. (c) Software-implementable means can be implemented in hardware and hardware-implementable means can be implemented in software. [Explanation of symbols]
[0067] 100 ATM (terminal equipment) 101 Control section 102 Touch Panel 103 Camera 104 Proximity Sensor 105 Line of Sight Detection Unit 106 Screen control section 200 Network 300 Servers 301 Customer information 10. Transaction selection screen 11 "Deposit" button 12. "Withdrawal" button 13 "Transfer" button 14 "Gaze input" button 20 Transaction selection screen 21 "Deposit" button 22 "Withdrawal" button 23 "Transfer" button 24 "Stop gaze input" button 31 First Object 32 Second Object 33 First external shape area 34 Second external shape area 35 1st Symbol 36 Second Symbol 41~43 marks 50 Eye gaze input guidance screen 51 "Do" button 52 "Don't do this" button
Claims
1. A display unit; a gaze detection unit that detects a gaze of a user of the terminal device directed toward the display unit; a screen control unit that causes the display unit to display a first screen or a second screen different from the first screen, The first screen is a first object having a first symbol disposed inside a first outer region; a second object having a second symbol disposed inside a second outer shape region; At least The second screen is a third object having a third symbol disposed inside a third outer region located at a position corresponding to the first outer region; a fourth object having a fourth symbol disposed inside a fourth outer region located at a position corresponding to the second outer region; At least the screen control unit, upon receipt of a predetermined trigger input to the terminal device, switches from the second screen to the first screen and displays the first screen on the display unit; the first screen satisfies at least one of the following: the first symbol is disposed at a position opposite the second object with respect to a center of the first outer shape region; and the second symbol is disposed at a position opposite the first object with respect to a center of the second outer shape region; a distance between the first symbol and the second symbol is greater than a distance between the third symbol and the fourth symbol arranged on the second screen; the first screen is a screen for the user to operate the terminal device with a line of sight, The second screen is a screen for the user to operate the terminal device with his / her fingers.
2. The first screen switched from the second screen by the screen control unit further comprises:
2. The terminal device of claim 1, wherein the first symbol is arranged so that a margin area on the second object side in the first outer shape region is wider than a margin area on the fourth object side in the third outer shape region, and the second symbol is arranged so that a margin area on the first object side in the second outer shape region is wider than a margin area on the third object side in the fourth outer shape region.
3. When the first object and the second object are arranged side by side, 2. The terminal device according to claim 1, wherein the first screen satisfies at least one of the following: the first symbol is positioned opposite the second object with respect to the left-right center of the first outer shape region; and the second symbol is positioned opposite the first object with respect to the left-right center of the second outer shape region.
4. When the first object and the second object are arranged vertically next to each other, 2. The terminal device according to claim 1, wherein the first screen satisfies at least one of the following: the first symbol is positioned opposite the second object with respect to the vertical center of the first outer shape region; and the second symbol is positioned opposite the first object with respect to the vertical center of the second outer shape region.
5. When the first object and the second object are arranged diagonally next to each other, 2. The terminal device according to claim 1, wherein the first screen satisfies at least one of the following: the first symbol is positioned opposite the second object with respect to the center of the first outer shape region; and the second symbol is positioned opposite the first object with respect to the center of the second outer shape region.
6. The first symbol includes a first line-of-sight guidance symbol for guiding the user's line of sight, The terminal device according to claim 1 , wherein the second symbol includes a second line-of-sight guidance symbol for guiding the user's line of sight.
7. The terminal device according to claim 6 , wherein the screen control unit blinks at least one of the first gaze guidance symbol and the second gaze guidance symbol.
8. A display unit; a gaze detection unit that detects a gaze of a user of the terminal device directed toward the display unit; a screen control unit that causes a first screen to be displayed on the display unit, The first screen is a first object having a first symbol disposed inside a first outer region; a second object having a second symbol disposed inside a second outer shape region; At least the first screen satisfies at least one of the following: the first symbol is disposed at a position opposite the second object with respect to a center of the first outer shape region; and the second symbol is disposed at a position opposite the first object with respect to a center of the second outer shape region; the screen control unit causes the display unit to display a second screen different from the first screen; Switching from the second screen to the first screen and displaying the first screen on the display unit in response to a predetermined trigger input to the terminal device; the second screen includes a third object and a fourth object; A terminal device in which the distance between the first object and the second object, which are arranged on the first screen, is greater than the distance between the third object and the fourth object, which are arranged on the second screen.
9. The terminal device according to claim 1 , wherein the screen control unit causes the display unit to display a third screen for confirming whether or not to perform eye gaze input the next time the terminal device is used.
10. A computer of a terminal device having a display unit, a gaze detection unit that detects a gaze of a user of the terminal device directed toward the display unit; functioning as a screen control unit that causes the display unit to display a first screen or a second screen different from the first screen; The first screen is a first object having a first symbol disposed inside a first outer region; a second object having a second symbol disposed inside a second outer shape region; At least The second screen is a third object having a third symbol disposed inside a third outer region located at a position corresponding to the first outer region; a fourth object having a fourth symbol disposed inside a fourth outer region located at a position corresponding to the second outer region; At least causing the screen control unit to switch from the second screen to the first screen and display the first screen on the display unit in response to a predetermined trigger input to the terminal device; the first screen satisfies at least one of the following: the first symbol is disposed at a position opposite the second object with respect to a center of the first outer shape region; and the second symbol is disposed at a position opposite the first object with respect to a center of the second outer shape region; a distance between the first symbol and the second symbol is greater than a distance between the third symbol and the fourth symbol arranged on the second screen; the first screen is a screen for the user to operate the terminal device with a line of sight, The second screen is a screen for the user to operate the terminal device with his / her fingers.
11. A display method for displaying a screen for allowing a user of a terminal device to input gaze information into the terminal device, comprising: A control unit of the terminal device a first step of acquiring screen layout information including at least a first object having a first symbol arranged inside a first outer region and a second object having a second symbol arranged inside a second outer region; a second step of displaying a first screen based on the screen layout information; a third step of displaying a second screen different from the first screen; a fourth step of switching from the second screen to the first screen in response to a predetermined trigger input to the terminal device; In the second step, arranging the first symbol at a position opposite the second object with respect to a center of the first outer region and / or the second symbol at a position opposite the first object with respect to a center of the second outer region; The second screen is a third object having a third symbol disposed inside a third outer region located at a position corresponding to the first outer region; a fourth object having a fourth symbol disposed inside a fourth outer region located at a position corresponding to the second outer region; At least a distance between the first symbol and the second symbol is greater than a distance between the third symbol and the fourth symbol arranged on the second screen; the first screen is a screen for the user to operate the terminal device with a line of sight, The second screen is a screen for the user to operate the terminal device with his / her fingers.
Citation Information
Patent Citations
Device and method for selecting sight line correspondence and information processor
JP1996272517A
Visual line input intention transmitting device and method therefor and storage medium
JP1999073274A
Automated teller machine and method for acquiring personal identification number for automated teller machine
JP2009187443A
Display controller, display control method and program
JP2015125616A
Eye gaze control system
US20170160908A1
