User input device

Abstract

A user input device includes a key, which, when triggered, provides a control signal to the user input device; a first optical sensor, which is located beside the key, senses first optical data; and a processing circuit, which determines a moving direction of an object based on the first optical data and determines a triggering state of the key based on the moving direction. The user input device can trigger the key in advance. Thus, the triggering of the key can be detected faster, and the combination or triggering of two or more keys can be determined, thereby expanding the application range of the user input device.

Description

Technical Field

[0001] This invention relates to a user input device, and more particularly to a user input device that can assist in detecting key presses. Background Technology

[0002] Traditional game joysticks typically have multiple buttons. When playing a game, the user can trigger at least one button (e.g., press or touch a button), causing the joystick to generate a control signal to control the game. As game controls become increasingly complex, the latency requirements between the user's button trigger and the joystick's control signal generation become increasingly stringent. However, traditional game joysticks usually only begin generating a control signal when the user actually triggers the action, lacking the ability to pre-detect which button the user will press. This not only increases the latency of the joystick's control signal generation but also limits its application range. Summary of the Invention

[0003] One objective of this invention is to disclose a user input device that can assist in detecting key presses.

[0004] One objective of this invention is to disclose a user input device that allows for advance button triggering time.

[0005] An embodiment of the present invention discloses a user input device, comprising: a button that provides a control signal to the user input device when triggered; a first optical sensor located next to the button for sensing first optical data; and a processing circuit for determining the direction of movement of an object based on the first optical data, and for determining the trigger state of the button based on the direction of movement.

[0006] Another embodiment of the present invention discloses a user input device, including: a plurality of buttons, including a first button and a second button, which provide a control signal to the user input device when triggered; a first optical sensor located next to the first button and the second button for sensing first optical data; and a processing circuit for determining, based on the first optical data, which button an object moves from the first button to. If it is determined that the object moves to the second button, the triggering time of the second button is advanced.

[0007] Another embodiment of the present invention discloses a user input device, comprising: a plurality of buttons, including a first button, a second button, and a third button, which provide control signals to the user input device when pressed; a first optical sensor surrounded by the first button, the second button, and the third button for sensing first optical data; and a processing circuit for determining a control signal based on the first optical signal, the control signal representing an arrangement of button actions, the button actions encompassing actions of at least two of the first button, the second button, and the third button, the button actions allowing for repeated actions and excluding actual physical pressing of the plurality of buttons.

[0008] According to the above embodiments, key triggering can be detected more quickly, which helps to determine the combination or triggering of two or more keys, thereby expanding the application range of the user input device. Attached Figure Description

[0009] Figure 1 A schematic diagram of a joystick according to an embodiment of the present invention is shown.

[0010] Figure 2 The illustration shows the invention Figure 1 A cross-sectional view of the joystick.

[0011] Figure 3 A schematic diagram illustrating finger movement according to an embodiment of the present invention is shown. Figure 4 A schematic diagram illustrating the field of view (FOV) of a first optical sensor according to an embodiment of the present invention is shown.

[0012] Figure 5 A schematic diagram illustrating an embodiment of the present invention, showing that the triggering time of a button is advanced.

[0013] Figure 6 , Figure 7A and Figure 7B The illustration depicts a scenario where a button is being triggered and an object is moving away from the button, according to an embodiment of the present invention.

[0014] Figure 8 A schematic diagram of a joystick according to another embodiment of the present invention is shown.

[0015] The reference numerals in the attached figures are explained as follows: 100 joystick 101 Processing Circuit 201 Outer Shell 203 Printed Circuit Board 800 joystick B_S, B_1, B_2, B_3, B_4 buttons Images of the buttons BP_1, BP_2, BP_3, and BP_4 F finger F_1, F_2 field of view FI, FI_1a, FI_2a, FI_1, FI_2, FI_3, FI_1', FI_2', FI_3' finger images LS_1 light source OS_1 First Optical Sensor OS_2 Second Optical Sensor Positions of P_1, P_2, P_3, P_4 SI, SI_a, SI_b, SI_c, SI_d, SI_1a, SI_2a, SI_1, SI_2, SI_3, SI_1', SI_2', SI_3' Sensing Images T_A, T_D, T_O time X dashed line Detailed Implementation The present invention will be described below with reference to several embodiments. Please note that the terms "first," "second," and similar descriptions used in the following description are only used to define different elements, parameters, data, signals, or steps, and are not intended to limit their order. For example, the first device and the second device may be devices with the same structure but different from each other. Please note that in the following embodiments, a joystick used for playing games is used as an example. However, the concepts disclosed in this invention can be applied to any other user input device having at least one button or at least one key, such as a mouse or keyboard. Furthermore, in the following embodiments, "key being triggered" means that the key is touched, pressed, or hovered.

[0016] Figure 1 A schematic diagram of a joystick 100 according to an embodiment of the present invention is shown. It should also be noted that the scope of the invention is not limited to this. Figure 1 The position, number, and shape of the elements shown in the following embodiments. The joystick 100 includes at least one button, a first optical sensor OS_1, and processing circuitry 101. The button is used to provide a control signal to the joystick 100 when triggered. As described above, the button can be triggered by various actions (e.g., pressing, touching, or hovering). Figure 1 In this embodiment, four buttons B_1, B_2, B_3 and B_4 are used as examples for illustration.

[0017] A first optical sensor OS_1 is located next to buttons B_1, B_2, B_3, and B_4 and is used to detect first optical data. In one embodiment, the first optical sensor OS_1 is an image sensor, therefore the first optical data is at least one image. Figure 1In one embodiment, buttons B_1, B_2, B_3, and B_4 are arranged in a polygon, with the first optical sensor OS_1 located in the middle portion of the polygon and surrounded by buttons B_1, B_2, B_3, and B_4. Alternatively, in one embodiment, no optical sensor is provided on any of buttons B_1, B_2, B_3, and B_4. In another embodiment, the joystick 100 also includes at least one light source located in the middle portion. Figure 1 In this embodiment, only one light source, LS_1, is marked for illustration.

[0018] The processing circuit 101 is used to determine the direction of movement of the object based on the first optical data, and to determine the trigger state of the button based on the direction of movement. In the following embodiments, the concept of the present invention is illustrated using finger F as an example.

[0019] Figure 2 The illustration shows the invention Figure 1 A cross-sectional view of the joystick 100. Specifically, Figure 2 It is along Figure 1 A cross-sectional view along the dashed line X. Figure 2 In the illustrated embodiment, the joystick 100 includes a housing 201 and a printed circuit board 203 disposed within the housing 201. Buttons B_2 and B_3 are disposed outside the housing 201. Furthermore, a first optical sensor OS_1 and a light source LS_1 are disposed between buttons B_2 and B_3, located inside the housing 201. Thus, when a finger F moves between buttons B_1, B_2, B_3, and B_4 and is positioned above the first optical sensor OS_1, light emitted by the light source LS_1 can illuminate the finger F, and the first optical sensor OS_1 can sense an image of the finger F.

[0020] As described above, the processing circuit 101 can determine the direction of the object's movement based on the first optical data. Figure 3 A schematic diagram illustrating the movement of finger F according to an embodiment of the present invention is shown. Figure 3 In this embodiment, the sensed image SI refers to the image sensed by the first optical sensor OS_1. According to... Figure 1 and Figure 2 As shown in the structure, when finger F moves between buttons B_1, B_2, B_3, and B_4, the first optical sensor OS_1 can also sense the finger image FI. Figure 1 and Figure 2 As described in the embodiment, the finger F may reflect light from the light source LS_1. Therefore, a brighter finger image FI may appear in the sensing image SI.

[0021] Therefore, the direction of finger F's movement can be determined based on the finger image FI in different sensing images SI. For example... Figure 3As shown in the above figure, because the finger image FI in the sensing images SI_a and SI_b moves from left to right, it is determined that the finger F moves from left to right. Furthermore, in Figure 3 In the figure below, since the finger image FI in the sensing images SI_c and SI_d moves from top to bottom, it is determined that the finger F moves from top to bottom. Note that the direction of movement of finger F and the direction of movement of finger image FI are not necessarily the same. Due to the arrangement or algorithm of the first optical sensor OS_1, the direction of movement of finger F and the direction of movement of finger image FI may be different, or even opposite. In the following embodiments, an example in which the direction of movement of finger F and the direction of movement of finger image FI are the same will be described.

[0022] In one embodiment, the first optical sensor OS_1 is an event sensor, and the first optical data is an event signal, where the event signal corresponds to an event change (e.g., a change in the brightness of a pixel image). The processing circuit 101 can determine the location of the event based on the event signal, thereby determining the direction of movement of the finger F. For example, each pixel of the first optical sensor OS_1 has its own event signal. Therefore, the processing circuit 101 can determine which pixel image of the sensed image SI has changed (e.g., a change in brightness), and then determine the direction of movement of the finger F based on the change in the pixel image.

[0023] As described above, the processing circuit 101 can determine the trigger state of the key based on the movement direction of the finger F. In one embodiment, the trigger state is the trigger sequence of the key. For example, in Figure 1 In one embodiment, if button B_1 has been triggered and the finger F moves from top to bottom, the triggering order is determined to be button B_1 → button B_4. In another example, if the finger image first appears on the right side, then moves to the upper left corner, and finally moves to the lower left corner, the triggering order is determined to be button B_2 → button B_1 → button B_3. Note that the determination of the triggering order is not limited to the requirement that a certain button must be triggered first. Even if a certain button is not triggered first, the triggering order can still be determined based on the finger image FI.

[0024] More specifically, determining the trigger sequence based on finger image FI is to detect button triggers more quickly, allowing two or more button actions to be linked together, thus broadening the application range of the joystick. For example, when a user quickly triggers buttons B_1-B_2 while playing a game (e.g., with a time interval of 0.1 milliseconds), it is determined that a combo skill or combination skill in the game has been triggered. In this case, if the user moves from button B_1 to button B_2 too slowly (e.g., with a time interval of 0.2 milliseconds), the triggering of the combination skill or combination technique may fail. Using the method disclosed in this invention, when the user's finger leaves button B_1, before button B_2 is triggered, the imminent triggering of button B_2 can be detected (with a time interval of 0.1 milliseconds). Even if button B_2 has not yet received a trigger action provided by the user (e.g., touch, press, or hover), button B_2 can be triggered directly. Therefore, the triggering time interval between buttons B_1 and B_2 is 0.1 milliseconds instead of 0.2 milliseconds, thus successfully triggering combo skills or combination skills.

[0025] The sensitivity of the connection button action can be set in several ways. For example, users can adjust the sensitivity according to their own needs. Alternatively, a game console can automatically set the sensitivity based on the type of game the user is playing. Higher sensitivity makes it easier for the user to trigger the connection button action, but also increases the possibility of false triggers. Conversely, lower sensitivity makes it less likely for the user to trigger the connection button action, but also reduces the possibility of false triggers. Note that the above detection of button activation can also be considered a "prediction," as the button has not yet been actually triggered.

[0026] However, in another embodiment, key trigger detection is based on the sequence of key presses of at least two keys. For example, in Figure 1 In the illustrated embodiment, the finger moves sequentially to buttons B1-B2-B4-B2. Even if none of these buttons are pressed, the movement of the finger can still be determined based on the first optical data detected by the first optical sensor OS_1. Then, the processing circuit 101 can generate control signals corresponding to the signals generated by pressing buttons B1-B2-B4-B2 in sequence, based on the movement of the finger. As mentioned above, these control signals can be a single signal corresponding to the sequential pressing of buttons B1-B2-B4-B2, or at least one combination of signals corresponding to the sequential pressing of buttons B1-B2-B4-B2.

[0027] Based on this embodiment, the joystick can be considered as: a joystick including: multiple buttons, including a first button (e.g., Figure 1The first button (e.g., button B_1), the second button (e.g., button B_2), and the third button (e.g., button B_4) provide control signals to the user input device when pressed; the first optical sensor (e.g., Figure 1 The system includes a first optical sensor (OS_1), surrounded by the first, second, and third buttons, for sensing first optical data; and a processing circuit (e.g., processing circuit 101) for determining a control signal based on the first optical signal. This control signal represents an arrangement of button actions (e.g., B_2→B_4 or B_1→B_2→B_4). The button actions include virtual trigger actions corresponding to at least two of the first, second, and third buttons being pressed. These button actions allow for repeated virtual trigger actions (e.g., B_1→B_2→B_1) corresponding to one of the multiple buttons, and the button actions do not require actual physical pressing of any of the multiple buttons. In other words, in the prior art, generating the corresponding control signal for buttons B_1→B_2→B_4 requires actual physical pressing of these buttons. However, if the method disclosed in this invention is used, the user's finger can be determined by optical data to move in the order of buttons B_1→B_2→B_4. Even if the user's finger does not actually physically press B_1, B_2, B_4, the corresponding control signal (virtual trigger action) of buttons B_1→B_2→B_4 can still be generated.

[0028] The contents of the sensed image SI may vary depending on the field of view (FOV) of the first optical sensor OS_1. Figure 4 A schematic diagram illustrating the field of view of a first optical sensor according to an embodiment of the present invention is shown. Figure 4 As shown in the image above, the field of view F_1 is small, therefore the first optical sensor OS_1 cannot sense the images of buttons B_1-B_4. Conversely, in Figure 4 In the image below, the field of view F_2 is relatively large, so the first optical sensor OS_1 can sense a portion of the image of each button B_1-B_4.

[0029] Specifically, in Figure 4 In the above image, the sensed image SI_1 does not include any button images. Figure 4In the figure below, the sensing image SI_2 includes the button portion images BP_1, BP_2, BP_3, and BP_4 for each button B_1-B_4. Note that the position of the button portion images may vary depending on the position or arrangement of the first optical sensor OS_1. The button portion images in Figure 4 can be used as a reference to help determine the direction of finger F movement, thereby making the determination more accurate. The event signals generated by the aforementioned event sensors may also be affected by different fields of view. For example, if button portion images BP_1, BP_2, BP_3, and BP_4 are detected, the corresponding event signals may have constant values ​​because buttons B_1-B_4 do not move, and therefore do not cause a change in brightness (i.e., no event change).

[0030] As mentioned above, the trigger time for pressing the key can be advanced based on the direction of finger movement F. Figure 5 A schematic diagram illustrating an embodiment of the present invention, showing that the triggering time of a button is advanced. Figure 5 In this context, time T_D represents the time when a key press is detected. Furthermore, time T_O represents the original trigger time of the key. More specifically, time T_O represents the time when the key actually receives the trigger action (e.g., is pressed). In other words, time T_O represents the trigger time of a traditional key. Figure 5 In this process, based on the detected direction of finger F movement, time T_O is advanced to time T_A, as described in the above embodiment. Time T_A is not earlier than time T_D because the advancement of time T_O depends on the event occurring at time T_D.

[0031] according to Figure 5 In the illustrated embodiment, the operation of the joystick 100 can be described as follows: The joystick includes multiple buttons, a first optical sensor, and processing circuitry. The buttons include a first button (e.g., B_1) and a second button (e.g., B_2), which provide control signals to the user input device when triggered. The first optical sensor (e.g., OS_1) is located next to the first and second buttons and is used to detect first optical data. The processing circuitry (e.g., 101) is used to determine, based on the first optical data, which button a finger should move from the first button to, for example, determining which of buttons B_2, B_3, and B_4 finger F should move from button B_1 to. If it is determined that the finger should move to the second button, the triggering time of the second button is advanced, such as... Figure 5 As illustrated in the embodiment, the trigger time of the second button is advanced to a first time (e.g., time T_A), which is no earlier than the second time (e.g., time T_D) when the processing circuit determines that the finger will move to the second button.

[0032] In one embodiment, the processing circuit 101 determines the trigger state based on the brightness change of consecutive images sensed by the first optical sensor, where the trigger state represents which button is to be triggered. Figure 6 , Figure 7A and Figure 7B illustrates a schematic diagram according to an embodiment of the present invention, where the button is to be triggered and the object is leaving the button. Also note that, for the sake of convenience of explanation, Figure 6 only some elements of the rocker 100 in FIG. 1 are shown in the embodiment of

[0033] In Figure 6 the illustrated embodiment, the light source LS_1 can emit light towards the finger F, so that the first optical sensor OS_1 can receive the reflected light from the finger F. In Figure 6 the upper diagram of Figure 6 , the finger F is far from the first optical sensor OS_1, the light source LS_1, and the buttons B_2, B_3. Therefore, the first optical sensor OS_1 receives less or no reflected light from the finger F. Thus, in this case, the brightness of the finger image FI in the corresponding sensed image SI is low, which is represented by a slant line. On the contrary, in

[0034] the lower diagram of Figure 6 , the finger F is close to the first optical sensor OS_1, the light source LS_1, and the buttons B_2, B_3. Therefore, the first optical sensor OS_1 receives more reflected light from the finger F. In this case, the brightness of the finger image FI in the corresponding sensed image SI is high, which is represented by a blank.

[0034] The trigger state of the finger F can be judged according to the Figure 6 rules shown in Figure 7A In the upper diagram of Figure 7A , the trigger state represents which button is being triggered, that is, the finger F is approaching the button. The processing circuit 101 determines the trigger state based on the brightness change or event signal of consecutive images detected by the first optical sensor OS_1. More specifically, if Figure 7A the finger F in Figure 7A is approaching the button, the finger image FI will become larger, and the reflected light received by the first optical sensor OS_1 from the finger F will also increase. Therefore, in the upper diagram of Figure 7A , the size order of the finger images FI_1, FI_2, and FI_3 is FI_1 < FI_2 < FI_3, and the brightness order of the finger images FI_1, FI_2, and FI_3 is FI_1 < FI_2 < FI_3.

[0035] In Figure 7A the lower diagram of Figure 7AIf finger F is leaving the key, the finger image FI will shrink, and the reflected light received by the first optical sensor OS_1 from finger F will decrease. Therefore, in Figure 7A In the image below, the size order of finger images FI_1', FI_2', and FI_3' is FI_1'>FI_2'>FI_3', and the brightness order of finger images FI_1'>FI_2'>FI_3' is FI_1'>FI_2'>FI_3'.

[0036] Please note, Figure 7A The term "continuous image" mentioned in the embodiments can refer to directly continuous images or indirectly continuous images. For example, if the first optical sensor senses N sensed images, then Figure 7A The sensed images SI_1, SI_2, and SI_3 can represent images (N-2), (N-1), and N, respectively, or images (N-4), (N-2), and N. In other words, in one embodiment, no sensed images are generated between sensed images SI_1, SI_2, and SI_3. In another embodiment, at least one sensed image can exist between sensed images SI_1, SI_2, and SI_3. This rule also applies. Figure 7A The sensed images SI_1', SI_2', and SI_3' in the image.

[0037] exist Figure 6 and Figure 7A In this embodiment, the position of finger F can also be obtained based on changes in brightness. Therefore, the position of finger F can be used to determine the key to be triggered or the key from which finger F leaves. Furthermore, a sensing image excluding the key image can also be used to achieve this. Figure 6 and Figure 7A The illustrated embodiments, for example Figure 4 The sensor image SI_1 is shown. Additionally, sensor images including at least a portion of the button images can also be used to implement this. Figure 6 and Figure 7A The illustrated embodiments, for example Figure 4 The sensor image SI_2 is shown.

[0038] exist Figure 7A In this embodiment, the first optical sensor OS_1 is an image sensor. However, in Figure 7B In this embodiment, the first optical sensor OS_1 is the aforementioned event sensor. As described above, the event signal corresponds to an event change, such as a change in the brightness of a pixel image. Therefore, in Figure 7B In this embodiment, if the brightness change exceeds the threshold, the event signal can be assumed to be 1; if the brightness change is below the threshold, the event signal can be assumed to be 0.

[0039] In addition, Figure 7BIn the embodiment, the image pixels with the symbol x in the finger images FI_1a and FI_2a of the sensed images SI_1a and SI_2a represent image pixels corresponding to event signal 1. In other words, the image pixels with the symbol x in the finger images FI_1a and FI_2a represent image pixels whose brightness changes exceed a threshold.

[0040] exist Figure 7B In the image above, the finger is closer to the light source LS_1 and the first optical sensor OS_1. Therefore, in this state, light is concentrated in a specific area of ​​the finger (e.g., the central area). Consequently, when the finger moves in this state, the distribution of image pixels with large brightness changes will also be more concentrated. Figure 7B In the image below, the finger is relatively far from the light source LS_1 and the first optical sensor OS_1. In this state, light illuminates a more dispersed area on the finger. Therefore, when the finger moves in this state, the distribution of pixels with large brightness changes in the image will become even more dispersed. Thus, according to Figure 7B The example shown can determine the distance between a finger and a key based on the distribution of regions with event signal 1 in the finger image. Therefore, the proximity or retraction of the finger can be determined based on the distance determined by the event signal. However, Figure 7B This is merely an illustrative example and is not intended to limit the event signal distribution of the present invention.

[0041] In the above embodiment, only one optical sensor (the first optical sensor) is used to determine the movement of finger F. However, multiple optical sensors can also be used to determine the movement of finger F. Figure 8 A schematic diagram of a joystick according to another embodiment of the present invention is shown. Figure 8 As shown, the joystick 800 includes a button B_S, a first optical sensor OS_1, and a second optical sensor OS_2. The first optical sensor OS_1 and the second optical sensor OS_2 are located next to different positions of the button B_S. In this case, the aforementioned trigger state indicates the direction from which the finger F triggers the button.

[0042] For example, if finger F moves from position P_1 to P_2, the sensor image from the first optical sensor OS_1 can be used to determine that button B_S was triggered from the upper left to the lower right. Conversely, if finger F moves from position P_3 to P_4, the sensor image from the second optical sensor OS_2 can be used to determine that button B_S was triggered from the lower right to the upper left. Figure 1 The illustrated embodiments and Figure 8 The embodiments shown can be used individually or in combination. This expands the application range of the joystick.

[0043] According to the above embodiments, key triggering can be detected more quickly, which helps to determine the combination or triggering of two or more keys, thereby expanding the application range of the user input device.

[0044] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A user input device, characterized in that, include: When a button is triggered, it provides a control signal to the user's input device. A first optical sensor, located next to the button, is used to sense first optical data: and The processing circuit is used to determine the direction of movement of the object based on the first optical data, and to determine the trigger state of the button based on the direction of movement.

2. The user input device as claimed in claim 1, characterized in that, No optical sensor is located on any of these buttons.

3. The user input device as claimed in claim 1, characterized in that, There are multiple buttons, and the trigger state is the triggering order of the buttons.

4. The user input device as claimed in claim 3, characterized in that, The button forms a polygon, and the first optical sensor is located in the middle part of the polygon.

5. The user input device as claimed in claim 4, characterized in that, Further includes: The light source is located in the middle section.

6. The user input device as claimed in claim 1, characterized in that, The device further includes a second optical sensor and is a single button. The first and second optical sensors are located next to different parts of the single button, and the trigger state indicates the direction from which the object triggers the single button.

7. The user input device as claimed in claim 1, characterized in that, The first optical sensor is an image sensor, and the first optical data includes an image of a portion of each of the buttons.

8. The user input device as claimed in claim 7, characterized in that, The trigger state indicates which of the buttons is triggered, and the processing circuit determines the trigger state based on the brightness changes of the continuous image sensed by the first optical sensor.

9. The user input device as claimed in claim 1, characterized in that, The first optical sensor is an event sensor, wherein the trigger state represents which of the buttons the object is moving away from. The processing circuit determines the trigger state based on the distribution of regions in the finger image sensed by the first optical sensor, and each region corresponds to an event signal with a specific value.

10. A user input device, characterized in that, include: Multiple buttons, including a first button and a second button, provide control signals to the user input device when triggered; A first optical sensor, located next to the first button and the second button, is used to sense first optical data: and The processing circuit is used to determine, based on the first optical data, which of the buttons the object moves from the first button to. If it is determined that the object moves to the second button, the triggering time of the second button is advanced.

11. The user input device as claimed in claim 10, characterized in that, The trigger time of the second button is advanced to a first time, which is no earlier than a second time. The processing circuit determines at the second time that the object will move to the second button.

12. The user input device as claimed in claim 10, characterized in that, No optical sensor is located on any of these buttons.

13. The user input device as claimed in claim 10, characterized in that, There are multiple buttons that form a polygon, and the first optical sensor is located in the middle part of the polygon.

14. The user input device as claimed in claim 13, characterized in that, Further includes: The light source is located in the middle section.

15. The user input device as claimed in claim 10, characterized in that, The button is a single button, and the first optical sensor and the second optical sensor are located next to different parts of the single button, wherein the trigger state indicates the direction from which the object triggers the single button.

16. The user input device as claimed in claim 10, characterized in that, The first optical sensor is an image sensor, and the first optical data includes an image of a portion of each of the buttons.

17. The user input device as claimed in claim 16, characterized in that, The processing circuit determines the trigger state based on the brightness changes of the continuous image sensed by the first optical sensor, and the trigger state indicates which of the buttons is triggered.

18. The user input device as claimed in claim 10, characterized in that, The first optical sensor is an event sensor. The processing circuit determines the trigger state based on the distribution of regions in the finger image sensed by the first optical sensor. Each region corresponds to an event signal with a specific value, where the trigger state indicates which of the buttons the object is moving away from.

19. A user input device, characterized in that, include: Multiple buttons, including a first button, a second button, and a third button, provide control signals to the user input device when pressed; A first optical sensor, surrounded by the first button, the second button, and the third button, is used to sense first optical data: and The processing circuit is used to determine a control signal based on the first optical signal. The control signal represents the arrangement of key actions. The key actions include virtual trigger actions corresponding to at least two of the first key, the second key, and the third key being pressed. The key actions allow the virtual trigger actions to be repeated for one of the multiple keys, and the key actions do not require the actual physical pressing of any of the multiple keys.

Images