Virtual image display device and input interface setting method thereof
Patent Information
- Application Number
- DE602022017930
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-01-04
- Filing Date
- 2022-07-05
- Publication Date
- 2025-07-23
- Estimated Expiration
- 2042-07-05
AI Technical Summary
Users of virtual image display devices face challenges in accurately performing touch actions on input interfaces due to varying finger lengths and personal usage habits, leading to incorrect touch areas.
A virtual image display device that adjusts touch areas based on user-specific finger positions by analyzing touch actions and generating customized effective touch areas for improved accuracy and comfort.
Enhances user convenience and comfort by providing personalized input interfaces tailored to individual users, ensuring accurate touch operations.
Description
BACKGROUNDTechnical Field
[0001] The disclosure relates to a virtual image display device and a setting method for an input interface thereof, and more particularly, to a virtual image display device and a setting method for an input interface thereof that can set touch areas for individual users.Description of Related Art
[0002] When using a virtual image display device, a user can perform a touch action through an input interface displayed on the handheld electronic device, and use it to operate the virtual image display device. However, while experiencing the virtual reality, the user cannot see the input interface displayed by the handheld electronic device at the same time. In addition, since each user has different finger lengths, palm sizes and personal usage habits, when performing touch actions on the input interface, he or she may often touch an incorrect touch area.
[0003] US 2007 / 0075566 A1 discloses a mobile terminal and controlling method thereof, by which a virtual keypad with high accuracy can be provided to the mobile terminal. The mobile terminal includes a touchscreen displaying a keypad including a plurality of key buttons and a controller, if a touch input to the keypad is detected, determining coordinates of the detected touch input, the controller determining for the determined coordinates the key button having a highest probability among a plurality of the key button currently displayed using a previously cumulated dot history, the controller processing an input to the key button having the highest probability.SUMMARY
[0004] The disclosure provides a virtual image display device and a setting method for an input interface thereof, which may improve the convenience of a user's touch operation.
[0005] A virtual image display device of the present invention is provided as set forth in claim 1.
[0006] A setting method for an input interface of a virtual image display device of the present invention is provided as set forth in claim 5. Preferred embodiments of the present invention may be gathered from the dependent claims.
[0007] Based on the above, in the setting method for the input interface of the virtual image display device of the disclosure, by receiving the positions of the touch actions performed by the user corresponding to different prompt commands in the setting action and analyzing the positions of the touch actions, the effective touch areas suitable for the lengths of the user's fingers are calculated. In this way, the input interface provided by the handheld electronic device may be more suitable for any user, thereby improving the convenience of operation and the comfort in use of the virtual image display device.BRIEF DESCRIPTION OF THE DRAWINGS
[0008] FIG. 1 is a schematic diagram of a virtual image display device according to an embodiment of the disclosure. FIG 2 is a flowchart illustrating a setting method for an input interface of a virtual image display device according to an embodiment of the disclosure. FIGs. 3A to 3D are schematic diagrams illustrating operations of a setting method for an input interface of a virtual image display device according to an embodiment of the disclosure. FIG 4 is a flowchart illustrating a setting method for an input interface of a virtual image display device according to an embodiment of the disclosure. DESCRIPTION OF EMBODIMENTS
[0009] Please refer to FIG 1. FIG 1 is a schematic diagram of a virtual image display device according to an embodiment of the disclosure. In FIG 1, the virtual image display 100 device includes a virtual image display 110 and a handheld electronic device 120. The virtual image display 110 may be a head-mounted display. The handheld electronic device 120 may be a smart mobile phone. The handheld electronic device 120 may display an input interface GUI for the user to perform a touch action on the input interface GUI to operate the virtual image display 110.
[0010] Since the length of each user's finger is different, without watching the display screen of the handheld electronic device 120, the input touch actions performed by the user may not effectively occur in the preset initial touch areas. Therefore, the virtual image display device 100 needs to set the positions of multiple touch areas on the input interface GUI for each user.
[0011] The virtual image display 110 may execute an application to perform a setting action of the input interface GUI displayed by the handheld electronic device 120. In the setting action, the virtual image display 110 may provide multiple prompt commands to the user according to the application, and require the user to perform input touch actions on the input interface GUI displayed on the handheld electronic device 120 according to the prompt commands. The prompt commands may be an image signal and / or a sound signal generated by the virtual image display 110.
[0012] In this embodiment, the input interface GUI displayed by the handheld electronic device 120 has touch areas Z1 to Z4 corresponding to virtual keys BT1 to BT4, respectively. The virtual image display 110 may execute the application to perform the setting action of the input interface GUI. In the setting action, please refer to FIG 2 as well. FIG 2 is a flowchart illustrating a setting method for an input interface of a virtual image display device according to an embodiment of the disclosure. In step S210, the virtual image display 110 may execute the application to provide multiple prompt commands to perform the setting action of the input interface. In step S220, the handheld electronic device 120 is configured to display the input interface, and in the setting action, the virtual image display 110 instructs the user to perform input touch actions on one of the virtual keys BT1 to BT4, and the handheld electronic device 120 receives the input touch actions performed by the user through the input interface corresponding to each of the prompt commands. Correspondingly, the virtual image display 110 may record the positions of the input touch actions corresponding to each of the prompt commands.
[0013] In detail, the user may perform multiple input touch actions on the virtual key BT1 according to a first prompt command provided by the virtual image display 110; may perform multiple input touch actions on the virtual key BT2 according to a second prompt command provided by the virtual image display 110; may perform multiple input touch actions on the virtual key BT3 according to a third prompt command provided by the virtual image display 110; and may perform multiple input touch actions on the virtual key BT4 according to a fourth prompt command provided by the virtual image display 110.
[0014] After multiple prompt commands are issued, in step S230, the virtual image display 110 may analyze the positions of the input touch actions performed by the user on each of the virtual keys BT1 to BT4, and calculate the position distributions of the user's input touch actions corresponding to various prompt commands. The virtual image display 110 may then calculate multiple effective touch areas corresponding to the prompt commands according to the position distributions.
[0015] The virtual image display 110 causes the handheld electronic device 120 to perform the display operation of the input interface GUI according to the updated effective touch areas.
[0016] In addition, the above-mentioned setting action of the input interface may be customized for each user. The virtual image display 110 may store the user's identification information corresponding to the setting result. When the user operates the virtual image display device 100, the user only needs to input the identification information, and the virtual image display 110 may display the input interface GUI suitable for the user's operation on the handheld electronic device 120, which effectively improves the convenience in use.
[0017] Please refer to FIGs. 3A to 3D for the following description. FIGs. 3A to 3D are schematic diagrams illustrating operations of a setting method for an input interface of a virtual image display device according to an embodiment of the disclosure. In FIG 3A, the virtual image display executes the application to cause a handheld electronic device 320 to display an input interface. The input interface may have multiple initial touch areas Z1 to Z4 corresponding to the virtual keys BT1 to BT4, and an initial boundary IBD configured to separate the initial touch areas Z1 to Z4.
[0018] In FIG 3B, the virtual image display provides multiple prompt commands, and instructs the user to perform multiple input touch actions on each of the initial touch areas Z1 to Z4 on the input interface, and generates multiple touch points TC1 to TC4, respectively. The touch points TC1 correspond to the prompt command for inputting touch actions for the virtual key BT1; the touch points TC2 correspond to the prompt command for inputting touch actions for the virtual key BT2; the touch points TC3 correspond to the prompt command for inputting touch actions for the virtual key BT3; the touch points TC4 correspond to the prompt command for inputting touch actions for the virtual key BT4.
[0019] The virtual image display records the positions of the touch points TC1 to TC4, and analyzes the distribution range of the positions of the touch points TC1, the distribution range of the positions of the touch points TC2, the distribution range of the positions of the touch points TC3, and the distribution range of the positions of the touch points TC4.
[0020] Next, in FIG 3C, the virtual image display may generate an updated boundary ABD according to the distribution ranges of the positions of the touch points TC1 to TC4, and regenerate effective touch areas Z1' to Z4' corresponding to the virtual keys BT1 to BT4 through the updated boundary ABD, as shown in FIG 3D.
[0021] In this embodiment, the virtual image display may calculate a first center position of the multiple touch points TC1, a second center position of the multiple touch points TC2, a third center position of the multiple touch points TC3, and a fourth center position of the multiple touch points TC4. Then the updated boundary ABD is calculated according to the first center position to the fourth center position. The newly generated effective touch areas Z1' to Z4' may respectively include the positions where the touch points TC1 to TC4 occur according to the updated boundary ABD.
[0022] Further, in the embodiment of the disclosure, setting the four virtual keys BT1 to BT4 is only an example for illustration. In other embodiments of the disclosure, the input interface on the handheld electronic device may have different numbers of virtual keys and different numbers of touch areas. In addition, the distribution pattern of the touch areas is not limited to the pattern shown in FIG. 3A, and the designer may design the layout of the touch areas according to actual needs, and there is no limitation in this regard.
[0023] Please refer to FIG 4 for the following description. FIG 4 is a flowchart illustrating a setting method for an input interface of a virtual image display device according to an embodiment of the disclosure. In step S410, a head-mounted display as the virtual image display requires the user to touch different virtual keys for a certain number of times through the application. In step S420, the head-mounted display records and calculates the positions of the touch actions. In step S430, the head-mounted display adjusts the initial touch areas of the virtual keys to new effective touch areas, and in step S440, the head-mounted display may store the effective touch areas of the virtual keys for this user, and when the user performs an operation, the stored effective touch areas are provided for the input operation.
[0024] The details of the above steps have been described in detail in the foregoing embodiments, and will not be repeated here.
[0025] To sum up, the virtual image display of the disclosure executes an application to collect multiple touch positions corresponding to each of the virtual keys when individual users perform touch actions on the virtual keys, and generates effective touch areas corresponding to individual users according to the position information of the collected touch actions. In this way, each user may simply touch the virtual keys through the input interface provided by the handheld electronic device when experiencing the virtual reality or augmented reality images, which effectively improves the comfort of use and enhance the user experience.
Claims
1. A virtual image display device (100), comprising: a virtual image display (110) which is configured to execute an application to provide a plurality of prompt commands to perform a setting action of an input interface; and a handheld electronic device (120) which is configured to display the input interface and to receive a plurality of input touch actions corresponding to each of the prompt commands through the input interface in the setting action, wherein the virtual image display (110) is configured to calculate a plurality of effective touch areas (Z1', Z2', Z3', Z4') respectively corresponding to the prompt commands according to a position distribution of the input touch actions corresponding to each of the prompt commands, and to update the input interface displayed by the handheld electronic device (120) according to the effective touch areas (Z1', Z2', Z3', Z4'), wherein the effective touch areas (Z1', Z2', Z3', Z4') correspond to virtual keys (BT1, BT2, BT3, BT4) .
2. The virtual image display device according to claim 1, wherein the virtual image display (110) is configured to execute the application to cause the handheld electronic device (120) to display the input interface, wherein the input interface comprises a plurality of initial touch areas (Z1, Z2, Z3, Z4).
3. The virtual image display device according to claim 2, wherein the virtual image display (110) is configured to execute the application to provide the prompt commands, and each of the prompt commands is configured to prompt a user to perform each of the input touch actions on one of the initial touch areas (Z1, Z2, Z3, Z4).
4. The virtual image display device according to claim 1, wherein the virtual image display (110) is configured to calculate the position distribution of the input touch actions corresponding to each of the prompt commands to set a boundary (ABD) between the effective touch areas (Z1', Z2', Z3', Z4').
5. A setting method for an input interface of a virtual image display device (100), comprising: executing (S210) an application by a virtual image display (110) to provide a plurality of prompt commands to perform a setting action of the input interface; displaying (S220) the input interface by a handheld electronic device (120) and receiving a plurality of input touch actions corresponding to each of the prompt commands through the input interface in the setting action; calculating (S230) a plurality of effective touch areas (Z1', Z2', Z3', Z4') respectively corresponding to the prompt commands according to a position distribution of the input touch actions corresponding to each of the prompt commands; and updating the input interface displayed by the handheld electronic device (120) according to the effective touch areas (Z1', Z2', Z3', Z4') by the virtual image display (110), wherein the effective touch areas (Z1', Z2', Z3', Z4') correspond to virtual keys (BT1, BT2, BT3, BT4).
6. The setting method according to claim 5, wherein displaying the input interface by the handheld electronic device (120) and receiving the input touch actions corresponding to each of the prompt commands through the input interface in the setting action comprises: executing the application by the virtual image display (110) to cause the handheld electronic device (120) to display the input interface, wherein the input interface comprises a plurality of initial touch areas (Z1, Z2, Z3, Z4).
7. The setting method according to claim 6, wherein displaying the input interface by the handheld electronic device (120) and receiving the input touch actions corresponding to each of the prompt commands through the input interface in the setting action further comprises: executing the application by the virtual image display (110) to provide the prompt commands, and prompting a user to perform each of the input touch actions on one of the initial touch areas (Z1, Z2, Z3, Z4) through each of the prompt commands.
8. The setting method according to claim 5, further comprising: calculating a position distribution of the input touch actions corresponding to each of the prompt commands by the virtual image display (110) to set a boundary (ABD) between the effective touch areas (Z1', Z2', Z3', Z4').