Virtual keyboard calibration method, device, electronic device and medium
The calibration method for virtual keyboards in virtual reality systems addresses misalignment issues by using sensing data and image recognition to align virtual keys with physical keys, improving input accuracy and efficiency.
Patent Information
- Application Number
- CN202210578609.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-25
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2042-05-25
AI Technical Summary
Existing virtual keyboard technologies lack calibration processes, leading to misoperation, low accuracy, and inefficiency in virtual keyboard input, adversely affecting user experience in virtual reality environments.
A method and device for calibrating virtual keyboards by acquiring sensing data from user interactions, determining corresponding virtual keys, and adjusting the virtual keyboard based on consistency with target keys, utilizing built-in touch sensors and image recognition to refine key mappings.
Improves the accuracy and efficiency of virtual keyboard input by ensuring precise alignment of virtual keys with physical keys, enhancing user experience without requiring new hardware or altering existing interaction methods.
Smart Images

Figure CN115113795B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of virtual reality technology, and in particular to a virtual keyboard calibration method, device, electronic device and medium. Background Art
[0002] With the development of science and technology, the metaverse is an important direction for the future, and virtual reality (VR) office is an important scene in the metaverse. Users can present multiple virtual display screens through virtual interaction, simulating multiple screen displays in a real physical environment, and the most commonly used interactive device with virtual screens is a virtual keyboard. However, the existing technology does not involve the calibration process of the virtual keyboard, which is prone to misoperation, resulting in low accuracy and efficiency of virtual keyboard input, affecting the user experience. Summary of the invention
[0003] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a virtual keyboard calibration method, device, electronic device and medium, which can calibrate the virtual keyboard, thereby facilitating improving the accuracy and efficiency of virtual keyboard input and improving the user experience.
[0004] In order to achieve the above objectives, the technical solutions provided by the embodiments of the present disclosure are as follows:
[0005] In a first aspect, the present disclosure provides a virtual keyboard calibration method, the method comprising:
[0006] In response to a first trigger operation of a user on a target key of a target keyboard, acquiring first sensing data;
[0007] Based on the correspondence between the first sensing data and the virtual keys in the virtual keyboard, obtaining the virtual keys corresponding to the first sensing data, wherein the virtual keyboard is displayed in a display interface of the virtual reality head mounted display device worn by the user;
[0008] In response to a second trigger operation of the user on the target key of the target keyboard, determining the target key;
[0009] The virtual keyboard is calibrated based on whether the virtual key is consistent with the target key.
[0010] As an optional implementation of the embodiment of the present disclosure, the calibrating the virtual keyboard based on whether the virtual key is consistent with the target key includes:
[0011] If the virtual key is inconsistent with the target key, obtaining second sensing data corresponding to the second trigger operation;
[0012] The virtual keyboard is calibrated according to the second sensing data and the target key until the virtual key is consistent with the target key.
[0013] As an optional implementation of the embodiment of the present disclosure, the calibrating the virtual keyboard based on whether the virtual key is consistent with the target key includes:
[0014] If the virtual key is inconsistent with the target key, in response to a second trigger operation of the user on a preset key in the target keyboard, obtaining third sensing data;
[0015] The virtual keyboard is calibrated according to the third sensing data and the virtual keys corresponding to the third sensing data in the virtual keyboard.
[0016] As an optional implementation of the embodiment of the present disclosure, the virtual keyboard is obtained by:
[0017] Acquire a target image corresponding to the target keyboard;
[0018] Modeling the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard;
[0019] Performing character recognition on the keys contained in the target image to determine the character information corresponding to each key;
[0020] The character information is displayed on a corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
[0021] As an optional implementation of the embodiment of the present disclosure, modeling the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard includes:
[0022] Performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys;
[0023] Graphic modeling is performed based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
[0024] As an optional implementation of the embodiment of the present disclosure, the method further includes:
[0025] Determine the character prompt information corresponding to each key based on the input method type used by the user;
[0026] The character prompt information is displayed on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
[0027] As an optional implementation of the embodiment of the present disclosure, the target keyboard is covered with a keyboard soft film with a built-in touch sensor;
[0028] The step of acquiring first sensing data in response to a first triggering operation of a target key of a target keyboard by a user includes:
[0029] In response to a first triggering operation of a target key of a target keyboard by a user, first sensing data is acquired through a keyboard soft membrane with a built-in touch sensor.
[0030] In a second aspect, the present disclosure provides a virtual keyboard calibration device, the device comprising:
[0031] A first acquisition module, configured to acquire first sensing data in response to a first trigger operation of a user on a target key of a target keyboard;
[0032] a second acquisition module, configured to acquire virtual keys corresponding to the first sensing data based on a correspondence between the first sensing data and virtual keys in a virtual keyboard, wherein the virtual keyboard is displayed in a display interface of a virtual reality head mounted display device worn by the user;
[0033] a key determination module, configured to determine the target key in response to the user's second triggering operation on the target key of the target keyboard;
[0034] The calibration module is used to calibrate the virtual keyboard based on whether the virtual key is consistent with the target key.
[0035] As an optional implementation of the embodiment of the present disclosure, the calibration module is specifically used to:
[0036] If the virtual key is inconsistent with the target key, obtaining second sensing data corresponding to the second trigger operation;
[0037] The virtual keyboard is calibrated according to the second sensing data and the target key until the virtual key is consistent with the target key.
[0038] As an optional implementation of the embodiment of the present disclosure, the calibration module is further specifically used for:
[0039] If the virtual key is inconsistent with the target key, in response to a second trigger operation of the user on a preset key in the target keyboard, obtaining third sensing data;
[0040] The virtual keyboard is calibrated according to the third sensing data and the virtual keys corresponding to the third sensing data in the virtual keyboard.
[0041] As an optional implementation of the embodiment of the present disclosure, the device further includes: a virtual keyboard determination module;
[0042] The virtual keyboard determination module includes:
[0043] An image acquisition unit, used to acquire a target image corresponding to the target keyboard;
[0044] A display model determination unit, configured to model the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard;
[0045] A character information determination unit, used to perform character recognition on the keys contained in the target image, and determine the character information corresponding to each key;
[0046] The virtual keyboard determining unit is used to display the character information on the corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
[0047] As an optional implementation of the embodiment of the present disclosure, the display model determination unit is specifically used to:
[0048] Performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys;
[0049] Graphic modeling is performed based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
[0050] As an optional implementation of the embodiment of the present disclosure, the virtual keyboard determination module further includes:
[0051] A prompt information determining unit, used to determine the character prompt information corresponding to each key based on the input method type used by the user;
[0052] The virtual keyboard determination unit is specifically used to: display the character prompt information on the corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
[0053] As an optional implementation of the embodiment of the present disclosure, the target keyboard is covered with a keyboard soft film with a built-in touch sensor;
[0054] The first acquisition module is specifically used to: in response to a first trigger operation of a user on a target key of a target keyboard, acquire first sensing data through a keyboard soft membrane with a built-in touch sensor.
[0055] In a third aspect, the present disclosure further provides an electronic device, including:
[0056] one or more processors;
[0057] a storage device for storing one or more programs,
[0058] When the one or more programs are executed by the one or more processors, the one or more processors implement any one of the virtual keyboard calibration methods described in the embodiments of the present disclosure.
[0059] In a fourth aspect, the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any one of the virtual keyboard calibration methods described in the embodiments of the present disclosure.
[0060] Compared with the prior art, the technical solution provided by the embodiment of the present disclosure has the following advantages: first, in response to a first trigger operation of a user on a target key of a target keyboard, first sensing data is obtained, and then based on the correspondence between the first sensing data and a virtual key in a virtual keyboard, a virtual key corresponding to the first sensing data is obtained, wherein the virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user, and then in response to a second trigger operation of the user on a target key of the target keyboard, the target key is determined, and finally, based on whether the virtual key is consistent with the target key, the virtual keyboard is calibrated. The above method can calibrate the virtual keyboard, which is beneficial to improving the accuracy and efficiency of virtual keyboard input and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0062] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0063] Figure 1A A hardware configuration block diagram of an electronic device according to one or more embodiments of the present disclosure;
[0064] Figure 1BA schematic diagram of software configuration of an electronic device according to one or more embodiments of the present disclosure;
[0065] Figure 2A A flowchart of a virtual keyboard calibration method provided by an embodiment of the present disclosure;
[0066] Figure 2B A schematic diagram of the principle of a virtual keyboard calibration method provided by an embodiment of the present disclosure;
[0067] Figure 3A A schematic diagram of a flow chart of another virtual keyboard calibration method provided by an embodiment of the present disclosure;
[0068] Figure 3B A schematic diagram of another virtual keyboard calibration method provided by an embodiment of the present disclosure;
[0069] Figure 4A A flowchart of another virtual keyboard calibration method provided by an embodiment of the present disclosure;
[0070] Figure 4B A schematic diagram of the principle of another virtual keyboard calibration method provided by an embodiment of the present disclosure;
[0071] Figure 5A A flowchart of a method for determining a virtual keyboard provided by an embodiment of the present disclosure;
[0072] Figure 5B A schematic diagram of the principle of a virtual keyboard determination method provided by an embodiment of the present disclosure;
[0073] Figure 5C A schematic diagram of a virtual keyboard display model provided by an embodiment of the present disclosure;
[0074] Figure 5D A schematic diagram of a virtual keyboard provided in an embodiment of the present disclosure;
[0075] Fig. 6A A schematic diagram of a principle for obtaining a virtual keyboard display model provided by an embodiment of the present disclosure;
[0076] Figure 6B Another schematic diagram of the principle of obtaining a virtual keyboard display model provided by an embodiment of the present disclosure;
[0077] Fig. 7A A schematic diagram of a principle for obtaining a virtual keyboard corresponding to an input method type provided by an embodiment of the present disclosure;
[0078] Figure 7B A schematic diagram of character prompt information based on the Wubi input method provided in an embodiment of the present disclosure;
[0079] Figure 7CA schematic diagram of a virtual keyboard based on a foreign language input method provided in an embodiment of the present disclosure;
[0080] Figure 8 is a structural schematic diagram of a virtual keyboard calibration device provided by an embodiment of the present disclosure;
[0081] Fig. 9 It is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION
[0082] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0083] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0084] The terms "first" and "second" in the present disclosure are used to distinguish different objects rather than to describe a specific order of objects. For example, first sensing data and second sensing data are used to distinguish different sensing data rather than to describe a specific order of sensing data.
[0085] With the continuous development of science and technology and the diversification of market demand, head-mounted display devices such as virtual reality devices are becoming more and more common and are used in many fields, such as computer games, office, health and safety, industry, and education and training. For example, mixed virtual reality systems are being integrated into mobile communication devices, game consoles, personal computers, cinemas, theme parks, laboratories, classrooms, and hospital exercise and fitness rooms.
[0086] Taking VR head-mounted display devices as an example, by simulating the position of the user's eyes and fixing two color or black-and-white video cameras on the VR head-mounted display device according to the position of the human eyes, the external real physical three-dimensional environment can be captured in real time. The images captured by the two color or black-and-white video cameras are then processed in real time through the computer's stereoscopic vision and image rendering technology, and finally presented to the user through the VR head-mounted display device. The user can view the external real physical three-dimensional environment in real time through the VR head-mounted display device. This function is called the perspective function of virtual reality.
[0087] A typical application scenario of the perspective function of virtual reality is virtual office. Users have a lot of keyboard input needs when using VR for office work. If you use a physical keyboard directly for input, the error rate of keyboard input may be high because the user cannot see the position of the physical keyboard clearly when wearing a VR head-mounted display device. Even if some keys on some physical keyboards have convex points to assist in positioning, which makes it easy to input English letters, the remaining keys on the physical keyboard, including auxiliary keys such as 0-9 numbers, punctuation marks, delete, and back, are still not easy to input; if you use a VR device with gesture recognition function, although the VR device can capture the position of both hands, it cannot capture the position of the keyboard, and the user's fingers may block the camera field of view of the VR device, and it is impossible to determine the keyboard keys under fingers other than the thumb and index finger.
[0088] Currently, there are several ways to solve keyboard input in VR:
[0089] 1. Enable the perspective window mode for the keyboard position in the VR virtual space so that you can see the physical keyboard and the position of the user's hands captured by the camera from the window.
[0090] 2. Customize a special keyboard, such as adding markers to the four corners of the keyboard, and rebuild a virtual keyboard in real time in the virtual space that corresponds to the key layout and real-time position of the physical keyboard, and then combine it with gesture recognition technology to facilitate input.
[0091] However, in the first method, the camera of the VR device is required to clearly identify the outline of the physical keyboard, and collect and display it in high definition. This solution has high requirements on the resolution of the camera, which is difficult to meet with the cameras built into current VR devices. In the second method, a special keyboard with high cost needs to be customized, which is not easy to popularize. In addition, the camera cannot collect the key positions blocked by the user's fingers, and it is still easy to make mistakes.
[0092] In view of the problem that the keyboard input process in the above VR is prone to errors, the virtual keyboard can solve this problem well. In this embodiment, when the user uses the target keyboard to operate, the virtual keyboard is displayed in the display interface of the VR head-mounted display device worn by the user. First, the operating system of the VR head-mounted display device can respond to the user's touch operation on the target key of the target keyboard (the touch operation can be understood as the contact operation on the target key, but the target key is not pressed), obtain the first sensing data, and obtain the virtual key corresponding to the first sensing data based on the correspondence between the first sensing data and the virtual key; then the operating system responds to the user's key input operation on the target key of the target keyboard (the key input operation can be understood as pressing the target key) to determine the target key; finally, the operating system can calibrate the virtual keyboard based on whether the virtual key is consistent with the target key. The above method can not only calibrate the virtual keyboard, but also help improve the accuracy and efficiency of the virtual keyboard input, and there is no need to introduce a new keyboard and change the existing keyboard interaction method, which can improve the user experience.
[0093] The virtual keyboard calibration method provided by the embodiments of the present disclosure may be implemented based on an electronic device, or a functional module or functional entity in the electronic device.
[0094] The electronic device may include a personal computer (PC) and a physical keyboard, a laptop computer and a physical keyboard, etc., which is not specifically limited in the embodiments of the present disclosure.
[0095] For example, Figure 1A FIG. 1 is a hardware configuration block diagram of an electronic device according to one or more embodiments of the present disclosure. Figure 1AAs shown, the electronic device includes: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and at least one of a user interface 280. Among them, the controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner 210 receives broadcast television signals by wired or wireless reception, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as and EPG audio and video data signals. The communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example: the communicator can include other network communication protocol chips or near field communication protocol chips such as Wifi modules, Bluetooth modules, wired Ethernet modules, and at least one of infrared receivers. The electronic device can establish the transmission and reception of control signals and data signals with the server 203 or the local control device 205 through the communicator 220. The detector 230 is used to collect signals of the external environment or the external interaction. The controller 250 and the tuner-demodulator 210 can be located in different split devices, that is, the tuner-demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 can be used to receive control signals of a control device (such as an infrared remote controller, etc.).
[0096] In some embodiments, the controller 250 controls the operation of the electronic device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the electronic device. The user can input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
[0097] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, and control displayed on the display screen of an electronic device, where the control can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.
[0098] Figure 1B FIG. 1 is a schematic diagram of software configuration of an electronic device according to one or more embodiments of the present disclosure, such as Figure 1B As shown in the figure, the system is divided into four layers, from top to bottom, namely the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
[0099] In some embodiments, at least one application is running in the application layer, and these applications may be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the applications in the application layer include but are not limited to the above examples.
[0100] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
[0101] In some embodiments, the kernel layer is a layer between hardware and software, and includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0102] The virtual keyboard calibration method provided in the embodiment of the present application can be implemented based on the above electronic device.
[0103] The virtual keyboard calibration process provided by the embodiment of the present disclosure first obtains first sensing data in response to a first trigger operation of a user on a target key of a target keyboard, and then obtains a virtual key corresponding to the first sensing data based on the correspondence between the first sensing data and a virtual key in the virtual keyboard, wherein the virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user, and then determines the target key in response to a second trigger operation of the user on the target key of the target keyboard, and finally calibrates the virtual keyboard based on whether the virtual key is consistent with the target key. The above method can calibrate the virtual keyboard, which is beneficial to improving the accuracy and efficiency of virtual keyboard input and improving the user experience.
[0104] In order to explain this scheme in more detail, the following will be combined in an exemplary manner Figure 2A To explain, it is understandable that Figure 2A The steps involved may include more steps or fewer steps in actual implementation, and the order of these steps may also be different, so as to implement the virtual keyboard calibration method provided in the embodiment of the present application.
[0105] Figure 2A A flowchart of a virtual keyboard calibration method provided by an embodiment of the present disclosure is shown in FIG. Figure 2B A schematic diagram of the principle of a virtual keyboard calibration method provided in an embodiment of the present disclosure. This embodiment can be applied to calibrate a virtual keyboard to facilitate user key input. The method of this embodiment can be executed by a virtual keyboard calibration device, which can be implemented in hardware and / or software and can be configured in an electronic device.
[0106] like Figure 2A As shown, the method specifically comprises the following steps:
[0107] S210, acquiring first sensing data in response to a first triggering operation of a target key of a target keyboard by a user.
[0108] Among them, the target keyboard can be understood as a physical keyboard that matches a device such as a personal computer or laptop used by the user. The first trigger operation can be understood as a contact operation on the target key, but the target key is not pressed, such as a finger touch operation. The target key can be understood as any key in the target keyboard, and this embodiment does not make specific limitations on this. The first sensing data can be understood as the coordinate position data obtained according to the first trigger operation, and the coordinate position data can be obtained based on the touch sensor built into the target key, and can also be obtained by other means, and this embodiment does not make specific limitations on this.
[0109] When the target key of the target keyboard receives the user's first trigger operation, the first sensing data corresponding to the first trigger operation can be obtained based on the touch sensor built into the target key. Correspondingly, the operating system of the VR head-mounted display device responds to the first operation and obtains the first sensing data by receiving the first sensing data sent by the target keyboard.
[0110] S220: Acquire a virtual key corresponding to the first sensing data based on a correspondence between the first sensing data and a virtual key in the virtual keyboard.
[0111] The virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user.
[0112] After obtaining the first sensing data, the operating system of the VR head-mounted display device queries the coordinate position data table corresponding to each virtual key in the virtual keyboard stored in the operating system, and compares the first sensing data with the coordinate position data table. It can determine the correspondence between the first sensing data and the virtual key, that is, which virtual key's coordinate position data corresponds to the first sensing data, thereby obtaining the virtual key in the virtual keyboard corresponding to the first sensing data.
[0113] In some embodiments, after acquiring the virtual key corresponding to the first sensing data, the method may further specifically include: displaying the virtual key in the virtual keyboard in a first display mode.
[0114] The first display mode may be a first brightness value display, a flashing display, or a display in different colors, etc., which is not specifically limited in this embodiment. The first brightness value may be a preset value, or may be determined according to specific circumstances, which is not specifically limited in this embodiment.
[0115] In this embodiment, by displaying the virtual key in the virtual keyboard in the first display mode, the user can see the specific position of the virtual key corresponding to the first trigger operation in the virtual keyboard, which is conducive to improving the accuracy of keyboard input.
[0116] S230, in response to a second trigger operation of the user on a target key of the target keyboard, determining the target key.
[0117] The second trigger operation may be understood as an operation of pressing a target key, such as a finger key input operation.
[0118] The operating system of the VR head mounted display device responds to the second trigger operation of the user on the target key of the target keyboard, and can determine the target key corresponding to the second trigger operation through the identification information corresponding to the target key sent by the target keyboard. The identification information may include character information, position information, etc. of the target key, which is not specifically limited in this embodiment.
[0119] In some embodiments, after determining the target key, the method may further specifically include: displaying the target virtual key corresponding to the target key in the virtual keyboard in a second display mode.
[0120] The second display mode may be displayed using a second brightness value, or may be displayed using a color different from that in the first display mode, etc., which is not specifically limited in this embodiment. The second brightness value may be a preset value, or may be determined according to specific circumstances, and the second brightness value is different from the first brightness value for distinction, which is not specifically limited in this embodiment.
[0121] In this embodiment, by using the second display mode in the virtual keyboard to display the target virtual key corresponding to the target key, it is convenient to prompt the user and determine whether the target virtual key and the virtual key corresponding to the first sensing data are the same virtual key, which is beneficial to improving the accuracy and efficiency of the keyboard input process.
[0122] S240: Calibrate the virtual keyboard based on whether the virtual key is consistent with the target key.
[0123] After obtaining the virtual key corresponding to the first sensing data and determining the target key, the operating system of the VR head-mounted display device can determine whether the virtual key is consistent with the target key, and thus calibrate the virtual keyboard based on whether the virtual key is consistent with the target key. Specifically, if the virtual key is inconsistent with the target key, it means that there may be an error in the mapping relationship between the virtual keyboard and the target keyboard, resulting in an error in the obtained virtual key. At this time, the virtual keyboard needs to be calibrated; if the virtual key is consistent with the target key, it means that the mapping relationship between the virtual keyboard and the target keyboard is basically accurate. At this time, the virtual keyboard does not need to be calibrated, and the second sensing data corresponding to the second trigger operation can be obtained. According to the second sensing data, the coordinate position data corresponding to the virtual key corresponding to the first sensing data in the coordinate position data table stored in the operating system is continuously corrected, fitted and fine-tuned to ensure the accuracy of the coordinate position data table.
[0124] In this embodiment, first, in response to a first trigger operation of a user on a target key of a target keyboard, first sensing data is obtained, and then based on the correspondence between the first sensing data and a virtual key in the virtual keyboard, a virtual key corresponding to the first sensing data is obtained, wherein the virtual keyboard is displayed in a display interface of a virtual reality head-mounted display device worn by the user, and then in response to a second trigger operation of the user on a target key of the target keyboard, the target key is determined, and finally, based on whether the virtual key is consistent with the target key, the virtual keyboard is calibrated. The above method can calibrate the virtual keyboard, which is beneficial to improving the accuracy and efficiency of virtual keyboard input and improving the user experience.
[0125] In some embodiments, the target keyboard is covered with a keyboard soft membrane with a built-in touch sensor;
[0126] The step of acquiring first sensing data in response to a first triggering operation of a user on a target key of a target keyboard may specifically include:
[0127] In response to a first triggering operation of a target key of a target keyboard by a user, first sensing data is acquired through a keyboard soft membrane with a built-in touch sensor.
[0128] Specifically, when the target keyboard is covered with a soft keyboard membrane with a built-in touch sensor, the soft keyboard membrane can be connected to a personal computer or laptop computer and other devices used by the user via a universal serial bus (USB), so that the sensing data obtained by the touch sensor can be transmitted to the personal computer or laptop computer and other devices, and the VR head-mounted display device is connected to the personal computer or laptop computer and other devices, so the operating system of the VR head-mounted display device can respond to the user's first trigger operation on the target key of the target keyboard, and obtain the first sensing data through the soft keyboard membrane with the built-in touch sensor.
[0129] In this embodiment, the first sensing data is obtained by the above method, which is simple, efficient and inexpensive.
[0130] Figure 3A A flowchart of another virtual keyboard calibration method provided by an embodiment of the present disclosure is provided. Figure 3B A schematic diagram of another virtual keyboard calibration method provided by an embodiment of the present disclosure. This embodiment mainly describes the process of one of the calibration methods for calibrating a virtual keyboard.
[0131] like Figure 3A As shown, the method specifically comprises the following steps:
[0132] S310, acquiring first sensing data in response to a first triggering operation of a target key of a target keyboard by a user.
[0133] S320: Based on the correspondence between the first sensing data and the virtual keys in the virtual keyboard, obtain the virtual keys corresponding to the first sensing data.
[0134] S330, in response to a second triggering operation of the user on a target key of the target keyboard, determining the target key.
[0135] S340: If the virtual key is inconsistent with the target key, obtain second sensing data corresponding to the second trigger operation.
[0136] Specifically, when the user's finger performs the second trigger operation on the target key, the sensing data generated during the finger pressing process may change. Therefore, if the virtual key is inconsistent with the target key, the sensing data at this time can be obtained when the target keyboard receives the second trigger operation, that is, the second sensing data corresponding to the second trigger operation is obtained, so as to facilitate the subsequent calibration of the virtual keyboard according to the second sensing data and the target key.
[0137] S350: Calibrate the virtual keyboard according to the second sensing data and the target key until the virtual key is consistent with the target key.
[0138] After obtaining the second sensing data corresponding to the second trigger operation, since the target key at this time is the accurate value, the virtual keyboard can be calibrated through the second sensing data and the target key, and then return to execute S310-S330 until the virtual key is consistent with the target key, and the calibration process ends.
[0139] Exemplarily, suppose that the user performs a finger touch operation on the "A" key of the target keyboard. Based on the first sensing data corresponding to the finger touch operation, the virtual key obtained is the "S" virtual key. In response to the user's finger key input operation on the "A" key of the target keyboard, the determined target key is the "A" key. At this time, the virtual key is inconsistent with the target key, indicating that an error has occurred in the determined virtual key. By obtaining the second sensing data corresponding to the finger key input operation, since the second sensing data is real-time data for the target key, the virtual keyboard can be calibrated through the second sensing data and the target key, that is, the mapping relationship between the virtual keyboard and the target keyboard is calibrated, mainly by correcting the first sensing data corresponding to the "S" virtual key to the second sensing data corresponding to the "A" virtual key, and then returning to execute S310-S330 until the virtual key is consistent with the target key, and the calibration process ends.
[0140] In this embodiment, if the virtual key is inconsistent with the target key, the second sensing data corresponding to the second trigger operation is obtained, and the virtual keyboard is calibrated according to the second sensing data and the target key until the virtual key is consistent with the target key. This calibration method can automatically correct the mapping relationship between the virtual keyboard and the target keyboard, thereby realizing the self-calibration function.
[0141] Figure 4A A flowchart of another virtual keyboard calibration method provided by an embodiment of the present disclosure is shown. Figure 4B This is a schematic diagram of the principle of another virtual keyboard calibration method provided by an embodiment of the present disclosure. This embodiment mainly describes the process of another calibration method for calibrating a virtual keyboard.
[0142] like Figure 4A As shown, the method specifically comprises the following steps:
[0143] S410, acquiring first sensing data in response to a first triggering operation of a target key of a target keyboard by a user.
[0144] S420: Based on the correspondence between the first sensing data and the virtual keys in the virtual keyboard, obtain the virtual keys corresponding to the first sensing data.
[0145] S430: In response to a second trigger operation of the user on a target key of the target keyboard, determine the target key.
[0146] S440: If the virtual key is inconsistent with the target key, in response to a second trigger operation of the user on a preset key in the target keyboard, obtain third sensing data.
[0147] Among them, the preset keys can be a preset number of keys determined in advance, for example, a key is determined respectively at the four corners of the target keyboard (upper left corner, upper right corner, lower left corner, and lower right corner). It can also depend on the specific situation. This embodiment does not limit the specific position and specific number of the preset keys.
[0148] If the virtual key is inconsistent with the target key, recalibration may be performed, specifically, in response to the user's second triggering operation on a preset key in the target keyboard, obtaining corresponding third sensing data.
[0149] S450: Calibrate the virtual keyboard according to the third sensing data and the virtual keys corresponding to the third sensing data in the virtual keyboard.
[0150] After obtaining the third sensing data, the operating system of the VR head-mounted display device queries the coordinate position data table corresponding to each virtual key in the virtual keyboard stored in the operating system, and compares the third sensing data with the coordinate position data table. It can determine which virtual key's coordinate position data corresponds to the third sensing data, thereby obtaining the virtual key in the virtual keyboard corresponding to the third sensing data. According to the third sensing data and the virtual key in the virtual keyboard corresponding to the third sensing data, the virtual keyboard can be calibrated, that is, the mapping relationship between the virtual keyboard and the target keyboard is determined.
[0151] In this embodiment, if the virtual key is inconsistent with the target key, in response to the user's second trigger operation on a preset key in the target keyboard, third sensing data is obtained, and the virtual keyboard is calibrated according to the third sensing data and the virtual key corresponding to the third sensing data in the virtual keyboard. By returning to the calibration process for calibration, it can be determined whether there is an error in the mapping relationship between the virtual keyboard and the target keyboard, which facilitates locating the cause of the error.
[0152] In some embodiments, the calibration process of the virtual keyboard may include the following steps:
[0153] 1. When the user wears a VR head-mounted display device, the binocular camera on the VR head-mounted display device takes a picture of the target keyboard to obtain a corresponding image. The operating system of the VR head-mounted display device recognizes the image through an image algorithm to determine the coordinate position data corresponding to all keys in the target keyboard;
[0154] 2. When the user takes off the VR head-mounted display device, cover the target keyboard with the keyboard soft membrane with built-in touch sensor, and connect the keyboard soft membrane to the personal computer or laptop corresponding to the target keyboard via USB to start calibration;
[0155] 3. In response to the user's second triggering operation on the preset keys in the target keyboard (for example, pressing the four preset keys "Q", "Z", "P" and "M" in sequence), the third sensing data corresponding to the four preset keys are obtained, and the operating system of the VR head mounted display device maps the four sets of third sensing data with the virtual keys corresponding to the four sets of third sensing data in the virtual keyboard, and establishes a mapping relationship between the virtual keyboard and the target keyboard;
[0156] 4. Complete the calibration.
[0157] It should be noted that: after the mapping relationship between the virtual keyboard and the target keyboard is established, the sensor of the soft membrane part outside the key area of the target keyboard can be turned off to reduce false sensing operations; if the keyboard soft membrane moves, recalibration is required.
[0158] Figure 5A A flowchart of a method for determining a virtual keyboard provided in an embodiment of the present disclosure is provided. Figure 5B A schematic diagram of the principle of a virtual keyboard determination method provided by an embodiment of the present disclosure. This embodiment mainly describes the process of constructing a virtual keyboard.
[0159] like Figure 5A As shown, the method specifically comprises the following steps:
[0160] S510: Acquire a target image corresponding to a target keyboard.
[0161] Specifically, the target keyboard may be photographed by a binocular camera on a VR head mounted display device, thereby obtaining a target image corresponding to the target keyboard.
[0162] S520: Model the keys included in the target image to obtain a virtual keyboard display model corresponding to the target keyboard.
[0163] After the target image is obtained, a virtual keyboard display model corresponding to the target keyboard can be obtained by performing 2D modeling on all keys included in the target image using a corresponding modeling method.
[0164] In some embodiments, since the target image captured by the binocular camera on the VR head-mounted display device is a colorless black and white image, when modeling the keys contained in the target image, the resulting virtual keyboard display model is also displayed without color. However, the color style of the virtual keyboard display model can be adjusted through the keyboard skin, thereby improving the user experience and satisfaction.
[0165] S530, performing character recognition on the keys included in the target image to determine character information corresponding to each key.
[0166] After the target image is obtained, character information corresponding to each key can be determined by performing character recognition on all keys included in the target image using a character recognition algorithm, such as an optical character recognition (OCR) algorithm.
[0167] It should be noted that: in this embodiment, S520 may be executed first and then S530; S530 may be executed first and then S520; S520 and S530 may also be executed at the same time. In this embodiment, the execution order of S520 and S530 is not specifically limited.
[0168] S540: Display the character information on the corresponding key model in the virtual keyboard display model to obtain a virtual keyboard.
[0169] Specifically, after obtaining the virtual keyboard display model corresponding to the target keyboard and the character information corresponding to each key, the character information is superimposed and displayed on the key model corresponding to the character information in the virtual keyboard display model, thereby obtaining the virtual keyboard.
[0170] In this embodiment, a virtual keyboard is obtained through the above method, which is simple, efficient, has no cost burden, and has strong operability.
[0171] For example, Figure 5C A schematic diagram of a virtual keyboard display model provided by an embodiment of the present disclosure, such as Figure 5C As shown: The figure provides a virtual keyboard display model corresponding to some keys in a target keyboard (excluding the first row of keys in the target keyboard, namely the "Esc" key, ..., the "F12" key).
[0172] For example, Figure 5D A schematic diagram of a virtual keyboard provided in an embodiment of the present disclosure, Figure 5C Based on the target keyboard, the character information corresponding to the keys on the target keyboard is displayed on Figure 5C The corresponding key model in the virtual keyboard display model can be obtained Figure 5D The virtual keyboard shown in .
[0173] In some embodiments, modeling the keys included in the target image to obtain a virtual keyboard display model corresponding to the target keyboard may specifically include:
[0174] Performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys;
[0175] Graphic modeling is performed based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
[0176] Specifically, an image detection method is used, such as a brightness gradient, to perform edge detection on the keys contained in the target image, determine the edge of the closed curve as a key, and locate the rectangular area containing all the keys as a keyboard; the key shapes of the keys contained in the target image are identified, and the key shapes can generally be divided into rounded rectangles, circles, and quadrilaterals with one side curved, etc.; all keys are detected and numbered, and the coordinate data of the edge feature points corresponding to each key is obtained, and the second coordinate data of the rectangular area containing all the keys is determined. Among them, for the rounded rectangle keys, the edge feature points can be the four corners; for the circular keys, the edge feature points can be the four tangent points of the top, bottom, left, and right; for the quadrilateral keys with one side curved, the edge feature points can be the four corners and the lower tangent point of the arc. After obtaining the first coordinate data and the second coordinate data, graphic modeling is performed according to the first coordinate data and the second coordinate data, so that the virtual keyboard display model corresponding to the target keyboard can be obtained.
[0177] In this embodiment, the virtual keyboard display model is obtained by the above method, which is simple and fast, does not increase additional costs, and is relatively convenient to operate and use.
[0178] For example, Fig. 6A A schematic diagram of a principle for obtaining a virtual keyboard display model provided by an embodiment of the present disclosure, Fig. 6A The corresponding steps have been described in the above embodiments, and will not be described again here to avoid repetition.
[0179] In some embodiments, performing graphic modeling based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard may specifically include:
[0180] Obtaining a difference between the second coordinate data and each first coordinate data;
[0181] Based on the difference and the distance between adjacent keys, a key model corresponding to each key is drawn in the rectangular area to obtain a virtual keyboard display model corresponding to the target keyboard.
[0182] Specifically, after obtaining the first coordinate data and the second coordinate data, the difference between the second coordinate data and each first coordinate data is obtained, and the position of each key relative to the entire keyboard can be determined based on the difference. At the same time, based on the difference and the spacing between adjacent keys, the key model corresponding to each key is drawn in the rectangular area until all the keys in the target keyboard are drawn, and the virtual keyboard display model corresponding to the preset keyboard can be obtained. Among them, the spacing of the key models in the virtual keyboard display model can refer to the spacing of the corresponding keys in the target keyboard, so that the virtual keyboard display model is more closely matched to the target keyboard.
[0183] In this embodiment, the virtual keyboard display model is obtained by the above method, which can improve the accuracy of the virtual keyboard display model and make the virtual keyboard display model more suitable for the target keyboard.
[0184] For example, Figure 6B Another schematic diagram of the principle of obtaining a virtual keyboard display model provided by an embodiment of the present disclosure, Figure 6B The corresponding steps have been described in the above embodiments, and will not be described again here to avoid repetition.
[0185] In some embodiments, the method may further specifically include:
[0186] Determine the character prompt information corresponding to each key based on the input method type used by the user;
[0187] The character prompt information is displayed on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
[0188] Specifically, when the input method type used by the user is different, the character prompt information corresponding to each key is also different. Based on the input method type used by the user, the character prompt information corresponding to each key in the target keyboard is determined, and the character prompt information is displayed on the key model corresponding to the character prompt information in the virtual keyboard display model, so that a virtual keyboard corresponding to the input method type can be obtained.
[0189] In this embodiment, the virtual keyboard corresponding to the input method type is obtained by the above method, which can further expand the practicality of the virtual keyboard and provide better services for users.
[0190] For example, Fig. 7A A schematic diagram of a principle of obtaining a virtual keyboard corresponding to an input method type provided by an embodiment of the present disclosure, Fig. 7A The corresponding steps have been described in the above embodiments, and will not be described again here to avoid repetition.
[0191] For example, Figure 7B A schematic diagram of character prompt information based on the Wubi input method provided in an embodiment of the present disclosure, Figure 7B The character prompt information corresponding to some keys is shown in the figure.
[0192] For example, Figure 7C A schematic diagram of a virtual keyboard based on a foreign language input method provided in an embodiment of the present disclosure, Figure 7C The virtual keyboard display model corresponding to some keys based on the Japanese input method is shown in FIG.
[0193] Figure 8: is a structural diagram of a virtual keyboard calibration device provided in an embodiment of the present disclosure. The device is configured in an electronic device and can implement the virtual keyboard calibration method described in any embodiment of the present application. The device specifically includes the following:
[0194] A first acquisition module 801 is used to acquire first sensing data in response to a first trigger operation of a user on a target key of a target keyboard;
[0195] A second acquisition module 802 is used to acquire a virtual key corresponding to the first sensing data based on a correspondence between the first sensing data and a virtual key in a virtual keyboard, wherein the virtual keyboard is displayed in a display interface of a virtual reality head mounted display device worn by the user;
[0196] A key determination module 803, configured to determine the target key in response to the user's second triggering operation on the target key of the target keyboard;
[0197] The calibration module 804 is configured to calibrate the virtual keyboard based on whether the virtual key is consistent with the target key.
[0198] As an optional implementation of the embodiment of the present disclosure, the calibration module 804 is specifically used to:
[0199] If the virtual key is inconsistent with the target key, obtaining second sensing data corresponding to the second trigger operation;
[0200] The virtual keyboard is calibrated according to the second sensing data and the target key until the virtual key is consistent with the target key.
[0201] As an optional implementation of the embodiment of the present disclosure, the calibration module 804 is further specifically used for:
[0202] If the virtual key is inconsistent with the target key, in response to a second trigger operation of the user on a preset key in the target keyboard, obtaining third sensing data;
[0203] The virtual keyboard is calibrated according to the third sensing data and the virtual keys corresponding to the third sensing data in the virtual keyboard.
[0204] As an optional implementation of the embodiment of the present disclosure, the device further includes: a virtual keyboard determination module;
[0205] The virtual keyboard determination module includes:
[0206] An image acquisition unit, used to acquire a target image corresponding to the target keyboard;
[0207] A display model determination unit, configured to model the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard;
[0208] A character information determination unit, used to perform character recognition on the keys contained in the target image, and determine the character information corresponding to each key;
[0209] The virtual keyboard determining unit is used to display the character information on the corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
[0210] As an optional implementation of the embodiment of the present disclosure, the display model determination unit is specifically used to:
[0211] Performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys;
[0212] Graphic modeling is performed based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
[0213] As an optional implementation of the embodiment of the present disclosure, the virtual keyboard determination module further includes:
[0214] A prompt information determining unit, used to determine the character prompt information corresponding to each key based on the input method type used by the user;
[0215] The virtual keyboard determination unit is specifically used to: display the character prompt information on the corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
[0216] As an optional implementation of the embodiment of the present disclosure, the target keyboard is covered with a keyboard soft film with a built-in touch sensor;
[0217] The first acquisition module 801 is specifically configured to: in response to a first trigger operation of a user on a target key of a target keyboard, acquire first sensing data through a keyboard soft membrane with a built-in touch sensor.
[0218] The virtual keyboard calibration device provided in the embodiments of the present disclosure can execute the virtual keyboard calibration method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method. To avoid repetition, they will not be described here.
[0219] An embodiment of the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement any one of the virtual keyboard calibration methods described in the embodiments of the present disclosure.
[0220] Fig. 9 Schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Fig. 9 As shown, the electronic device includes a processor 910 and a storage device 920; the number of processors 910 in the electronic device can be one or more. Fig. 9 A processor 910 is taken as an example; the processor 910 and the storage device 920 in the electronic device can be connected via a bus or other means. Fig. 9 The example of connecting through bus is taken in the following.
[0221] The storage device 920, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the virtual keyboard calibration method in the embodiment of the present disclosure. The processor 910 executes various functional applications and data processing of the electronic device by running the software programs, instructions and modules stored in the storage device 920, that is, implements the virtual keyboard calibration method provided in the embodiment of the present disclosure.
[0222] The storage device 920 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal, etc. In addition, the storage device 920 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the storage device 920 may further include a memory remotely arranged relative to the processor 910, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0223] An electronic device provided in this embodiment can be used to execute the virtual keyboard calibration method provided in any of the above embodiments, and has corresponding functions and beneficial effects.
[0224] An embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned virtual keyboard calibration method are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0225] The computer readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0226] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A virtual keyboard calibration method, characterized in that: The method comprises: In response to a first trigger operation of a user on a target key of a target keyboard, acquiring first sensing data, wherein the target keyboard is a physical keyboard; Based on the correspondence between the first sensing data and a virtual key in a virtual keyboard, obtaining a virtual key corresponding to the first sensing data, wherein the virtual keyboard is displayed in a display interface of a virtual reality head mounted display device worn by the user, and the first sensing data indicates that the target key is touched; In response to a second trigger operation of the user on the target key of the target keyboard, determining the target key, wherein the second trigger operation is pressing the target key; When the virtual key is inconsistent with the target key, the virtual keyboard is calibrated.
2. The method according to claim 1, characterized in that: When the virtual key is inconsistent with the target key, calibrating the virtual keyboard includes: When the virtual key is inconsistent with the target key, obtaining second sensing data corresponding to the second trigger operation; The virtual keyboard is calibrated according to the second sensing data and the target key until the virtual key is consistent with the target key.
3. The method according to claim 1, characterized in that When the virtual key is inconsistent with the target key, calibrating the virtual keyboard includes: When the virtual key is inconsistent with the target key, in response to a second trigger operation of the user on a preset key in the target keyboard, acquiring third sensing data; The virtual keyboard is calibrated according to the third sensing data and the virtual keys corresponding to the third sensing data in the virtual keyboard.
4. The method according to claim 1, characterized in that: The virtual keyboard is obtained by: Acquire a target image corresponding to the target keyboard; Modeling the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard; Performing character recognition on the keys contained in the target image to determine the character information corresponding to each key; The character information is displayed on a corresponding key model in the virtual keyboard display model to obtain the virtual keyboard.
5. The method according to claim 4, characterized in that The step of modeling the keys contained in the target image to obtain a virtual keyboard display model corresponding to the target keyboard includes: Performing image detection on the keys contained in the target image to obtain first coordinate data of edge feature points corresponding to each key and second coordinate data of a rectangular area containing all the keys; Graphic modeling is performed based on the first coordinate data and the second coordinate data to obtain a virtual keyboard display model corresponding to the target keyboard.
6. The method according to claim 4, characterized in that Also includes: Determine the character prompt information corresponding to each key based on the input method type used by the user; The character prompt information is displayed on a corresponding key model in the virtual keyboard display model to obtain a virtual keyboard corresponding to the input method type.
7. The method according to any one of claims 1 to 6, characterized in that: The target keyboard is covered with a keyboard soft membrane with a built-in touch sensor; The step of acquiring first sensing data in response to a first triggering operation of a target key of a target keyboard by a user includes: In response to a first triggering operation of a target key of a target keyboard by a user, first sensing data is acquired through a keyboard soft membrane with a built-in touch sensor.
8. A virtual keyboard calibration device, characterized in that: The device comprises: A first acquisition module, configured to acquire first sensing data in response to a first trigger operation of a user on a target key of a target keyboard, wherein the target keyboard is a physical keyboard; a second acquisition module, configured to acquire a virtual key corresponding to the first sensing data based on a correspondence between the first sensing data and a virtual key in a virtual keyboard, wherein the virtual keyboard is displayed in a display interface of a virtual reality head mounted display device worn by the user, and the first sensing data indicates that the target key is touched; a key determination module, configured to determine the target key in response to a second trigger operation of the user on the target key of the target keyboard, wherein the second trigger operation is pressing the target key; The calibration module is used to calibrate the virtual keyboard when the virtual key is inconsistent with the target key.
9. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
