Input method keyboard display method, device and terminal equipment

Abstract

The present application discloses an input method keyboard display method, device and terminal device. In the method, in response to a keyboard display instruction, a first input method keyboard is displayed in a keyboard display window of a touch screen. In the displayed first input method keyboard, a first key is displayed at the geometric center of the keyboard display window, keys in a second key set are displayed around the first key, the keys in the second key set have a predetermined relationship with the first key, and the display size of the first key and the keys in the second key set are larger than the display size of other keys. Since some keys are directly enlarged and displayed when the input method keyboard is displayed, it helps to increase the probability of the user touching the target key at one time, thereby improving the input speed and accuracy.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an input method keyboard display method, device and terminal equipment. Background Art

[0002] In the input scenario of a terminal device with a touch screen, the layouts of a touch-type virtual keyboard mainly include a nine-grid keyboard layout and a full keyboard layout.

[0003] Among them, the nine-grid keyboard layout combines letter keys with number keys to reduce the number of keys on the keyboard, thereby increasing the size of a single key, so that users can accurately touch the corresponding key. However, since each key in the nine-grid keyboard layout corresponds to multiple letters, it is not suitable for English input scenarios. Although the full keyboard is suitable for various input scenarios, for portable terminal devices with small touch screens such as smart watches, due to the limited screen size, the size of each key on the keyboard is very small, resulting in low user operation accuracy and input speed, and an unfriendly operation experience. Summary of the invention

[0004] The present application provides an input method keyboard display method, device and terminal device to solve the problem of low user input accuracy and speed due to the small size of keys in a full keyboard limited by the screen size.

[0005] In a first aspect, the present application provides an input method keyboard display method, the method comprising:

[0006] In response to a keyboard display instruction, a first input method keyboard is displayed in the keyboard display window of the touch screen. In the first input method keyboard, a first key is displayed at the geometric center of the keyboard display window, keys in a second key set are displayed around the first key, the keys in the second key set have a predetermined relationship with the first key, and the display size of the first key and the keys in the second key set are larger than the display size of other keys.

[0007] In this way, some keys on the input method keyboard are directly enlarged and displayed when the input method keyboard is displayed. That is, before the user touches the keyboard, the enlarged keys can be used to perform input operations, which helps to increase the probability of the user touching the target key at one time, thereby improving the input speed and accuracy.

[0008] In one implementation, the first button has a first display size, the first part of the buttons of the second button set has a second display size, and the second part of the buttons of the second button set has a third display size, and the first display size, the second display size, and the third display size decrease in sequence according to a predetermined ratio.

[0009] In one implementation, the second display size is the same as the third display size and is smaller than the first display size. In this implementation, the display size of the first button is the largest, and the display sizes of the buttons in the second button set are smaller than the display size of the first button.

[0010] In one implementation, the first display size, the second display size, and the third display size are the same. In this implementation, the first button and the buttons in the second button set are displayed in the same size. In one implementation, the second button set includes buttons adjacent to the first button in a predetermined button matrix, or includes buttons that are pre-associated with the first button, and the predetermined button matrix includes at least all English letter buttons. In addition, the first button may be a preset button.

[0011] In this way, the user can pre-set the first button according to his / her own needs, and can also design different predetermined relationships so that the button that needs to be magnified can be used as a button in the second button set and can be magnified.

[0012] In one implementation, the method also includes: detecting a user operation on a first input method keyboard; if the user operation is consistent with a predetermined operation for adjusting the key layout, determining a third key and a fourth key set based on the user operation, and there is a predetermined relationship between the keys in the fourth key set and the third key; adjusting the key layout of the first input method keyboard based on the third key and the fourth key set, and in the adjusted first input method keyboard, the display size of the third key and the keys in the fourth key set is larger than the display size of other keys, and the keys in the fourth key set are displayed around the third key.

[0013] In this way, when the first input method keyboard is displayed, the user can adjust the keyboard key layout by inputting a predetermined gesture operation, that is, change the keys that are enlarged and displayed on the first input method keyboard. Then, the user can enlarge the target keys on the keyboard through input operations as needed.

[0014] In one implementation, the predetermined operation for adjusting the key layout includes a first predetermined operation and a second predetermined operation, wherein the first predetermined operation is a single-finger sliding operation from any starting contact point to the geometric center of the input method keyboard; the second predetermined operation is a two-finger sliding operation from the first starting contact point along the first direction and from the second starting contact point along the second direction, and the distance between the first starting contact point and the second starting contact point is less than the preset distance.

[0015] In this way, the user can adjust the button layout through a simple two-finger sliding operation or a single-finger sliding operation.

[0016] In one implementation, when the user operation is consistent with the first predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the geometric center of the keyboard display window.

[0017] That is to say, after the user adjusts the key layout, the keys that are enlarged and displayed change from the keys in the first key and the second key set to the keys in the third key and the fourth key set; and the third key is displayed at the geometric center of the keyboard display window, and the keys in the fourth key set surround the third key and are displayed in the central area of ​​the keyboard display window, which is convenient for user operation. When the user operation is consistent with the second predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the original display position, and the original display position refers to the display position of the third key in the first input method keyboard before adjustment. In this case, the third key is still displayed at the original display position, and the keys in the fourth key set are displayed around the third key. Since the display position of the keys remains unchanged, it is conducive to users gradually getting used to and using the input method keyboard with such a layout.

[0018] It can be seen that the button layout can also be adjusted by the user inputting a second predetermined operation to enlarge the third button and the buttons in the fourth button set, but without changing the display position of the third button.

[0019] In one implementation, the keys in the fourth key set are keys whose distances from the third key in the current key layout meet a preset condition. In this way, after selecting the third key, the user can preview other keys to be magnified and displayed from the current key layout, and can select other keys to be magnified and displayed according to the current key layout.

[0020] In one implementation, the method further includes: detecting a user operation on a first input method keyboard; if the user operation is consistent with a fourth predetermined operation, switching the first input method keyboard to a second input method keyboard, in which keys of the same type have the same display size; the fourth predetermined operation is a two-finger sliding operation of sliding from different starting contact points simultaneously toward the center. The key types include English letters, numbers, symbols, emoticons, etc. In this implementation, in the second input method keyboard, at least all English letter keys have the same display size.

[0021] In this way, when the touch screen displays the first input method keyboard, the user can switch the first input method keyboard in the enlarged mode to the second input method keyboard in the normal mode through a predetermined gesture operation.

[0022] In one implementation, the method also includes: detecting a user operation on a second input method keyboard; if the user operation is consistent with a third predetermined operation, switching the second input method keyboard to the first input method keyboard; the third predetermined operation is a two-finger sliding operation from a first starting contact point along a first direction and from a second starting contact point along a second direction, and the distance between the first starting contact point and the second starting contact point is less than a preset distance.

[0023] In this way, when the touch screen displays the second input method keyboard, the user can switch the second input method keyboard in the normal mode to the first input method keyboard in the enlarged mode through a predetermined gesture operation.

[0024] In one implementation, the keyboard display instruction includes: when the input method keyboard is not displayed, an instruction to display the input method keyboard is received; and, when the second input method keyboard is displayed, a keyboard switching instruction generated when a third predetermined operation is received.

[0025] In one implementation, the first key is a preset key or a key determined according to a third predetermined operation, wherein the first key is a key corresponding to the first starting contact point, the second starting contact point, or the midpoint of the line connecting the first starting contact point and the second starting contact point.

[0026] In this way, the user can pre-set the first button according to his or her own needs, or can select the key to be enlarged as the first button by inputting predetermined gesture operations with different trajectories, and can also design different predetermined relationships so that different keys can be used as buttons in the second button set and the fourth button set, so that they can be enlarged and displayed.

[0027] In one implementation, the key positions on the first input method keyboard are fixed, the keys in the first key set and the second key set, or the keys in the third key set and the fourth key set are respectively displayed on predetermined key positions, and the remaining keys are displayed on remaining key positions according to preset rules.

[0028] In this way, no matter how the user adjusts the key layout or how the display positions of the keys change, the global design of the first input method keyboard remains unchanged, thereby ensuring that all keys can be evenly distributed on the input method keyboard.

[0029] In a second aspect, the present application further provides an input method keyboard display device, applied to a terminal device, the device comprising:

[0030] An input method module is used to respond to a keyboard display instruction to display a first input method keyboard in a keyboard display window of a touch screen, in which a first key is displayed at the geometric center of the keyboard display window, keys in a second key set are displayed around the first key, there is a predetermined relationship between the keys in the second key set and the first key, and the display size of the first key and the keys in the second key set are larger than the display size of other keys.

[0031] In this way, some keys on the input method keyboard are directly enlarged and displayed when the input method keyboard is displayed. That is, before the user touches the keyboard, the enlarged keys can be used to perform input operations, which helps to increase the probability of the user touching the target key at one time, thereby improving the input speed and accuracy.

[0032] In one implementation, the first button has a first display size, the first part of the buttons of the second button set has a second display size, and the second part of the buttons of the second button set has a third display size, and the first display size, the second display size, and the third display size decrease in sequence according to a predetermined ratio.

[0033] In one implementation, the second display size is the same as the third display size and is smaller than the first display size.

[0034] In one implementation, the first display size, the second display size, and the third display size are the same.

[0035] In one implementation, the second key set includes keys adjacent to the first key in a predetermined letter key matrix, or includes keys that are pre-associated with the first key.

[0036] In this way, the user can pre-set the first button according to his / her own needs, and can also design different predetermined relationships so that the button that needs to be magnified can be used as a button in the second button set and can be magnified.

[0037] In one implementation, the device further includes:

[0038] a gesture recognition module, configured to detect a user operation on the first input method keyboard; if the user operation is consistent with a predetermined operation for adjusting the key layout, determining a third key and a fourth key set according to the user operation, wherein the keys in the fourth key set have a predetermined relationship with the third key;

[0039] The input method module is also used to adjust the key layout of the first input method keyboard according to the third key and the fourth key set. In the adjusted first input method keyboard, the display size of the keys in the third key and the fourth key set is larger than the display size of other keys, and the keys in the fourth key set are displayed around the third key.

[0040] In this way, when the first input method keyboard is displayed, the user can adjust the keyboard key layout by inputting a predetermined gesture operation, that is, change the keys that are enlarged and displayed on the first input method keyboard. Then, the user can enlarge the target keys on the keyboard through input operations as needed.

[0041] In one implementation, the predetermined operation for adjusting the key layout includes a first predetermined operation and a second predetermined operation, wherein:

[0042] In the case where the user operation is consistent with the first predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the geometric center of the keyboard display window; that is, when the user adjusts the key layout, the keys that are enlarged and displayed are changed from the keys in the first key and the second key set to the keys in the third key and the fourth key set; and the third key is displayed at the geometric center of the keyboard display window, and the keys in the fourth key set surround the third key and are displayed in the central area of ​​the keyboard display window, which is convenient for user operation. In the case where the user operation is consistent with the second predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the original display position, and the original display position refers to the display position of the third key in the first input method keyboard before adjustment. In this case, the third key is still displayed at the original display position, and the keys in the fourth key set are displayed around the third key. Since the display position of the keys remains unchanged, it is conducive to the user gradually getting used to and using the input method keyboard with such a layout. It can be seen that the way to adjust the key layout can also be that the user enters the second predetermined operation to enlarge the third key and the keys in the fourth key set, but does not change the display position of the third key.

[0043] In one implementation, the first predetermined operation is a single-finger sliding operation from any starting contact point to the geometric center of the input method keyboard; the second predetermined operation is a two-finger sliding operation from the first starting contact point along the first direction and from the second starting contact point along the second direction, and the distance between the first starting contact point and the second starting contact point is less than the preset distance.

[0044] In this way, the user can adjust the button layout through a simple two-finger sliding operation or a single-finger sliding operation.

[0045] In one implementation, the keys in the fourth key set are keys whose distances from the third key in the current key layout meet a preset condition.

[0046] In one implementation, the input method module is also used to: if the user operation is consistent with a fourth predetermined operation, switch the first input method keyboard to a second input method keyboard, in which the display size of keys of the same type is the same; the fourth predetermined operation is a two-finger sliding operation that slides simultaneously from different starting contact points toward the center.

[0047] In this way, when the touch screen displays the first input method keyboard, the user can switch the first input method keyboard in the enlarged mode to the second input method keyboard in the normal mode through a predetermined gesture operation.

[0048] In one implementation, the input method module is also used to: switch the second input method keyboard to the first input method keyboard if the user operation is consistent with a third predetermined operation; the third predetermined operation is a two-finger sliding operation from the first starting contact point along the first direction and from the second starting contact point along the second direction, and the distance between the first starting contact point and the second starting contact point is less than the preset distance.

[0049] In this way, when the touch screen displays the second input method keyboard, the user can switch the second input method keyboard in the normal mode to the first input method keyboard in the enlarged mode through a predetermined gesture operation.

[0050] In one implementation, the keyboard display instruction includes: an input method keyboard start instruction received when the input method keyboard is not displayed; and a keyboard switch instruction generated when a third predetermined operation is received when the second input method keyboard is displayed.

[0051] In one implementation, the first button is a preset button or a button determined according to a third predetermined operation.

[0052] In one implementation, the first key is a key corresponding to the first starting contact point, the second starting contact point, or a midpoint of a line connecting the first starting contact point and the second starting contact point.

[0053] In this way, the user can pre-set the first button according to his or her own needs, or can select the key to be enlarged as the first button by inputting predetermined gesture operations with different trajectories, and can also design different predetermined relationships so that different keys can be used as buttons in the second button set and the fourth button set, so that they can be enlarged and displayed.

[0054] In one implementation, the key positions on the first input method keyboard are fixed, the keys in the first key set and the second key set, or the keys in the third key set and the fourth key set are respectively displayed on predetermined key positions, and the remaining keys are displayed on remaining key positions according to preset rules.

[0055] In this way, no matter how the user adjusts the key layout or how the display positions of the keys change, the global design of the first input method keyboard remains unchanged, thereby ensuring that all keys can be evenly distributed on the input method keyboard.

[0056] In a third aspect, the present application also provides a terminal device, comprising a memory and a processor, wherein the memory is coupled to the processor; the memory is used to store computer program code, and the computer program code comprises computer instructions, and when the processor executes the computer instructions, the terminal device executes the input method keyboard display method described in the first aspect.

[0057] As can be seen from the above embodiments, the present application provides an input method keyboard display method, device and terminal device, in which, in response to a keyboard display instruction, a first input method keyboard is displayed in a keyboard display window of a touch screen, in which a first key is displayed at the geometric center of the keyboard display window, a second key is displayed around the first key, the second key has a predetermined relationship with the first key, and the display size of the first key and the second key is larger than the display size of other keys. Since some keys are directly enlarged and displayed when the input method keyboard is displayed, it helps to increase the probability of the user touching the target key at one time, thereby improving the input speed and accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0059] FIG1( a ) is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application;

[0060] FIG1( b ) is a schematic diagram of a software architecture of a terminal device provided in an embodiment of the present application;

[0061] FIG. 1( c ) is a schematic diagram showing the composition of an input method application provided in an embodiment of the present application;

[0062] Figure 2(a) to Figure 2(c) This is a schematic diagram of a user interface of a terminal device exemplarily shown in this application;

[0063] Figure 3 This is a schematic diagram of changes in the user interface of a terminal device exemplarily shown in this application;

[0064] Figure 4 This is a flowchart of an input method keyboard display method exemplified in this application;

[0065] Figure 5This is a schematic diagram of user interface changes and interactions during the input method keyboard display process exemplified in this application;

[0066] Figure 6 This is a schematic diagram of a user interface of a terminal device exemplarily shown in this application;

[0067] Figure 7 This is a schematic diagram of the working process of the terminal device module exemplified in this application;

[0068] Figure 8 This is a flowchart of another input method keyboard display method exemplified in this application;

[0069] Fig. 9 is a schematic diagram of user interface changes and interactions during the input method keyboard switching process exemplified in this application;

[0070] Fig.10 is a schematic diagram of user interface changes and interactions during the input method keyboard switching process exemplified in this application;

[0071] Fig.11 is a schematic diagram of user interface changes and interactions during the input method keyboard switching process exemplified in this application;

[0072] Fig.12 is a schematic diagram of user interface changes and interactions during the input method keyboard switching process exemplified in this application;

[0073] Fig.13 This is a flowchart of another input method keyboard display method exemplified in this application;

[0074] Fig.14 is a schematic diagram of the user interface change, i.e., the interaction process, during the input method keyboard switching process exemplified in the present application;

[0075] FIG15( a) is a schematic diagram of a working process of a terminal device module exemplarily shown in the present application;

[0076] FIG15( b) is another schematic diagram of the working process of the terminal device module exemplarily shown in the present application;

[0077] Fig.16 This is a flowchart of another input method keyboard display method exemplified in this application;

[0078] Fig.17 is a schematic diagram of a user interface change process and an interaction process when adjusting a key layout, exemplarily shown in the present application;

[0079] Fig.18 is a schematic diagram of the user interface change process and interaction process when adjusting the button layout, which is exemplified in the present application;

[0080] Fig.19 A schematic diagram of a working process of a terminal device module exemplarily shown in this application;

[0081] Fig. 20 This is a schematic diagram of the interface change process and interaction when adjusting the button layout, which is exemplified in this application;

[0082] Fig.21 This is a schematic diagram of the key position distribution in the keyboard display window exemplarily shown in this application;

[0083] Fig. 22 This is a block diagram of an input method keyboard display device exemplarily shown in this application. DETAILED DESCRIPTION

[0084] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present application.

[0085] The input keyboard display method provided in the embodiment of the present application is applied to a terminal device, and the terminal device may include at least one processor, at least one memory and at least one communication interface. Figure 1 (a) is a schematic diagram of the structure of a terminal device 100 exemplarily shown in the present application. As shown in Figure 1 (a), the mobile terminal device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0086] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0087] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0088] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0089] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0090] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the terminal 100.

[0091] FIG1( b ) is a software structure block diagram of the terminal device 100 according to an embodiment of the present invention.

[0092] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0093] The application layer can include a series of application packages.

[0094] As shown in FIG. 1( b ), the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, input method, etc.

[0095] As shown in FIG. 1( c ), the input method application may include an input method module 201, a keyboard layout module 202, and a gesture recognition module 203. Each module has a different division of labor, and the modules can interact with each other to collaboratively complete the functions provided by the input method application. It should be noted that the input method module 201, the keyboard layout module 202, and the gesture recognition module 203 can be deployed in the application layer, or can be deployed across layers, for example, a portion of the executable code of the input method module 201 is deployed in the application layer, and another portion of the executable code is deployed in the application framework layer.

[0096] In other embodiments, the input method module, keyboard layout module and gesture recognition module involved in the present application may also be functional modules deployed in the application framework layer.

[0097] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0098] As shown in FIG. 1( b ), the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0099] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0100] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0101] The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0102] The phone manager is used to provide communication functions of the terminal device 100, such as management of call status (including connection, disconnection, etc.).

[0103] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0104] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages. It can stay for a short time and then disappear automatically without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, the terminal device vibrates, and the indicator light flashes.

[0105] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0106] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0107] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0108] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0109] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0110] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0111] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0112] A 2D graphics engine is a drawing engine for 2D drawings.

[0113] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0114] An input method program can be run on a terminal device with a touch screen, and the user uses the input method program to input text. In the user interface for text input, an input method keyboard and an input window are included, wherein the input method keyboard displays keys for inputting text and symbols in a specific key layout, and the input window is used to display the content input by the user. In the embodiment of the present application, the key layout refers to a layout design based on various information such as the arrangement order, display position, and display size of the keys. Depending on the layout of the input method keyboard, the input method keyboard can be divided into a full keyboard and a nine-square keyboard. Among them, in the full keyboard, each letter key corresponds to a separate key position, so that all 26 letter keys can be displayed on the full keyboard in a specific arrangement order. Different from a full keyboard, in a nine-square keyboard, at least three letter keys and one number key share one key position. This layout method of merging letter keys with number keys makes the number of keys displayed on the nine-square keyboard significantly less than the number of keys on a full keyboard. Furthermore, when the display window size of the input method keyboard is unified, the display size of the keys on the full keyboard is smaller than that on the nine-square keyboard. In particular, the display size of the letter keys on the full keyboard is smaller than that on the nine-square keyboard. This makes the nine-square keyboard easier for users to accurately touch the target keys.

[0115] However, since one key on the nine-grid keyboard corresponds to multiple letters, its specific input rules make its audience smaller than that of the full keyboard, and it is not suitable for English input. The full keyboard input rules are simple, easy to be accepted by most users, and suitable for English input, but compared with the nine-grid keyboard, the display size of the keys on it is smaller, which is not conducive to the operation experience of users who have requirements for key size, such as middle-aged or elderly users. In addition, the impact of the display size of the keys on the full keyboard on the user's operation experience is particularly obvious on terminal devices with smaller touch screen sizes, such as smart watches, smart bracelets and other small-screen wearable terminal devices.

[0116] Taking a smartwatch with a circular touch screen as an example, it includes a touch screen for displaying a user interface and detecting and receiving user input. In an input scenario, the user interface includes but is not limited to a keyboard display window and an input window, the keyboard display window is used to display an input method keyboard, and the input window is used to display the content input by the user.

[0117] Figure 2(a) illustrates a possible smart watch user interface. As shown in Figure 2(a), the user interface includes a keyboard display window 210 and an input window 220. The input window 220 is displayed above the keyboard display window 210. The keyboard display window is used to display a nine-square keyboard and associated words. The input window 220 is used to display text content input by the user. In this way, the user can preview the input text content in real time in the input window 220.

[0118] Figure 2(b) illustrates another possible smart watch user interface. As shown in Figure 2(b), the user interface includes a keyboard display window 210 and an input window 220. The input window 220 is displayed above the keyboard display window 210. The keyboard display window 210 is used to display a QWERTY keyboard (a type of full keyboard), and the input window 220 is used to display text content input by a user.

[0119] FIG2(c) shows another possible smart watch user interface. As shown in FIG2(c), the user interface includes a keyboard display window 210 and an input window 220. Unlike the QWERTY keyboard shown in FIG2(b), in FIG2(c), the keyboard display window 210 is located in a circular area around the user interface, and the circular area is divided into multiple sub-areas, each of which is used to display 3-4 letter keys. As can be seen from FIG2(b), 26 letter keys are displayed in a specific order in the circular area to form a circular full keyboard.

[0120] Depend on Figure 2(a) to Figure 2(c) It can be seen that compared to the full keyboard, the display size of the keys on the nine-grid keyboard is larger, but since multiple letter labels and number labels correspond to one key position, it is not suitable for English input, and since multiple letter labels and number labels need to be displayed simultaneously in the key display area, each letter label and number label is very small and difficult for users to identify. Compared to the nine-grid keyboard, the 26 letter keys in the QWERTY keyboard and the circular full keyboard are displayed simultaneously in the same size. Although it is convenient for users to input English, it is limited by the size of the keyboard display window or the size of the terminal device touch screen, and the display size of each letter key on the keyboard is very small. In the actual input process, it is difficult for users to accurately touch the target key at one time, and it is very easy to touch other keys around the target key, which results in low accuracy and input speed of input operations, and an unfriendly operation experience.

[0121] In some technical solutions, when contact is detected on the input method keyboard as shown in FIG2(b), a magnified window is displayed on the top layer of the interface according to the position of the contact point, the key corresponding to the contact point and some keys around the key are magnified in the magnified window, and the key corresponding to the current contact point is marked in the magnified window; when the movement of the contact point is detected, the display position of the magnified window is updated according to the movement trajectory of the contact point, and the key magnified in the magnified window is updated; when it is detected that the contact on the input method keyboard disappears, the magnified window is closed. In the embodiment of the present application, the magnified display means that the display size of the key in the magnified window is larger than its display size on the input method keyboard.

[0122] Figure 3 (a) is a user interface and interaction diagram in a user input process exemplified in this application. Figure 3 As shown in (a), the user interface displays a QWERTY keyboard and an input window above the keyboard. When the user touches the "O" key on the keyboard, the "O" key and the keys around it (such as the "I" key, the "P" key, etc.) are magnified and displayed in the magnified window at the top layer of the interface, and the "O" key is drawn in a different color from the other magnified keys to indicate that the key currently touched by the user is the "O" key. It should be understood that when the target key is not the "O" key but the "K" key, the finger is moved to the "K" key while maintaining contact with the touch screen. When the user's contact point with the touch screen moves to the "K" key, the "O" key is displayed. Figure 3 The user interface shown in (a) changes to Figure 3 (b) shows the user interface. Figure 3 In the user interface shown in (b), the magnified window is displayed near the "K" key, and the "K" key and the surrounding "J" and "L" keys are magnified in it. When the user removes the finger from the touch screen, the magnified window disappears, and the user interface shown in FIG2(b) is displayed.

[0123] It can be seen that through the displayed enlarged window, the user can know the key he is currently touching, which helps the user determine whether the key he is currently touching is the target key. When the key he is currently touching is not the target key, the touch position can be adjusted according to the positional relationship between the target key and the currently touched key to touch the target key.

[0124] However, since the above technical solution does not solve the problem that the key display size on the input method keyboard is too small, it is difficult for the user to touch the target key at the first touch. If the target key is not touched at the first touch, the user needs to continue to touch the keyboard to maintain the display of the magnified window and move the finger while maintaining contact with the touch screen to change the position of the contact point until the target key is touched. It can be seen that the process of gradually adjusting the touch position through the prompt of the magnified window until the target key is touched will make the user's input speed very low.

[0125] To solve the above technical problems, the present application provides an input method keyboard display method, which can directly enlarge and display some keys on the input method keyboard when displaying the input method keyboard. The user can directly perform input operations using the enlarged keys, which helps to increase the probability of the user touching the target key at one time, thereby improving the input speed and accuracy.

[0126] Figure 4 This is a flowchart of an input method keyboard display method exemplified in this application, such as Figure 4 As shown, the method may include the following steps:

[0127] Step 101, receiving an input method keyboard display instruction.

[0128] Step 102, in response to the instruction, in response to the keyboard display instruction, a first input method keyboard is displayed in the keyboard display window of the touch screen, in which the first key of the first input method keyboard is displayed at the geometric center of the keyboard display window, the keys in the second key set are displayed around the first key, the keys in the second key set have a predetermined relationship with the first key, and the display size of the first key and the keys in the second key set are larger than the display size of other keys. It should be understood that the instruction for displaying the input keyboard can be an input method program startup instruction received when the input method keyboard is not displayed, or an input method keyboard switching instruction received when the input method keyboard is displayed, wherein switching the input method keyboard means switching the currently displayed input method keyboard to another predetermined or user-specified input method keyboard, and the input method keyboards before and after the switch can have different key layouts.

[0129] In some embodiments, the preset key set includes a designated key and keys having a predetermined relationship with the designated key. The designated key can be determined based on the statistical key usage frequency, such as using the most frequently used key as the designated key, or can be a key that conforms to the user's personalized input habits and / or interest preferences, such as a key that the user independently sets using the setting function of the input method.

[0130] In some embodiments, the preset button set includes a first button and a second button set, the designated button in the preset button set is the first button, and the second button in the preset button set is the button constituting the second button set.

[0131] In a possible implementation, all letter keys are arranged in a specific order to form a letter key matrix. Exemplarily, the letter key matrix 1 may have the following structure:

[0132] Q W E R T Y U I O P / A S D F G H J K L / / Z X C V B N M /

[0133] Alternatively, the letter key matrix 2 may have the following structure:

[0134] Q W E R T Y U I O P A S D F G H J K L / / Z X C V B N M / /

[0135] Alternatively, the letter key matrix 3 may also have the following structure:

[0136]

[0137]

[0138] Based on this implementation method, the relationship between other keys in the preset key set and the designated key can specifically be a positional relationship with the designated key in the letter key matrix, such as an adjacent relationship. Furthermore, other keys in the preset key set can be some or all of the keys adjacent to the designated key in the letter key matrix.

[0139] In the following embodiments, the letter key matrix 1 is mainly taken as an example to illustrate the relationship between the specified key and other keys in the preset key set.

[0140] In one example, the designated key may be the "G" key, and the other keys may be the "F" key, the "Y" key, the "H" key, the "V" key, the "T" key, the "U" key, the "B" key, and the "C" key adjacent to the "G" key in the letter key matrix 1. Among them, the "F" key and the "H" key are adjacent to the "G" key on the left and right, the "Y" key and the "V" key are adjacent to the "G" key on the top and bottom, and the "T" key, the "U" key, the "B" key, and the "C" key are adjacent to the "G" key diagonally.

[0141] In some embodiments, the positional relationships of keys adjacent left to right and up to down in the letter key matrix are regarded as directly adjacent relationships, and the positional relationships adjacent diagonally are regarded as indirectly adjacent relationships.

[0142] In another possible implementation, the predetermined relationship may also be an association relationship between key identifiers, for example, the keys "G", "F", "H" and the like are associated in advance, and then when any one of the keys is used as a designated key to be displayed in an enlarged manner, other keys associated with the key will also be displayed in an enlarged manner at the same time. The enlarged display refers to displaying with a display size larger than other keys, or to displaying with a display size larger than a predetermined normal display size.

[0143] In another possible implementation, the key sequence refers to the sequence of keys in a specific key arrangement sequence. For example, in the QWERTY key arrangement sequence, the sequence of each letter key is 1 to 26, so the sequence of "Q" is 1, the sequence of W is 2, and so on. Based on this implementation, the predetermined relationship can also be an association relationship between key sequences, such as establishing associations between keys with sequences of "5", "14", "15", "16", "23", etc. in advance. When any one of the keys is used as a designated key to be magnified and displayed, other keys associated with the key are also magnified and displayed at the same time.

[0144] It is understandable that the preset key set includes different keys according to different designated keys and / or predetermined relationships.

[0145] Figure 5 (a) to Figure 5 (c) is a schematic diagram of the user interface changes and interactions during the display of the input method keyboard shown in the present application. In this example, the preset key set includes the "G" key, the "F" key, the "Y" key, the "H" key, the "V" key, the "T" key, the "U" key, the "B" key and the "C" key, among which the "G" key is a designated key, and the remaining keys are keys adjacent to the "G" key in the letter key matrix 1.

[0146] Figure 5 (a) shows a possible user interface, which is specifically the main interface of a smart watch. When the main interface is displayed, the chat program runs in the background. Figure 5 As shown in (a), the main interface displays time information, including "05:39" and "11 / 5 Wednesday". A notification bar 510 is displayed on the upper layer of the main interface. The notification bar displays messages pushed by the chat program and a reply control 511. The user can click the reply control 511 to switch the chat program to the foreground, display the chat window, and reply to the message. In some embodiments, when the chat program is switched to the foreground, the input method program is started.

[0147] Figure 5 (b) shows a possible user interface, which is specifically a user operation Figure 5 The user interface entered after replying to control 511 in (a). Figure 5 As shown in (b), the user interface includes a conversation content display area 520 and an input window 530, and the chat program can receive user input through the input window 530, such as an operation of indicating the display of an input method keyboard. For example, a user can click on the input area displayed in the input window 530 to input an instruction to indicate the display of an input method keyboard. When the terminal device receives the instruction, the input method keyboard is displayed. In some embodiments, in response to the instruction to indicate the display of the input method keyboard, the input window 530 is moved up, and a keyboard display window is displayed below the input window 530, and the keyboard display window is used to draw the input method keyboard.

[0148] Figure 5 (c) shows a possible user interface, which can be displayed in the form of Figure 5 (a) is a user interface that is displayed after receiving a user operation input in the input window. Figure 5 As shown in (c), the user interface includes a dialog content display area 520, an input window 530 and a keyboard display window 540. The keyboard display window 540 displays an input method keyboard 541 and an association word display area 542. The input method keyboard includes a key set arranged in a specific order, and the key set includes multiple types of keys, such as letter keys, symbol keys and number keys, etc., among which all 26 letter keys are displayed. It should be understood that in other embodiments of the present application, the letter keys can be arranged in other orders, and the present application is not limited to this.

[0149] It is worth noting that in Figure 5 In the input method keyboard shown in (c), the "G" key is displayed in an enlarged manner at the geometric center of the keyboard display window, and the "F" key, "Y" key, "H" key, "V" key, "T" key, "U" key, "B" key and "C" key are displayed in an enlarged manner around the "G" key in the central area of ​​the keyboard display window. In addition, the display size of the "G" key is the largest, the display sizes of the "F" key, "Y" key, "H" key and "V" key are the same and smaller than the display size of the "G" key, and the display sizes of the "T" key, "U" key, "B" key and "C" key are the same and smaller than the display sizes of the "F" key, "Y" key, "H" key and "V" key.

[0150] It should be understood that the buttons included in the preset button set may be different depending on the designated buttons and / or the predetermined relationship. Figure 6 Another user interface including an input method keyboard is shown, which is different from the input method keyboard shown in the above embodiment in that: Figure 6In the input method keyboard shown, the keys displayed in enlargement include only the "G key", the "F key", the "Y" key, the "H" key and the "V" key, among which the "F" key, the "Y" key, the "H" key and the "V" key are the keys directly adjacent to the "G key" in the letter key matrix 1.

[0151] The input method keyboard display method provided in the present application can be implemented based on multiple software modules in the input method application, for example, the input method module 201 and the keyboard layout module 202 shown in FIG. 1( c ).

[0152] In some embodiments, the input method application provides a setting function, which can at least be used to set the display mode of the input method keyboard. The user can use the setting function to select the required display mode. Among them, the selectable display modes may include a magnified mode and a normal mode. When the user sets the display mode to the magnified mode, the default display is as follows Figure 5 When the user sets the display mode to the normal mode, the input method keyboard shown in FIG2(b) is displayed by default. It should be understood that different display modes correspond to different layout rules.

[0153] In some embodiments, the input method module 201 is used to generate layout rule configuration information according to the screen size data and the layout rules corresponding to the magnification mode, and request the keyboard layout module 202 to generate keyboard layout information corresponding to the magnification mode according to the layout rule configuration information, draw the input method keyboard corresponding to the magnification mode according to the keyboard layout information, and render it to the display screen. The keyboard layout module 202 is used to generate keyboard layout information corresponding to the magnification mode according to the layout rule configuration information passed in by the input method module 201, such as key identification (such as key name, key code), display position of each key (such as the center coordinates of the display area), display size of each key (such as width, height), etc., and return the keyboard layout information to the input method module 201.

[0154] like Figure 7 As shown, in some embodiments, the steps performed by the input method module 201 and the keyboard layout module 202 are as follows:

[0155] S701, the input method module 201 is started.

[0156] In one implementation, when a designated application enters the foreground and runs, the input method module 201 is started. The designated application refers to all applications that need to call the input method, such as chat applications, short messages, etc.

[0157] Specifically, the designated application can send a startup instruction to the input method module 201 through a preset communication interface, and the input method module 201 starts in response to the instruction. Figure 5(a) shows the user interface, after clicking the reply control 511, the chat application enters the foreground and sends a start instruction to the input method module 201 through the communication interface with the input method application, and the input method module 201 starts in response to the instruction. Figure 5 (a) Change to Figure 5 (b).

[0158] Alternatively, the switching of the foreground application is monitored by a preset monitoring program, and when the specified application is monitored to switch to the foreground, the monitoring program instructs the input method module 201 to start. The monitoring program may be a system service in the system layer, such as an input method management service, which may be started during system initialization.

[0159] In another possible implementation, when the designated interface is switched to the top display, the application to which the designated interface belongs instructs the input method module 201 to start. The designated interface refers to an interface involving an input scenario, such as an interface including an input window.

[0160] It is worth noting that when the above-mentioned designated application is running in the foreground, the TOP interface (top interface / foreground interface) may or may not contain an input window. For example, when a user uses a chat application to browse hot news, the TOP interface is a news information display interface, which does not contain an input window. At this time, the chat application will not instruct the input method module 201 to start; when the user returns from the news information display interface to the foreground interface, the input method module 201 will not be displayed. Figure 5 (b) shows a chat interface, the TOP interface changes from a news information display interface to a chat interface, the chat interface includes an input window, at this time, the chat application instructs the input method module 201 to start. In addition, the input method module 201 can be started during the initialization process of the device system.

[0161] S702 , the input method module 201 starts the keyboard layout module 202 .

[0162] S703, the keyboard layout module 202 is started.

[0163] In specific implementation, the input method module 201 may send a specific control instruction to the keyboard layout module 202 to instruct the keyboard layout module 202 to start.

[0164] S704: the input method module 201 generates layout rule configuration information according to the screen size data and the layout rule corresponding to the zoom mode.

[0165] The screen size data, such as the dial (screen) size of the smart watch, may be preset in the input method module 201, or may be obtained by the input method module 201 by calling a method for obtaining the screen size data.

[0166] The layout rules corresponding to the magnification mode are preset in the input method module 201, and are used to configure the keyboard display window size, the maximum key size, and the minimum key size. For example, the maximum width of the keyboard display window is configured to be 100% of the screen diameter, the maximum height of the keyboard display window is configured to be 70% of the screen diameter, the maximum width of the key is configured to be 30% of the maximum width of the keyboard display window, the maximum height of the key is configured to be 30% of the maximum height of the keyboard display window, the minimum width of the key is configured to be 5% of the maximum width of the keyboard display window, and the minimum height of the key is configured to be 5% of the maximum height of the keyboard display window.

[0167] According to the layout rules and screen size data corresponding to the magnification mode, the layout rule configuration information can be calculated. The layout rule configuration information may specifically include: the maximum size of the keyboard display window, the maximum display size of the key, and the minimum display size of the key. For example, assuming that the screen diameter is 100mm, then according to the above layout rules, it can be calculated that the maximum width of the keyboard display window is 100mm and the maximum height is 70mm, the maximum width of the key is 30mm and the maximum height is 21mm, and the minimum width of the key is 5mm and the minimum height is 3.5mm.

[0168] In some embodiments, the layout rules corresponding to the magnification mode may also include magnification rules for buttons in a preset button set. According to the magnification rules, the buttons in the set may be magnified and displayed according to a preset magnification ratio. The magnification ratios for different buttons may be the same or different. Accordingly, the layout rule configuration information may also include one or more ratio parameters corresponding to the magnification rules, such as a decreasing ratio of the display size, or a magnification ratio corresponding to each button in the set.

[0169] In the first embodiment, the magnification rule is used to: let the decreasing ratio of the display size of the keys in the set be m, let the display size of the designated key be the maximum key size, that is, the display width and height are a and b respectively, let the display width and height of a part of the keys in the set be (1-m)a and (1-m)b respectively, and this part of the keys are the keys directly adjacent to the designated key in the letter key matrix 1, let the display width and height of another part of the keys be (1-m)(1-m)a and (1-m)(1-m)b respectively, and this part of the keys are the keys indirectly adjacent to the designated key in the letter key matrix 1.

[0170] For example, in Figure 5In the example shown in (c), the preset key set includes the "G" key, the "F" key, the "Y" key, the "H" key, the "V" key, the "T" key, the "U" key, the "B" key and the "C" key. Among them, the "G" key is a designated key, the "F" key, the "Y" key, the "H" key, the "V" key are directly adjacent to the "G" key in the letter key matrix 1, and the "T" key, the "U" key, the "B" key and the "C" key are indirectly adjacent to the "G" key in the letter key matrix 1. When the decreasing ratio is 30% and the display size of the "G" key is expressed as a×b, the display size of the "F" key, the "Y" key, the "H" key, the "V" key can be expressed as 70%a×70%b, and the display size of the "T" key, the "U" key, the "B" key and the "C" key can be expressed as 49%a×49%b.

[0171] In a second implementation, the magnification rule is used to make each key in the set displayed according to its own preset magnification ratio. As an example, the preset key set includes the "G" key, the "F" key, the "Y" key, the "H" key, the "V" key, the "T" key, the "U" key, the "B" key, and the "C" key. The magnification rule can make the "G" key, the "F" key, the "Y" key, the "H" key, the "V" key, the "T" key, the "U" key, the "B" key, and the "C" key. On the basis of c×d, the keys are displayed at enlargement ratios of 70%, 50%, 50%, 50%, 50%, 30%, 30%, 30%, 30% respectively. Then, the display size of the "G" key is 170%c×170%d, the display size of the "F" key, "Y" key and "H" key is 150%c×150%d, the display size of the "V" key, "T" key, "U" key, "B" key and "C" key is 130%c×130%d, and the display size of the remaining keys is c×d.

[0172] It should be noted that the input method keyboard displayed according to the method of the present application includes but is not limited to magnifying each key according to the above exemplary magnification rules.

[0173] For example, the magnification rule may also enable the buttons in a preset button set to be displayed in the same size. Figure 5 (d) shows another possible user interface. Figure 5 As shown in (d), the "G" key, "F" key, "Y" key, "H" key, "V" key, "T" key, "U" key, "B" key, and "C" key are displayed in an enlarged manner. Figure 5 (c) The difference is that Figure 5 In (d), the display sizes of the "G" key, the "F" key, the "Y" key, the "H" key, the "V" key, the "T" key, the "U" key, the "B" key, and the "C" key are the same.

[0174] For another example, the magnification rule may also display a specified key in a preset key set (such as the "G" key in the above example) in a larger size, and display the remaining keys in the set in the same smaller size. Figure 5 (e) shows another possible user interface. Figure 5 As shown in (e), the "G" key, "F" key, "Y" key, "H" key, "V" key, "T" key, "U" key, "B" key, and "C" key are displayed in an enlarged manner. Figure 5 (c) and Figure 5 (d) The difference is that the display size of the "G" key is the largest, and the display sizes of the "F", "Y", "H", "V", "T", "U", "B" and "C" keys are the same and smaller than the display size of the "G" key.

[0175] It should be understood that the present application does not limit the execution order of the aforementioned S702 and S704. For example, the input method module 201 may first send a message to start the keyboard layout module 202 and then generate the layout rule information, or may first generate the layout rule information and then send a message to start the keyboard layout module 202, or may perform these two steps simultaneously.

[0176] In some embodiments, before executing S704, the input method module 201 obtains the setting parameters corresponding to the input method application; determines the currently set display mode according to the parameters representing the input method keyboard display mode in the setting parameters; when the currently set display mode is the enlarged mode, executes the aforementioned S704 and subsequent steps; otherwise, the input method module 201 directly requests the keyboard layout module 202 to generate keyboard layout information corresponding to the normal mode.

[0177] As a possible implementation method, the layout rules corresponding to the normal mode can be preset in the keyboard layout module 202. Then, after receiving the request from the input method module, the keyboard layout module 202 generates the corresponding keyboard layout information according to the layout rules corresponding to the normal mode, and returns it to the input method module 201. The input method module 201 then draws the input method keyboard corresponding to the normal mode according to the keyboard layout information.

[0178] It should be noted that the keyboard layout request may include a field representing the display mode, and the input method module 201 may request the keyboard layout module 202 to generate keyboard layout information corresponding to the specified mode by encapsulating the specified field value in the field. The keyboard layout module determines the display mode according to the field value encapsulated in the field, and then generates the corresponding keyboard layout information.

[0179] In some embodiments, after completing the keyboard drawing, the input method module 201 records the current display mode. For example, after drawing the input method keyboard corresponding to the magnified mode, the current display mode is recorded as the magnified mode, and after drawing the input method keyboard corresponding to the normal mode, the current display mode is recorded as the normal mode. In this way, when it is necessary to determine the current display mode, the saved record data can be read.

[0180] S705 , the input method module 201 sends the layout rule configuration information to the keyboard layout module 202 .

[0181] S706, the keyboard layout module 202 receives the layout rule configuration information sent by the input method module 201, and saves it.

[0182] S707, in response to the instruction for displaying the input method keyboard, the input method module 201 sends a keyboard layout request to the keyboard layout module 202, and the keyboard layout request carries at least specified key information. The keyboard layout request is used to instruct the keyboard layout module 202 to generate keyboard layout information corresponding to the magnification mode according to the specified key information.

[0183] In one implementation, the instruction for displaying the input method keyboard may be an instruction sent by the designated application to the input method module after receiving a predetermined user operation. Figure 5 In the example of the user interface shown in (b), when the chat application receives an operation of the user clicking on the input window, the chat application sends an instruction for displaying an input method keyboard to the input method module 201 .

[0184] In another implementation, the instruction for displaying the input method keyboard may also be a keyboard switching instruction generated when the input method keyboard is displayed. Fig. 9 (a) to Fig. 9 In the embodiment shown in (b), when the first input method keyboard is displayed, after receiving an operation for switching to the second input method keyboard, a keyboard switching instruction is generated.

[0185] It should be noted that, according to the different keys on the input method keyboard, the input method keyboard can be divided into different types, such as a numeric keyboard and an English alphabet keyboard. Among them, most or all of the keys on the numeric keyboard are numeric keys, and most or all of the keys on the English alphabet keyboard are English letters. When the application receives the operation of the user clicking the input window, it can determine the type of keyboard to be displayed according to the input scenario, and send a keyboard display instruction carrying a keyboard type identifier to the input method module 201. For example, if it is a numeric input scenario, a keyboard display instruction carrying a numeric keyboard identifier is sent to the input method module 201, and if it is a text input scenario, a keyboard display instruction carrying an English alphabet keyboard identifier is sent to the input method module. After receiving the keyboard display instruction, the input method module 201 encapsulates the keyboard type identifier therein in a keyboard layout request and sends it to the keyboard layout module 202, so that the keyboard layout module 202 generates the corresponding keyboard layout information.

[0186] It is worth noting that, unless otherwise specified, the input method keyboard involved in this application refers to an English alphabetic keyboard.

[0187] S708 , the keyboard layout module 201 receives the keyboard layout request sent by the input method module 201 .

[0188] S709: The keyboard layout module 201 generates keyboard layout information according to the layout rule configuration information and the designated key information in the keyboard layout request, where the keyboard layout information corresponds to the magnification mode.

[0189] In this embodiment, the keyboard layout request includes designated key information, and a predetermined relationship is preset in the keyboard layout module 202. After receiving the keyboard layout request, the keyboard layout module 202 determines the designated key according to the designated key information, determines other keys that need to be magnified and displayed according to the designated key and the preset predetermined relationship, and then determines all keys that need to be magnified and displayed. Then, the keyboard layout information is generated according to all keys that need to be magnified and displayed and the layout rule configuration information.

[0190] In one example, the designated key information carried in the keyboard layout request is "G", and the predetermined relationship preset in the keyboard layout module 202 is the direct adjacent relationship with the designated key in the letter key matrix 1. The keyboard layout module 202 can determine that the keys directly adjacent to "G" include the "F" key, the "H" key, the "Y" key, and the "V" key according to the positions of "G" and "G" in the letter key matrix 1, and further determine that all the keys that need to be magnified include the "G" key, the "F" key, the "H" key, the "Y" key, and the "V" key.

[0191] In another example, the designated key information carried in the keyboard layout request is "G", and the predetermined relationship preset in the keyboard layout module 202 is the direct adjacent relationship and the indirect adjacent relationship with the designated key in the letter key matrix 1. The keyboard layout module 202 can determine that the keys directly adjacent to "G" include the "F" key, the "H" key, the "Y" key, and the "V" key, and the keys indirectly adjacent to the "G" key include the "T" key, the "U" key, the "B" key, and the "C" key, and further determine that all the keys that need to be enlarged and displayed include the "F" key, the "H" key, the "Y" key, the "V" key, the "T" key, the "U" key, the "B" key, and the "C" key.

[0192] In the above example, the letter key matrix can be preset in the keyboard layout module 202, or can be carried in the keyboard layout request and sent by the input method module 201 to the keyboard layout module.

[0193] In some embodiments, after determining all keys that need to be enlarged, the keyboard layout module 202 calculates the display size of each key according to the layout rule configuration information, and determines the display position coordinates of each key. Finally, the keyboard layout information is generated according to the obtained size and coordinate data.

[0194] In one example, the layout rule configuration information sent by the input method module 201 to the keyboard layout module 202 includes: the maximum width of the keyboard display window is 100mm, the maximum height is 70mm, the maximum width of the key is 30mm, the maximum height is 21mm, the minimum width of the key is 5mm, the minimum height is 3.5mm, and the decreasing ratio is 30%. The keyboard layout request sent by the input method module 201 to the keyboard layout module 202 carries the "G" key information, that is, the keyboard layout module 202 is requested to enlarge the layout of the "G" key and the keys that meet the predetermined relationship with the "G" key. In this example, after receiving the keyboard layout request, the keyboard layout module 202 first determines other keys that need to be enlarged and displayed according to the specified key "G". For example, other keys that need to be enlarged and displayed may include the "F" key, the "T" key, the "Y" key, the "U" key, the "H" key, the "B" key, the "V" key, and the "C" key. Then, according to the maximum width and maximum height of the key, the display width and display height of the "G" key can be calculated to be 30mm and 21mm respectively. According to the decreasing ratio of 30% and the display size of the "G" key, the display width of the "F" key, the "Y" key, the "H" key and the "V" key are calculated to be 21mm and the display height is 14.7mm. According to the decreasing ratio of 30% and the display size of the "F" key, the "Y" key, the "H" key or the "V" key, the display width and display height of the "T" key, the "U" key, the "B" key and the "C" key are calculated to be 14.7mm and 10.29mm respectively. According to the decreasing ratio of 30% and the display size of the "T" key, the "U" key, the "B" key or the "C" key, the display width and display height of the remaining letter keys are calculated to be 10.29mm and 7.203mm respectively. Among them, since in the letter key matrix 1, the "F" key, the "Y" key, the "H" key and the "V" key are directly adjacent to the "G" key, and the "T" key, the "U" key, the "B" key and the "C" key are indirectly adjacent to the "G" key, the display sizes of the "F" key, the "Y" key, the "H" key and the "V" key are the same, the display sizes of the "T" key, the "U" key, the "B" key and the "C" key are the same, and the display sizes of the "F" key, the "Y" key, the "H" key and the "V" key are larger than the display sizes of the "T" key, the "U" key, the "B" key and the "C" key.

[0195] S710 , the keyboard layout module 202 returns the generated keyboard layout information to the input method module 201 .

[0196] S711, the input method module 201 receives the keyboard layout information.

[0197] S712: The input method module 201 generates an input method keyboard corresponding to the magnification mode according to the keyboard layout information.

[0198] exist Figure 7Based on the illustrated embodiments, the present application also provides a variety of different implementation methods.

[0199] In the first implementation, the layout rule configuration information may also include designated key information. In this way, the keyboard layout module 202 can determine the designated key according to the designated key information in the layout rule configuration information, and determine other keys that need to be magnified and displayed according to the designated key and the preset predetermined relationship; when receiving a keyboard layout request, the keyboard layout is performed according to all keys that need to be magnified and displayed and other information in the layout rule configuration information. Among them, the other information in the layout rule configuration information refers to information other than the designated key information.

[0200] In the second implementation, the layout rule configuration information may also include designated key information and predetermined relationship information. In this way, the keyboard layout module 202 can determine the designated key according to the designated key information in the keyboard layout request, and determine other keys that need to be magnified and displayed according to the designated key and the predetermined relationship information; when receiving the keyboard layout request, the keyboard layout is performed according to all keys that need to be magnified and displayed and other information in the layout rule configuration information. Among them, the other information in the layout rule configuration information refers to information other than the designated key information and the predetermined relationship information.

[0201] In a third implementation, the layout rule configuration information may also include key information of all keys in the preset key set and identify the specified keys. In this way, the keyboard layout module 202 can directly determine all keys that need to be magnified and displayed according to the layout rule configuration information; when receiving a keyboard layout request, the keyboard layout is performed according to all keys that need to be magnified and displayed and other information in the layout rule configuration information. Among them, the other information in the layout rule configuration information refers to information other than the preset key set.

[0202] It should be noted that in the above three implementations, the keyboard layout request may not include the designated key information. In addition, there is no limitation on the timing when the keyboard layout module 202 determines all keys that need to be magnified. For example, the keyboard layout module 202 may determine all keys that need to be magnified before receiving the keyboard layout request sent by the input method module 201, or may determine all keys that need to be magnified before receiving the keyboard layout request sent by the input method module 201.

[0203] In a fourth implementation, the keyboard layout request includes the designated key information and the predetermined relationship information. In this way, the keyboard layout module 202 can determine the designated key according to the designated key information in the keyboard layout request, determine other keys that need to be magnified and displayed according to the designated key and the predetermined relationship information, and perform keyboard layout according to all keys that need to be magnified and displayed and the layout rule configuration information.

[0204] In a fifth implementation, the keyboard layout request may include key information of all keys in the preset key set and identify the specified key. In this way, the keyboard layout module 202 may directly determine all keys that need to be magnified according to the keyboard layout request, and perform keyboard layout according to all keys that need to be magnified and the layout rule configuration information.

[0205] In a sixth implementation, the keyboard layout request may include key information of all keys in the preset key set and the magnification ratio corresponding to each key, and identify the specified key. In this way, the keyboard layout module 202 may directly determine all keys that need to be magnified according to the keyboard layout request, and perform keyboard layout according to all keys that need to be magnified, the magnification ratio corresponding to each key, and the layout rule configuration information. In this implementation, the layout rule configuration information may not include various parameters corresponding to the magnification rule.

[0206] It should be understood that in order to display the input method keyboard corresponding to the magnification mode, the terminal device may also include more or fewer functional modules, and is not limited to the input method module and keyboard layout module in the above example. In addition, those skilled in the art may implement other embodiments by changing the steps implemented by each functional module without paying creative labor, and all of them belong to the protection scope of this application.

[0207] It can be seen from the above embodiments that the input method keyboard display method provided by the present application directly enlarges and displays some keys when displaying the input method keyboard. Compared with the input method keyboard with a full keyboard layout as shown in FIG2(b), the enlarged display of some keys can effectively improve the user's touch accuracy, improve the input speed and accuracy, and improve the input speed and accuracy. Figure 3 (a) and Figure 3 Compared with the enlarged display scheme shown in (b), the present application enlarges and displays the designated part of the keys before the user touches the keyboard. There is no need for user operation to trigger the enlargement of the keys, nor does it require the user to keep in contact with the keys to maintain the enlargement of the keys, thereby saving user operations and improving the accuracy of the user's first touch.

[0208] Figure 8 This is another flow chart of the input keyboard display method shown in the present application as an example. Figure 8 As shown, the method may include the following steps:

[0209] Step 201: display a first input method keyboard, in which keys of the same type have the same display size.

[0210] Step 202, receiving a user operation on the first input method keyboard;

[0211] Step 203, in response to determining that the user operation is consistent with a predetermined operation for switching the input method keyboard, switching the first input method keyboard to a second input method keyboard, wherein, in the second input method keyboard, a first key is displayed at the geometric center of the keyboard display window, keys in a second key set are displayed around the first key, the keys in the second key set have a predetermined relationship with the first key, and the display size of the first key and the keys in the second key set is larger than the display size of other keys.

[0212] For example, the first input method keyboard may be the input method keyboard shown in FIG. 2( b), and the second input method keyboard may be the input method keyboard shown in FIG. Figure 5 (b) to Figure 6 It should be understood that in Figure 8 In the illustrated embodiment, the first input-method keyboard is an input-method keyboard corresponding to the normal mode, and the second input-method keyboard is an input-method keyboard corresponding to the enlarged mode.

[0213] In some embodiments, the key types on the input-method keyboard include English letter types, number types, punctuation marks, etc. On the first input-method keyboard, at least all English letter keys have the same display size.

[0214] It should be noted that the "first" and "second" in the first input method keyboard and the second input method keyboard do not specifically refer to any one input method keyboard, but are only used to distinguish the input method keyboards before and after switching. It is understandable that in other embodiments, the input method keyboard corresponding to the enlarged mode may also be referred to as the first input method keyboard, and the input method keyboard corresponding to the normal mode may also be referred to as the second input method keyboard.

[0215] based on Figure 8 In the input method keyboard display method provided in the illustrated embodiment, the user can switch the input method keyboard that does not include keys that are displayed in an enlarged manner (i.e., the first input method keyboard) to an input method keyboard that displays some designated keys in an enlarged manner (i.e., the second input method keyboard) by inputting a predetermined gesture operation. For example, the first input method keyboard may be an input method keyboard with a full keyboard layout as shown in FIG. 2( b), and the second input method keyboard may be an input method keyboard with a full keyboard layout as shown in FIG. 2( c). Figure 5 (b) to Figure 6 The input method keyboard shown.

[0216] It should be understood that the terminal device may display the first input method keyboard in response to receiving an instruction for displaying the input method keyboard, wherein the instruction for displaying the input method keyboard may be an input method program startup instruction received when the input method keyboard is not displayed, or an input method keyboard switching instruction received when the input method keyboard is displayed.

[0217] As a possible implementation, the user can slide two fingers simultaneously from the same starting point or two different and sufficiently close starting points in different directions to input a gesture operation for switching the first input method keyboard to the second input method keyboard. The two-finger sliding operation can be from any same starting point or any two different and sufficiently close starting points pointing to any two different directions.

[0218] Fig. 9 (a) to Fig. 9 (b) is a schematic diagram of the user interface changes and interactions during the input method keyboard switching process exemplified in this application. Fig. 9 (a) exemplarily shows an interactive scene when a user inputs a gesture operation on the displayed first input method keyboard. Fig. 9 As shown in (a), all letter keys on the first input method keyboard are displayed in the same display size. The user slides one finger from near the "F" key to the first direction and slides another finger from near the "F" key to the second direction. Fig. 9 (b) exemplifies a possible user interface including a second input method keyboard, which is specifically a user interface displayed after receiving a predetermined operation for switching the input method keyboard when the user interface shown in 9(a) is displayed. It can be seen that in the second input method keyboard, the display size of the keys such as the "G" key and the "F" key belonging to the preset key set is larger than the display size of other keys, and larger than the display size of the same type of keys on the first input method keyboard. For example, the display size of the "F" key on the second input method keyboard is larger than the display size of the letter keys such as the "A" and "S" keys on the second input method keyboard, and larger than the display size of all letter keys on the first input method keyboard.

[0219] Fig.10 (a) to Fig.10 (b) is a schematic diagram of the user interface changes and interactions during the input method keyboard switching process exemplified in this application. Fig.10 (a) shows the first input method keyboard. The user slides one finger from the vicinity of the "J" key toward the third direction, and slides another finger from the vicinity of the "J" key toward the fourth direction. Fig.10 (a) shows the gesture operation, the user interface consists of Fig.10 (a) Change to Fig.10 (b).

[0220] In the above example, the key layout of the second input method keyboard after switching is fixed, that is, the keys displayed on the keyboard are fixed. Fig. 9 (a) When the gesture is operated, switch to Fig. 9(b) the second input method keyboard shown; when the first input method keyboard is displayed, a Fig.10 (a) also switches to the Fig. 9 (b) the second input method keyboard (with Fig.10 b).

[0221] It should be noted that in some other embodiments of the present application, when the terminal device receives a gesture operation for switching the input method keyboard, it can switch to a second input method keyboard with a different key layout according to different input gesture operations. Among them, the keys in different key layouts, including but not limited to the keys that are magnified and displayed, are not completely the same.

[0222] As a possible implementation manner, the key to be displayed in an enlarged manner may be determined according to the starting contact point of the input operation.

[0223] Fig.11 (a) to Fig.11 (b) is a schematic diagram of the user interface changes and interactions during the input method keyboard switching process exemplified in this application. Fig.11 (a) shows the Fig. 9 (a) the same first input method keyboard and user operation, in response to receiving the user operation, the user interface is Fig.11 (a) Change to Fig.11 (b) With Fig. 9 (b) The difference is that, since the key corresponding to the initial contact point of the gesture operation in FIG11(a) is the "F" key, Fig.11 In the second input method keyboard shown in (b), the "F" key is used as a designated key, and it and its surrounding "D" key are displayed in an enlarged manner.

[0224] Fig.12 (a) to Fig.12 (b) is a schematic diagram of the user interface changes and interactions during the input method keyboard switching process exemplified in this application. Fig.12 (a) shows the Fig.10 (a) the same first input method keyboard and user operation, in response to receiving the user operation, the user interface is Fig.12 (a) Change to Fig.12 (b) With Fig.10 (b) The difference is that Fig.12 The key corresponding to the initial contact point of the gesture operation shown in (a) is the "J" key, so Fig.12 In the second input method keyboard shown in (b), the "J" key is used as a designated key, and it and its surrounding "K" keys are displayed in an enlarged manner at the same time.

[0225] It should be noted that the initial contact point refers to the starting point of the user's contact trajectory with the screen, and the key corresponding to the initial contact point is the key whose display area includes the initial contact point, or the key whose center position of the display area is closest to the initial contact point. For example, when the coordinates of the initial contact point fall in the display area of ​​a certain key, then the key is the key corresponding to the initial contact point. When the initial contact point does not fall in the display area of ​​any key, the key closest to the initial contact point is the key corresponding to the initial contact point. When there are multiple keys that are closest to the initial contact point, any one of them can be taken as the key corresponding to the initial contact point, or the key corresponding to the initial contact point can be selected from the multiple keys according to a preset rule.

[0226] It should be understood that the predetermined gesture operation for switching the input method keyboard includes but is not limited to the two-finger sliding operation shown in the above example, for example, it can also be a double-click operation, a long press operation, a sliding operation along a specified direction, etc.

[0227] It can be seen from the above embodiments that the input method keyboard display method provided by the present application, when displaying the input method keyboard corresponding to the normal mode (i.e., the first input method keyboard), the user can switch the input method keyboard corresponding to the normal mode to the input method keyboard corresponding to the enlarged mode (i.e., the second input method keyboard) by inputting a predetermined gesture operation.

[0228] Fig.13 This is another flow chart of the input keyboard display method shown in the present application as an example. Fig.13 As shown, the method may include the following steps:

[0229] Step 301, when displaying a second input method keyboard, receiving a user operation on the second input method keyboard;

[0230] Step 302: in response to determining that the user operation is consistent with a predetermined operation for switching an input method keyboard, switching the second input method keyboard to the first input method keyboard.

[0231] Among them, in the first input method keyboard, the display size of keys of the same type is the same, and in the second input method keyboard, the display size of keys belonging to a preset key set is larger than the display size of keys not belonging to the preset key set, and is larger than the display size of keys of the same type on the first input method keyboard.

[0232] based on Fig.13 In the input method keyboard display method provided in the illustrated embodiment, when the touch screen displays the second input method keyboard, the user can switch the currently displayed second input keyboard to the first input method keyboard through a predetermined gesture operation. For example, the first input method keyboard can be an input method keyboard with a full keyboard layout as shown in FIG. 2, and the second input method keyboard can be an input method keyboard with a full keyboard layout as shown in FIG. Figure 6 The input method keyboard shown.

[0233] As a possible implementation manner, the user may slide two fingers simultaneously from two different and sufficiently far start contact points in different directions to input a gesture operation for switching the second input method keyboard to the first input method keyboard.

[0234] Fig.14 (a) to Fig.14 (b) is a schematic diagram of the user interface change, i.e., the interaction process, during the input method keyboard switching process exemplified in the present application. Fig.14 (a) exemplarily shows an interactive scene when a user inputs a gesture operation on the displayed second input method keyboard, Fig.14 (b) shows the user interface displayed after the keyboard switching is completed, and the user interface includes the first input method keyboard. Fig.14 As shown in (a), on the second input method keyboard, the display size of the "G" key, "F" key and other keys is larger than the display size of other keys, and larger than the display size of the same type of keys on the first input method keyboard. For example, the display size of the "G" key and "F" key on the second input method keyboard is larger than the display size of the "A" and "S" keys on the second input method keyboard, and larger than the display size of all letter keys on the first input method keyboard. Fig.14 On the input method keyboard shown in (a), the user slides one finger from the first starting point of contact to the first direction, and slides another finger from the second starting point of contact to the second direction. In response to the user operation input, the user interface is Fig.14 (a) Change to Fig.14 (b).

[0235] It should be noted that the operation for switching the input method keyboard includes but is not limited to the two-finger sliding operation in the above example. For example, it can also be a long press operation, a double-click operation, a sliding operation along a specified direction, etc., which is not limited in this application.

[0236] It can be seen from the above embodiments that the input method keyboard display method provided by the present application, when displaying the input method keyboard of the keys corresponding to the magnification mode (i.e., the second input method keyboard), the user can switch the input method keyboard corresponding to the magnification mode to the input method keyboard of the keys corresponding to the normal mode (i.e., the first input method keyboard) by inputting a predetermined gesture operation.

[0237] In some embodiments, the gesture operation for switching the first input method keyboard to the second input method keyboard is referred to as a third predetermined operation, and the gesture operation for switching the second input method keyboard to the first input method keyboard is referred to as a fourth predetermined operation.

[0238] As shown in FIG. 1( c ), the module for implementing the input method application function further includes a gesture recognition module 203 .

[0239] In some embodiments, the gesture recognition module 203 is used to receive input user operations, and to determine whether the user operation is a predetermined operation by comparing the contact trajectory corresponding to the user operation with the trajectory data corresponding to each predetermined operation in the preset gesture library. Among them, the preset gesture library includes at least the trajectory data corresponding to the third predetermined operation and the fourth predetermined operation. When it is determined that the user operation is the third predetermined operation or the fourth predetermined operation, the third predetermined operation or the fourth predetermined operation is sent to the input method module 201 in the form of a signal. After receiving the signal, the input method module 201 requests the keyboard layout module 202 to generate new keyboard layout information, so as to draw the corresponding input method keyboard according to the new keyboard layout information, thereby completing the switching of the input method keyboard.

[0240] In some embodiments, when the input method keyboard corresponding to the magnified mode is displayed, the user can switch the input method keyboard in the magnified mode to the input method keyboard corresponding to the normal mode by inputting a fourth predetermined operation. Figure 7 After the steps shown, the input method module 201, the keyboard layout module 202 and the gesture recognition module 203 may perform the following steps:

[0241] S151 , the input method module 201 starts the gesture recognition module 203 .

[0242] In specific implementation, the input method module 201 may send a specific control instruction to the gesture recognition module 203 to instruct the gesture recognition module to start.

[0243] In one implementation, after completing the drawing of the input method keyboard, the input method module 201 sends a start message to the gesture recognition module 203 .

[0244] In another implementation, the input method module 201 may also instruct the gesture recognition module to start before the drawing of the input method keyboard is completed. For example, the input method module 201 controls the gesture recognition module 203 to start while controlling the keyboard layout module 202 to start. It should be understood that the simultaneous includes the same time or the time interval is small enough.

[0245] S152, the gesture recognition module 203 is started.

[0246] After the gesture recognition module 203 is started ( S152 ), it starts to detect the user operation, that is, the contact between the user and the display screen.

[0247] S153: The gesture recognition module 203 receives a user operation.

[0248] S154, the gesture recognition module 203 determines whether the received user operation is a predetermined operation. If it is determined that the user operation is the fourth predetermined operation, S155 is executed, otherwise, the process returns to S153.

[0249] S155 , when the user operation matches the trajectory of the fourth predetermined operation, the gesture recognition module 203 sends a fourth signal corresponding to the fourth predetermined operation to the input method module 201 .

[0250] S156, the input method module 201 receives the fourth signal and determines whether the currently displayed input method keyboard corresponds to the magnification mode. If so, S157 is executed. If not, the input fourth predetermined operation is regarded as an invalid operation, and thus the process returns to S156.

[0251] S157, the input method module 201 sends a first keyboard layout request to the keyboard layout module 202, where the first keyboard layout request is used to enable the keyboard layout module 202 to generate first keyboard layout information, where the first keyboard layout information is used to draw an input method keyboard corresponding to the normal mode, namely, a first input method keyboard.

[0252] S158, after receiving the first keyboard layout request, the keyboard layout module 202 generates first keyboard layout information according to the layout rule corresponding to the normal mode preset in the module.

[0253] S159, the keyboard layout module 202 returns the first keyboard layout information to the input method module 201.

[0254] S160: The input method module 201 receives first keyboard layout information.

[0255] S161: Draw a first input method keyboard according to the first keyboard layout information, that is, an input method keyboard corresponding to the normal mode.

[0256] As can be seen from FIG. 15( a ), when the input method keyboard corresponding to the enlarged mode is displayed, the user can switch the input method keyboard in the enlarged mode to the input method keyboard corresponding to the normal mode by inputting a fourth predetermined operation.

[0257] In some embodiments, when the input method keyboard corresponding to the normal mode is displayed, the user can switch the input method keyboard of the normal mode to the input method keyboard corresponding to the magnified mode by inputting a third predetermined operation. As shown in FIG. 15( b ), if it is determined in S154 that the user operation is the third predetermined operation, the input method module 201, the keyboard layout module 202, and the gesture recognition module 203 can perform the following steps:

[0258] S162 , the gesture recognition module 203 sends a third signal corresponding to the third predetermined operation to the input method module 201 .

[0259] S163, after receiving the third signal, the input method module 201 determines whether the currently displayed input method keyboard corresponds to the normal mode; if so, execute S164.

[0260] In one implementation, if the currently displayed input method keyboard corresponds to the magnification mode, the input third predetermined operation is regarded as an invalid operation, and the process returns to S163.

[0261] In another implementation, if the currently displayed input method keyboard corresponds to the magnification mode, the key corresponding to the initial contact point operated by the user is used as the designated key, and the key layout of the input method keyboard is adjusted, that is, the input method module 201 may execute Fig.19 S193 and subsequent steps, see below for details Fig.19 The embodiment shown.

[0262] S164, the input method module 201 sends a second keyboard layout request to the keyboard layout module 202, and the second keyboard layout request carries specified key information, which is used to enable the keyboard layout module 202 to generate second keyboard layout information according to the specified key information. The second keyboard layout information is used to draw a second input method keyboard, that is, the input method keyboard corresponding to the magnification mode.

[0263] S165: After receiving the second keyboard layout request, the keyboard layout module 202 generates second keyboard layout information according to the designated key information.

[0264] In one implementation, the designated key information carried in the second keyboard layout request is preset in the input method module. In this implementation, the designated key is independent of the user operation, such as Fig. 9 (a)- Fig. 9 (b) and Fig.10 (a)-10(b) are embodiments shown. Based on this implementation, the present application can also provide a variety of other implementations, including at least the above-mentioned Figure 7 The six implementation methods provided in the illustrated embodiment are not described in detail here.

[0265] In another implementation, the gesture recognition module 203 determines the designated key information carried in the second keyboard layout request according to the starting point of the user operation, and after determining the designated key information according to the starting point of the user operation, sends the key information and the third signal to the input method module 201 in S162. After receiving the key information, the input method module 201 uses the key information as the designated key information, carries it in the second keyboard layout request, and sends it to the keyboard layout module 202. In this implementation, the user can independently select the key that he wants to enlarge, such as Fig.11 (a)- Fig.11 (b) and Fig.12 (a)-12 (b) shows an embodiment.

[0266] Specifically, after determining that the user operation matches the third predetermined operation, the gesture recognition module 203 first determines the first starting contact point, the second starting contact point, or the midpoint of the line connecting the first starting contact point and the second starting contact point according to the user operation trajectory, and determines the key corresponding to the first starting contact point, the second starting contact point, or the midpoint of the line connecting the first starting contact point and the second starting contact point, wherein the first starting contact point and the second output point are the two starting contact points of the two-finger sliding operation, respectively. Then, in an optional implementation, a key can be randomly selected from the keys corresponding to the first starting contact point, the second starting contact point, and the midpoint of the line connecting the first starting contact point and the second starting contact point as the designated key.

[0267] In another optional implementation, the distance between the first starting contact point and the display position of the first corresponding key, the distance between the second starting contact point and the display position of the third corresponding key, and the distance between the midpoint of the line connecting the first starting contact point and the second starting contact point and the display position of the third corresponding key are calculated respectively, and the key that produces the smallest distance is determined to be the designated key. The first corresponding key is the key corresponding to the first starting contact point, the second corresponding key is the key corresponding to the second starting contact point, and the third corresponding key is the key corresponding to the midpoint of the line connecting the first starting contact point and the second starting contact point.

[0268] It should be understood that in S165, the keyboard layout module 202 specifically generates the second keyboard layout information according to the designated key information and the layout rule configuration information received in S706. For specific steps, see Figure 7 The illustrated embodiments are not described in detail here.

[0269] S166 , the keyboard layout module 202 returns the second keyboard layout information to the input method module 201 .

[0270] S167: The input method module 201 receives second keyboard layout information.

[0271] S168: The input method module 201 draws a second input method keyboard according to the second keyboard layout information, that is, an input method keyboard corresponding to the magnification mode.

[0272] It can be seen from the embodiment shown in FIG. 15( b ) that when the input method keyboard corresponding to the normal mode is displayed, the user can switch the input method keyboard of the normal mode to the input method keyboard of the enlarged mode by inputting a third predetermined operation.

[0273] In some embodiments, when the gesture recognition module 203 recognizes the received user operation, it may not distinguish whether it is the third predetermined operation or the fourth predetermined operation, but only needs to recognize whether it is a predetermined operation for switching the input method keyboard. If the gesture recognition module 203 determines through S154 that the user operation is a predetermined operation for switching the input method keyboard, a keyboard switching instruction signal is sent to the input method module. After receiving the keyboard switching instruction signal, the input method module 201 determines the display mode corresponding to the current input method keyboard. If the mode corresponding to the current input method keyboard is the enlarged mode, a first keyboard layout request is sent to the keyboard layout module 202. After receiving the first keyboard layout request, the keyboard layout module 202 generates the first keyboard layout information according to the layout rule corresponding to the normal mode and returns it to the input method module 201. If the mode corresponding to the current input method keyboard is the normal mode, a second keyboard layout request is sent to the keyboard layout module 202. After receiving the second keyboard layout request, the keyboard layout module 202 generates the second keyboard layout information according to the specified key information and the previously received layout rule configuration information and returns it to the input method module 201. The input method module 201 draws an input method keyboard according to the received first keyboard layout information or second keyboard layout information to complete the switching of the input method keyboard.

[0274] Fig.16 This is another flow chart of the input keyboard display method shown in the present application as an example. Fig.16 As shown, the method may include the following steps:

[0275] Step 401, when displaying a second input method keyboard, receiving user operations on the second input method keyboard, in which a first key is displayed at the geometric center of the keyboard display window, keys in a second key set are displayed around the first key, there is a predetermined relationship between the keys in the second key set and the first key, and the display size of the first key and the keys in the second key set is larger than the display size of other keys.

[0276] Step 402, in response to determining that the user operation is consistent with a predetermined operation for adjusting the key layout, adjusting the key layout of the second input method keyboard according to the user operation, wherein in the second input method keyboard after the key layout is adjusted, the display size of the third key and the keys in the fourth key set are larger than the display size of other keys, and the keys in the fourth key set are displayed around the third key.

[0277] based on Fig.16The input method keyboard display method provided in the illustrated embodiment allows the user to adjust the key layout of the keyboard by inputting a predetermined gesture operation when displaying the input method keyboard corresponding to the magnification mode. The keys magnified and displayed in the key layout before and after the adjustment are not exactly the same. In this way, the user can adjust the target key to the key magnified and displayed on the keyboard according to needs.

[0278] For the convenience of distinction and description, in the embodiment of the present application, the keys that are enlarged and displayed before the layout adjustment include the first key and the keys in the second key set, and the keys that are enlarged and displayed after the layout adjustment include the third key and the keys in the fourth key set. The first key has a predetermined relationship with the keys in the second key set; the third key has a predetermined relationship with the keys in the fourth key set.

[0279] For ease of explanation, the keys in the second key set are referred to as second keys, and the keys in the fourth key set are referred to as fourth keys.

[0280] It should be noted that the present application may have multiple gesture operations for adjusting the key layout. For example, it may be a single-finger sliding operation from any starting contact point to the geometric center of the keyboard display window, or a two-finger sliding operation from the same starting contact point or from two sufficiently close starting contact points in different directions. For the convenience of distinction and description, the aforementioned single-finger sliding operation is referred to as the first predetermined operation, and the aforementioned two-finger sliding operation is referred to as the second predetermined operation.

[0281] In some embodiments, the first key is displayed at the geometric center of the keyboard display window, and the second key is displayed around the first key. When the received user operation is a predetermined operation for adjusting the key layout, the third key and the fourth key are determined according to the starting point of the user operation. The third key is displayed at the geometric center of the keyboard display window, and the fourth key is displayed around the third key.

[0282] Fig.17 (a) to Fig.17 (c) shows the user interface change process and interaction process diagram when adjusting the button layout. Fig.17 (a) shows the input method keyboard and the gesture operation of the user input before the layout adjustment. Fig.17 (b) shows the input method keyboard after the layout is adjusted. Fig.17 As shown in (a), in the input method keyboard, the first key set includes the first key "G" and the second keys "F", "Y", "H", "V", "T", "U", "B" and "C". Among them, the "G" key is enlarged and displayed at the geometric center of the keyboard display window, and the second key "F" key and the like are enlarged and displayed around the "G" key. When the user slides a finger from the "S" key to the geometric center, the input method keyboard is enlarged. Fig.17(a) changes to Fig.17 (c). Fig.17 As shown in (c), in the input method keyboard after the layout change, the second key set includes the third key "S" and the fourth keys "D", "R", "Q", "W", "E", "T", "F", and "A". Among them, the third key "S" is determined according to the starting contact point of the sliding operation, and the other keys are determined according to the "S" key and the predetermined relationship.

[0283] Depend on Fig.17 (a) and Fig.17 (c) It can be seen that during the interaction, the user drags the "S" key and the keys around it to the geometric center area of ​​the keyboard display window for enlarged display. At the same time, the "G" key and the keys around it are moved to the right area of ​​the keyboard for display according to predetermined rules.

[0284] In some embodiments, when the user's finger is detected sliding from the "S" key to the "G" key, Fig.17 The interface shown in (a) changes to Fig.17 (b) shows the interface, and then Fig.17 (b) The interface changes to Fig.17 (c) shows the interface. Fig.17 (a) to Fig.17 As shown in (b), as the contact point moves, the "G" key and its surrounding keys move out of the geometric center area of ​​the keyboard display window and move to the right area of ​​the keyboard display window, the "F" key and its surrounding keys move to the geometric center area of ​​the keyboard display window and are displayed in an enlarged manner, and the "S" key and its surrounding keys gradually approach the geometric center area. As the contact point continues to move, the "F" key and its surrounding keys move out of the geometric center area of ​​the keyboard display window and move to the right area of ​​the keyboard display window for display, and the "S" key and its surrounding keys move to the geometric center area of ​​the keyboard display window and are displayed in an enlarged manner.

[0285] In other embodiments, when a sliding operation of the user's finger from the "S" key to the geometric center is detected, the key layout of the input method keyboard is directly changed from: Fig.17 (a) Update to Fig.17 (c) without showing Fig.17 (b) An intermediate state is shown exemplarily.

[0286] In some embodiments, the third key and the fourth key may not be displayed in the geometric center area of ​​the keyboard display window, but may be displayed in their original display positions / areas.

[0287] Fig.18 (a) to Fig.18 (b) shows the user interface change process and interaction process diagram when adjusting the button layout. Fig.18 (a) shows the input method keyboard and Figure 5 The input method keyboard shown in (b) has the same key layout, which will not be described in detail here. On the input method keyboard, the user slides one finger from the first starting contact point to the first direction, and slides another finger from the second starting contact point to the second direction. The first starting contact point and the second starting contact point are both points near the "S" key, and the first direction and the second direction are different directions. Fig.18 When the gesture operation is shown in (a), the button layout is as follows: Fig.18 (a) Change to Fig.18 (b) If Fig.18 As shown in (b), in the input method keyboard, the second key set includes the third key "S" and the fourth keys "D", "R", "Q", "W", "E", "T", "F", and "A". These keys are displayed in enlarged form at their original display positions, and the "G" key and the keys around it are reduced to normal size.

[0288] It can be seen from the above embodiments that in the input method keyboard display method provided in the embodiments of the present application, when displaying the input method keyboard in the enlarged mode, the user can adjust the key layout of the keyboard by inputting a predetermined gesture operation, and the keys enlarged and displayed in the key layout before and after the adjustment are not exactly the same. In this way, the user can adjust the target key to the key enlarged and displayed on the keyboard according to needs.

[0289] On the basis of the foregoing embodiment, the preset gesture library also includes trajectory data corresponding to the first predetermined operation and the second predetermined operation. After the gesture recognition module 203 receives the user operation, it can determine whether the user operation is the first predetermined operation or the second predetermined operation by comparing the contact trajectory corresponding to the user operation with the trajectory data corresponding to each predetermined operation in the preset gesture library. When it is determined that the user operation is the first predetermined operation or the second predetermined operation, the first predetermined operation or the second predetermined operation is sent to the input method module 201 in the form of a signal. After receiving the signal, the input method module 201 requests the keyboard layout module 202 to generate new keyboard layout information, so as to draw the corresponding input method keyboard according to the new keyboard layout information, thereby completing the adjustment of the key layout.

[0290] Fig.19 FIG. 2 is a schematic diagram showing the interaction process of the gesture recognition module 203, the input method module 201 and the keyboard layout module 202 in the process of adjusting the key layout. If the gesture recognition module 203 confirms through S154 that the received user operation is a predetermined operation for adjusting the key layout, such as Fig.19 As shown, the input method module 201, the keyboard layout module 202 and the gesture recognition module 203 may also perform the following steps:

[0291] S191, the gesture recognition module 203 sends a corresponding signal to the input method module 201, where the signal carries third key information.

[0292] In this embodiment, the third button information is determined according to the initial contact point of the user's operation.

[0293] In one implementation, when the position coordinates of the starting contact point in the keyboard display window fall into the display area (key position) of a certain key, the key is determined to be the key corresponding to the starting contact point. It is worth noting that if the position coordinates of the starting contact point in the keyboard display window do not fall into the display area of ​​any key, the key closest to the starting contact point is determined to be the key corresponding to the starting contact point. When there are two starting contacts operated by the user, if the position coordinates of the two starting contacts in the keyboard display window fall into the display area of ​​the same key, the key corresponding to the starting contact point is determined, and if the position coordinates of the two starting contacts in the keyboard display window fall into the display areas of two different keys respectively, any one of the keys is selected as the third key, or one of the keys is selected as the third key according to a preset rule. This application is not limited to this.

[0294] As mentioned above, the predetermined operation for adjusting the key layout may include a first predetermined operation and a second predetermined operation. The first predetermined operation may be Fig.17 (a) shows a single-finger sliding operation, the second predetermined operation can be as follows Fig.18 (a) shows a two-finger slide operation.

[0295] In order to display different key layouts when the user inputs different predetermined operations, if the gesture recognition module 203 confirms that the first predetermined operation is received through S154, then in S191, a first signal is sent to the input method module 201; if the gesture recognition module 203 confirms that the second predetermined operation is received through S154, then in S191, a second signal is sent to the input method module 201. The first signal or the second signal carries the third key information.

[0296] S192, the input method module 201 receives the signal sent by the gesture recognition module 203, and determines whether the currently displayed input method keyboard corresponds to the magnification mode; if so, S193 is executed. If not, the input first predetermined operation or the second predetermined operation is regarded as an invalid operation, and thus returns to S192.

[0297] It should be noted that, in some embodiments, the second predetermined operation and the third predetermined operation are actually the same gesture operation. Fig.18 (a) shows the user operation and Fig. 9 (a), 10(a), Fig.11 (a) and Fig.12The user operation shown in (a) is a two-finger sliding operation with two fingers separated. It should be understood that if the user operation is received when the input method keyboard in the normal mode is displayed, the user operation is used to switch the input method keyboard in the normal mode to the input method keyboard in the enlarged mode.

[0298] Based on this, in another implementation, if in S192, the input method module 201 determines that the currently displayed input method keyboard corresponds to the normal mode, the input method module 201 can execute S164 and subsequent steps shown in Figure 15(b), specifically refer to the embodiment shown in Figure 15(b).

[0299] In addition, if the user operation is received when the input method keyboard corresponding to the magnification mode is displayed, the key corresponding to the initial contact point of the user operation is used as the designated key, and the key layout of the input method keyboard is adjusted. Based on this, in the embodiment shown in FIG. 15( b), if it is determined in S163 that the currently displayed input method keyboard corresponds to the magnification mode, the input method module 201 can execute Fig.19 For details on S193 and subsequent steps, see Fig.19 The embodiment shown.

[0300] S193, the input method module 201 sends a layout adjustment request to the keyboard layout module, the layout adjustment request carries the third key information, and the layout adjustment request is used to enable the keyboard layout module 202 to generate new keyboard layout information according to the third key information.

[0301] Specifically, if the input method module 201 receives the first signal, it sends a first layout adjustment request to the keyboard layout module 202, and the first layout adjustment request is used to enable the keyboard layout module 202 to generate a first keyboard layout information according to the third key information, and the first keyboard layout information is used to draw the first keyboard layout information. Fig.17 If the input method module 201 receives the second signal, it sends a second layout adjustment request to the keyboard layout module 202. The second layout adjustment request is used to enable the keyboard layout module 202 to generate second keyboard layout information according to the third key information. The second keyboard layout information is used to draw the second keyboard layout information. Fig.18 (b) shows the input method keyboard.

[0302] The difference between the two types of key layout information is that the display positions of the third key and the fourth key are different. Specifically, in the first type of key layout information, the third key is displayed at the geometric center of the keyboard display window, and correspondingly, the fourth key is displayed around the third key in the geometric center area of ​​the keyboard display window. In the second type of key layout information, the third key is displayed at its original position, and the fourth key is displayed around the third key. For example, Fig.17 (c) with Fig.18(b) The difference is that Fig.17 In (c), the third key "S" is displayed in an enlarged manner at the geometric center of the keyboard display window, and the fourth keys "A", "Q", "W", "E", "R", "F", "D", and "Z" are displayed around "S" in the central area of ​​the keyboard display window; and Fig.18 In (b), the third button "S" is displayed in an enlarged manner at its original display position, and "A", "Q", "W", "E", "R", "F", "D", and "Z" are displayed in an enlarged manner around "S".

[0303] S194, the keyboard layout module 202 receives the layout adjustment request sent by the input method module 201, and generates new keyboard layout information according to the third key information.

[0304] If the keyboard layout module 202 receives the first layout adjustment request, it generates the first keyboard layout information according to the third key information, and the first keyboard layout information is used to draw the Fig.17 If the keyboard layout module 202 receives the second layout adjustment request, it generates the second keyboard layout information according to the third key information, and the second keyboard layout information is used to draw the input method keyboard shown in (c). Fig.18 (b) shows the input method keyboard.

[0305] In this embodiment, the layout adjustment request includes third key information, and a predetermined relationship is preset in the keyboard layout module 202. After receiving the layout adjustment request, the keyboard layout module 202 determines the third key according to the third key information, and determines the fourth key according to the third key and the preset predetermined relationship. Then, the first or second keyboard layout information is generated according to the third key, the fourth key, and the layout rule configuration information received in S706. The difference between the first keyboard layout information and the second keyboard layout information is that the display position coordinates of some or all corresponding keys are different.

[0306] It should be noted that the predetermined relationship involved in adjusting the key layout in this application may be the same as or different from the predetermined relationship involved in displaying the keyboard for the first time or switching the keyboard. In other words, the predetermined relationship between the third key and the fourth key may be the same as or different from the predetermined relationship between the specified key and other keys in the preset key set.

[0307] Based on this, in one implementation, the first predetermined relationship and the second predetermined relationship are preset in the keyboard layout module 202. When the keyboard layout module 202 receives a keyboard layout request, it determines other keys that need to be magnified and displayed according to the specified key information in the keyboard layout request and the first predetermined relationship. When the keyboard layout module 202 receives a layout adjustment request, it determines other keys that need to be magnified and displayed according to the third key information in the layout adjustment request and the second predetermined relationship.

[0308] It is worth noting that, in addition to the predetermined relationship mentioned above, the second predetermined relationship may also be the distance relationship between the keys on the specified key layout, and the specified key layout may be the key layout corresponding to the normal mode as shown in FIG2(b), or the current key layout. It should be understood that the current key layout may be the key layout in the normal mode, or the key layout in the magnified mode. For example, the fourth key is a key whose distance from the third key in the current key layout is less than a predetermined value. For another example, the fourth key is one of the n keys whose distance from the third key in the current key layout is the smallest.

[0309] In one example, the current key layout is as follows Fig.17 As shown in (a), the third key information carried in the layout adjustment request is "S", and the second predetermined relationship preset in the keyboard layout module 202 stipulates that the fourth key is a key whose distance from the third key in the current key layout is less than a predetermined value. The keyboard layout module 202 calculates the distance between each key and "S" according to the display position of each key in the current key layout, and then, it can be determined that the keys whose distance from "S" is less than the predetermined value are "D", "R", "Q", "W", "E", "T", "F", and "A" respectively.

[0310] In another example, the current key layout is as follows Fig.17 As shown in (a), the third key information carried in the layout adjustment request is "S", and the second predetermined relationship preset in the keyboard layout module 202 stipulates that the fourth key is the four keys with the smallest distance from the third key in the current key layout. The keyboard layout module 202 calculates the distance between each key and "S" according to the display position of each key in the current key layout, and then, it can be determined that the four keys with the smallest distance from "S" are "R", "W", "A", and "T" respectively.

[0311] In addition, based on the above example, the enlargement rule for some keys can be used to: let the decreasing ratio of the display size of the keys in the set be m, let the display size of the third key be the maximum key size (the display width and height are a and b respectively); let the display width and height of a part of the fourth keys in the set be (1-m)a and (1-m)b respectively, and in the current key layout, the distance between this part of the keys and the third key is less than the first value; let the display width and height of another part of the fourth keys in the set be (1-m)(1-m)a and (1-m)(1-m)b respectively, and in the current key layout, the distance between this part of the keys and the third key falls into the second value, where the first value is less than the second value. For example, in Fig.17 In the key layout shown in (c), since the distance between "R", "W", "T", "A" and "S" is less than the first value, and "D", "Q", "E", and "F" are less than the second value, the display size of "R", "W", "T", and "A" is greater than the display size of "D", "Q", "E", and "F". S195, the keyboard layout module 202 returns the keyboard layout information to the input method module 201.

[0312] S196, the input method module 201 receives the keyboard layout information returned by the keyboard layout module 202.

[0313] S197, updating the input method keyboard according to the keyboard layout information, wherein in the updated input method keyboard, the third key and the fourth key having a predetermined relationship with the third key are enlarged and displayed.

[0314] Depend on Fig.19 It can be seen that when the input method keyboard is displayed in the magnified mode, the user can adjust the keyboard key layout by inputting a predetermined gesture operation. The keys enlarged and displayed in the key layout before and after the adjustment are not exactly the same. In this way, the user can adjust the target key to the key enlarged and displayed on the keyboard according to needs.

[0315] It should be noted that, based on this embodiment, the present application can also provide a variety of other implementations, including at least the above-mentioned Figure 7 The six implementation methods provided in the illustrated embodiment are not described in detail here.

[0316] See also Fig.17 As can be seen from the key layout of the input method keyboard shown in (c), after the "S" key and the keys around it are adjusted to the center area of ​​the keyboard display window for enlarged display, the keys that do not belong to the second key set are all displayed in the right area of ​​the keyboard display window, making the arrangement of these keys more crowded. Moreover, in the case where the area of ​​the right area is insufficient, in order to display all these keys, the display size of these keys will need to be further reduced. This not only affects the aesthetics of the user interface, but also is not conducive to user operation.

[0317] Fig. 20 (a) to Fig. 20 (b) is an exemplary diagram of the interface change process and interaction when adjusting the button layout in this application. Fig. 20 (a) shows the input method keyboard and user operation and Fig.17 (a) is the same and will not be described here. When a user slides from the "S" key to the "G" key, the key layout is changed from Fig. 20 (a) changes to Fig. 20 (b) With Fig.18 (b) and Fig.17 (c) The difference is that Fig. 20 In the key layout shown in (b), the key layout on the left and right sides of the keyboard display window is basically symmetrical. This is because several keys in the right area of ​​the keyboard are moved to the left area of ​​the keyboard display window for display, thereby reducing the number of keys in the right area and increasing the number of keys in the right area, so that all keys can be evenly arranged in the keyboard display window, improving the basic symmetry of the key layout, which can not only ensure the beauty of the user interface, but also facilitate user operation.

[0318] Key position refers to the position or area in the keyboard display window used to display each key. As a possible implementation, when displaying the input method keyboard in the magnified mode or adjusting the key layout, the key position can be fixed unchanged, and under the principle of retaining the specific arrangement order of the keys, the key position corresponding to each key in the preset key set and the key position corresponding to the remaining keys are determined in turn, and each key is laid out at its corresponding key position. In this way, no matter which keys need to be magnified and displayed, the key layout on the left and right sides of the keyboard display window can be guaranteed to be basically symmetrical, thereby ensuring the beauty of the user interface and the convenience of user operation.

[0319] Fig.21 Schematic diagram of an exemplary key position distribution. In this example, one key position corresponds to one key position identifier, and the key position identifier can represent the position sequence number of the key position among all key positions.

[0320] Combination Fig. 20 (a), the letter keys that conform to the QWERTY arrangement order are displayed in sequence as follows Fig.21 The key positions "1-26" are shown in the figure. Among them, the key position corresponding to the designated key "G" is "17", the key positions corresponding to the "F", "Y", "H", "V", "T", "U", "B", and "C" keys are "16", "4", "18", "23", "10", "11", "24", and "22", respectively, and the key positions corresponding to the "Q", "W" and other keys are "1", "2", and so on.

[0321] Combination Fig. 20(b), in response to the user's gesture operation of dragging the "S" key from key position "9" to key position "17", the "S" key is moved from key position "9" to key position "17" and displayed in an enlarged manner, and the "R" and other keys are moved from key position "8" to key position "16" and displayed in an enlarged manner, and the "M", "N", "B" and other keys at the end of the QWERTY arrangement sequence are moved to key positions "21", "15", "14" and other keys in turn for display. It can be seen that when the user adjusts the key layout through gesture operation, the key position design on the input method keyboard remains unchanged. While keeping the specific arrangement order unchanged, the keys are moved to the new key positions for display, and the new key positions are determined according to the input user operation.

[0322] In another possible implementation, when the input method keyboard in the magnified mode is displayed or the key layout is adjusted, the fixed key positions remain unchanged, the keys to be magnified are displayed on pre-marked key positions, and the remaining keys are randomly displayed on the remaining key positions.

[0323] In the above embodiments, various implementation methods of the input method keyboard display method of the present application are introduced in combination with the user interface changes and the interaction process between the user and the device. It is understandable that, in order to realize the above functions, each terminal device includes a hardware structure and / or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the exemplary user interfaces, interaction methods, and algorithm steps described in the embodiments disclosed herein, the present invention can be implemented in the form of a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0324] For example, the terminal device 100 may implement corresponding functions through software modules.

[0325] In some embodiments, Fig. 22 As shown, the input method keyboard display device for realizing the above functions of the above terminal device includes:

[0326] An input method module is used to display a first input method keyboard in a keyboard display window of a touch screen in response to a keyboard display instruction, wherein in the first input method keyboard, a first key is displayed at the geometric center of the keyboard display window, keys in a second key set are displayed around the first key, there is a predetermined relationship between the keys in the second key set and the first key, and the display size of the first key and the keys in the second key set are larger than the display size of other keys.

[0327] In one implementation, the first button has a first display size, the first part of the buttons of the second button set has a second display size, and the second part of the buttons of the second button set has a third display size, and the first display size, the second display size and the third display size decrease in sequence according to a predetermined ratio.

[0328] In one implementation, the second display size is the same as the third display size and is smaller than the first display size.

[0329] In one implementation, the first display size, the second display size, and the third display size are the same.

[0330] In one implementation, the second key set includes keys adjacent to the first key in a predetermined letter key matrix, or includes keys that are pre-associated with the first key.

[0331] In one implementation, the device further includes:

[0332] a gesture recognition module, configured to detect a user operation on the first input method keyboard; if the user operation is consistent with a predetermined operation for adjusting the key layout, determining a third key and a fourth key set according to the user operation, wherein the keys in the fourth key set have a predetermined relationship with the third key;

[0333] The input method module is also used to adjust the key layout of the first input method keyboard according to the third key and the fourth key set. In the adjusted first input method keyboard, the display size of the keys in the third key and the fourth key set is larger than the display size of other keys, and the keys in the fourth key set are displayed around the third key.

[0334] In one implementation, the predetermined operation for adjusting the key layout includes a first predetermined operation and a second predetermined operation, wherein:

[0335] When the user operation is consistent with the first predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the geometric center of the keyboard display window;

[0336] When the user operation is consistent with the second predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the original display position, and the original display position refers to the display position of the third key in the first input method keyboard before the adjustment.

[0337] In one implementation, the first predetermined operation is a single-finger sliding operation from any starting contact point to the geometric center of the input method keyboard; the second predetermined operation is a two-finger sliding operation from the first starting contact point along the first direction and from the second starting contact point along the second direction, and the distance between the first starting contact point and the second starting contact point is less than the preset distance.

[0338] In one implementation, the keys in the fourth key set are keys whose distances from the third key in the current key layout meet a preset condition.

[0339] In one implementation, the input method module is also used to: if the user operation is consistent with a fourth predetermined operation, switch the first input method keyboard to a second input method keyboard, in which the display size of keys of the same type is the same; the fourth predetermined operation is a two-finger sliding operation that slides simultaneously from different starting points toward the center.

[0340] In one implementation, the input method module is also used to: if the user operation is consistent with a third predetermined operation, switch the second input method keyboard to the first input method keyboard; the third predetermined operation is a two-finger sliding operation from a first starting contact point along a first direction and from a second starting contact point along a second direction, and the distance between the first starting contact point and the second starting contact point is less than a preset distance.

[0341] In one implementation, the keyboard display instruction includes: an input method keyboard start instruction received when the input method keyboard is not displayed; and a keyboard switching instruction generated when the third predetermined operation is received when the second input method keyboard is displayed.

[0342] In one implementation, the first button is a preset button or a button determined according to the third predetermined operation.

[0343] In one implementation, the first key is a key corresponding to the first starting contact point, the second starting contact point, or a midpoint of a line connecting the first starting contact point and the second starting contact point.

[0344] In one implementation, the key positions on the first input method keyboard are fixed, the keys in the first key set and the second key set, or the keys in the third key set and the fourth key set are respectively displayed on predetermined key positions, and the remaining keys are displayed on remaining key positions according to preset rules.

[0345] In some embodiments, the present application also provides a terminal device, including a memory and a processor, wherein the memory is coupled to the processor; the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the terminal device executes the input method keyboard display method provided in an embodiment of the present application.

[0346] In a specific implementation, the present invention further provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the input method keyboard display method provided by the present invention. The storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).

[0347] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention or some parts of the embodiments.

[0348] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.

[0349] The above-described embodiments of the present invention do not limit the protection scope of the present invention.

Claims

1. An input method keyboard display method, characterized in that: The method comprises: In response to the keyboard display instruction, a first input method keyboard is displayed in a keyboard display window of the touch screen, wherein in the first input method keyboard, a first key is displayed at a geometric center of the keyboard display window, keys in a second key set are displayed around the first key, there is a predetermined relationship between the keys in the second key set and the first key, the predetermined relationship includes at least one of a positional relationship between the keys in the second key set and the first key, an association relationship between key identifiers, and an association relationship between key sequences, and the display size of the first key and the keys in the second key set are larger than the display size of other keys; Detecting a user operation on the first input method keyboard; If the user operation is consistent with a predetermined operation for adjusting the key layout, a third key and a fourth key set are determined according to the user operation, and there is a predetermined relationship between the keys in the fourth key set and the third key, and the predetermined relationship includes at least one of a position relationship between the keys in the fourth key set and the third key, an association relationship between key identifiers, and an association relationship between key sequences; the key layout of the first input method keyboard is adjusted according to the third key and the fourth key set, and in the adjusted first input method keyboard, the display size of the third key and the keys in the fourth key set is larger than the display size of other keys, and the keys in the fourth key set are displayed around the third key; Alternatively, if the user operation is consistent with a fourth predetermined operation, the first input method keyboard is switched to a second input method keyboard, in which keys of the same type have the same display size; the fourth predetermined operation is a two-finger sliding operation that slides simultaneously from different starting points toward the center.

2. The method according to claim 1, characterized in that: The first button has a first display size, the first part of the buttons of the second button set has a second display size, and the second part of the buttons of the second button set has a third display size. The first display size, the second display size and the third display size decrease in sequence according to a predetermined ratio.

3. The method according to claim 2, characterized in that The second display size is the same as the third display size and is smaller than the first display size.

4. The method according to claim 2, characterized in that: The first display size, the second display size and the third display size are the same.

5. The method according to any one of claims 1 to 4, characterized in that: The second key set includes keys adjacent to the first key in a predetermined key matrix, or includes keys that are pre-associated with the first key, and the predetermined key matrix includes at least all English letter keys.

6. The method according to claim 1, characterized in that The predetermined operation for adjusting the key layout includes a first predetermined operation and a second predetermined operation, wherein: When the user operation is consistent with the first predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the geometric center of the keyboard display window; When the user operation is consistent with the second predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the original display position, and the original display position refers to the display position of the third key in the first input method keyboard before the adjustment.

7. The method according to claim 6, characterized in that The first predetermined operation is a single-finger sliding operation from any starting contact point to the geometric center of the input method keyboard; the second predetermined operation is a two-finger sliding operation from the first starting contact point along the first direction and from the second starting contact point along the second direction, and the distance between the first starting contact point and the second starting contact point is less than the preset distance.

8. The method according to claim 1, characterized in that The keys in the fourth key set are keys whose distances from the third key in the current key layout meet a preset condition.

9. The method according to claim 1, characterized in that: The method further comprises: detecting a user operation on the second input method keyboard; If the user operation is consistent with a third predetermined operation, the second input method keyboard is switched to the first input method keyboard; the third predetermined operation is a two-finger sliding operation from a first starting contact point along a first direction and from a second starting contact point along a second direction, and the distance between the first starting contact point and the second starting contact point is less than a preset distance.

10. The method according to claim 9, characterized in that The keyboard display instructions include: In the case where the input method keyboard is not displayed, a received instruction to display the input method keyboard; and, when the second input method keyboard is displayed, a keyboard switching instruction generated when the third predetermined operation is received.

11. The method according to claim 9, characterized in that The first button is a preset button or a button determined according to the third predetermined operation.

12. The method according to claim 11, characterized in that The step of determining the first key according to the third predetermined operation includes: determining the first starting contact, the second starting contact, the key corresponding to the midpoint of the line connecting the first starting contact and the second starting contact, or the key closest to the midpoint of the line connecting the first starting contact and the second starting contact as the first key.

13. The method according to claim 1, characterized in that The key positions on the first input method keyboard are fixed, the keys in the first key set and the second key set, or the keys in the third key set and the fourth key set are respectively displayed on predetermined key positions, and the remaining keys are displayed on remaining key positions according to preset rules.

14. An input method keyboard display device, applied to a terminal device, characterized in that: The device comprises: An input method module, configured to display a first input method keyboard in a keyboard display window of a touch screen in response to a keyboard display instruction, wherein in the first input method keyboard, a first key is displayed at a geometric center of the keyboard display window, keys in a second key set are displayed around the first key, there is a predetermined relationship between the keys in the second key set and the first key, the predetermined relationship includes at least one of a positional relationship between the keys in the second key set and the first key, an association relationship between key identifiers, and an association relationship between key sequences, and the display size of the first key and the keys in the second key set are larger than the display size of other keys; a gesture recognition module, configured to detect a user operation on the first input method keyboard; if the user operation is consistent with a predetermined operation for adjusting the key layout, determine a third key and a fourth key set according to the user operation, wherein the keys in the fourth key set have a predetermined relationship with the third key, and the predetermined relationship includes at least one of a position relationship between the keys in the fourth key set and the third key, an association relationship between key identifiers, and an association relationship between key sequences; The input method module is further used to adjust the key layout of the first input method keyboard according to the third key and the fourth key set, so that in the adjusted first input method keyboard, the display size of the keys in the third key and the fourth key set is larger than the display size of other keys, and the keys in the fourth key set are displayed around the third key; The input method module is also used to switch the first input method keyboard to a second input method keyboard if the user operation is consistent with a fourth predetermined operation, in which the display size of keys of the same type are the same; the fourth predetermined operation is a two-finger sliding operation of sliding from different starting contact points simultaneously to the center.

15. The device according to claim 14, characterized in that The first button has a first display size, the first part of the buttons of the second button set has a second display size, and the second part of the buttons of the second button set has a third display size. The first display size, the second display size and the third display size decrease in sequence according to a predetermined ratio.

16. The device according to claim 15, characterized in that The second display size is the same as the third display size and is smaller than the first display size.

17. The device according to claim 15, characterized in that The first display size, the second display size and the third display size are the same.

18. The device according to any one of claims 14 to 17, characterized in that: The second key set includes keys adjacent to the first key in a predetermined letter key matrix, or includes keys that are pre-associated with the first key.

19. The device according to claim 14, characterized in that The predetermined operation for adjusting the key layout includes a first predetermined operation and a second predetermined operation, wherein: When the user operation is consistent with the first predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the geometric center of the keyboard display window; When the user operation is consistent with the second predetermined operation, in the adjusted first input method keyboard, the third key is displayed at the original display position, and the original display position refers to the display position of the third key in the first input method keyboard before the adjustment.

20. The device according to claim 19, characterized in that The first predetermined operation is a single-finger sliding operation from any starting contact point to the geometric center of the input method keyboard; the second predetermined operation is a two-finger sliding operation from the first starting contact point along the first direction and from the second starting contact point along the second direction, and the distance between the first starting contact point and the second starting contact point is less than the preset distance.

21. The device according to claim 14, characterized in that The keys in the fourth key set are keys whose distances from the third key in the current key layout meet a preset condition.

22. The device according to claim 14, characterized in that The input method module is also used for: If the user operation is consistent with a third predetermined operation, the second input method keyboard is switched to the first input method keyboard; the third predetermined operation is a two-finger sliding operation from a first starting contact point along a first direction and from a second starting contact point along a second direction, and the distance between the first starting contact point and the second starting contact point is less than a preset distance.

23. The device according to claim 22, characterized in that The keyboard display instructions include: When the input method keyboard is not displayed, an input method keyboard activation instruction is received; and, when the second input method keyboard is displayed, a keyboard switching instruction generated when the third predetermined operation is received.

24. The device according to claim 22, characterized in that The first button is a preset button or a button determined according to the third predetermined operation.

25. The device according to claim 23, characterized in that The first key is a key corresponding to the first starting contact, the second starting contact, a midpoint of a line connecting the first starting contact and the second starting contact, or a key closest to the midpoint of a line connecting the first starting contact and the second starting contact.

26. The device according to claim 14, characterized in that The key positions on the first input method keyboard are fixed, the keys in the first key set and the second key set, or the keys in the third key set and the fourth key set are respectively displayed on predetermined key positions, and the remaining keys are displayed on remaining key positions according to preset rules.

27. A terminal device, comprising a memory and a processor, wherein the memory is coupled to the processor; the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the terminal device executes the method as described in any one of claims 1-13.

Images