Input method, device and electronic device

By determining the target object in the input method panel and processing specified gesture operations, combined with voice information feedback, the problem of flexibility and efficiency in the use of the input method is solved, and the user experience is improved, especially for visually impaired users.

CN111679746BActive Publication Date: 2024-11-05BEIJING SOGOU TECHNOLOGY DEVELOPMENT CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202010444416.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-05-22
Publication Date
2024-11-05
Estimated Expiration
2040-06-19

AI Technical Summary

Technical Problem

The existing input methods are not flexible and efficient enough during use, and the user input experience is poor.

Method used

By determining the currently selected target object in the input method panel and processing according to the custom function operation when a specified gesture operation is monitored, the voice information of the target object is played to improve input flexibility and efficiency.

Benefits of technology

It realizes more efficient input by users when using the input method, improves user experience, and provides voice feedback for visually impaired users, enhancing the convenience of operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111679746B_ABST
    Figure CN111679746B_ABST
Patent Text Reader

Abstract

The embodiments of the present invention provide an input method, device and electronic device, the method comprising determining a target object currently selected in an input method panel; wherein the target object is used to process according to a corresponding custom function operation when a touch operation is detected to be a designated gesture operation; and playing voice information of the target object. The embodiments of the present invention perform corresponding processing on the target object based on the custom function operation corresponding to the touch operation, so that the user can input more flexibly and efficiently during the use of the input method, thereby improving the user's input experience. In addition, voice information corresponding to the target object is provided to prompt the user, further improving the user's input experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to an input method, device and electronic equipment. Background Art

[0002] With the development of computer technology, electronic devices such as mobile phones and tablet computers are becoming more and more popular, bringing great convenience to people's life, study and work. These electronic devices are usually installed with input method applications (input methods for short), so that users can use the input methods to input information.

[0003] As user demands continue to increase, the functions of input methods also need to be continuously enriched to better provide the required input services for different users. However, in the process of using input methods, the input is still not flexible and efficient enough, and the user input experience is not high. Summary of the invention

[0004] The embodiment of the present invention provides an input method to enable a user to input more flexibly and efficiently when using the input method, thereby improving the user's input experience.

[0005] Correspondingly, an embodiment of the present invention further provides an input device and an electronic device to ensure the implementation and application of the above method.

[0006] In order to solve the above problems, an embodiment of the present invention discloses an input method, which specifically includes: determining the target object currently selected in the input method panel; the target object is used to process according to the corresponding custom function operation when the touch operation is detected to be a specified gesture operation; and playing the voice information of the target object.

[0007] Optionally, determining the target object currently selected in the input method panel includes: starting the input method panel, determining the target control currently selected in the input method panel; and using the target control as the currently selected target object.

[0008] Optionally, after taking the target control as the currently selected target object, the method further includes: when a touch operation on the target control is detected, popping up a setting pop-up window corresponding to the target control; when a touch operation on a setting item in the setting pop-up window is detected, taking the setting item as the target setting item, and processing the sub-controls contained in the target setting item; when a touch operation outside the setting pop-up window is detected, closing the setting pop-up window.

[0009] Optionally, determining the target object currently selected in the input method panel includes: obtaining input information input by the user through the input method panel; obtaining candidate items corresponding to the input information; determining a target candidate item from the candidate items, and using the target candidate item as the currently selected target object.

[0010] Optionally, the playing of the voice information of the target object includes: determining a play mode of the target candidate item according to the number of characters of the target candidate item; and playing the voice information of the target candidate item according to the play mode.

[0011] Optionally, determining the playback mode of the target candidate item based on the number of characters of the target candidate item includes: when the number of characters of the target candidate item is less than or equal to a preset number, determining the playback mode of the target candidate item to be a first playback mode; wherein the first playback mode is to play the characters in the target candidate item and the explanatory information corresponding to the characters one by one; when the number of characters of the target candidate item is greater than a preset number, determining the playback mode of the target candidate item to be a second playback mode; wherein the second playback mode is to play all the characters of the target candidate item, and then play the characters in the target candidate item and the explanatory information corresponding to the characters one by one.

[0012] Optionally, obtaining input information input by the user through the input method panel includes: monitoring the holding time of the touch operation on the space bar on the input method panel; when the holding time meets the preset response time, triggering the voice input mode; in the voice input mode, obtaining the user's voice information as the user's input information.

[0013] Optionally, the obtaining of input information input by the user through the input method panel includes: monitoring a touch operation on a key on the input method panel; when the touch operation on the key is a preset touch operation, using a character corresponding to the key as the user's input information.

[0014] Optionally, the method further includes: when the key targeted by the touch operation changes, or the operation type of the touch operation changes, triggering prompt information corresponding to the key targeted by the touch operation.

[0015] Optionally, the touch operation includes at least one of a pressing operation and a hand-raising operation, and the prompt information includes at least one of a key sound effect and a key vibration.

[0016] Optionally, determining the target candidate item from the candidate items includes: taking the first candidate item among the candidate items as the target candidate item.

[0017] Optionally, after obtaining the candidate items corresponding to the input information, the method further includes: obtaining a participle symbol input by the user through the input method panel for the input information; combining the input information and the participle symbol into new input information, and obtaining an update candidate item corresponding to the new input information;

[0018] The step of determining a target candidate item from the candidate items and using the target candidate item as the currently selected target object includes: determining a target update candidate item from the update candidate items and using the target update candidate item as the currently selected target object.

[0019] Optionally, the method further includes: after switching to the symbol keyboard on the input method panel, determining the currently selected symbol keyboard; and playing voice information corresponding to the currently selected symbol keyboard.

[0020] Optionally, after determining the target candidate item from the candidate items, the method includes: acquiring a touch operation of the user on the input method panel; and processing the candidate item according to the touch operation on the input method panel.

[0021] Optionally, processing the candidate items according to the touch operation on the input method panel includes:

[0022] Determine the first custom function operation corresponding to the touch operation of the input method panel, and process the candidate item according to the first custom function operation; the first custom function operation corresponding to the touch operation is a function operation on the candidate item corresponding to the specified gesture operation matching the touch operation; wherein, the processing of the candidate item at least includes: obtaining the previous candidate item of the target candidate item as a new target candidate item; obtaining the next candidate item of the target candidate item as a new target candidate item; putting the target candidate item on the screen; after updating the input information and obtaining new candidate items, the first of the new candidate items is used as a new target candidate item; clearing the input information; obtaining the previous page of candidates corresponding to the target candidate item; obtaining the next page of candidates corresponding to the target candidate item.

[0023] Optionally, the method further includes: when no candidate item corresponding to the input information can be obtained, obtaining a touch operation of the user on the input method panel; and processing the input information according to the touch operation on the input method panel.

[0024] Optionally, processing the input information according to the touch operation on the input method panel includes: determining a second custom function operation corresponding to the touch operation of the input method panel, and processing the input information according to the second custom function operation; the second custom function operation corresponding to the touch operation is a functional operation on the input information corresponding to a specified gesture operation matching the touch operation; wherein, processing the input information at least includes: moving the cursor forward on the input information; moving the cursor backward on the input information; selecting the character before the cursor in the input information; selecting the character after the cursor in the input information.

[0025] Optionally, the designated gesture operation includes at least one of two-finger left swipe, two-finger right swipe, two-finger up swipe and two-finger down swipe.

[0026] Optionally, the method further includes: determining a keyboard type of the input method panel; obtaining a touch operation of the user on a designated key on the input method panel; and processing the candidate items according to the keyboard type and the touch operation on the designated key.

[0027] Optionally, the processing of the candidate items according to the keyboard type and the touch operation on the designated key includes: when the input method panel is a full-key panel, if it is a touch operation on a comma key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a period key, obtaining the next candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a number switch key, obtaining the previous page of candidates corresponding to the target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next page of candidates corresponding to the target candidate item; when the input method panel is a nine-key panel, if it is a touch operation on a number switch key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next candidate item of the target candidate item as a new target candidate item.

[0028] An embodiment of the present invention also discloses an input device, which specifically includes: a determination module, used to determine the target object currently selected in the input method panel; wherein the target object is used to process according to the corresponding custom function operation when the touch operation is detected to be a specified gesture operation; and a playback module, used to play the voice information of the target object.

[0029] Optionally, the determination module is used to start the input method panel, determine the target control currently selected in the input method panel, and use the target control as the currently selected target object.

[0030] Optionally, the device also includes: a monitoring module, which is used to pop up a setting pop-up window corresponding to the target control when a touch operation on the target control is detected; when a touch operation on a setting item in the setting pop-up window is detected, the setting item is used as a target setting item, and the sub-controls contained in the target setting item are processed; when a touch operation outside the setting pop-up window is detected, the setting pop-up window is closed.

[0031] Optionally, the determination module is used to obtain input information input by the user through the input method panel; obtain candidate items corresponding to the input information; determine a target candidate item from the candidate items, and use the target candidate item as the currently selected target object.

[0032] Optionally, the playing module is used to determine the playing mode of the target candidate item according to the number of characters of the target candidate item; and play the voice information of the target candidate item according to the playing mode.

[0033] Optionally, the playback module is used to determine that the playback mode of the target candidate item is a first playback mode when the number of characters of the target candidate item is less than or equal to a preset number; wherein the first playback mode is to play the characters in the target candidate item and the explanatory information corresponding to the characters one by one; when the number of characters of the target candidate item is greater than the preset number, determine that the playback mode of the target candidate item is a second playback mode; wherein the second playback mode is to play all the characters of the target candidate item, and then play the characters in the target candidate item and the explanatory information corresponding to the characters one by one.

[0034] Optionally, the determination module is used to monitor the holding time of the touch operation on the space bar on the input method panel; when the holding time meets the preset response time, trigger the voice input mode; in the voice input mode, obtain the user's voice information as the user's input information.

[0035] Optionally, the determination module is used to monitor the touch operation on the key on the input method panel; when the touch operation on the key is a preset touch operation, the character corresponding to the key is used as the user's input information.

[0036] Optionally, the determination module is used to trigger prompt information corresponding to the key targeted by the touch operation when the key targeted by the touch operation changes, or the operation type of the touch operation changes.

[0037] Optionally, the touch operation includes at least one of a pressing operation and a hand-raising operation, and the prompt information includes at least one of a key sound effect and a key vibration.

[0038] Optionally, the determination module is used to take the first candidate item among the candidate items as the target candidate item.

[0039] Optionally, the device also includes: an update module, used to obtain the participle symbol input by the user for the input information through the input method panel; combine the input information and the participle symbol into new input information, and obtain update candidate items corresponding to the new input information; the determination module, used to determine the target update candidate items from the update candidate items, and use the target update candidate items as the currently selected target object.

[0040] Optionally, the device further includes: a symbol keyboard voice playing module, which is used to determine the currently selected symbol keyboard after switching to the symbol keyboard on the input method panel; and play the voice information corresponding to the currently selected symbol keyboard.

[0041] Optionally, the device includes: a first candidate item processing module, configured to obtain a touch operation of the user on the input method panel; and process the candidate items according to the touch operation on the input method panel.

[0042] Optionally, the first candidate item processing module is used to determine the first custom function operation corresponding to the touch operation of the input method panel, and process the candidate item according to the first custom function operation; the first custom function operation corresponding to the touch operation is a function operation on the candidate item corresponding to a specified gesture operation matching the touch operation; wherein, the processing of the candidate item at least includes: obtaining the previous candidate item of the target candidate item as a new target candidate item; obtaining the next candidate item of the target candidate item as a new target candidate item; putting the target candidate item on the screen; after updating the input information and obtaining a new candidate item, the first of the new candidate items is used as a new target candidate item; clearing the input information; obtaining the previous page of candidates corresponding to the target candidate item; obtaining the next page of candidates corresponding to the target candidate item.

[0043] Optionally, the device further includes: an input information processing module, configured to obtain the user's touch operation on the input method panel when no candidate item corresponding to the input information is obtained; and process the input information according to the touch operation on the input method panel.

[0044] Optionally, the input information processing module is used to determine a second custom function operation corresponding to the touch operation of the input method panel, and process the input information according to the second custom function operation; the second custom function operation corresponding to the touch operation is a functional operation on the input information corresponding to a specified gesture operation matching the touch operation; wherein, processing the input information at least includes: moving the cursor forward on the input information; moving the cursor backward on the input information; selecting the character before the cursor in the input information; selecting the character after the cursor in the input information.

[0045] Optionally, the designated gesture operation includes at least one of two-finger left swipe, two-finger right swipe, two-finger up swipe and two-finger down swipe.

[0046] Optionally, the device also includes: a second candidate item processing module, used to determine the keyboard type of the input method panel; obtain the user's touch operation on the designated key on the input method panel; and process the candidate items according to the keyboard type and the touch operation on the designated key.

[0047] Optionally, the second candidate item processing module is used for, when the input method panel is a full-key panel, if it is a touch operation on a comma key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a period key, obtaining the next candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a number switch key, obtaining the previous page of candidates corresponding to the target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next page of candidates corresponding to the target candidate item; when the input method panel is a nine-key panel, if it is a touch operation on a number switch key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next candidate item of the target candidate item as a new target candidate item.

[0048] An embodiment of the present invention further discloses a readable storage medium. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the input method as described in any one of the embodiments of the present invention.

[0049] An embodiment of the present invention also discloses an electronic device, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: determining a target object currently selected in an input method panel; and playing voice information of the target object.

[0050] The embodiments of the present invention include the following advantages:

[0051] In an embodiment of the present invention, after starting the input method, the target object currently selected in the input method panel is determined, and voice information of the target object is played, wherein the target object is used to perform processing according to the corresponding custom function operation when the touch operation is detected to be a specified gesture operation, and corresponding processing is performed on the target object based on the custom function operation corresponding to the touch operation, so that the user's input is more flexible and efficient during the use of the input method, thereby improving the user's input experience. In addition, voice information corresponding to the target object is provided to prompt the user, further improving the user's input experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 is a flow chart of steps of an input method embodiment of the present invention;

[0053] Figure 2 is a flowchart of steps of an optional embodiment of an input method of the present invention;

[0054] Figure 3 is a schematic diagram of a voice setting pop-up window of the present invention;

[0055] Figure 4 is a schematic diagram of a voice translation panel of the present invention;

[0056] Figure 5 is a flowchart of steps of another optional embodiment of the input method of the present invention;

[0057] Figure 6 is a schematic diagram of a barrier-free arrangement of the present invention;

[0058] Figure 7 is a customized schematic diagram of a two-finger sliding operation of the present invention;

[0059] Figure 8 is a structural block diagram of an input device embodiment of the present invention;

[0060] Fig. 9 A structural block diagram of an electronic device for input according to an exemplary embodiment;

[0061] Fig.10 It is a structural schematic diagram of an electronic device for input according to another exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0062] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0063] Reference Figure 1, shows a flow chart of steps of an input method embodiment of the present invention, which may specifically include the following steps:

[0064] Step 102, determining the target object currently selected in the input method panel; wherein the target object is used to process according to the corresponding custom function operation when the touch operation is detected to be a designated gesture operation.

[0065] Step 104: play the voice information of the target object.

[0066] In the process of using the input method, it is necessary to first start the input method panel. Among them, the input method panel includes multiple panels, such as a symbol panel, a number panel, a voice panel, a voice translation panel, a pinyin panel, and an English panel. In an embodiment of the present invention, the controls displayed on the input method panel and the candidate items obtained after the user inputs information through the input method panel can all be used as the currently selected target object. Among them, the target object can be automatically located and selected by the input method, or it can be manually selected by the user.

[0067] In the embodiment of the present invention, a corresponding custom function operation is set for a specified gesture operation. When the monitored touch operation is a specified gesture operation, the target object will be processed according to the custom function operation corresponding to the specified gesture operation, so that the user can input more flexibly and efficiently during the use of the input method, thereby improving the user's input experience. Among them, the specified gesture operation can be provided in advance by the system, and the system can also provide custom function operations. The user can set the corresponding relationship between the specified gesture operation and the custom function operation by himself, and the user can also be allowed to add or delete the specified gesture operation and custom function operation to provide a better input experience.

[0068] After determining the currently selected target object, the voice information of the target object will be played so that the user can get voice feedback of the target object. For example, after starting a certain input method panel, the setting control of the panel will be automatically located and selected as the target object, and then the voice information corresponding to the playback setting control will be "set". For another example, after the user inputs information through the input method panel to obtain candidate items, the first candidate item will be automatically used as the target object, and the voice information corresponding to the first candidate item will be played.

[0069] In a preferred example, the embodiment of the present invention is applicable to visually impaired users. For visually impaired users, since they cannot obtain clear visual feedback when using electronic devices such as mobile phones, they can only distinguish the content of the current operation through hearing or touch. Therefore, in the process of visually impaired users using input methods, the embodiment of the present invention can automatically determine or the user can manually determine the target object currently selected in the input method panel, and for the target object, if the touch operation is detected as a specified gesture operation, it will be processed according to the corresponding custom function operation, making user input more flexible and efficient, and improving the user's input experience. In addition, the embodiment of the present invention can also play the voice information corresponding to the target object to prompt the visually impaired user, further improving the user's input experience.

[0070] Reference Figure 2 , shows a flow chart of steps of an optional embodiment of an input method of the present invention, which may specifically include the following steps:

[0071] Step 202: start the input method panel and determine the target control currently selected in the input method panel.

[0072] Step 204: Use the target control as the currently selected target object.

[0073] Step 206: Play the voice information of the target object.

[0074] Among them, the input method panel includes one or more controls, such as a voice setting control and a language selection control in the voice panel, a language selection control in the voice translation panel, etc.

[0075] In an embodiment of the present invention, one or more controls of the input method panel can be set as target controls in advance, and after the user starts the input method panel, the target control of the input method panel is automatically selected. For example, assuming that the voice panel includes a voice setting control and a language setting control, wherein the voice setting control is the target control, then the voice setting control will be selected after the voice panel is started; assuming that the voice translation panel includes a language selection control, wherein the language selection control is the target control, then the language selection control will be selected after the voice translation panel is started. After determining the target control in the input method panel, it can be used as the currently selected target object, and the voice information corresponding to the target object can be played.

[0076] In one embodiment of the present invention, after the target control is taken as the currently selected target object, the method further includes: when a touch operation on the target control is detected, popping up a setting pop-up window corresponding to the target control; when a touch operation on a setting item in the setting pop-up window is detected, taking the setting item as the target setting item, and processing the sub-controls contained in the target setting item; when a touch operation outside the setting pop-up window is detected, closing the setting pop-up window.

[0077] The touch operation may be a click operation, a press operation or a double-click operation. In the embodiment of the present invention, the setting pop-up window of the target control is started or closed according to the user's touch operation.

[0078] In one example of the present invention, after the voice panel is started, the voice setting control of the voice panel is selected as the target control, and then the corresponding voice information "voice setting" is played. If the user's double-click operation is detected, a voice setting pop-up window will pop up, wherein each setting item in the voice setting pop-up window is a whole, that is, all sub-controls of the setting item will perform corresponding play, select / cancel or jump operations together. If the language selection control of the voice panel is selected as the target control, and then the corresponding voice information "the language selection is currently xx" is played, wherein xx is the currently displayed language, if the user's double-click operation is detected, a language selection pop-up window will pop up, wherein each setting item in the language selection pop-up window is a whole, that is, all sub-controls of the setting item will perform corresponding play, select / cancel or expand / collapse operations together. Reference Figure 3 , which shows the voice setting pop-up window. The selected part is a setting item. Since each setting item is a whole, all sub-controls of the selected setting item will perform corresponding play, select / cancel or jump operations. For example, for Figure 3 When the selected "Whisper Recognition" setting item needs to be played, the entire content of the "Whisper Recognition" setting item will be played, that is, the voice information that needs to be played is "Whisper Recognition" and "Recognizable Whisper".

[0079] In an embodiment of the present invention, when the user enters the voice panel in the barrier-free mode (input method mode for visually impaired users), the voice input function is not automatically started temporarily. Instead, the user is prompted to click a button to start the voice input function, and a short vibration prompt is given when the user starts the voice input function, that is, when the voice panel enters the recording state. In addition, when the voice input function is not started, that is, when it is not in the recording state, the focus range of the microphone button at the bottom is the entire column of buttons. The larger range makes it easier for users to select to start the voice input function.

[0080] In another example of the present invention, referring to Figure 4The voice translation panel shown, after starting the voice translation panel, the language translation control of the voice translation panel is selected as the target control, and then the corresponding voice information is played, and the voice information is in the currently selected language, wherein, if the currently selected language is switched, it also needs to be played. For example, assuming that the voice information "x translated to x" is played when it is initially selected, when the language is switched, the voice information "switched to x translated to x" is played, wherein x represents the language. If the user's click on the drop-down arrow next to the language translation control (language setting control) is detected, a language setting pop-up window will pop up, wherein each setting item in the pop-up window is a whole, and the corresponding play, selection / cancel operations are performed.

[0081] By applying the embodiment of the present invention, the input method panel can be adapted, and voice information can be provided for the control during the adaptation operation, so that the user can set the input method according to the voice information, thereby improving the input method setting efficiency.

[0082] It should be noted that the embodiment of the present invention can also perform settings such as word library, account management, quick phrases, clipboard, text editing and quick translation, and the settings in actual applications can be single-click selection and double-click activation. Of course, in addition to the above settings for the input method, other settings can continue to be opened, and the embodiment of the present invention does not need to limit this.

[0083] Reference Figure 5 , shows a flow chart of steps of an optional embodiment of an input method of the present invention, which may specifically include the following steps:

[0084] Step 502: Acquire input information input by the user through the input method panel.

[0085] In the embodiment of the present invention, when the user uses the input method, the input information input by the user through the input method panel can be obtained, wherein the input information may include: information input by the user calling the input method in other applications, and other applications may refer to applications other than the input method, such as chat applications, game applications, etc., which are not limited in the embodiment of the present invention. Among them, there are many input methods for the user to input information through the input method panel, such as keyboard input, handwriting input, voice input, etc., which are not limited in the embodiment of the present invention.

[0086] In an example of the present invention, step 502, the obtaining of input information input by the user through the input method panel, may include: monitoring the holding time of the touch operation on the space bar on the input method panel; when the holding time meets the preset response time, triggering the voice input mode; in the voice input mode, obtaining the user's voice information as the user's input information.

[0087] Among them, the space bar in the input method panel can be a trigger button for voice input. In the embodiment of the present invention, the preset response time for the space bar is set to 1s (second). When the user's touch operation (such as pressing operation) on the space bar on the input method panel is monitored, the holding time of the touch operation for the space bar pressing operation is counted. If the holding time reaches the preset response time, voice input can be triggered. At this time, the user's voice information can be obtained and converted into characters as the user's input information.

[0088] It should be noted that when the embodiment of the present invention starts to count the holding time of the pressing operation on the space bar, it does not care whether the user's pressing operation directly lands at the position of the space bar or slides from other keys to the position of the space bar. In other words, even if the user's finger is not at the position of the space bar when it initially presses, as long as it can maintain the pressing time for 1 second after sliding to the space bar, the voice input is triggered. By not limiting the triggering method of the user's finger landing point, the embodiment of the present invention can make the user's voice input more convenient, especially the voice input of the visually impaired user.

[0089] In an example of the present invention, step 502, the obtaining of input information input by the user through the input method panel, may include: monitoring the touch operation on the key on the input method panel; when the touch operation on the key is a preset touch operation, using the character corresponding to the key as the user's input information.

[0090] In an embodiment of the present invention, the touch operation on the key on the input method panel is detected in real time. In an example of the present invention, the touch operation includes at least one of a pressing operation and a hand-lifting operation, and the prompt information includes at least one of a key sound effect and a key vibration.

[0091] Among them, keyboard input is completed by pressing the keys on the input method panel. Assuming that the preset touch operation is a press operation and a hand-lifting operation, when the touch operation of the key on the input method panel is detected to be a press operation and a hand-lifting operation is performed, the character corresponding to the key can be used as the user's input information. Of course, in addition to the above-mentioned preset touch operations, other touch operations can also be set, such as a double-click operation, and the embodiment of the present invention does not need to be limited to this.

[0092] In an example of the present invention, the method may further include: when the key targeted by the touch operation changes, or the operation type of the touch operation changes, triggering prompt information corresponding to the key targeted by the touch operation.

[0093] To facilitate user input, an embodiment of the present invention is configured so that when a user is performing a touch operation on a key, if it is detected that the key targeted by the touch operation has changed, such as moving from key "A" to key "S", a key sound effect and key vibration will be triggered; if the operation type of the touch operation has changed, such as from a pressing operation to a hand-raising operation, a key sound effect and key vibration will also be triggered.

[0094] That is to say, pressing, lifting, and changes in the key currently being pressed by the user will trigger key sounds and key vibrations. For example, when the user first puts down their finger to press a key, the corresponding key sound and key vibration will be triggered. Then, when the user slides to select another key, the finger will move to the new key, triggering the key sound and key vibration corresponding to the new key again. Finally, when the user lifts his hand, the key sound and key vibration will be triggered again.

[0095] Step 504: Obtain candidate items corresponding to the input information.

[0096] After obtaining the input information, the candidate items corresponding to the input information can be searched in the preset word library. Optionally, the preset word library may include: user word library, system word library, cell word library, cloud word library, etc. The embodiment of the present invention does not limit the specific word library.

[0097] Step 506, determining a target candidate item from the candidate items, and using the target candidate item as the currently selected target object; wherein the target object is used to process according to the corresponding custom function operation when the touch operation is detected to be a specified gesture operation.

[0098] In the embodiment of the present invention, the target candidate item may be marked with a focus, wherein the focus may be in the form of a cursor or a box, and may jump as the target candidate item changes.

[0099] In an example of the present invention, step 506, determining a target candidate item from the candidate items, may include: taking the first candidate item among the candidate items as the target candidate item.

[0100] Among them, there are usually multiple candidate items corresponding to the input information. If all of them are used as target candidates and the corresponding voice information is played one by one, it will take a lot of unnecessary time. Therefore, the embodiment of the present invention uses the first candidate item among the candidates as the target candidate item. This is because during the input process, the first candidate item is usually the one with the highest quality, and the probability of the user selecting it on the screen is relatively high. Therefore, after obtaining the candidate items according to the user's input information, the embodiment of the present invention can use the first candidate item as the target candidate item and play the corresponding voice information to improve the user's input efficiency.

[0101] In an example of the present invention, the method may further include: obtaining a participle symbol input by a user through an input method panel for the input information; combining the input information and the participle symbol into new input information, and obtaining an update candidate item corresponding to the new input information; then step 506, determining a target candidate item from the candidate items, and using the target candidate item as the currently selected target object, may include: determining a target update candidate item from the update candidate items, and using the target update candidate item as the currently selected target object.

[0102] When the user inputs via the keyboard, the user can modify the input information that has been entered, such as adding a participle symbol to the input information. For example, assuming that the input information that has been entered is "xian", after adding the participle symbol, the input information becomes "xi'an".

[0103] In an embodiment of the present invention, after the user inputs the participle symbol, the candidate items will be refreshed to obtain updated candidate items, wherein the updated candidate items may change or remain unchanged. In order to prompt the user that the input of the participle symbol has been completed normally, regardless of whether the updated candidate items have changed, the first updated candidate item will be obtained from the updated candidate items as the target updated candidate item, and as the currently selected target object, the corresponding voice information will be played.

[0104] In an example of the present invention, the method may further include: after switching to the symbol keyboard on the input method panel, determining the currently selected symbol keyboard; and playing voice information corresponding to the currently selected symbol keyboard.

[0105] If the user switches to the symbol keyboard on the input method panel, the voice information corresponding to the currently selected symbol keyboard will be played. When the symbol keyboard is initially switched, it is usually switched to a default symbol keyboard, at which time the default symbol keyboard can be automatically selected and the corresponding voice information will be played.

[0106] In practice, there can be multiple symbol keyboards. If the user switches the symbol keyboards, the switched symbol keyboard will be selected and the corresponding voice information will be played, such as playing "current xx symbol keyboard" (xx is the keyboard name, usually only the non-numeric part of the keyboard name needs to be played).

[0107] For example, assume that the symbol keyboard includes a "1. Common" symbol keyboard, a "2. English" symbol keyboard, and a "3. Chinese" symbol keyboard. If the initial switch is to the "1. Common" symbol keyboard, then the voice message "Current common symbol keyboard" will be played. Throughout the input method panel, if the user switches to the "2. English" symbol keyboard through operations such as two-finger swiping (for example, swiping left with two fingers to switch to the previous symbol keyboard, and swiping right with two fingers to switch to the next symbol keyboard) or double-clicking, then the voice message "Current English symbol keyboard" can be played.

[0108] Optionally, embodiments of the present invention can also optimize the voice messages corresponding to the symbols in the symbol keyboard to make the pronunciation more accurate and easier for users to perceive. In one example, the content of the voice messages of some symbols before and after optimization can be as follows: @: Previously played as "Aite symbol", after optimization, played as the English pronunciation "at"; &: Previously not played, after optimization, played as "And symbol"; ^: Currently played as "caret", after optimization, played as "Circumflex symbol"; `: Previously played as "Reverse single quote", after optimization, played as "Accent symbol"; \: Previously played as "Double backslash", after optimization, played as "Backslash". Of course, the optimization of the voice messages of the above several symbols is only used as an example. In actual use, problems can be continuously discovered and continuously optimized, and embodiments of the present invention do not need to be restricted in this regard.

[0109] In one example of the present invention, the method may further include: obtaining the touch operation of the user on the input method panel; processing the candidate items according to the touch operation on the input method panel.

[0110] Among them, the specified gesture operation includes at least one of swiping left with two fingers, swiping right with two fingers, swiping up with two fingers, and swiping down with two fingers. When the candidate items corresponding to the input information are obtained, if touch operations such as swiping left with two fingers, swiping right with two fingers, swiping up with two fingers, and swiping down with two fingers on the input method panel are monitored, it can be determined that the specified gesture operation is recognized, and the candidate items will be processed according to the custom function operations corresponding to these specified gesture operations.

[0111] In one example of the present invention, determine the first custom function operation corresponding to the touch operation on the input method panel, and process the candidate items according to the first custom function operation; the first custom function operation corresponding to the touch operation is the function operation on the candidate items corresponding to the specified gesture operation matching the touch operation;

[0112] Among them, the processing of the candidate items at least includes: obtaining the previous candidate item of the target candidate item as a new target candidate item; obtaining the next candidate item of the target candidate item as a new target candidate item; putting the target candidate item on the screen; after updating the input information and obtaining new candidate items, the first of the new candidate items is used as a new target candidate item; clearing the input information; obtaining the previous page of candidates corresponding to the target candidate item; obtaining the next page of candidates corresponding to the target candidate item.

[0113] In an embodiment of the present invention, a corresponding custom function operation can be defined in advance for a specified gesture operation, and the corresponding custom function operation will be executed when the touch operation detected on the input method panel is a specified gesture operation. Figure 6 In the "Accessibility Settings" panel, enter the gesture customization option to set it. Specifically, the input method panel supports the customization of four two-finger sliding operations: "two-finger swipe up", "two-finger swipe down", "two-finger swipe left", and "two-finger swipe right". Figure 7 In the check box pop-up window shown, the four two-finger sliding operations that can support the selection of defined custom function operations may include: selecting the previous candidate; selecting the next candidate; displaying the current candidate (target candidate); deleting a pinyin (character); clearing all pinyin (symbols); the previous page of candidates; the next page of candidates. Among them, when a custom function operation has been selected by other two-finger sliding operations, it will not be displayed to avoid assigning the same custom function operation to the same two-finger sliding operation, causing unnecessary trouble. After the check box pop-up window pops up, the user can touch each function option (custom function operation) with one finger, select the target function option, double-click to complete the setting and automatically close the pop-up window. In addition, if the user does not make any settings after the check box pop-up window pops up, he can touch the "Close" button to close the pop-up window.

[0114] For the convenience of users, the embodiments of the present invention pre-set default custom function operations for the four two-finger sliding operations of "two-finger swipe up", "two-finger swipe down", "two-finger swipe left" and "two-finger swipe right". For example, "two-finger swipe up" corresponds to the current candidate item on the upper screen, "two-finger swipe down" corresponds to deleting a pinyin, "two-finger swipe left" corresponds to selecting the previous candidate item, and "two-finger swipe right" corresponds to selecting the next candidate item.

[0115] In an example of the present invention, the method may further include: when no candidate item corresponding to the input information is obtained, obtaining the touch operation of the user on the input method panel; and processing the input information according to the touch operation on the input method panel.

[0116] It should be noted that the above-mentioned custom function operation regarding the specified gesture operation is for the case where the candidate items corresponding to the input information are obtained. When the candidate items corresponding to the input information cannot be obtained, the input information will be processed according to the touch operation.

[0117] In an example of the present invention, the processing of the input information according to the touch operation on the input method panel includes: determining a second custom function operation corresponding to the touch operation on the input method panel, and processing the input information according to the second custom function operation; the second custom function operation corresponding to the touch operation is a function operation on the input information corresponding to a specified gesture operation matching the touch operation;

[0118] The processing of the input information at least includes: moving a cursor forward on the input information; moving a cursor backward on the input information; selecting a character before the cursor in the input information; and selecting a character after the cursor in the input information.

[0119] To facilitate user settings, when the candidate items corresponding to the input information cannot be obtained, in an embodiment of the present invention, corresponding custom function operations can be set for the four two-finger sliding operations of "two-finger swipe up", "two-finger swipe down", "two-finger swipe left" and "two-finger swipe right". For example, "two-finger swipe up" corresponds to moving the cursor forward, "two-finger swipe down" corresponds to moving the cursor backward, "two-finger swipe left" corresponds to selecting the characters before the cursor, and "two-finger swipe right" corresponds to selecting the characters after the cursor.

[0120] The embodiment of the present invention sets custom function operations for designated gesture operations for the cases where input information has candidate items and no candidate items, respectively, so that different input operations can be performed in the cases where there are candidate items and no candidate items, thereby improving input efficiency.

[0121] In an example of the present invention, the method may also include: determining the keyboard type of the input method panel; obtaining the user's touch operation on a designated key in the input method panel; and processing the candidate items according to the keyboard type and the touch operation on the designated key.

[0122] In the embodiment of the present invention, when the candidate items corresponding to the input information are obtained, in addition to operating the candidate items through four two-finger sliding operations, the candidate items can also be operated through the keyboard of the input method panel. Preferably, the embodiment of the present invention has different customized function operations for keys for input method panels with different keyboard types.

[0123] In an example of the present invention, the processing of the candidate items according to the keyboard type and the touch operation on the designated key includes: when the input method panel is a full-key panel, if it is a touch operation on a comma key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a period key, obtaining the next candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a number switch key, obtaining the previous page of candidates corresponding to the target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next page of candidates corresponding to the target candidate item; when the input method panel is a nine-key panel, if it is a touch operation on a number switch key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next candidate item of the target candidate item as a new target candidate item.

[0124] Among them, the keyboard type can include a full-key panel (such as 26 keys for Pinyin and 26 keys for English) and a nine-key panel (such as 9 keys for Pinyin and 9 keys for English). When it is a full-key panel, the custom function operations of the "," comma key and the "." period key on the left side of the space bar are respectively "previous candidate" and "next candidate"; the "123" digital switch key and the "Chinese / English" Chinese-English switch key on the left side of the space bar are respectively defined as "previous page candidates" and "next page candidates". When it is a nine-key panel, since the nine-key panel only has the "123" digital switch key and the "Chinese / English" Chinese-English switch key, they can be defined as "previous candidate" and "next candidate" respectively.

[0125] Step 508: Determine the play mode of the target candidate item according to the number of characters of the target candidate item.

[0126] Step 510: Play the voice information of the target candidate item according to the play mode.

[0127] After obtaining the candidate items corresponding to the input information, these candidate items can be presented at the corresponding position in the input method panel for the user to select. In actual application, the user can determine the target candidate item from the candidate items by groping, as the currently selected target object and play the corresponding voice information, so that the user can determine whether the candidate item is the content that the user wants to input based on the voice information of the target candidate item.

[0128] Preferably, when playing the voice information of a target candidate item in an embodiment of the present invention, different playing modes can be adopted according to the number of characters of the target candidate item to improve the input efficiency of the user. Specifically, when the number of characters of the target candidate item is two characters or less, a first playing mode of explaining character by character is adopted; when it is more than two characters, a second playing mode of playing the complete candidate and explaining character by character is adopted. For example, assuming the target candidate item is "经历", then the first playing mode will be adopted, and the played voice information will be "经 is the 经 of 经过, 历 is the 历 of 历史". Assuming the target candidate item is "中华民族", then the second playing mode will be adopted, and the played voice information will be "中华民族, 中 is the 中 of 中国, 华 is the 华 of 华丽, 民 is the 民 of 人民, 族 is the 族 of 水族馆".

[0129] In the embodiment of the present invention, by adopting different playing modes for target candidate items with different numbers of characters for playing, the efficiency of the user to determine the actual meaning of the candidate items can be improved, thereby improving the input efficiency of the user.

[0130] It should be noted that for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequences, because according to the embodiments of the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential for the embodiments of the present invention.

[0131] Referring to Figure 8 , a structural block diagram of an embodiment of an input device of the present invention is shown, which may specifically include the following modules:

[0132] A determination module 802, configured to determine a currently selected target object in the input method panel; wherein, the target object is used to be processed according to a corresponding custom function operation when a touch operation is detected as a specified gesture operation.

[0133] A playing module 804, configured to play the voice information of the target object.

[0134] Optionally, the determination module 802 is configured to start the input method panel, determine a currently selected target control in the input method panel; and use the target control as the currently selected target object.

[0135] Optionally, the device also includes: a monitoring module, which is used to pop up a setting pop-up window corresponding to the target control when a touch operation on the target control is detected; when a touch operation on a setting item in the setting pop-up window is detected, the setting item is used as a target setting item, and the sub-controls contained in the target setting item are processed; when a touch operation outside the setting pop-up window is detected, the setting pop-up window is closed.

[0136] Optionally, the determination module 802 is used to obtain input information input by the user through the input method panel; obtain candidate items corresponding to the input information; determine a target candidate item from the candidate items, and use the target candidate item as the currently selected target object.

[0137] Optionally, the playing module 804 is used to determine a playing mode of the target candidate item according to the number of characters of the target candidate item; and play the voice information of the target candidate item according to the playing mode.

[0138] Optionally, the playback module 804 is used to determine that the playback mode of the target candidate item is a first playback mode when the number of characters of the target candidate item is less than or equal to a preset number; wherein the first playback mode is to play the characters in the target candidate item and the explanatory information corresponding to the characters one by one; when the number of characters of the target candidate item is greater than the preset number, determine that the playback mode of the target candidate item is a second playback mode; wherein the second playback mode is to play all the characters of the target candidate item, and then play the characters in the target candidate item and the explanatory information corresponding to the characters one by one.

[0139] Optionally, the determination module 802 is used to monitor the holding time of the touch operation on the space bar on the input method panel; when the holding time meets the preset response time, trigger the voice input mode; in the voice input mode, obtain the user's voice information as the user's input information.

[0140] Optionally, the determination module 802 is used to monitor the touch operation on the key on the input method panel; when the touch operation on the key is a preset touch operation, the character corresponding to the key is used as the user's input information.

[0141] Optionally, the determining module 802 is configured to trigger prompt information corresponding to the key targeted by the touch operation when the key targeted by the touch operation changes, or when the operation type of the touch operation changes.

[0142] Optionally, the touch operation includes at least one of a pressing operation and a hand-raising operation, and the prompt information includes at least one of a key sound effect and a key vibration.

[0143] Optionally, the determination module 802 is configured to use the first candidate item among the candidate items as the target candidate item.

[0144] Optionally, the device also includes: an update module, used to obtain the participle symbol input by the user for the input information through the input method panel; combine the input information and the participle symbol into new input information, and obtain update candidate items corresponding to the new input information; the determination module, used to determine the target update candidate items from the update candidate items, and use the target update candidate items as the currently selected target object.

[0145] Optionally, the device further includes: a symbol keyboard voice playing module, which is used to determine the currently selected symbol keyboard after switching to the symbol keyboard on the input method panel; and play the voice information corresponding to the currently selected symbol keyboard.

[0146] Optionally, the device includes: a first candidate item processing module, configured to obtain a touch operation of the user on the input method panel; and process the candidate items according to the touch operation on the input method panel.

[0147] Optionally, the first candidate item processing module is used to determine the first custom function operation corresponding to the touch operation of the input method panel, and process the candidate item according to the first custom function operation; the first custom function operation corresponding to the touch operation is a function operation on the candidate item corresponding to a specified gesture operation matching the touch operation; wherein, the processing of the candidate item at least includes: obtaining the previous candidate item of the target candidate item as a new target candidate item; obtaining the next candidate item of the target candidate item as a new target candidate item; putting the target candidate item on the screen; after updating the input information and obtaining a new candidate item, the first of the new candidate items is used as a new target candidate item; clearing the input information; obtaining the previous page of candidates corresponding to the target candidate item; obtaining the next page of candidates corresponding to the target candidate item.

[0148] Optionally, the device further includes: an input information processing module, configured to obtain the user's touch operation on the input method panel when no candidate item corresponding to the input information is obtained; and process the input information according to the touch operation on the input method panel.

[0149] Optionally, the input information processing module is used to determine a second custom function operation corresponding to the touch operation of the input method panel, and process the input information according to the second custom function operation; the second custom function operation corresponding to the touch operation is a function operation on the input information corresponding to a specified gesture operation matching the touch operation;

[0150] The processing of the input information at least includes: moving a cursor forward on the input information; moving a cursor backward on the input information; selecting a character before the cursor in the input information; and selecting a character after the cursor in the input information.

[0151] Optionally, the designated gesture operation includes at least one of two-finger left swipe, two-finger right swipe, two-finger up swipe and two-finger down swipe.

[0152] Optionally, the device also includes: a second candidate item processing module, used to determine the keyboard type of the input method panel; obtain the user's touch operation on the designated key on the input method panel; and process the candidate items according to the keyboard type and the touch operation on the designated key.

[0153] Optionally, the second candidate item processing module is used for, when the input method panel is a full-key panel, if it is a touch operation on a comma key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a period key, obtaining the next candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a number switch key, obtaining the previous page of candidates corresponding to the target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next page of candidates corresponding to the target candidate item; when the input method panel is a nine-key panel, if it is a touch operation on a number switch key, obtaining the previous candidate item of the target candidate item as a new target candidate item; if it is a touch operation on a Chinese-English switch key, obtaining the next candidate item of the target candidate item as a new target candidate item.

[0154] In an embodiment of the present invention, after starting the input method, the target object currently selected in the input method panel is determined, and voice information of the target object is played, wherein the target object is used to perform processing according to the corresponding custom function operation when the touch operation is detected to be a specified gesture operation, and corresponding processing is performed on the target object based on the custom function operation corresponding to the touch operation, so that the user's input is more flexible and efficient during the use of the input method, thereby improving the user's input experience. In addition, voice information corresponding to the target object is provided to prompt the user, further improving the user's input experience.

[0155] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0156] Fig. 91 is a block diagram of an electronic device 900 for input according to an exemplary embodiment. For example, the electronic device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0157] Reference Fig. 9 , the electronic device 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0158] The processing component 902 generally controls the overall operation of the electronic device 900, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 902 may include one or more modules to facilitate the interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate the interaction between the multimedia component 908 and the processing component 902.

[0159] The memory 904 is configured to store various types of data to support operations on the device 900. Examples of such data include instructions for any application or method operating on the electronic device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0160] The power component 906 provides power to the various components of the electronic device 900. The power component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 900.

[0161] The multimedia component 908 includes a screen that provides an output interface between the electronic device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the electronic device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0162] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), and when the electronic device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 904 or sent via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0163] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0164] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the electronic device 900. For example, the sensor assembly 914 can detect the open / closed state of the device 900, the relative positioning of components, such as the display and keypad of the electronic device 900, and the sensor assembly 914 can also detect the position change of the electronic device 900 or a component of the electronic device 900, the presence or absence of user contact with the electronic device 900, the orientation or acceleration / deceleration of the electronic device 900, and the temperature change of the electronic device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0165] The communication component 916 is configured to facilitate wired or wireless communication between the electronic device 900 and other devices. The electronic device 900 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 914 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 914 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0166] In an exemplary embodiment, the electronic device 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0167] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions, and the instructions can be executed by a processor 920 of an electronic device 900 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0168] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute an input method as described in any one of the embodiments of the present invention.

[0169] Fig.101 is a schematic diagram of the structure of an electronic device 1000 for input according to another exemplary embodiment of the present invention. The electronic device 1000 may be a server, which may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 1022 (for example, one or more processors) and a memory 1032, and one or more storage media 1030 (for example, one or more mass storage devices) storing application programs 1042 or data 1044. Among them, the memory 1032 and the storage medium 1030 may be temporary storage or permanent storage. The program stored in the storage medium 1030 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processor 1022 may be configured to communicate with the storage medium 1030 and execute a series of instruction operations in the storage medium 1030 on the server.

[0170] The server may also include one or more power supplies 1026, one or more wired or wireless network interfaces 1050, one or more input and output interfaces 1058, one or more keyboards 1056, and / or, one or more operating systems 1041, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0171] An electronic device includes a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors. The one or more programs include operation instructions for performing an input method as described in any of the embodiments of the present invention.

[0172] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0173] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0174] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0175] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0176] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0177] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0178] The above is a detailed introduction to an input method, an input device and an electronic device provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. An input method, It is characterized in that include: When a visually impaired user uses the input method, monitoring the holding time of the touch operation on the space key on the input method panel, wherein the holding time is the holding time on the space key when the pressing operation slides from other keys to the space key; When the holding time meets the preset response time, the voice input mode is triggered; In the voice input mode, obtaining the user's voice information as the user's input information; Obtaining candidate items corresponding to the input information; Determine a target candidate item from the candidate items, and use the target candidate item as the currently selected target object; the target object is used to process according to the corresponding custom function operation when the touch operation is detected to be a designated gesture operation; the custom function operation setting process corresponding to the designated gesture operation is that the user selects the gesture customization option in the accessibility setting interface of the input method, touches each function option of the preset gesture on the pop-up gesture customization setting interface, selects the target function option, and then double-clicks to complete the setting; Each function option corresponds to a custom function operation; When the number of characters in the target candidate item is less than or equal to a preset number, determining that the play mode of the target candidate item is a first play mode; wherein the first play mode is to play the characters in the target candidate item and the explanation information corresponding to the characters one by one; When the number of characters of the target candidate item is greater than a preset number, determining that the play mode of the target candidate item is a second play mode; wherein the second play mode is to play all the characters of the target candidate item and then play the characters in the target candidate item and the explanation information corresponding to the characters one by one; The voice information of the target candidate item is played according to the playing mode.

2. The method according to claim 1, It is characterized in that Determining the target object currently selected in the input method panel includes: Starting the input method panel and determining the target control currently selected in the input method panel; The target control is used as the currently selected target object.

3. The method according to claim 2, It is characterized in that After taking the target control as the currently selected target object, the method further includes: When a touch operation on the target control is detected, a setting pop-up window corresponding to the target control is popped up; When a touch operation on a setting item in the setting pop-up window is detected, the setting item is used as a target setting item, and sub-controls contained in the target setting item are processed; When a touch operation outside the setting pop-up window is detected, the setting pop-up window is closed.

4. An input device, It is characterized in that include: A determination module is used to monitor the holding time of the touch operation on the space key on the input method panel when the visually impaired user uses the input method, wherein the holding time is the holding time on the space key when the pressing operation slides from other keys to the space key; when the holding time meets the preset response time, trigger the voice input mode; in the voice input mode, obtain the user's voice information as the user's input information; and obtain the candidate items corresponding to the input information; Determine a target candidate from the candidate items, and use the target candidate as the currently selected target object; the target object is used to process according to the corresponding custom function operation when the touch operation is detected to be a designated gesture operation; the custom function operation setting process corresponding to the designated gesture operation is that the user selects the gesture customization option in the accessibility setting interface of the input method, touches each function option of the preset gesture on the pop-up gesture customization setting interface, selects the target function option, and then double-clicks to complete the setting; each function option corresponds to a custom function operation; A playback module is used to determine that the playback mode of the target candidate item is a first playback mode when the number of characters in the target candidate item is less than or equal to a preset number; wherein the first playback mode is to play the characters in the target candidate item and the explanatory information corresponding to the characters one by one; when the number of characters in the target candidate item is greater than the preset number, determine that the playback mode of the target candidate item is a second playback mode; wherein the second playback mode is to play all the characters of the target candidate item, and then play the characters in the target candidate item and the explanatory information corresponding to the characters one by one; and play the voice information of the target candidate item according to the playback mode.

5. An electronic device, It is characterized in that The system comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: When a visually impaired user uses the input method, monitoring the holding time of the touch operation on the space key on the input method panel, wherein the holding time is the holding time on the space key when the pressing operation slides from other keys to the space key; When the holding time meets the preset response time, the voice input mode is triggered; In the voice input mode, obtaining the user's voice information as the user's input information; Obtaining candidate items corresponding to the input information; Determine a target candidate item from the candidate items, and use the target candidate item as the currently selected target object; the target object is used to process according to the corresponding custom function operation when the touch operation is detected to be a designated gesture operation; the custom function operation setting process corresponding to the designated gesture operation is that the user selects the gesture customization option in the accessibility setting interface of the input method, touches each function option of the preset gesture on the pop-up gesture customization setting interface, selects the target function option, and then double-clicks to complete the setting; Each function option corresponds to a custom function operation; When the number of characters in the target candidate item is less than or equal to a preset number, determining that the play mode of the target candidate item is a first play mode; wherein the first play mode is to play the characters in the target candidate item and the explanation information corresponding to the characters one by one; When the number of characters of the target candidate item is greater than a preset number, determining that the play mode of the target candidate item is a second play mode; wherein the second play mode is to play all the characters of the target candidate item and then play the characters in the target candidate item and the explanation information corresponding to the characters one by one; The voice information of the target candidate item is played according to the playing mode.

6. A readable storage medium, It is characterized in that When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the input method as described in any one of method claims 1-3.

Citation Information

Patent Citations

  • Handwriting input method and terminal

    CN103631436A

  • Screen reading method and device of secure keyboard

    CN106055260A

  • Input method and device, and device used for input

    CN108073291A

  • Portable touch screen device, method, and graphical user interface for providing workout support

    US20100060586A1