Control input method and device, electronic equipment, storage medium and program product

Abstract

The present disclosure provides a control input method, device, electronic equipment, storage medium and program product, relates to the technical field of computers, and particularly relates to the technical field of artificial intelligence. The specific implementation scheme is: displaying an input method interface and monitoring a user state; in the case that the user state is monitored to be consistent with a preset state, obtaining target content from an intelligent voice interaction system, and displaying the target content on the input method interface; the intelligent voice interaction system is used for providing target content to be input into the input method interface based on a voice instruction of the user. The present disclosure provides a quick input method for the input method interface.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, and particularly relates to the technical field of artificial intelligence. BACKGROUND

[0002] At present, with the development of science and technology, the application of input method is more and more mature. In addition, with the development of intelligent voice technology, intelligent voice function is applied to many scenes, which brings people more extensive voice interaction services. SUMMARY

[0003] The present disclosure provides a control input method, device, electronic equipment, storage medium and program product.

[0004] According to an aspect of the present disclosure, a control input method comprises:

[0005] displaying an input method interface and monitoring a user state; in a case where it is monitored that the user state meets a preset state, obtaining target content from an intelligent voice interaction system, and displaying the target content on the input method interface; the intelligent voice interaction system is configured to provide target content to be input to the input method interface based on a voice instruction of a user.

[0006] According to another aspect of the present disclosure, a control input device is provided, comprising:

[0007] a monitoring module configured to display an input method interface and monitor a user state; and a processing module configured to, in a case where it is monitored that the user state meets a preset state, obtain target content from an intelligent voice interaction system, and display the target content on the input method interface; the intelligent voice interaction system is configured to provide target content to be input to the input method interface based on a voice instruction of a user.

[0008] According to another aspect of the present disclosure, an electronic equipment is provided, comprising:

[0009] at least one processor; and a memory connected with the at least one processor in communication; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the above-mentioned method.

[0010] According to another aspect of the present disclosure, a non-transitory computer readable storage medium storing computer instructions is provided, wherein the computer instructions are configured to enable the computer to perform the above-mentioned method.

[0011] According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the above-mentioned method.

[0012] It should be understood that the matters described herein are intended to be illustrative and are not intended to limit or restrict the scope of the embodiments of the present disclosure. Other features of the present disclosure will become apparent to those skilled in the art upon a reading of the following specification. BRIEF DESCRIPTION OF DRAWINGS

[0013] The accompanying drawings are included to provide a further understanding of the present application, and are incorporated in and constitute a part of this specification. In the drawings:

[0014] Figure 1 is a flow diagram of a control input method according to the present disclosure;

[0015] Figure 2 is a flow diagram of another control input method according to the present disclosure;

[0016] Figure 3 is a flow diagram of obtaining target content from an intelligent voice interaction system according to the present disclosure;

[0017] Figure 4 is a flow diagram of another method of obtaining target content from an intelligent voice interaction system according to the present disclosure;

[0018] Figure 5 is a flow diagram of another control input method according to the present disclosure;

[0019] Figure 6 is a flow diagram of another control input method according to the present disclosure;

[0020] Figure 7 is a schematic diagram of an input method interface according to the present disclosure;

[0021] Figure 8 is a schematic diagram of another input method interface according to the present disclosure;

[0022] Figure 9 is a schematic diagram of another input method interface according to the present disclosure;

[0023] Figure 10 is a schematic diagram of another input method interface according to the present disclosure;

[0024] Figure 11 is a schematic diagram of another input method interface according to the present disclosure;

[0025] Figure 12 is a schematic diagram of another input method interface according to the present disclosure;

[0026] Figure 13 is a schematic diagram of another input method interface according to the present disclosure;

[0027] Figure 14 is a schematic diagram of another input method interface shown according to the present disclosure;

[0028] Figure 15 is a control input device block diagram according to the present disclosure;

[0029] Figure 16 shows a schematic block diagram of an example electronic device that can be used to implement embodiments of the present disclosure. DETAILED DESCRIPTION

[0030] Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to assist in understanding them. These should be considered as merely exemplary. Thus, those of ordinary skill in the art will recognize various changes and modifications of the embodiments described herein, which will not depart from the scope and spirit of the present disclosure. Also, descriptions of known functions and constructions are omitted in the following description for clarity and conciseness.

[0031] The control input method provided by the embodiments of the present disclosure can be applied to a scenario in which a user inputs content through an input method.

[0032] In daily life, in the process in which a user inputs content through an input method, the user cannot directly input a character that is difficult to spell, such as an obscure character.

[0033] To address the above problem, in the related art, a user can invoke a voice input method and perform a voice-to-text function through the voice input method, so that the corresponding content can be smoothly input. However, in the related art, the user needs to perform input method switching, touch start and stop controls when inputting through the voice input method, and this method has the problem of high learning cost, and cannot meet the use requirements of a user group that does not have strong learning ability, such as the elderly.

[0034] Therefore, the embodiments of the present disclosure provide a control input method, which can assist a user in inputting content through an intelligent voice interaction system in a scenario in which the user inputs. Specifically, the state of the user can be monitored when an input method interface is displayed, and when it is detected that the state of the user meets a preset state, the target content required by the user can be obtained through the intelligent voice interaction system based on a voice instruction of the user, and the target content is displayed on the input method interface. Based on this, the intelligent voice interaction system can obtain and input the target content required by the user through the voice instruction of the user. Moreover, for the above process, the user only needs to issue a voice instruction to obtain the target content from the intelligent voice interaction system, which reduces the operation cost of the user and improves the use experience of the user.

[0035] Figure 1 is a flowchart of a control input method according to the present disclosure, as shown in Figure 1 includes the following steps.

[0036] In step S101, display the input method interface and monitor the user state.

[0037] In step S102, if it is monitored that the user state meets the preset state, obtain the target content from the intelligent voice interaction system and display the target content on the input method interface.

[0038] The intelligent voice interaction system is configured to provide target content to be input into the input method interface based on the voice instruction of the user.

[0039] The control input method provided by the embodiments of the present disclosure can obtain the target content required by the user through the intelligent voice interaction system when the user state meets the preset state in the input scenario, which can assist the user in completing the input operation through the intelligent voice interaction system, and the operation cost of the user in the overall process is low, which can meet the use demand of the user.

[0040] In the embodiments of the present disclosure, at least one of the following conditions is met when it is monitored that the user state meets the preset state:

[0041] ①It is determined that the duration of not receiving the user input operation exceeds the preset duration.

[0042] ②It is monitored that the user feature meets the preset feature.

[0043] The control input method provided by the embodiments of the present disclosure will be exemplarily described below by taking the case that the user state meets the preset state is determined by both ① and ②.

[0044] Figure 2 is another flowchart of a control input method according to the present disclosure, as shown in Figure 2 The step S201 in the embodiments of the present disclosure is similar to the implementation process of the step S101 in the embodiments of the present disclosure, and will not be described here. Figure 1

[0045] In step S202, if it is determined that the duration of not receiving the user input operation exceeds the preset duration and it is monitored that the user feature meets the preset feature, obtain the target content from the intelligent voice interaction system and display the target content on the input method interface.

[0046] For example, it can be determined that the duration of not receiving the touch operation of the user for the handwriting input interface exceeds the preset duration.

[0047] ​In the embodiments of the present disclosure, the features include one or a combination of expressions, actions, and postures.

[0048] For example, for the expression, the preset features include one or a combination of frowning, squinting, and wry smile. For example, it can be determined that the user features meet the preset features when it is monitored that the current expression of the user is frowning, squinting, or wry smile. For the action, the preset features include one or a combination of scratching the head, biting the lips, and shaving the beard. For example, it can be determined that the current features of the user meet the preset features when it is monitored that the current action of the user is scratching the head, biting the lips, or shaving the beard. For the posture, the preset features include one or a combination of arm folding and cheek resting. For example, it can be determined that the user features meet the preset features when it is monitored that the current posture of the user is arm folding or cheek resting.

[0049] In addition, the detection of the user features can also be achieved by monitoring the blood pressure or the breathing rate of the user, which is only an example and is not limited in the present disclosure. It can be understood that the purpose of monitoring the user features is to know the current psychological state of the user, so as to indirectly determine whether the user needs to use the intelligent voice interaction system to complete the input operation.

[0050] In an embodiment, the image acquisition device such as a camera can be used to acquire images of the user. The features of the user can be analyzed and monitored by the acquired images. The analysis of the user features can be achieved by human feature recognition and human key point detection, which is not limited in the present disclosure.

[0051] For example, the target content can be obtained from the intelligent voice interaction system in the following manner.

[0052] Figure 3 is a flowchart of obtaining target content from an intelligent voice interaction system according to the present disclosure, as shown in Figure 3 The method includes the following steps.

[0053] In step S301, the voice instruction input by the user is listened to, and the semantic information corresponding to the voice instruction is analyzed.

[0054] For example, the voice instruction can include a query instruction, a voice-to-text instruction, and a text adjustment instruction. The query instruction represents the user's question, and is used to obtain the target content through the reply content of the intelligent voice interaction system. The voice-to-text instruction is used to control the intelligent voice interaction system to perform the voice-to-text function. The text adjustment instruction is used to control the intelligent voice interaction system to adjust the to-be-input content or the already-input content.

[0055] In step S302, the target content provided by the intelligent voice interaction system based on the semantic information is obtained.

[0056] The control input method provided by the embodiments of the present disclosure can perform semantic analysis on a voice instruction issued by a user, and provide target content according to semantic information obtained through the analysis.

[0057] For example, the input method interface can include a keyboard input method interface (as shown in Figure 7 ), a voice input method interface (as shown in Figure 8 ), or a handwriting input method interface (as shown in Figure 9 ). In addition, the control input method provided by the embodiments of the present disclosure can be matched with a voice instruction, and include the following application scenarios.

[0058] Scenario one: a user inputs content through a handwriting input method or a keyboard input method, and the intelligent voice interaction system initiates interaction with the user in the form of voice (triggered when it is monitored that the user state meets a preset state) in response to a situation that the user cannot spell (for example, the user does not understand the stroke configuration of a character, or is not clear about the pinyin matched with the character), the user issues a voice-to-text instruction to make the intelligent voice interaction system execute a voice-to-text function, and obtain the target content required by the user.

[0059] Scenario two: a user inputs content through a voice input method, the voice input method executes a voice-to-text function through voice content input by the user, and displays preview text obtained through the conversion. In response to a situation that the user stops inputting because of finding an error in the preview text, the intelligent voice interaction system initiates interaction with the user in the form of voice (triggered when it is monitored that the user state meets a preset state), the user issues a text adjustment instruction to perform operations such as insertion, modification, or deletion on the preview text, so as to obtain the target content required by the user.

[0060] Scenario three: a user inputs content through a handwriting input method, a keyboard input method, or a voice input method, and the intelligent voice interaction system initiates interaction with the user in the form of voice (triggered when it is monitored that the user state meets a preset state) in response to a situation that the user cannot directly obtain the content (for example, if the user intends to express the content in the form of an idiom, but cannot obtain a suitable idiom). The user issues an inquiry instruction to inform the intelligent voice interaction system of a question in the form of a question, the intelligent voice interaction system performs content retrieval according to the inquiry instruction, and obtains the target content required by the user.

[0061] The following is a brief description of the application process corresponding to scenario three for ease of understanding.

[0062] For example, if the current input content of the user includes "daughter, I have heard the doctor's advice, suddenly", and the smart voice interaction system detects that the user state meets the preset state (for example, the time length during which the user does not perform input operation exceeds the preset time length, and it is detected that the user frowns), triggers to execute the interaction function, and issues an inquiry in the form of voice (for example, "do you need help?"). In this case, the user can ask a question by issuing an inquiry instruction (for example, "how to write the word suddenly understood?"). Further, the smart voice interaction system can search through the network or in the pre-stored word library to obtain the corresponding target content (for example, "dazheng guangding"). Based on this, the user can obtain the required target content.

[0063] For example, if the input method interface is a text input interface, the input method interface can be switched from the text input interface to the voice input interface, so that the analyzed semantic information can be displayed in the voice input interface.

[0064] Figure 4 is another flowchart for obtaining target content from a smart voice interaction system according to the present disclosure, as shown in Figure 4 The implementation process of step S401 in the embodiment of the present disclosure is similar to that of step S301 in Figure 3 , and will not be repeated here.

[0065] In step S402, if the input method interface is a text input interface, the input method interface is switched to a voice input interface, the semantic information is displayed in a text display box in the voice input interface, and the target content provided by the smart voice interaction system based on the semantic information is obtained.

[0066] The control input method provided by the embodiment of the present disclosure switches the input method interface to the voice input interface, which facilitates the user to know that the current input scene has been switched to the voice input scene, and can reduce the learning cost for special user groups such as the elderly. Moreover, the analyzed voice information is displayed in the voice input interface, which facilitates the user to check the voice information and judge whether the analyzed voice information is accurate, and can meet the use requirements of the user.

[0067] For example, the input method interface can be switched from the text input interface as shown in Figure 9 to the voice input interface as shown in Figure 12 . As shown in Figure 12 , the voice instruction "please enter: dazheng guangding" can be analyzed and the analyzed semantic information (for example, "please enter: dazheng guangding") can be displayed in the text display box in the voice input interface when the user issues the voice instruction "please enter: dazheng guangding" in the form of voice.

[0068] Exemplarily, the target content obtained through the intelligent voice interaction system can be displayed in the text editing box of the text input interface and then uploaded to the text input box. Here, the text editing box can be understood as the display area where the user performs text editing, and this area displays the to-be-input content generated by editing. The text input interface can be understood as the area where the input content is displayed. Exemplarily, as Figure 13 shown, the text display area with the text "醍醐灌顶" accompanied by pinyin identification is the text display box, and the display area with "女儿,我听完医生的建议,一下子" is the text editing box.

[0069] Exemplarily, for the scenario of uploading the target content from the text editing box to the text input box, the following method can be used to control the input.

[0070] Figure 5 is a schematic flowchart of another control input method shown according to the present disclosure. As Figure 5 shown, the implementation process of step S501 in the embodiments of the present disclosure is similar to that of Figure 1 step S101, and will not be elaborated here.

[0071] In step S502, when it is monitored that the user state meets the preset state, the target content is obtained from the intelligent voice interaction system, and the target content is displayed in the text editing box of the text input interface and then uploaded to the text input box.

[0072] The control input method provided by the embodiments of the present disclosure can add the target content required by the user to the previously edited input content by uploading the target content in the text editing box to the text input box. Based on this, a complete process from obtaining the target content to inputting the target content can be achieved, meeting the actual usage requirements of the user for the input scenario.

[0073] Exemplarily, for the user's input scenario, a judgment link for the working mode can be inserted at multiple nodes in the control input process. For example, the user state can be monitored when the input method interface is displayed and it is determined that the working mode is the preset working mode. Another example is that the target content is obtained from the intelligent voice interaction system when it is monitored that the user state meets the preset state and it is determined that the working mode is the preset working mode. Of course, the judgment link for the working mode can also be inserted at other nodes in the control input process, and the present disclosure does not make specific limitations on this. <00​​​​​​​As shown, the step S602 in the embodiment of the present disclosure is similar to the implementation process of the step S102, and thus is not described herein. Figure 1

[0076] In the step S601, the input method interface is displayed, and in the case where it is determined that the working mode is the preset working mode, the state of the user is monitored.

[0077] The preset working mode represents a working mode for a special user group such as students or the elderly. The special user group can be understood as a user group that has an auxiliary input demand for an input method input scene. For the special user group mentioned above, there is usually a demand for using the intelligent voice interaction system.

[0078] For example, the cultural level of the elderly group is usually low, and there is a spelling difficulty problem for the input of rare characters. For another example, a primary school student intends to briefly summarize the text content he thinks of in the form of an idiom, but cannot find a suitable idiom. In contrast, the adult group often uses the input method for input operation, and has less demand for the intelligent voice interaction system. If the input scene of the adult group triggers the intelligent voice interaction system to perform an interaction process, it may bring negative benefits and affect the normal input of the adult group for the output scene.

[0079] Based on this, in the embodiment of the present disclosure, a node can be inserted in the control input complete process for determining that the working mode is the preset working mode. The method can filter the user group by determining the working mode, and provide the function of auxiliary input for the user group that has an auxiliary input demand through the intelligent voice interaction system. The preset working mode matched with the user group can be a teenager mode, a student mode or an elderly mode.

[0080] The control input method provided by the embodiment of the present disclosure is described below taking the input scene of the elderly as an example.

[0081] For example, the elderly can perform identity verification on the elderly through face recognition and the like in the use process of a terminal such as a mobile phone, so that the terminal used triggers entering the elderly mode. Further, in the case where the input method interface is detected and it is determined that the current working mode is the elderly mode, the state of the elderly is triggered to be monitored. And in the case where it is determined that the time length during which the elderly does not perform input operation exceeds a preset time length, and the camera captures that the elderly is currently frowning and holding the cheek with one hand, the interaction process between the elderly and the intelligent voice interaction system is triggered.

[0082] For example, as shown in Figure 9 ​As shown, the elderly person has entered the content "Daughter, after I listened to the doctor's advice, all of a sudden" in the input method interface, and stopped the input operation after entering this content, pondering, frowning and holding the chin with one hand. In this case, switch from the text input interface shown in Figure 9 to the voice input interface shown in Figure 10 . The intelligent voice interaction system issues a voice prompt of "Do you need help?" and displays this voice prompt on the voice input interface. Based on this, the elderly person can learn that the intelligent voice interaction system is called, and then ask questions to the intelligent voice interaction system in the form of issuing voice commands.

[0083] Specifically, as shown in Figure 11 , the elderly person can issue a voice command with the content "Excuse me: How to write a word that means suddenly understood?". The intelligent voice interaction system receives the voice command, analyzes and obtains the semantic information with the content "Excuse me: How to write a word that means suddenly understood?", and then performs a search for relevant content and displays the semantic information on the voice input interface. Based on this, the elderly person can check the content through the semantic information displayed on the voice input interface and wait for the intelligent voice system to feedback the search result.

[0084] Furthermore, when the intelligent voice interaction system retrieves the target content with the content "醍醐灌顶" through the semantic information with the content "Excuse me: How to write a word that means suddenly understood?", it can display the target content in the text editing box of the text input interface (as shown in Figure 13 ). Based on this, the elderly person judges whether the meaning represented by the target content is the same as their target result according to the displayed target content, and when the target content is determined, the target content is moved from the text editing box to the text input box. For example, after the target content with the content "醍醐灌顶" is moved to the text input box, the display effect is as shown in Figure 14 .

[0085] Through the above process, when the elderly person is inputting, they can perform input operations conveniently and quickly through the intelligent voice interaction assistant, and because the learning cost and operation cost of this method are relatively low, it can meet the actual usage needs of the elderly person for the input scenario.

[0086] Based on the same concept, the embodiments of the present disclosure also provide a control input device.

[0087] It can be understood that the control input device provided by the embodiments of the present disclosure includes the hardware structure and / or software module corresponding to the execution of each function in order to realize the above functions. In combination with the modules and algorithm steps of the examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be realized in the form of hardware or a combination of hardware and computer software. Whether a certain function is realized by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of the embodiments of the present disclosure.

[0088] Figure 15 is a block diagram of a control input device according to the present disclosure. Referring to Figure 15 The device 700 includes a monitoring module 701 and a processing module 702.

[0089] The monitoring module 701 is configured to display an input method interface and monitor a user state.

[0090] The processing module 702 is configured to, in a case where it is monitored that the user state meets a preset state, acquire target content from an intelligent voice interaction system and display the target content on the input method interface. The intelligent voice interaction system is configured to provide target content to be input to the input method interface based on a voice instruction of the user.

[0091] In an embodiment, monitoring that the user state meets the preset state includes at least one of the following: determining that a duration during which no user input operation is received exceeds a preset duration. Monitoring that the user feature meets the preset feature, the feature including one or a combination of an expression, a motion, and a posture.

[0092] In an embodiment, the processing module 702 acquires the target content from the intelligent voice interaction system in the following manner: listening to a voice instruction input by the user and analyzing semantic information corresponding to the voice instruction. The target content is acquired from the intelligent voice interaction system based on the semantic information.

[0093] In an embodiment, the processing module 702 is further configured to, in a case where the input method interface is a text input interface, switch to a voice input interface and display the semantic information in a text display box in the voice input interface.

[0094] In an embodiment, the processing module 702 displays the target content on the input method interface in the following manner: displaying the target content in a text editing box of the text input interface and uploading the target content to a text input box.

[0095] In an embodiment, the processing module 702 is further configured to determine that the working mode is a preset working mode.

[0096] As to the apparatus in the above-mentioned embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and thus will not be described in detail here.

[0097] In the technical solutions of the present disclosure, the acquisition, storage and application of user personal information involved are in line with relevant laws and regulations and do not violate public order and good customs.

[0098] According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0099] Figure 16 A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present disclosure described and / or claimed in this document.

[0100] As shown in Figure 16 The electronic device 800 includes a computing unit 801 that can perform various appropriate actions and processes in accordance with a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. Various programs and data required for the operation of the electronic device 800 can also be stored in the RAM 803. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other through a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0101] Various components in the electronic device 800 are connected to the I / O interface 805, including an input unit 806, such as a keyboard, a mouse, etc., an output unit 807, such as various types of displays, a speaker, etc., the storage unit 808, such as a magnetic disk, an optical disk, etc., and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the electronic device 800 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0102] The computing unit 801 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs various methods and processes described above, such as the control input method. For example, in some embodiments, the control input method can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded onto the RAM 803 and executed by the computing unit 801, one or more steps of the control input method described above can be performed. Alternatively, in other embodiments, the computing unit 801 can be configured to perform the control input method by any other suitable means, such as by means of firmware.

[0103] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a programmable logic device (PLD), a computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0104] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces the functions / operations specified in the flowcharts and / or the block diagrams. The program code can be entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine or entirely on a remote machine or server.

[0105] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0106] To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0107] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0108] The computer system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0109] It should be understood that the various forms of flow shown above can be used to reorder, add, or remove steps. For example, the steps described in the present disclosure can be performed in parallel, in series, or in a different order, without limitation herein, so long as the desired results of the technology described in the present disclosure are achieved.

[0110] The specific implementation described above does not constitute a limitation on the protection scope of the present disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for controlling input, comprising: In response to user input via the input method, the input method interface is displayed, and the user status is monitored; When the user's status is detected to be in a preset state, the interactive function is triggered to issue a question in the form of voice. When the user asks a question by issuing an inquiry command, the target content is obtained from the intelligent voice interaction system, and the target content is displayed in the text editing box of the text input interface and then displayed on the screen. The intelligent voice interaction system is used to provide target content to be input into the input method interface based on the user's voice commands; The detected user status conforming to a preset status includes at least one of the following: The time during which no user input has been received exceeds a preset time. The system detects user characteristics that match preset characteristics, including one or a combination of facial expressions, actions, and postures.

2. The method according to claim 1, wherein, The process of obtaining the target content from the intelligent voice interaction system includes: Listen to the user's voice input commands and parse the semantic information corresponding to the voice commands; Obtain the target content provided by the intelligent voice interaction system based on the semantic information.

3. The method according to claim 2, further comprising: If the input method interface is a text input interface, then switch to the voice input interface and display the semantic information in the text display box of the voice input interface.

4. The method according to any one of claims 1 to 3, further comprising: Set the working mode to the preset working mode.

5. A control input device, comprising: The monitoring module is used to respond to user input via the input method, display the input method interface, and monitor the user's status. The processing module is used to trigger the execution of interactive functions when the user's state meets the preset state, to issue a question in the form of voice, and to obtain the target content from the intelligent voice interaction system when the user asks a question by issuing an inquiry command, and to display the target content in the text editing box of the text input interface and upload it to the text input box; the intelligent voice interaction system is used to provide the target content to be input into the input method interface based on the user's voice command. The detected user status conforming to a preset status includes at least one of the following: The time during which no user input has been received exceeds a preset time. The system detects user characteristics that match preset characteristics, including one or a combination of facial expressions, actions, and postures.

6. The apparatus according to claim 5, wherein, The processing module obtains the target content from the intelligent voice interaction system in the following manner: Listen to the user's voice input commands and parse the semantic information corresponding to the voice commands; Obtain the target content provided by the intelligent voice interaction system based on the semantic information.

7. The apparatus according to claim 6, wherein the processing module is further configured to: When the input method interface is a text input interface, switch to the voice input interface and display the semantic information in the text display box of the voice input interface.

8. The apparatus according to any one of claims 5 to 7, wherein the processing module is further configured to: Set the working mode to the preset working mode.

9. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-4.

10. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-4.

11. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1-4.

Images