A method, device, electronic device and storage medium for switching an interaction mode

Abstract

The present application discloses a method, apparatus, electronic device and storage medium for switching interaction modes, relating to the field of intelligent interaction technology. The specific implementation scheme of the switching method is as follows: when the screen-carrying voice interaction device is in a multi-modal interaction mode, according to a first switching instruction, the screen-carrying voice interaction device is switched to a touch interaction mode; the multi-modal interaction mode is a mode that supports displaying voice interaction information and touch interaction; in the touch interaction mode, according to the reception time of a touch instruction, a valid second switching instruction is determined; the second switching instruction is an instruction for switching the screen-carrying voice interaction device to the multi-modal interaction mode. The present application utilizes the multi-modal interaction mode to support executing the action instructions of the user while displaying voice interaction information. Determining a valid switching instruction according to the reception time of the switching instruction can avoid frequent switching caused by invalid switching instructions, so as to accurately identify the switching instruction of the user and improve the interaction experience.

Description

Technical Field

[0001] This application relates to the field of computer technology, and particularly to the field of intelligent interaction technology. Background Art

[0002] In the existing screen-equipped intelligent voice interaction devices, other operations cannot be performed simultaneously when interacting with users by voice, that is, the screen-equipped intelligent voice interaction devices only support a single interaction mode at the same time. In addition, in the full-duplex hands-free wake-up working mode, there may be misoperations when switching from one single interaction mode to another single interaction mode, resulting in poor user experience. Summary of the Invention

[0003] Embodiments of this application provide a method, apparatus, electronic device, and storage medium for switching interaction modes to solve one or more technical problems in the prior art.

[0004] In a first aspect, this application provides a method for switching interaction modes, including:

[0005] When the screen-equipped voice interaction device is in a multi-interaction mode, according to a first switching instruction, switch the screen-equipped voice interaction device to a touch interaction mode; wherein, the multi-interaction mode is a mode that supports displaying voice interaction information and touch interaction;

[0006] In the touch interaction mode, determine a valid second switching instruction according to the reception time of the touch instruction; the second switching instruction is an instruction to switch the screen-equipped voice interaction device to the multi-interaction mode.

[0007] Through the above solution, the multi-interaction mode can be used to support executing the user's action instructions while displaying voice interaction information, improving the user experience. When switching interaction modes, determining a valid switching instruction according to the reception time of the switching instruction can avoid frequent switching caused by invalid switching instructions, thereby accurately identifying the user's switching instruction and improving the interaction experience.

[0008] In a second aspect, embodiments of this application provide a device for switching interaction modes, including:

[0009] A first switching module, configured to switch the screen-equipped voice interaction device to a touch interaction mode according to a first switching instruction when the screen-equipped voice interaction device is in a multi-interaction mode; wherein, the multi-interaction mode is a mode that supports displaying voice interaction information and touch interaction;

[0010] A second switching instruction determination module, configured to determine a valid second switching instruction according to the reception time of the touch instruction in the touch interaction mode; the second switching instruction is an instruction to switch the screen-equipped voice interaction device to the multi-interaction mode.

[0011] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0012] at least one processor; and

[0013] a memory communicatively connected to the at least one processor; wherein,

[0014] the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method provided in any embodiment of the present application.

[0015] In a fourth aspect, an embodiment of the present application provides a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method provided in any embodiment of the present application.

[0016] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program / instructions, and the computer program / instructions, when executed by a processor, implement the method provided in any embodiment of the present application.

[0017] Other effects of the above optional manners will be described in conjunction with specific embodiments below. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings are used to better understand the solution and do not limit the present application. Among them:

[0019] Figure 1 is a flowchart of a method for switching interaction modes according to an embodiment of the present application;

[0020] Figure 2 is a schematic diagram of a multi-party interaction mode according to an embodiment of the present application;

[0021] Figure 3 is a schematic diagram of a multi-party interaction mode according to another embodiment of the present application;

[0022] Figure 4 is a schematic diagram of a multi-party interaction mode according to another embodiment of the present application;

[0023] Figure 5 is a schematic diagram of a touch interaction mode according to an embodiment of the present application;

[0024] Figure 6 is a flowchart of determining a valid second switching instruction according to an embodiment of the present application;

[0025] Figure 7 is a schematic diagram of a device for switching interaction modes according to an embodiment of the present application;

[0026] Figure 8It is a block diagram of an electronic device for implementing the interaction mode switching method of the embodiments of the present application. Detailed implementation manners

[0027] The following describes exemplary embodiments of the present application with reference to the accompanying drawings. Various details of the embodiments of the present application are included to facilitate understanding, and they should be considered merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0028] As Figure 1 shown, in one implementation manner, a method for switching interaction modes is provided, including the following steps:

[0029] S101: When the screen-enabled voice interaction device is in a multi-modal interaction mode, according to a first switching instruction, switch the screen-enabled voice interaction device to a touch interaction mode; wherein, the multi-modal interaction mode is a mode that supports displaying voice interaction information and touch interaction.

[0030] S102: In the touch interaction mode, determine a valid second switching instruction according to the reception time of the touch instruction; the second switching instruction is an instruction to switch the screen-enabled voice interaction device to the multi-modal interaction mode.

[0031] In the embodiments of the present application, the touch interaction mode includes receiving and responding to touch instructions. That is, the screen of the screen-enabled voice interaction device can receive touch instructions such as tapping or swiping by the user, and responding to the touch instructions can be performing corresponding operations according to the user's touch instructions. For example, according to the user's tap instruction, operations such as opening or closing an application can be performed, and according to the user's swipe instruction, operations such as turning pages can be performed correspondingly.

[0032] The multi-modal interaction mode can include receiving and executing touch instructions while displaying voice interaction information. In the case of the multi-modal interaction mode, the display area of the display device can be divided into a first screen area and a second screen area.

[0033] The first screen area can be used as the display area for voice interaction information. For example, it can display the user's voice information "Have you eaten today", or display feedback information for the user's question or voice control instruction. For example, the user's question is "What's the weather like today". According to the query result, "The temperature in XX District, XX City today is XX °C" can be displayed in the voice interaction information display area (the first screen area). Another example is that the user's voice control instruction is "Play the next episode", and "Switched to episode XX for you" can be displayed in the voice interaction information display area.

[0034] The second screen area can be used to receive touch or swipe operations from the user. For example, the user's voice messages are displayed in the first screen area, or feedback information for the user's questions or voice control instructions is displayed. At the same time, when the second screen area receives a swipe instruction from the user, screen paging, or operations such as screen brightness and volume adjustment can be performed according to the parsing of the swipe instruction.

[0035] The multi-modal interaction mode can be executed in the desktop state of the display device, or when an application is launched, etc. For example, Figure 2 as shown in the execution in the desktop state, Figure 3 as shown in the execution in the state of launching music playback, Figure 4 as shown in the execution in the state of launching video playback. In Figures 2 to 4 all of them, the example of "What's the weather like today" is shown in the display area of the voice interaction information.

[0036] In the case of the multi-modal interaction mode, it can be switched to the touch interaction mode according to the first switching instruction. The first switching instruction can include a touch switching instruction, a gesture switching instruction, or a voice switching instruction, etc. For example, when it is detected that the user clicks the interaction mode switching switch on the screen, a specific gesture of the user is detected, or a voice switching instruction from the user is received, etc.

[0037] Figure 5 As shown in the schematic diagram of the touch interaction mode. In the touch interaction mode, a valid second switching instruction can be determined according to the reception time of the touch instruction. The second switching instruction can be an instruction to switch the screen-enabled voice interaction device from the touch interaction mode to the multi-modal interaction mode.

[0038] The second switching instruction can include a gaze switching instruction, a voice switching instruction, a gesture switching instruction, and a touch switching instruction, etc. For example, within 5 seconds of switching from the multi-modal interaction mode to the touch interaction mode, only the voice switching instruction, the gesture switching instruction, or the touch switching instruction is a valid second switching instruction. In the case of exceeding 5 seconds, on the basis of the foregoing switching instructions, the gaze switching instruction can also be determined as a valid second switching instruction.

[0039] Among them, the gaze switching instruction can include that when it is detected that the user's gaze is focused on the screen-enabled voice interaction device and exceeds a certain time, it is determined that the gaze switching instruction is received.

[0040] The voice switching instruction can include a specific wake word, such as "Xiaodu, Xiaodu". Or specific instructions, such as "Louder", "Play the next song", etc. When the above wake word or specific instruction is received, it is confirmed that the voice switching instruction is received.

[0041] The gesture switching instruction may include a preset specific gesture action, etc. When a specific gesture action made by the user is collected, it is confirmed that the gesture switching instruction is received.

[0042] The touch control switching instruction may include collecting that the user clicks on the interaction mode switching switch on the screen, and confirming that the switching control instruction is received.

[0043] Through the above solution, multiple interaction modes can be used to support executing the user's action instructions while displaying voice interaction information, improving the user experience. When performing the conversion of the interaction mode, an effective switching instruction is determined according to the reception time of the switching instruction, which can avoid frequent switching caused by invalid switching instructions, so that the user's switching instruction can be accurately recognized and the interaction feeling can be improved.

[0044] In one implementation manner, it further includes:

[0045] When a valid second switching instruction is obtained, switch to the multiple interaction mode.

[0046] Through the above solution, the interaction mode is switched only when a valid second switching instruction is obtained. Frequent switching caused by invalid switching instructions can be avoided, so that the user's switching instruction can be accurately recognized and the interaction feeling can be improved.

[0047] In one implementation manner, determining a valid second switching instruction according to the reception time of the touch control instruction includes:

[0048] When no touch control instruction is received within the first predetermined time period, within the first predetermined time period, determine that the touch control switching instruction, the gesture switching instruction or the voice switching instruction is a valid second switching instruction.

[0049] The switch from the multiple interaction mode to the touch control interaction mode is performed according to the first switching instruction. As mentioned above, the first switching includes the touch control switching instruction, the gesture switching instruction, the voice switching instruction, etc. Thus, it can be determined that the switch from the multiple interaction mode to the touch control interaction mode is based on the user's relatively clear subjective will.

[0050] The second switching instruction includes, in addition to the touch instruction, the gesture switching instruction, and the voice switching instruction, a line-of-sight switching instruction. Since the line-of-sight switching instruction is prone to misoperation, within the first predetermined time period after switching from multiple interaction modes to the touch interaction mode, it is possible to confirm whether the user still has a switching intention by determining whether a touch instruction is received. That is, within the first predetermined time period (for example, within 5 seconds), if no touch instruction is received, it can be indicated that the user has ended the operation. In this case, it is possible that the user's line of sight still remains on the display interface of the screen-equipped voice interaction device. For this situation, the line-of-sight switching instruction can be temporarily prohibited within the first predetermined time period. Within the first predetermined time period, only the methods of switching back to multiple interaction modes using the touch switching instruction, the gesture switching instruction, or the voice switching instruction are retained.

[0051] Through the above solution, when the user expresses the intention to end the operation by not performing a touch operation, the line-of-sight switching instruction can be temporarily turned off, and only the touch switching instruction and the voice switching instruction are retained. This avoids misoperations caused by the user's line of sight not having enough time to move away, thereby improving the user's interaction experience.

[0052] In one embodiment, it further includes:

[0053] When the first predetermined time period is exceeded, it is determined that the touch switching instruction, the gesture switching instruction, the voice switching instruction, or the line-of-sight switching instruction is a valid second switching instruction.

[0054] When the first predetermined time period is exceeded, it is equivalent to having passed the buffer period for turning off the line-of-sight switching. Based on this, it is possible to resume using the line-of-sight switching instruction as a valid second switching instruction.

[0055] Through the above solution, after passing the buffer period for turning off the line-of-sight switching, the line-of-sight switching instruction can be re-enabled as a valid second switching instruction, satisfying the support for multiple switching methods, thereby improving the user's interaction experience.

[0056] As Figure 6 shown, in one embodiment, determining a valid second switching instruction according to the reception time of the touch instruction includes:

[0057] S601: Within the first predetermined time period, determine the moment when the last touch instruction is received.

[0058] S602: Taking this moment as the starting moment, within the second predetermined time period, determine that the touch switching instruction, the gesture switching instruction, or the voice switching instruction is a valid second switching instruction.

[0059] If there is a situation where a touch command is received within the first predetermined time period, it indicates that the user's operation intention is only to turn off the display of voice interaction information. In this case, the user's touch situation can be continuously monitored until the user's last touch behavior is determined.

[0060] The determination method may include determining based on the time interval between two adjacent received touch commands. For example, after receiving the Nth touch command, if the (N + 1)th touch command is not received within the time interval threshold, the moment when the Nth touch command is received can be determined as the moment when the last touch command is received. Here, N is a positive integer.

[0061] Starting from the moment when the last touch command is received as the starting moment, within the second predetermined time period, the touch switching command, the gesture switching command, and the voice switching command are determined as valid second switching commands. The reason for setting the second predetermined time period is the same as the reason for setting the first time period described above, and will not be elaborated here.

[0062] The second predetermined time period can be the same as the first predetermined time period or longer than the first predetermined time period. It is not limited here.

[0063] Through the above method, it is judged whether the user wants to end the operation by the last received touch command. In the case where the user shows the intention to end the operation, the sight switching command can be turned off, and only the touch switching command and the voice switching command are retained. This can avoid misoperations caused by the user's sight not having time to move away, thereby improving the user's interaction experience.

[0064] In one embodiment, it further includes:

[0065] In the case where the second predetermined time period is exceeded, the touch switching command, the gesture switching command, the voice switching command, or the sight switching command is determined as a valid second switching command.

[0066] In the case where the second predetermined time period is exceeded, it is equivalent to having passed the buffer period for turning off the sight switching. Based on this, the sight switching command can be restored as a valid second switching command.

[0067] Through the above solution, after passing the buffer period for turning off the sight switching, the sight switching command can be re-enabled as a valid second switching command, meeting the support for multiple switching methods, thereby improving the user's interaction experience.

[0068] In one embodiment, the value range of the first predetermined time period includes any value from 5 seconds to 10 seconds.

[0069] In one embodiment, the second predetermined time period is 10 seconds.

[0070] The first predetermined time period can be set to 5 seconds, 8.5 seconds, 10 seconds, etc. It is not difficult to understand that the above-mentioned first and second predetermined time periods can be adjusted according to the actual needs of the user.

[0071] By setting the above time periods, it can meet the user's need to have enough time to move their line of sight away from the screen-based voice interaction device.

[0072] In one embodiment, in the case of the multi-modal interaction mode, the display interface of the screen-based voice interaction device includes:

[0073] An interaction mode switch, a voice interaction information display area, and a touch command receiving area.

[0074] As previously mentioned, the multi-modal interaction mode is a mode that supports the display of voice interaction information and touch interaction. Based on this, in the case of the multi-modal interaction mode, the display interface of the screen-based voice interaction device includes: an interaction information display area for displaying voice interaction information, a touch command receiving area for receiving touch commands, and an interaction mode switch for receiving the first switching command and the second switching command in the form of touch.

[0075] Among them, the interaction information display area corresponds to the aforementioned first screen area, and the touch command receiving area corresponds to the aforementioned second screen area.

[0076] In addition, the form of the interaction mode switch can change with the switching of the interaction mode. Taking Figures 2 to 5 as an example, the identifier in the lower left corner of the figure is the interaction mode switch. As Figures 2 to 4 shown, in the multi-modal interaction mode, the interaction mode switch can be presented in a first form; as Figure 5 shown, in the touch interaction mode, the interaction mode switch can be presented in a second form.

[0077] The voice interaction information display area and the touch command receiving area can exist in the form of having partially overlapping areas. For example, the voice interaction information display area can cover the touch command receiving area in the form of an overlay layer. The covered part of the touch command receiving area is adjusted to not respond to the received touch commands, and the other parts of the touch command receiving area remain responsive to the received touch commands. Not responding to the received touch commands can mean not performing the corresponding operation after receiving the user's touch command.

[0078] Through the above solution, it can support the display of voice interaction information while also supporting the reception of the user's touch commands. It meets the user's interaction needs and improves the user's interaction experience.

[0079] In one embodiment, in the case of the touch interaction mode, the display interface of the screen-based voice interaction device includes:

[0080] An interaction mode switching switch and a touch instruction receiving area.

[0081] In the case of the touch interaction mode, the voice interaction information display area can be turned off. The turning-off method may include canceling the text display attribute of the original voice interaction information display area and adjusting it to respond to the received touch instructions.

[0082] Through the above solution, in the case of the touch interaction mode, the screen-equipped voice interaction device can respond to the received touch instructions in a full-screen form.

[0083] Such as Figure 7 shown, in one embodiment, a switching device for an interaction mode is provided, including the following components:

[0084] A first switching module 701, configured to switch the screen-equipped voice interaction device to the touch interaction mode according to a first switching instruction when the screen-equipped voice interaction device is in a multi-modal interaction mode; wherein, the multi-modal interaction mode is a mode that supports the display of voice interaction information and touch interaction.

[0085] A second switching instruction determination module 702, configured to determine a valid second switching instruction according to the reception time of the touch instruction in the touch interaction mode; the second switching instruction is an instruction to switch the screen-equipped voice interaction device to the multi-modal interaction mode.

[0086] In one embodiment, it further includes:

[0087] A second switching module, configured to switch to the multi-modal interaction mode when a valid second switching instruction is obtained.

[0088] In one embodiment, the second switching instruction determination module 702 is configured to determine that a touch switching instruction, a gesture switching instruction, or a voice switching instruction is a valid second switching instruction within a first predetermined time period when no touch instruction is received within the first predetermined time period.

[0089] In one embodiment, the second switching instruction determination module 702 is further configured to: determine that a touch switching instruction, a gesture switching instruction, a voice switching instruction, or a gaze switching instruction is a valid second switching instruction when the first predetermined time period is exceeded.

[0090] In one embodiment, the second switching instruction determination module 702 is configured to: determine the moment when the last touch instruction is received within the first predetermined time period;

[0091] Taking this moment as the starting moment, within a second predetermined time period, determine that a touch switching instruction, a gesture switching instruction, or a voice switching instruction is a valid second switching instruction.

[0092] In one embodiment, the second switching instruction determination module 702 is further configured to: determine that a touch switching instruction, a gesture switching instruction, a voice switching instruction, or a gaze switching instruction is a valid second switching instruction when a second predetermined time period is exceeded.

[0093] In one embodiment, the value range of the first predetermined time period includes any value from 5 seconds to 10 seconds.

[0094] In one embodiment, the second predetermined time period is 10 seconds.

[0095] In one embodiment, in the case of the touch interaction mode, the display interface of the screen-equipped voice interaction device includes:

[0096] An interaction mode switching switch, a voice interaction information display area, and a touch instruction receiving area.

[0097] In one embodiment, in the case of the touch interaction mode, the display interface of the screen-equipped voice interaction device includes:

[0098] An interaction mode switching switch and a touch instruction receiving area.

[0099] For the functions of the modules in each device of the embodiments of the present application, reference may be made to the corresponding descriptions in the above methods, and details are not described herein again.

[0100] According to the embodiments of the present application, the present application also provides an electronic device, a readable storage medium, and a computer program product.

[0101] In the technical solution of the present disclosure, the acquisition, storage, and application of the user's personal information involved all comply with the provisions of relevant laws and regulations and do not violate public order and good customs.

[0102] As Figure 8 shown, it is a block diagram of an electronic device for a method of switching interaction modes according to an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as, a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, a personal digital processor, a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present application described and / or claimed herein.

[0103] As Figure 8As shown, the electronic device includes: one or more processors 810, a memory 820, and interfaces for connecting the components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and can be mounted on a common motherboard or otherwise mounted as required. The processor can process instructions executed within the electronic device, including instructions stored in the memory or on the memory for displaying graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, multiple processors and / or multiple buses can be used with multiple memories and multiple memories if needed. Also, multiple electronic devices can be connected, with each device providing some necessary operations (such as an array of servers, a set of blade servers, or a multi-processor system). Figure 8 In the figure, a processor 810 is taken as an example.

[0104] The memory 820 is the non-transitory computer-readable storage medium provided in this application. Among them, the memory stores instructions executable by at least one processor, so that the at least one processor executes the method for switching interaction modes provided in this application. The non-transitory computer-readable storage medium of this application stores computer instructions, and these computer instructions are used to make a computer execute the method for switching interaction modes provided in this application.

[0105] As a non-transitory computer-readable storage medium, the memory 820 can be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as the program instructions / modules corresponding to the method for switching interaction modes in the embodiments of this application (for example, the Figure 7 first switching module 701 and the second switching instruction determination module 702 shown in the figure). The processor 810 executes various functional applications and data processing of the server by running the non-transitory software programs, instructions, and modules stored in the memory 820, that is, implements the method for switching interaction modes in the above method embodiments.

[0106] The memory 820 can include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the electronic device of the method for switching interaction modes, etc. In addition, the memory 820 can include high-speed random access memory and can also include non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some embodiments, the memory 820 can optionally include memories remotely set relative to the processor 810, and these remote memories can be connected to the electronic device of the method for switching interaction modes through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0107] The electronic device for the method of switching interaction modes may further include: an input device 830 and an output device 840. The processor 810, the memory 820, the input device 830, and the output device 840 may be connected via a bus or other means. Figure 8 Taking the connection via a bus as an example.

[0108] The input device 830 may receive input digital or character information, as well as generate key signal inputs related to the user settings and function controls of the electronic device for the method of switching interaction modes, such as input devices like touchscreens, keypads, mice, trackpads, touchpads, pointing sticks, one or more mouse buttons, trackballs, joysticks, etc. The output device 840 may include a display device, an auxiliary lighting device (e.g., LED), and a haptic feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touchscreen.

[0109] The various embodiments of the systems and techniques described herein may be implemented in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that may be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, and can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0110] These computing programs (also referred to as programs, software, software applications, or code) include machine instructions for a programmable processor and may implement these computing programs using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms “machine-readable medium” and “computer-readable medium” refer to any computer program product, device, and / or apparatus (e.g., a disk, an optical disk, a memory, a programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term “machine-readable signal” refers to any signal for providing machine instructions and / or data to a programmable processor.

[0111] To provide for interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can also be used to provide for interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0112] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0113] A computer system can include clients and servers. The clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server is generated by computer programs running on the respective computers and having a client-server relationship to each other.

[0114] It should be understood that the various forms of the processes shown above can be used, with steps reordered, added, or deleted. For example, the steps recited in this application can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this application can be achieved, and no limitation is imposed herein.

[0115] The above specific embodiments do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application shall be included within the scope of protection of this application.

Claims

1. A method for switching an interaction mode, characterized in that Including: When the screen - enabled voice interaction device is in the multi - interaction mode, according to the first switching instruction, switch the screen - enabled voice interaction device to the touch - interaction mode; wherein, the multi - interaction mode is a mode that supports displaying voice interaction information and touch interaction; in the case of the multi - interaction mode, the display interface of the screen - enabled voice interaction device includes an interaction mode switching switch, a voice interaction information display area, and a touch command receiving area; the voice interaction information display area is used to display the user's voice information or display the feedback information for the user's question or voice control command; the touch command receiving area is used to receive the user's touch command; the multi - interaction mode receives and executes touch commands while displaying voice interaction information; In the touch - interaction mode, determine a valid second switching instruction according to the reception time of the touch command; the second switching instruction is an instruction to switch the screen - enabled voice interaction device to the multi - interaction mode; the second switching instruction includes a touch switching instruction, a gesture switching instruction, a voice switching instruction, and a sight - line switching instruction; Wherein, the determining a valid second switching instruction according to the reception time of the touch command in the touch - interaction mode includes: In the case that no touch command is received within the first predetermined time period after switching from the multi - interaction mode to the touch - interaction mode, temporarily prohibit the sight - line switching instruction, and determine the touch switching instruction, the gesture switching instruction, or the voice switching instruction as the valid second switching instruction; In the case that a touch command is received within the first predetermined time period after switching from the multi - interaction mode to the touch - interaction mode, determine the moment when the last touch command is received according to the time interval between two adjacent received touch commands; Taking the moment as the starting moment, within the second predetermined time period, determine the touch switching instruction, the gesture switching instruction, or the voice switching instruction as the valid second switching instruction.

2. The method according to claim 1, wherein Also including: In the case of obtaining the valid second switching instruction, switch to the multi - interaction mode.

3. The method according to claim 1, wherein Also including: In the case of exceeding the first predetermined time period, determine the touch switching instruction, the gesture switching instruction, the voice switching instruction, or the sight - line switching instruction as the valid second switching instruction.

4. The method according to claim 1, wherein Also including: In the case of exceeding the second predetermined time period, determine the touch switching instruction, the gesture switching instruction, the voice switching instruction, or the sight - line switching instruction as the valid second switching instruction.

5. The method according to any one of claims 1 to 3, characterized in that, The value range of the first predetermined time period includes any value from 5 seconds to 10 seconds.

6. The method according to claim 1 or 4, characterized in that, The second predetermined time period is 10 seconds.

7. The method according to claim 1, characterized in that In the case of the touch - interaction mode, the display interface of the screen - enabled voice interaction device includes: An interaction mode switching switch and a touch command receiving area.

8. A switching device for an interaction mode, characterized in that, Including: A first switching module, configured to switch the screen-equipped voice interaction device to a touch interaction mode according to a first switching instruction when the screen-equipped voice interaction device is in a multi-modal interaction mode; wherein, the multi-modal interaction mode is a mode that supports displaying voice interaction information and touch interaction; in the case of the multi-modal interaction mode, the display interface of the screen-equipped voice interaction device includes an interaction mode switching switch, a voice interaction information display area, and a touch instruction receiving area; the voice interaction information display area is configured to display the user's voice information, or display feedback information on the user's question or voice control instruction; the touch instruction receiving area is configured to receive the user's touch instruction; the multi-modal interaction mode receives and executes touch instructions while displaying voice interaction information. A second switching instruction determination module, configured to determine a valid second switching instruction according to the reception time of a touch instruction in the touch interaction mode; the second switching instruction is an instruction to switch the screen-equipped voice interaction device to the multi-modal interaction mode; the second switching instruction includes a touch switching instruction, a gesture switching instruction, a voice switching instruction, and a gaze switching instruction. Wherein, the second switching instruction determination module is configured to: When no touch instruction is received within a first predetermined time period after switching from the multi-modal interaction mode to the touch interaction mode, temporarily prohibit the gaze switching instruction, and determine the touch switching instruction, the gesture switching instruction, or the voice switching instruction as a valid second switching instruction. When a touch instruction is received within a first predetermined time period after switching from the multi-modal interaction mode to the touch interaction mode, determine the moment when the last touch instruction is received according to the time interval between two adjacent received touch instructions. Taking the moment as the starting moment, within a second predetermined time period, determine the touch switching instruction, the gesture switching instruction, or the voice switching instruction as a valid second switching instruction.

9. The device according to claim 8, characterized in that, Further comprising: A second switching module, configured to switch to the multi-modal interaction mode when the valid second switching instruction is obtained.

10. The device according to claim 8, characterized in that, The second switching instruction determination module is further configured to: when the first predetermined time period is exceeded, determine the touch switching instruction, the gesture switching instruction, the voice switching instruction, or the gaze switching instruction as a valid second switching instruction.

11. The device according to claim 8, characterized in that, The second switching instruction determination module is further configured to: when the second predetermined time period is exceeded, determine the touch switching instruction, the gesture switching instruction, the voice switching instruction, or the gaze switching instruction as a valid second switching instruction.

12. An electronic device, characterized in that, Comprising: At least one processor; And A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1 to 7.

13. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 7.

Images