Speech interaction method, and interaction device, electronic device and storage medium

Abstract

The embodiments of the present disclosure relate to a speech interaction method, and an interaction device, an electronic device and a storage medium. The method proposed herein comprises: in response to a preset operation for an interaction device, controlling an audio collection unit of the interaction device to start collecting a first speech signal, wherein the interaction device is suitable for being worn on a finger of a user; acquiring the first speech signal collected by the audio collection unit; and sending the first speech signal to a terminal device connected to the interaction device, such that the terminal device uses the first speech signal to generate a second speech signal.

Description

Method for voice interaction, interaction device, electronic device and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411253085.4, filed on September 6, 2024, entitled "Method for voice interaction, interaction device, electronic device and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The example embodiments of the present disclosure generally relate to the field of computer, in particular, to a method for voice interaction, an interaction device, an electronic device and a storage medium. BACKGROUND

[0003] With the development of computer technology, voice interaction technology has become one of the important ways of human-computer interaction. For example, a user can interact with a terminal device through voice to obtain feedback content of the terminal device.

[0004] The traditional voice interaction scene is usually directly interacted by the user with the terminal device, which has great limitations and affects the efficiency of voice interaction. SUMMARY

[0005] In a first aspect of the present disclosure, a method for voice interaction is provided. The method comprises: in response to a preset operation on an interaction device, controlling an audio acquisition unit of the interaction device to start collecting a first voice signal, the interaction device being adapted to be worn on a finger of a user; acquiring the first voice signal collected by the audio acquisition unit; and sending the first voice signal to a terminal device connected to the interaction device, for the terminal device to generate a second voice signal using the first voice signal.

[0006] In a second aspect of the present disclosure, an interaction device adapted to be worn on a finger of a user is provided. The interaction device comprises: an interaction module configured to collect a preset operation of the user on the interaction device; a control module configured to, in response to the preset operation on the interaction device connected to a terminal device, control an audio acquisition unit of the interaction device to start collecting a first voice signal; an acquisition module configured to acquire the first voice signal collected by the audio acquisition unit; and a sending module configured to send the first voice signal to a terminal device connected to the interaction device, for the terminal device to generate a second voice signal using the first voice signal.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device comprises at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to perform the method of the first aspect.

[0008] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon computer-executable instructions that are executable by a processor to implement the method of the first aspect.

[0009] In a fifth aspect of the present disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0010] It should be understood that nothing in the Summary is to be construed as a limitation on the scope of the embodiments of the present disclosure. Other features, aspects, and advantages of the present disclosure will become apparent from the following detailed description, figures and claims. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements, in which:

[0012] FIG. 1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure can be implemented;

[0013] FIG. 2 shows a flowchart of a voice interaction process according to some embodiments of the present disclosure;

[0014] FIG. 3 shows a flowchart of an example interaction process according to some embodiments of the present disclosure;

[0015] FIG. 4 shows a schematic block diagram of an example interaction device according to some embodiments of the present disclosure; and

[0016] FIG. 5 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein, but rather, the embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It should be understood that the drawings and embodiments of the present disclosure are only for illustrative purposes and should not be construed as limiting the scope of protection of the present disclosure.

[0018] It should be noted that the titles of any sections / sub-sections provided herein are not limiting. Various embodiments are described throughout this document and any type of embodiment can be included under any section / sub-section. Furthermore, embodiments described in any section / sub-section can be combined with any other embodiments described in the same section / sub-section and / or different section / sub-section in any manner.

[0019] In the description of the embodiments of the present disclosure, the term "comprising" and its similar terms, such as "comprises" and "comprised of", should be understood as open terms, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "an embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit or implicit definitions can also be included below. The terms "first", "second", etc. can refer to different or same objects. Other explicit and implicit definitions can also be included below.

[0020] Data of users, acquisition and / or use of data, etc. can be involved in embodiments of the present disclosure. These aspects all comply with corresponding laws and regulations and relevant provisions. In embodiments of the present disclosure, all collection, acquisition, processing, processing, forwarding, use, etc. of data are performed on the premise that the user is aware of and confirms. Accordingly, when implementing embodiments of the present disclosure, the type of data or information that can be involved, the use range, the use scenario, etc. should be notified to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations. The specific notification and / or authorization manner can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this aspect.

[0021] In the present specification and embodiments, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0022] As mentioned above, voice interaction is an important interaction capability. For example, some terminal devices can deploy a voice assistant to interact with a user in voice. A conventional scheme usually wakes up the voice assistant through a voice instruction. However, such a wake-up manner is not applicable in some specific voice interaction scenarios (for example, noisy public occasions), thereby affecting the user's voice interaction experience.

[0023] Embodiments of the present disclosure propose a voice interaction scheme. According to the scheme, an interaction device can control an audio acquisition unit of the interaction device to start acquiring a first voice signal in response to a preset operation on the interaction device, wherein the interaction device is adapted to be worn on a finger of a user.

[0024] Further, the interaction device can acquire the first voice signal collected by the audio collection unit, and can send the first voice signal to a terminal device connected with the interaction device, so that the terminal device generates a second voice signal by using the first voice signal.

[0025] In this way, the embodiments of the present disclosure can perform voice interaction through the interaction device suitable for being worn on the finger, thereby improving the interaction efficiency. Specifically, the embodiments of the present disclosure can activate the voice interaction capability of the terminal device by detecting the preset operation on the interaction device. Further, by collecting the voice signal by using the audio collection unit carried by the interaction device and providing to the terminal device, the embodiments of the present disclosure can support more voice interaction scenarios and improve the efficiency of voice interaction.

[0026] Various example implementations of the scheme will be described in detail below in further conjunction with the accompanying drawings.

[0027] Example Environment

[0028] FIG. 1 shows a schematic diagram of an example environment 100 in which the embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include a terminal device 110.

[0029] In this example environment 100, the terminal device 110 can run an application 120 supporting voice interaction. The application 120 can include, but is not limited to, a voice assistant application, a digital assistant application, etc. A user 140 can interact with the application 120 via the terminal device 110 and / or its attached devices.

[0030] As shown in FIG. 1, the terminal device 110 can also be connected with an interaction device 160. The interaction device 160 can be worn on the finger of the user 140. As an example, the interaction device 160 can be in the form of a ring or a ring, etc.

[0031] In some embodiments, the interaction device 160 can include an audio collection unit, for example, a microphone or a microphone array. After detecting the preset operation of the user 140, the audio collection device of the interaction device 160 can start collecting the voice signal of the user to perform voice interaction with the terminal device 110.

[0032] As will be described in detail below, the user 140 can wake up the voice processing capability of the terminal device 110 by interacting with the interaction device 160. The specific process of voice interaction will be described in detail below with reference to FIG. 2.

[0033] In the environment 100 of FIG. 1, the terminal device 110 can further present an interface 150 for supporting interface interaction through the application 120 if the application 120 is in an active state. As an example, the interface 150 can be an interaction interface with a digital assistant to, for example, demonstrate an interaction process between a user and the digital assistant. The present disclosure is not intended to limit the specific form of the interface 150.

[0034] In some embodiments, the terminal device 110 communicates with the server 130 to implement the provisioning of services of the application 120. The terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a palmtop computer, a portable gaming terminal, a VR / AR device, a Personal Communication System (PCS) device, a personal navigation device, a Personal Digital Assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface to the user (such as a "wearable" circuit, etc.).

[0035] The server 130 can be a standalone physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 130 may, for example, include a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 can provide background services for the application 120 in the terminal device 110 that supports a virtual scene.

[0036] A communication connection can be established between the server 130 and the terminal device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the terminal device 110 can implement signaling interaction through the communication connection therebetween.

[0037] It should be appreciated that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and without implying any limitation on the scope of the present disclosure.

[0038] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0039] Example voice interaction procedure

[0040] A voice interaction procedure according to embodiments of the present disclosure will be described below with reference to the accompanying drawings. FIG. 2 shows a flowchart 200 of a voice interaction procedure according to some embodiments of the present disclosure.

[0041] As shown in FIG. 2, at 205, the interaction device 160 can detect a preset operation directed to the interaction device 160 to control an audio capturing unit in the interaction device 160 to start capturing a first voice signal.

[0042] In some embodiments, the interaction device 160 can be provided with a button. The button can include a physical button or a pressure-sensitive button. The interaction device 160 may, for example, detect an interaction operation directed to the button to detect a preset interaction directed to the interaction device 160.

[0043] For example, the interaction device 160 can detect a press of the physical button by the user 140. Alternatively, the interaction device 160 can also detect a press of the pressure-sensitive button through a pressure-sensitive sensor.

[0044] In some embodiments, such a press may, for example, include a single click, a double click, or a long press, or other appropriate press operation. In some embodiments, the specific button operation for triggering the audio capturing unit of the interaction device 160 can be determined based on a configuration of the user 140. As an example, the user may, for example, configure the specific button operation type via the interface 150 provided by the application 120.

[0045] By providing a button for waking up a voice interaction at the interaction device 160, embodiments of the present disclosure can support a user to achieve a more efficient voice wake-up through an interaction device worn on a finger and reduce the probability of misoperation.

[0046] In some embodiments, the interaction device 160 can also utilize the audio capturing unit to detect whether a preset audio input is received to detect a preset interaction directed to the interaction device 160.

[0047] In some embodiments, the interaction device 160 may, for example, utilize the audio capturing unit (e.g., a microphone) to perform sound detection. Upon detecting a sound with a volume exceeding a threshold size, the interaction device 160 can determine that a preset audio input is received and can utilize the audio capturing unit to start recording.

[0048] In other embodiments, the preset audio input can further include a preset voice content, e.g., a wake-up word. The interaction device 160 can receive the voice content output by the user 140 using the audio acquisition unit, and can determine whether the voice content matches the preset voice content, e.g., whether the preset wake-up word is included, by the interaction device 160 or the terminal device 110.

[0049] Upon detecting the preset voice content, the interaction device 160 can determine that the preset audio input is received, and can start recording using the audio acquisition unit.

[0050] In other examples, upon detecting the preset audio input, the interaction device 160 can further detect whether human voice content is received. Specifically, the received voice signal can be processed by the interaction device 160 or the terminal device 110 to determine whether human voice content is received. Upon detecting the human voice content, the interaction device 160 can start recording using the audio acquisition unit, instead of starting recording upon receiving the preset audio input. In this way, embodiments of the present disclosure can further provide effectiveness of audio acquisition.

[0051] In some embodiments, the interaction device 160 can further detect the preset interaction for the interaction device 160 using detecting a preset somatosensory action associated with the interaction device 160.

[0052] Specifically, such a preset somatosensory action can include an action associated with the hand of the user 140, for example. In some embodiments, the interaction device 160 or the terminal device 110 can detect the wrist action of the user 140 through a motion sensor (e.g., an acceleration sensor, a gyroscope, etc.) within the interaction device 160. For example, upon detecting that the user wearing the interaction device 160 performs a wrist-lifting action, the interaction device 160 can start recording using the audio acquisition unit.

[0053] In some embodiments, the interaction device 160 or the terminal device 110 can detect the gesture action of the user 140 through a motion sensor (e.g., an acceleration sensor, a gyroscope, etc.) within the interaction device 160. For example, upon detecting that the user wearing the interaction device 160 performs a two-finger pinch gesture, the interaction device 160 can start recording using the audio acquisition unit.

[0054] In some embodiments, such a preset somatosensory action can also be determined based on a configuration operation of the user 140. As an example, the user 140 can configure the somatosensory action via the interface 150 provided by the terminal device 110. For example, the user 140 can select a provided preset somatosensory action, or can acquire a customized somatosensory action.

[0055] In some embodiments, the interaction device 160 can also turn on the audio capturing unit based on a combination of multiple manners to capture the first voice signal.

[0056] As an example, the interaction device 160 can first detect a preset somatic action associated with the interaction device 160, such as the wrist lifting action or the gesture action mentioned above. Further, after detecting the preset somatic action, the interaction device 160 can turn on the audio capturing unit (e.g., microphone) at the interaction device 160.

[0057] Further, the interaction device 160 can utilize the turned-on audio capturing unit to detect a preset audio input to determine whether to acquire the first voice signal by the audio capturing unit.

[0058] The above describes the combination of the somatic wake-up manner and the audio wake-up manner. In another example, the interaction device 160 may, for example, also support the combination of the key wake-up manner and the audio wake-up manner. For example, the interaction device 160 can turn on the audio capturing unit after detecting the pressing operation on the key, and further detect the preset audio input to determine whether to acquire the first voice signal by the audio capturing unit.

[0059] The above describes different wake-up manners for waking up the voice interaction. In some embodiments, the interaction device 160 may, for example, support multiple wake-up manners at the same time. Additionally, the wake-up manners supported by the interaction device 160 (e.g., the operation type of the interaction operation, etc.) can also be determined based on the configuration operation of the user 140.

[0060] As an example, the user 140 may, for example, configure to support the key wake-up manner and the somatic wake-up manner via the interface 150 provided by the terminal device 110. In this case, the interaction device 160 can control the audio capturing unit to capture the first voice signal when detecting the pressing operation on the key or the preset somatic action, respectively.

[0061] With reference to FIG. 2 continuously, at 210, the interaction device 160 can capture the first voice signal by the audio capturing unit. In some embodiments, the interaction device 160 can turn on the audio capturing unit in response to the above wake-up manners, and start recording.

[0062] In other embodiments, after turning on the audio capturing unit, the interaction device 160 or the terminal device 110 can also perform voice detection on the audio signal captured by the audio capturing unit, and start recording to capture the first voice signal in the case of determining the presence of voice content.

[0063] In some embodiments, the interaction device 160 can further detect the pressing state of the key, taking the key-awakening mode as an example. When the key remains in the pressing state, the interaction device 160 can control the audio acquisition device to start acquiring the first voice signal.

[0064] For example, the user 140 can trigger the audio acquisition unit to start recording by long-pressing the key on the interaction device 160. During the pressing of the key, the audio acquisition unit continuously records, and after the end of the pressing state, the audio acquisition unit ends recording, thereby completing the acquisition of the first voice signal.

[0065] For example, the interaction device 160 can determine the completion of the acquisition of the first voice signal based on the end of the pressing state of the key.

[0066] For another example, the interaction device 160 or the terminal device 110 can detect whether the human voice content is continuously received within a preset time length (e.g., 3 seconds). If not, the interaction device 160 can determine the completion of the acquisition of the first voice signal.

[0067] For yet another example, the interaction device 160 can further detect a preset somatosensory action to determine the completion of the acquisition of the first voice signal. For example, in the case of awakening the voice interaction by lifting the wrist, the interaction device 160 can detect the somatosensory action of the user lowering the wrist, and complete the acquisition of the first voice signal upon detecting the somatosensory action.

[0068] In some embodiments, the interaction device 160 can be further provided with a reminding unit. Taking a ring as an example, the reminding unit may, for example, include a signal light provided on the ring. The signal light may, for example, be provided on the front surface of the ring, such as a breathing light. Alternatively, the signal light can be provided on the side surface of the ring, such as a ring-shaped light.

[0069] In some embodiments, in response to the audio acquisition unit starting to acquire the first voice signal, the interaction device 160 can present a first reminding signal by using the reminding unit. For example, during the opening of the audio acquisition unit or the recording, the signal light can be in a constant-on state to indicate that it is currently in the audio acquisition state.

[0070] With reference to FIG. 2, after the acquisition of the first voice signal is completed, at 215, the interaction device 160 can send the first voice signal to the terminal device 110.

[0071] Further, at 220, the terminal device 110 can generate a second voice signal by using the received first voice signal.

[0072] In some embodiments, the terminal device 110 can process the first speech signal, e.g., with a locally deployed application or model, to generate the second speech signal. For example, the terminal device 110 can be locally deployed with a speech processing model to generate the second speech signal based on the first speech signal as a reply to the first speech signal.

[0073] In some embodiments, as shown in FIG. 2, the terminal device 110 may, for example, further generate the second speech signal based on a communication with the server 130. As an example, the server 130 may, for example, provide a speech interaction service associated with the application 140.

[0074] At 225, upon receiving the first speech signal, the terminal device 110 can send the first speech signal to the server 130. The server 130 may, for example, generate a corresponding second speech signal based on the first speech signal.

[0075] As an example, the server 130 may, for example, convert the first speech signal to first text content and provide to a model associated with the application 140 to generate second text content. Further, the server 130 can generate a corresponding second speech signal based on the second text content.

[0076] It should be appreciated that such a model can include any appropriate generative model, e.g., a language model. Alternatively, the model may, for example, directly process the first speech signal to generate the second speech signal.

[0077] At 230, the terminal device 110 can obtain the generated second speech signal from the server 130. In some embodiments, the second speech signal can be played by the terminal device 110 or an audio device 202 connected with the terminal device 110. In some embodiments, the audio device 202 can include an external audio device, e.g., a headset, a sound system, etc., connected with the terminal device 110 and having an audio playing unit.

[0078] In some embodiments, although the interactive device 160 and the audio device 202 are shown as two separate blocks in FIG. 2, the audio device 202 can also be the interactive device 160 deployed with an audio playing unit, e.g., a speaker or a speaker array.

[0079] Specifically, as shown in FIG. 2, further, at 235, the terminal device 110 can control playing the second speech signal. For example, at 240, the terminal device 110 can send the second speech signal to the audio device 202 to play the second speech signal with the audio device 202. As another example, at 245, the terminal device 110 can send the second speech signal to the interactive device 160 to play the second speech signal with the audio playing unit of the interactive device 160.

[0080] In some embodiments, when the terminal device 110 is connected with multiple devices having audio playing capability, the terminal device 110 can select a specific device for playing according to a preset strategy. The disclosure is not intended to limit the specific selection strategy.

[0081] In some embodiments, during the playing of the second voice signal, the reminding unit at the interaction device can present a second reminding signal. For example, the signal light can be in a flashing state.

[0082] In some embodiments, during the playing of the second voice signal, the interaction device 160 can also detect a specific operation for the interaction device 160. In response to detecting the specific operation, the interaction device 160 can control the second voice signal to stop playing.

[0083] For example, the specific operation can include an interaction operation on a key of the interaction device 160. For example, in the process of playing the second voice signal by using the terminal device 110, the external audio device, or the interaction device 160, if a press on a key of the interaction device 160 by the user 140 is received, the playing of the second voice signal can be stopped.

[0084] Based on the voice interaction process described above, the embodiments of the disclosure can perform voice interaction through the interaction device adapted to be worn on a finger. Specifically, the embodiments of the disclosure can activate the voice interaction capability of the terminal device by detecting a preset operation for the interaction device. Further, by using the audio acquisition unit carried by the interaction device to acquire a voice signal and provide it to the terminal device, the embodiments of the disclosure can support more voice interaction scenarios and improve the efficiency of voice interaction.

[0085] Example process

[0086] FIG. 3 shows a flowchart of an example interaction process 300 according to some embodiments of the disclosure. The process 300 can be implemented at the interaction device 160. The process 300 is described below with reference to FIG. 1.

[0087] As shown, at block 310, in response to a preset operation for the interaction device 160, the interaction device 160 controls an audio acquisition unit of the interaction device 160 to start acquiring a first voice signal, the interaction device 160 being adapted to be worn on a finger of a user.

[0088] At block 320, the interaction device 160 acquires the first voice signal acquired by the audio acquisition unit.

[0089] At block 330, the interaction device 160 sends the first voice signal to a terminal device 110 connected with the interaction device 160, for the terminal device 110 to generate a second voice signal by using the first voice signal.

[0090] In some embodiments, the second voice signal can be played by the terminal device 110 or a target audio device connected to the terminal device 110.

[0091] In some embodiments, the interactive device 160 is deployed with an audio playing unit, the target audio device includes the interactive device 160 deployed with the audio playing unit, and the second voice signal can be played by the interactive device 160.

[0092] In some embodiments, the terminal device 110 is connected to an external audio device, the target audio device includes the external audio device, and the second voice signal can be played by the external audio device.

[0093] In some embodiments, the preset operation includes an interaction operation on a key on the interactive device.

[0094] In some embodiments, controlling the audio collection unit of the interactive device to start collecting the first voice signal includes: in response to the key being in a pressed state, controlling the audio collection device to start collecting the first voice signal.

[0095] In some embodiments, sending the first voice signal to the terminal device connected to the interactive device includes: in response to the pressed state ending, sending the first voice signal to the terminal device.

[0096] In some embodiments, the process 300 further includes: during playing of the second voice signal, in response to receiving an interaction operation on the key, controlling the second voice signal to stop playing.

[0097] In some embodiments, the preset operation includes a preset audio input to the audio collection unit.

[0098] In some embodiments, controlling the audio collection unit of the interactive device to start collecting the first voice signal includes: in response to detecting the preset audio input, detecting whether the audio collection unit receives a human voice input; and in response to the audio collection unit receiving the human voice input, controlling the audio collection unit to start collecting the first voice signal.

[0099] In some embodiments, controlling the audio collection unit of the interactive device to start collecting the first voice signal includes: in response to detecting the preset audio input, the preset audio containing preset voice content; and controlling the audio collection unit of the interactive device to start collecting the first voice signal.

[0100] In some embodiments, the process 300 further includes: in response to detecting a preset somatosensory action associated with the interactive device 160, starting an audio collection unit at the interactive device 160; and detecting whether a preset audio input is received by using the audio collection unit.

[0101] In some embodiments, the preset operation includes a preset somatosensory action associated with the interaction device 160.

[0102] In some embodiments, the preset somatosensory operation includes a wrist-lifting action, a gesture action.

[0103] In some embodiments, the process 300 further includes: in response to the audio acquisition unit starting to acquire the first voice signal, presenting, by the reminding unit at the interaction device 160, a first reminding signal.

[0104] In some embodiments, the process 300 further includes: during the playing of the second voice signal, presenting, by the reminding unit at the interaction device 160, a second reminding signal.

[0105] In some embodiments, the operation type of the preset operation is determined based on a configuration operation of the user.

[0106] Example apparatus and device

[0107] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above-mentioned method or process. FIG. 4 shows a schematic structural block diagram of an example interaction device 160 according to certain embodiments of the present disclosure. The interaction device 160 can be implemented as or included in the interaction device 160. Various modules / components in the interaction device 160 can be implemented by hardware, software, firmware, or any combination thereof.

[0108] As shown in FIG. 4, the interaction device 160 includes an interaction module 410 configured to acquire a preset operation of a user for the interaction device 160; a control module 420 configured to control an audio acquisition unit of the interaction device to start to acquire a first voice signal in response to the preset operation for the interaction device connected to a terminal device; an acquisition module 430 configured to acquire the first voice signal acquired by the audio acquisition unit; and a sending module 440 configured to send the first voice signal to the terminal device 110 connected to the interaction device 160, so that the terminal device 110 generates a second voice signal by using the first voice signal.

[0109] In some embodiments, the second voice signal can be played by the terminal device 110 or a target audio device connected to the terminal device 110.

[0110] In some embodiments, the interaction device 160 is deployed with an audio playing unit, the target audio device includes the interaction device 160 deployed with the audio playing unit, and the second voice signal can be played by the interaction device 160.

[0111] In some embodiments, the terminal device 110 is connected to an external audio device, the target audio device includes the external audio device, and the second voice signal can be played by the external audio device.

[0112] In some embodiments, the preset operation comprises an interaction operation on a key on the interaction device.

[0113] In some embodiments, the interaction device is configured to, in response to the key being in the pressed state, control the audio acquisition device to start collecting the first voice signal.

[0114] In some embodiments, the interaction device is further configured to, in response to the pressed state ending, send the first voice signal to the terminal device.

[0115] In some embodiments, the interaction device 160 further comprises a stopping module configured to, in response to receiving an interaction operation on the key during the playing of the second voice signal, control the second voice signal to stop playing.

[0116] In some embodiments, the preset operation comprises a preset audio input to the audio acquisition unit.

[0117] In some embodiments, the control module 420 is further configured to, in response to detecting the preset audio input, detect whether the audio acquisition unit receives a human voice input; and in response to the audio acquisition unit receiving the human voice input, control the audio acquisition unit to start collecting the first voice signal.

[0118] In some embodiments, the control module 420 is further configured to, in response to detecting the preset audio input, the preset audio containing preset voice content; and control the audio acquisition unit of the interaction device to start collecting the first voice signal.

[0119] In some embodiments, the control module 420 is further configured to, in response to detecting a preset somatosensory action associated with the interaction device 160, turn on the audio acquisition unit at the interaction device 160; and detect whether the preset audio input is received by using the audio acquisition unit.

[0120] In some embodiments, the preset operation comprises a preset somatosensory action associated with the interaction device 160.

[0121] In some embodiments, the preset somatosensory operation comprises a wrist lifting action, a gesture action.

[0122] In some embodiments, the interaction device 160 further comprises a reminding module configured to, in response to the audio acquisition unit starting to collect the first voice signal, present a first reminder signal by using a reminding unit at the interaction device 160.

[0123] In some embodiments, the reminding module is further configured to, during the playing of the second voice signal, present a second reminder signal by using a reminding unit at the interaction device 160.

[0124] In some embodiments, the operation type of the preset operation is determined based on a configuration operation of a user.

[0125] FIG. 5 illustrates a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 illustrated in FIG. 5 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 500 can be used for at least part of the steps of the voice interaction process described above.

[0126] As shown in FIG. 5, the electronic device 500 is in the form of a general electronic device. The components of the electronic device 500 can include, but are not limited to, one or more processors or processing units 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processor 510 can be a real or virtual processor and is capable of performing various processing according to programs stored in the memory 520. In a multi-processor system, multiple processors perform computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0127] The electronic device 500 generally includes a number of computer storage media. Such media can be any available media that is accessible by the electronic device 500 and includes both volatile and non-volatile media, removable and non-removable media. The memory 520 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 530 can be a removable or non-removable media and can include machine-readable media, such as a flash drive, a magnetic disk, or any other media that can be used to store information and / or data and can be accessed by the electronic device 500.

[0128] The electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive and a disk drive interface can be provided for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive and disk drive interface can be provided for reading from or writing to a removable, non-volatile optical disk (e.g., a "CD-ROM" or "DVD"). In these instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the disclosure.

[0129] The communication unit 540 enables communication through the communication medium with other electronic devices. Additionally, the functionality of the components of the electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating over a communication connection. As such, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0130] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown), such as a storage device, a display device, etc., through the communication unit 540, as necessary, with one or more devices that enable a user to interact with the electronic device 500, or with any device (e.g., a network card, a modem, etc.) that enables the electronic device 500 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0131] According to an example implementation of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, where the computer-executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, there is also provided a computer program product tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions, where the computer-executable instructions are executed by a processor to implement the method described above.

[0132] Various aspects of the disclosure are now described with reference to the drawings. In general, the drawings described below are diagrammatic and schematic representations of actual or conceptual structures and processes, and are not limiting of the scope of the present disclosure. In the drawings, the same reference numerals are used to represent similar components. The embodiments of the present disclosure will be described with reference to the drawings, beginning with FIG. 1.

[0133] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can direct a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including a manufacture including instructions which implement aspects of the function / act specified in the flowchart and / or block diagram block or blocks.

[0134] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0135] The flow diagrams and the block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various implementations of the present disclosure. In this regard, each block in the flow diagrams and the block diagrams can represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logic functions (s). In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in some cases, be executed substantially concurrently, or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flow diagrams, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and

[0136] implementations. Numerous modifications and adaptations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The herein described subject matter is to be considered in all its novel implications and applications and can be practiced in a variety of environments. It is also to be understood that such features are only examples and that many modifications, additions, or omissions can be made without departing from the scope of the claimed disclosure.

Claims

1.A voice interaction method applied to an interaction device, the method comprising: controlling an audio capturing unit of the interaction device to start capturing a first voice signal in response to a preset operation on the interaction device, the interaction device being adapted to be worn on a finger of a user; obtaining the first voice signal captured by the audio capturing unit; and sending the first voice signal to a terminal device connected to the interaction device, for the terminal device to generate a second voice signal using the first voice signal. 2.The method of claim 1, wherein the second voice signal is capable of being played by the terminal device or a target audio device connected to the terminal device. 3.The method of claim 2, wherein the interaction device is deployed with an audio playing unit, the target audio device comprises the interaction device deployed with the audio playing unit, and the second voice signal is capable of being played by the interaction device. 4.The method of claim 2, wherein the terminal device is connected to an external audio device, the target audio device comprises the external audio device, and the second voice signal is capable of being played by the external audio device. 5.The method of claim 1 or 2, wherein the preset operation comprises an interaction operation on a button on the interaction device. 6.The method of claim 5, wherein the controlling the audio capturing unit of the interaction device to start capturing the first voice signal comprises: controlling the audio capturing unit to start capturing the first voice signal in response to the button being kept in a pressed state. 7.The method of claim 6, wherein the sending the first voice signal to the terminal device connected to the interaction device comprises: sending the first voice signal to the terminal device in response to the pressed state ending. 8.The method of claim 5, further comprising: controlling the second voice signal to stop playing in response to receiving an interaction operation on the button during playing of the second voice signal. 9.The method of claim 1, wherein the preset operation comprises a preset audio input to the audio capturing unit. 10.The method of claim 9, wherein the controlling the audio capturing unit of the interaction device to start capturing the first voice signal comprises: detecting whether the audio capturing unit receives a human voice input in response to detecting the preset audio input; and controlling the audio capturing unit to start capturing the first voice signal in response to the audio capturing unit receiving the human voice input. 11.The method of claim 9, wherein the controlling the audio capturing unit of the interaction device to start capturing the first voice signal comprises: controlling the audio capturing unit to start capturing the first voice signal in response to detecting the preset audio input, the preset audio containing preset voice content. 12.The method of claim 9, wherein the controlling the audio capturing unit of the interaction device to start capturing the first voice signal comprises: starting the audio capturing unit at the interaction device in response to detecting a preset somatosensory action associated with the interaction device. ​ ​ ​ ​ and detecting, by the audio acquisition unit, whether the preset audio input is received. 13.The method of claim 1, wherein the preset operation comprises a preset somatosensory action associated with the interaction device. 14.The method of claim 12 or 13, wherein the preset somatosensory operation comprises a wrist raising action, a hand gesture action. 15.The method of claim 1, wherein the interaction device is further configured to present, by a reminder unit at the interaction device, a first reminder signal in response to the audio acquisition unit starting to acquire the first voice signal. 16.The method of claim 15, further comprising: presenting, by the reminder unit at the interaction device, a second reminder signal during the playing of the second voice signal. 17.The method of claim 1, wherein the operation type of the preset operation is determined based on a configuration operation of a user. 18.An interaction device adapted to be worn on a finger of a user, comprising: an interaction module configured to acquire a preset operation of a user for the interaction device; a control module configured to control an audio acquisition unit of the interaction device to start to acquire a first voice signal in response to the preset operation for the interaction device connected to a terminal device; an acquisition module configured to acquire the first voice signal acquired by the audio acquisition unit; and a sending module configured to send the first voice signal to a terminal device connected with the interaction device for the terminal device to generate a second voice signal by using the first voice signal. 19.The interaction device of claim 18, further comprising: a receiving module configured to receive the second voice signal sent from the terminal device, the second voice signal being generated by the terminal device based on the first voice signal; an audio playing module configured to play the second voice signal at the interaction device. 20.An electronic device comprising: at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform the method according to any one of claims 1 to 17. 21.A computer-readable storage medium having computer-executable instructions stored thereon that are executable by a processor to implement the method according to any one of claims 1 to 17. 22.A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 17. ​

Images