Voice interaction method, interaction device, electronic device and storage medium

Abstract

A voice interaction method, an interaction device, an electronic device, and a storage medium. The method comprises: acquiring a first voice signal collected by an audio collection unit deployed on the interaction device, the interaction device being adapted to be worn on a user's finger (310); and sending the first voice signal to a terminal device, so as to trigger the terminal device or an audio playback unit connected to the terminal device to play a second voice signal generated based on the first voice signal (320).

Description

Method for voice interaction, interaction device, electronic device and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411253191.2, filed on September 6, 2024, entitled “Method for voice interaction, interaction device, electronic device and storage medium”, the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The example embodiments of the present disclosure generally relate to the field of computer, in particular, to a method for voice interaction, an interaction device, an electronic device and a storage medium. BACKGROUND

[0003] With the development of computer technology, voice interaction technology has become one of the important ways of human-computer interaction. For example, a user can interact with a terminal device through voice to obtain feedback content of the terminal device.

[0004] The traditional voice interaction scene is usually directly interacted by a user with a terminal device, which has great limitations and affects the efficiency of voice interaction. SUMMARY

[0005] In a first aspect of the present disclosure, a method for voice interaction is provided. The method comprises: obtaining a first voice signal collected by an audio collection unit deployed at an interaction device, the interaction device being adapted to be worn on a finger of a user; and sending the first voice signal to a terminal device to trigger the terminal device or an audio playing unit connected with the terminal device to play a second voice signal generated based on the first voice signal.

[0006] In a second aspect of the present disclosure, an interaction device adapted to be worn on a finger of a user is provided. The interaction device comprises: a collection module configured to obtain a first voice signal collected by an audio collection unit deployed at the interaction device, the interaction device being adapted to be worn on a finger of a user; and a sending module configured to send the first voice signal to a terminal device to trigger the terminal device or an audio playing unit connected with the terminal device to play a second voice signal generated based on the first voice signal.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device comprises at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0008] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, the computer program being executable by a processor to implement the method of the first aspect.

[0009] In a fifth aspect of the present disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0010] It should be understood that nothing in the Summary is to be construed as a limitation on the scope of the embodiments of the present disclosure or the claims. Other features, aspects, and advantages of the present disclosure will become apparent from the following description, which is given for the purpose of illustration, but is not intended to be limiting, and from the claims. BRIEF DESCRIPTION OF DRAWINGS

[0011] The above and other features, aspects, and advantages of embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements, wherein:

[0012] FIG. 1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure can be implemented;

[0013] FIG. 2 shows a flowchart of a voice interaction process according to some embodiments of the present disclosure;

[0014] FIG. 3 shows a flowchart of an example interaction process according to some embodiments of the present disclosure;

[0015] FIG. 4 shows a schematic block diagram of an example interaction device according to some embodiments of the present disclosure; and

[0016] FIG. 5 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure will be more thoroughly and completely understood. It should be understood that the drawings and embodiments of the present disclosure are only for illustrative purposes and should not be construed as limiting the scope of protection of the present disclosure.

[0018] It should be noted that the headings provided in any section / subsection herein are not limitations. Various embodiments are described throughout this document and any type of embodiment can be included under any section / subsection. Furthermore, embodiments described in any section / subsection can be combined with any other embodiment described in the same section / subsection and / or a different section / subsection in any manner.

[0019] In the description of embodiments of the disclosure, the term "includes" and its derivatives, such as "including" should be understood in an open way, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions can also be included below. The terms "first", "second", etc. can refer to different or same objects. Other explicit and implicit definitions can also be included below.

[0020] Data of users, acquisition and / or use of data, etc. can be involved in embodiments of the disclosure. These aspects all comply with corresponding laws and regulations and relevant provisions. In embodiments of the disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are performed on the premise that the user is aware of and confirms. Accordingly, when implementing embodiments of the disclosure, the type of data or information that can be involved, the use range, the use scenario, etc. should be notified to the user and authorized by the user in a proper manner according to relevant laws and regulations. The specific notification and / or authorization manner can vary according to actual situations and application scenarios, and the scope of the disclosure is not limited in this aspect.

[0021] In the specification and embodiments, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0022] As mentioned above, voice interaction is an important interaction capability. For example, some terminal devices can deploy voice assistants to interact with users in voice. Traditional solutions usually perform interaction with terminal devices through microphones carried by mobile phones or dedicated audio devices (for example, earphones or speakers). However, such a voice interaction way has great limitations on the scene, or has better hardware requirements for external devices.

[0023] Embodiments of the present disclosure propose a voice interaction scheme. According to the scheme, an interaction device can acquire a first voice signal collected by an audio collection unit deployed at the interaction device, the interaction device being adapted to be worn on a finger of a user. Further, the interaction device can send the first voice signal to a terminal device to trigger the terminal device or an audio playing unit connected with the terminal device to play a second voice signal generated based on the first voice signal.

[0024] In this way, embodiments of the present disclosure can perform voice interaction with a terminal device through an interaction device adapted to be worn on a finger, so as to improve the convenience of voice interaction. In addition, the voice interaction scheme of the present disclosure can support more voice interaction scenarios and improve the efficiency of voice interaction.

[0025] Various example implementations of the scheme are described in further detail below in conjunction with the accompanying drawings.

[0026] Example Environment

[0027] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include a terminal device 110.

[0028] In the example environment 100, the terminal device 110 can run an application supporting voice interaction, e.g., a voice assistant application 120. The voice assistant application 120 can include, but is not limited to, a voice assistant application, a digital assistant application, etc. A user 140 can interact with the voice assistant application 120 via the terminal device 110 and / or its attached devices.

[0029] As shown in FIG. 1, the terminal device 110 can also be connected with an interaction device 160. The interaction device 160 can be worn on a finger of the user 140. As an example, the interaction device 160 can be in the form of a ring or a ring, etc.

[0030] In some embodiments, the interaction device 160 can include an audio collection unit, e.g., a microphone or a microphone array. As will be described in detail below, the user 140 can perform voice interaction with the terminal device 110 through the interaction device 160 worn on the finger. The specific process of voice interaction will be described in detail below with reference to FIG. 2.

[0031] In the environment 100 of FIG. 1, if the voice assistant application 120 is in an active state, the terminal device 110 can also present an interface 150 for supporting interface interaction through the voice assistant application 120. As an example, the interface 150 can be an interaction interface with a digital assistant to, for example, demonstrate the interaction process between the user and the digital assistant. The present disclosure is not intended to limit the specific form of the interface 150.

[0032] In some embodiments, the terminal device 110 communicates with the server 130 to implement provisioning of services of the voice assistant application 120. The terminal device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a tablet computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a palmtop computer, a portable gaming terminal, a VR / AR device, a Personal Communication System (PCS) device, a personal navigation device, a Personal Digital Assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including an accessory or peripheral device for any of the foregoing, or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface to the user (such as “wearable” circuitry, etc.).

[0033] The server 130 can be a standalone physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the voice assistant application 120 in the terminal device 110 that supports a virtual scene.

[0034] A communication connection can be established between the server 130 and the terminal device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the terminal device 110 can implement signaling interaction through the communication connection therebetween.

[0035] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, and do not imply any limitation on the scope of the present disclosure.

[0036] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0037] Example voice interaction process

[0038] A voice interaction process according to embodiments of the present disclosure will be described below with reference to the accompanying drawings. FIG. 2 illustrates a flowchart 200 of a voice interaction process according to some embodiments of the present disclosure.

[0039] As discussed with reference to FIG. 1, the interaction device 160 can be deployed with an audio acquisition unit, and the interaction device 160 can acquire the first voice signal of the user 140 by utilizing the audio acquisition device.

[0040] As an example, the user 140 can input voice content through a microphone deployed in a ring, and can accordingly trigger voice interaction with the terminal device 110. For example, the voice content can trigger the voice assistant application 120 in the terminal device 110 to play corresponding voice content.

[0041] In some embodiments, as shown in FIG. 2, at 205, the interaction device 160 can detect a first preset operation directed to the interaction device 160. Accordingly, at 210, the interaction device 210 can trigger the audio acquisition unit to acquire the first voice signal.

[0042] In some embodiments, such a first preset operation can include, but is not limited to, an interaction operation of a button directed to the interaction device 160, a preset somatosensory action associated with the interaction device 160, or a preset audio input directed to the audio acquisition device 160, etc.

[0043] In some embodiments, the interaction device 160 can be provided with a button. The button can include a physical button or a pressure-sensitive button. The interaction device 160 can detect, for example, an interaction operation of the button to trigger the start of acquisition of the first voice signal.

[0044] For example, the interaction device 160 can detect a press of the physical button by the user 140. Alternatively, the interaction device 160 can also detect a press of the pressure-sensitive button through a pressure-sensitive sensor.

[0045] In some embodiments, such a press can include, for example, a single click, a double click, or a long press, etc. In some embodiments, the specific button operation for triggering the audio acquisition unit of the interaction device 160 to start acquiring the voice signal can be determined based on the configuration of the user 140. As an example, the user can configure the specific button operation type, for example, via the interface 150 provided by the voice assistant application 120.

[0046] In some embodiments, the interaction device 160 can also detect the press state of the button. When the button remains in the press state, the interaction device 160 can control the audio acquisition device to start acquiring the first voice signal.

[0047] For example, the user 140 can trigger the audio acquisition unit to start recording by long-pressing a button on the ring. During the pressing of the button, the audio acquisition unit continuously records, and after the pressing state ends, the audio acquisition unit ends recording, thereby completing the acquisition of the first voice signal.

[0048] In some embodiments, the interaction device 160 can also utilize detecting a preset somatosensory action associated with the interaction device 160 to trigger the voice acquisition unit to start acquiring the first voice signal.

[0049] Specifically, such a preset somatosensory action can include, for example, an action associated with the hand of the user 140. In some embodiments, the interaction device 160 or the terminal device 110 can detect the wrist action of the user 140 through a motion sensor (e.g., an acceleration sensor, a gyroscope, etc.) within the interaction device 160. For example, in the case of detecting that the user wearing the interaction device 160 performs a wrist-lifting action, the interaction device 160 can utilize the audio acquisition unit to start recording.

[0050] In some embodiments, the interaction device 160 or the terminal device 110 can detect the gesture action of the user 140 through a motion sensor (e.g., an acceleration sensor, a gyroscope, etc.) within the interaction device 160. For example, in the case of detecting that the user wearing the interaction device 160 performs a two-finger pinch gesture, the interaction device 160 can utilize the audio acquisition unit to start recording.

[0051] In some embodiments, such a preset somatosensory action can also be determined based on a configuration operation of the user 140. As an example, the user 140 can configure the somatosensory action via the interface 150 provided by the terminal device 110. For example, the user 140 can select a provided preset somatosensory action, or can acquire a customized somatosensory action.

[0052] In yet some embodiments, the audio acquisition unit of the interaction device 160 can be in a semi-working state, for example, to detect whether a preset audio input is received. Such an audio input can include, for example, human voice content.

[0053] Specifically, the received voice signal can be processed by the interaction device 160 or the terminal device 110 to determine whether human voice content is received. After detecting the human voice content, the interaction device 160 can utilize the audio acquisition unit to start recording.

[0054] In some embodiments, after enabling the audio acquisition device to acquire the first voice signal, the interaction device 160 can also send the first voice signal to the terminal device based on a preset sending condition.

[0055] In this way, embodiments of the present disclosure can utilize the interaction device worn at the finger to trigger the voice interaction of the terminal device, thereby improving the efficiency of voice interaction.

[0056] With FIG. 2 as an example, if the user triggers the collection of the first voice signal by long-pressing the key at the interaction device 160, the interaction device 160 can further detect whether the pressing state ends. In response to the end of the pressing state, the interaction device 160 can determine that the collection of the first voice signal is completed, and send the collected first voice signal to the terminal device 110 at 215.

[0057] As another example, the interaction device 160 can also determine that the collection of the first voice signal is completed and send the collected first voice signal to the terminal device 110 in response to the content or the length of the first voice signal satisfying a preset rule.

[0058] For example, the interaction device 160 or the terminal device 110 can detect whether human voice content is continuously received within a preset time length (e.g., 3 seconds). If not, the interaction device 160 can determine that the collection of the first voice signal is completed. Alternatively, the interaction device 160 can complete the collection of the first audio signal when it is determined that the length of the collected first audio signal reaches a threshold.

[0059] As yet another example, the interaction device 160 can also detect a preset somatosensory action to determine that the collection of the first voice signal is completed. For example, in the case of triggering voice signal collection by lifting the wrist, the interaction device 160 can detect the somatosensory action of the user lowering the wrist, and complete the collection of the first voice signal when the somatosensory action is detected.

[0060] In some embodiments, the interaction device 160 can also be provided with a reminding unit. Taking a ring as an example, the reminding unit may, for example, include a signal light provided on the ring. The signal light may, for example, be provided on the front surface of the ring, e.g., a breathing light. Alternatively, the signal light can be provided on the side surface of the ring, e.g., a ring-shaped light.

[0061] In some embodiments, in response to the audio collection unit starting to collect the first voice signal, the interaction device 160 can present a first reminding signal by using the reminding unit. For example, during the opening of the audio collection unit or the recording, the signal light can be in a constant-on state to indicate that it is currently in an audio collection state.

[0062] Continuing to refer to FIG. 2, after receiving the first voice signal, the terminal device 110 can determine whether the first voice signal satisfies a preset condition at 220. For example, the terminal device 110 can determine whether the first voice signal is empty, i.e., whether it includes human voice content. If the terminal device 110 determines that the first voice signal does not include human voice content, the terminal device 110 can not respond to the voice signal.

[0063] In response to the first voice signal satisfying the preset condition, at 225, the terminal device 110 can generate a second voice signal based on the first voice signal.

[0064] In some embodiments, the terminal device 110 can process the first voice signal, e.g., with a locally deployed application or model, to generate the second voice signal. For example, the terminal device 110 can be locally deployed with a voice processing model to generate the second voice signal based on the first voice signal as a reply to the first voice signal.

[0065] In some embodiments, the terminal device 110 can also generate the second voice signal, e.g., based on a communication with the server 130. As an example, the server 130 can provide a voice interaction service associated with the voice assistant application 140.

[0066] In particular, in response to determining that the first voice signal satisfies the preset condition, the terminal device 110 can send the first voice signal to the server 130. The server 130 can generate a corresponding second voice signal based on the first voice signal, e.g.

[0067] As an example, the server 130 can convert the first voice signal to a first text and provide to a model associated with the application 140 to generate a second text. Further, the server 130 can convert the second text to a corresponding second voice signal.

[0068] It should be appreciated that such a model can include any appropriate generative model, e.g., a language model. Alternatively, the model can also directly process the first voice signal to generate the second voice signal, e.g.

[0069] Further, the terminal device 110 can obtain the generated second voice signal from the server 130.

[0070] In some embodiments, the terminal device 110 can play the received second voice signal with the terminal device 110 or an audio playback unit connected to the terminal device 110.

[0071] In some embodiments, the terminal device 110 determines device connection information, where the device connection information can indicate whether the terminal device 110 is connected to a target audio device having an audio playback capability.

[0072] In some embodiments, the target audio device can include an external audio device connected with the terminal device 110. Such an external audio device is, for example, deployed with an audio playing unit to provide the capability of audio playing. As an example, such an external audio device can include any appropriate audio playing device connected with the terminal device 110 in a wired or wireless manner, such as a mobile phone, earphone, sound box, watch, bracelet, etc.

[0073] In some embodiments, the target audio device can further include an interactive device 160 deployed with an audio playing unit.

[0074] In some embodiments, as shown in FIG. 2, in response to determining that the terminal device is not connected to the target audio device, the terminal device 110 can play the received second voice signal by utilizing the local audio playing unit, at 235.

[0075] On the contrary, if it is determined that the terminal device 110 is connected to the target audio device, the terminal device 110 can send the second voice signal to the target audio device to play the second voice signal by utilizing the audio playing unit at the target audio device.

[0076] In some scenarios, the terminal device 110 can be connected to an external audio device. Accordingly, as shown in FIG. 2, at 230, the terminal device 110 can send the second voice signal to the external audio device (e.g., earphone) to play the second voice signal by utilizing the external audio device.

[0077] In some scenarios, the terminal device 110 can be connected to an external audio device. Accordingly, as shown in FIG. 2, at 230, the terminal device 110 can send the second voice signal to the external audio device (e.g., earphone) to play the second voice signal by utilizing the external audio device.

[0078] In some embodiments, the terminal device 110 is connected with an external audio device different from the interactive device 160. If the external audio device is deployed with a corresponding audio collecting unit (e.g., microphone or microphone array), the audio collecting unit at the external audio device can be disabled during the collection of the first voice signal and / or within a preset time period when the second voice signal is played.

[0079] Continuing to refer to FIG. 2, at 240, the interactive device 160 can further detect the second preset operation of the user and can accordingly send a corresponding control signal to the terminal device 110, at 245.

[0080] In some instances, the type of the second preset operation can be different from the type of the first preset operation discussed above. As an example, the first preset operation can be a long-press operation for a button at the interaction device 160, and the second preset operation can be a single-click operation for the button at the interaction device 160.

[0081] In some embodiments, such a second preset operation can also be determined based on a configuration operation of the user 140. For example, the user 140 can configure the specific type of the second preset operation via the voice assistant application 120.

[0082] As shown, at 250, the terminal device 110 can determine whether the voice assistant application 120 is playing audio content. If the terminal device 110 determines that the voice assistant application 120 is playing the received second voice signal with the audio playback unit, at 255, the terminal device 110 can trigger the audio playback unit to stop playing the current audio content, e.g., the second voice signal, in response to the received control signal.

[0083] As an example, the user 140 may, for example, trigger the microphone on the ring to collect the voice signal of the user 140 by long-pressing the button on the ring, and trigger the voice assistant application 120 to generate the corresponding voice signal for the corresponding audio playback unit to play.

[0084] In addition, if the voice assistant application 120 is playing audio content with the audio playback unit, the user 140 can also trigger the audio playback unit to stop playing the audio content by single-clicking the button on the ring.

[0085] In some embodiments, the type of the second preset operation may, for example, also be the same as the first preset operation. In this case, if the second preset operation is received during the playing of the second voice signal, on one hand, the terminal device 110 can trigger the audio playback unit to stop playing the second voice signal; on the other hand, the audio collection device 110 can also start recording with the deployed audio collection unit to collect a third voice signal accordingly.

[0086] Correspondingly, the terminal device 110 can trigger the generation of a fourth voice signal based on the received third voice signal, and play the generated fourth voice signal with the audio playback unit, based on steps 220 to 235 as shown in FIG. 2.

[0087] For example, if the voice assistant application 120 is playing audio content by using the audio playing unit, the user 140 can also trigger the audio playing unit to stop playing the audio content by long-pressing the button on the ring. In addition, the ring can use the microphone to collect a new voice signal of the user 140, and trigger the voice assistant application 120 to generate a corresponding voice signal for the corresponding audio playing unit to play.

[0088] In some embodiments, during the voice interaction, the voice assistant application 120 at the terminal device 110 may, for example, also display, through the interface 150, text content corresponding to the first voice signal and / or the second voice signal in response to receiving the first voice signal. In this way, embodiments of the present disclosure can facilitate the user to understand the process of the voice interaction through the graphical interface.

[0089] Based on the voice interaction process described above, embodiments of the present disclosure can perform voice interaction with a terminal device through an interaction device suitable for being worn on a finger, so as to improve the convenience of voice interaction. In addition, the voice interaction manner of the present disclosure can support more voice interaction scenarios and improve the efficiency of voice interaction.

[0090] Example process

[0091] FIG. 3 shows a flowchart of an example interaction process 300 according to some embodiments of the present disclosure. The process 300 can be implemented at the interaction device 160. The process 300 is described below with reference to FIG. 1.

[0092] As shown, at block 310, the interaction device 160 acquires a first voice signal collected by an audio collection unit deployed at the interaction device, the interaction device being suitable for being worn on a finger of a user.

[0093] At block 320, the interaction device 160 sends the first voice signal to a terminal device to trigger the terminal device or an audio playing unit connected to the terminal device to play a second voice signal generated based on the first voice signal.

[0094] In some embodiments, the terminal device is configured to: send the first voice signal to a server in response to the first voice signal satisfying a preset condition; and acquire the second voice signal generated based on the first voice signal from the server.

[0095] In some embodiments, the server is configured to: convert the first voice signal into a first text; process the first text by using a model to generate a second text; and convert the second text into the second voice signal.

[0096] In some embodiments, the preset condition indicates that the first voice signal includes human voice content.

[0097] In some embodiments, the process 300 further includes: in response to the first preset operation for the interaction device, triggering the audio collection device to collect the first voice signal.

[0098] In some embodiments, the first preset operation includes at least one of: an interaction operation for a button of the interaction device; a preset somatosensory action associated with the interaction device; and a preset audio input for the audio collection device.

[0099] In some embodiments, the process 300 further includes: in response to the button being in the pressed state, enabling the audio collection device to collect the first voice signal.

[0100] In some embodiments, the process 300 further includes: after enabling the audio collection device to collect the first voice signal, sending the first voice signal to the terminal device based on a preset sending condition.

[0101] In some embodiments, sending the first voice signal to the terminal device based on the preset sending condition includes: in response to the pressed state ending, sending the first voice signal to the terminal device; and / or, in response to the content or duration of the first voice signal satisfying a preset rule, sending the first voice signal to the terminal device.

[0102] In some embodiments, the terminal device is further configured to: based on the device connection information, determine that the terminal device is not connected to the target audio device; and play the second voice signal using the terminal device.

[0103] In some embodiments, the terminal device is further configured to: based on the device connection information, determine that the terminal device is connected to the target audio device; and play the second voice signal using an audio playback unit in the target audio device.

[0104] In some embodiments, the interaction device is deployed with an audio playback unit, and the target audio device includes the interaction device; or the target audio device includes an external audio device connected to the terminal device.

[0105] In some embodiments, the terminal device is further configured to: based on the device connection information, determine that the terminal device is connected to the external audio device; and send the second voice signal to the external audio device to play the second voice signal using the external audio device.

[0106] In some embodiments, during the collection of the first voice signal and / or within a preset time period during which the second voice signal is played, an audio collection unit at the external audio device is disabled.

[0107] In some embodiments, the terminal device is further configured to: determine, based on the device connection information, that the terminal device is not connected to the external audio device and is connected to the interactive device on which the audio playing unit is deployed; and send the second voice signal to the interactive device to play the second voice signal by using the audio playing unit deployed at the interactive device.

[0108] In some embodiments, the external audio device includes at least one of a mobile phone, a headset, a sound box, a watch, and a bracelet.

[0109] In some embodiments, the process 300 further includes: during the playing of the first voice signal, triggering the audio playing unit to stop playing the second voice signal in response to receiving a second preset operation on the interactive device.

[0110] In some embodiments, the process 300 further includes: in response to the second preset operation, collecting a third voice signal by using an audio collecting unit at the interactive device; and triggering the audio playing unit to play a fourth voice signal generated based on the third voice signal.

[0111] In some embodiments, the process 300 further includes: in response to receiving the first voice signal, controlling a target application at the terminal device to display text content corresponding to the first voice signal and / or the second voice signal.

[0112] Example apparatuses and devices

[0113] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG. 4 shows a schematic structural block diagram of an example interactive device 160 according to certain embodiments of the present disclosure. The interactive device 160 can be implemented as or included in the interactive device 160. Various modules / components in the interactive device 160 can be implemented by hardware, software, firmware, or any combination thereof.

[0114] As shown in FIG. 4, the interactive device 160 includes a collecting module 410 configured to obtain a first voice signal collected by an audio collecting unit deployed at the interactive device, the interactive device being adapted to be worn on a finger of a user; and a sending module 420 configured to send the first voice signal to a terminal device to trigger the terminal device or an audio playing unit connected to the terminal device to play a second voice signal generated based on the first voice signal.

[0115] In some embodiments, the terminal device is configured to: in response to the first voice signal satisfying a preset condition, send the first voice signal to a server; and obtain, from the server, a second voice signal generated based on the first voice signal.

[0116] In some embodiments, the server is configured to: convert the first voice signal into a first text; process the first text by using a model to generate a second text; and convert the second text into a second voice signal.

[0117] In some embodiments, the preset condition indicates that the first voice signal comprises human voice content.

[0118] In some embodiments, the interaction device 160 further comprises a collection triggering module configured to trigger the audio collection device to collect the first voice signal in response to a first preset operation on the interaction device.

[0119] In some embodiments, the first preset operation comprises at least one of the following: an interaction operation on a button of the interaction device; a preset somatosensory action associated with the interaction device; and a preset audio input on the audio collection device.

[0120] In some embodiments, the collection triggering module is further configured to enable the audio collection device to collect the first voice signal in response to the button being in a pressed state.

[0121] In some embodiments, the collection triggering module is further configured to send the first voice signal to the terminal device based on a preset sending condition after enabling the audio collection device to collect the first voice signal.

[0122] In some embodiments, the collection triggering module is further configured to send the first voice signal to the terminal device in response to the pressed state ending; and / or, in response to the content or duration of the first voice signal satisfying a preset rule.

[0123] In some embodiments, the terminal device is further configured to determine, based on the device connection information, that the terminal device is not connected to the target audio device; and play the second voice signal by using the terminal device.

[0124] In some embodiments, the terminal device is further configured to determine, based on the device connection information, that the terminal device is connected to the target audio device; and play the second voice signal by using an audio playing unit in the target audio device.

[0125] In some embodiments, the interaction device is deployed with an audio playing unit, and the target audio device comprises the interaction device; or the target audio device comprises an external audio device connected to the terminal device.

[0126] In some embodiments, the terminal device is further configured to determine, based on the device connection information, that the terminal device is connected to the external audio device; and send the second voice signal to the external audio device to play the second voice signal by using the external audio device.

[0127] In some embodiments, the audio capturing unit at the external audio device is disabled during the capturing of the first voice signal and / or a preset time period when the second voice signal is played.

[0128] In some embodiments, the terminal device is further configured to: determine, based on the device connection information, that the terminal device is not connected to the external audio device and is connected to the interactive device on which the audio playing unit is deployed; and send the second voice signal to the interactive device, so as to play the second voice signal by using the audio playing unit deployed at the interactive device.

[0129] In some embodiments, the external audio device comprises at least one of a mobile phone, a headset, a sound box, a watch, and a bracelet.

[0130] In some embodiments, the interactive device 160 further comprises a playing stopping module configured to, in response to receiving a second preset operation for the interactive device during the playing of the first voice signal, trigger the audio playing unit to stop playing the second voice signal.

[0131] In some embodiments, the playing stopping module is further configured to: in response to the second preset operation, capture a third voice signal by using the audio capturing unit at the interactive device; and trigger the audio playing unit to play a fourth voice signal generated based on the third voice signal.

[0132] In some embodiments, the interactive device 160 further comprises a text content displaying module configured to, in response to receiving the first voice signal, control a target application at the terminal device to display text content corresponding to the first voice signal and / or the second voice signal.

[0133] In some embodiments, the interactive device 160 further comprises a receiving module configured to receive the second voice signal sent from the terminal device, the second voice signal being generated by the terminal device based on the first voice signal; and a playing module configured to play the second voice signal at the interactive device.

[0134] FIG. 5 shows a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 shown in FIG. 5 is merely an example and should not be construed as limiting on the functionality and scope of the embodiments described herein. The electronic device 500 can be used for at least part of the steps of the voice interaction process described above.

[0135] As shown in FIG. 5, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 can include, but are not limited to, one or more processors or processing units 510, memory 520, storage 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 can be a real or virtual processor and is capable of executing various processing in accordance with programs stored in memory 520. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0136] Electronic device 500 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by electronic device 500 and includes both volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory), or some combination thereof. Storage 530 can be removable or non-removable media and can include machine- readable media such as a flash drive, a magnetic disk drive, or any other media that can be used to store information and / or data and that can be accessed by electronic device 500.

[0137] Electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive for reading from or writing to a removable, non- volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk (e.g., a CD-ROM) can be provided. In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. Memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0138] Communication unit 540 enables communication with other electronic devices over communication media. Additionally, the functionality of the components of electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines capable of communicating over a communication connection. As such, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes.

[0139] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown), such as storage devices, display devices, etc., one or more devices that enable a user to interact with the electronic device 500, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 500 to communicate with one or more other electronic devices, as desired via the communication unit 540. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0140] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0141] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0142] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0143] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0144] The computer program product of the present disclosure can be a computer program product, which is a machine-readable medium (media) having instances of the software embodied thereon, such as computer software, firmware, wireless application protocol (WAP), middleware or microcode. For example, a computer program product can be a floppy disk, a CD-ROM, a DVD, a Blu-ray Disc™, a flash drive, a memory stick, a magnetic tape, or a hard disk drive. The computer program product can also be a downloaded file, such as a file downloaded from the Internet or another computer network. Of course, many modifications can be made by those skilled in the art to the inventive concept described herein, which can be practiced in various embodiments and over a variety of applications, and that the scope of the application is limited only by the following claims. For example, a computer program product can be a downloaded file, such as a file downloaded from the Internet or another computer network. Of course, many modifications can be made by those skilled in the art to the inventive concept described herein, which can be practiced in various embodiments and over a variety of applications, and that the scope of the application is limited only by the following claims.

[0145] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although the implementations described above have particular applications in the medical field, it should be recognized that the implementations of the disclosure have broad applicability to other fields. Numerous modifications and variations will be apparent to those skilled in the art in light of the above teachings. For example, the above-described implementations can be used in a variety of medical applications, such as in the diagnosis of medical conditions, in the administration of medical treatment, and in the administration of medical care. Any or all of the individual features or operations described above can be used separately or in any combination. By way of non-limiting example, features described above can be used in a medical device, a medical system, a medical method, a medical apparatus, a medical instrument, a medical computer program, a medical computer program product, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program distribution medium, a medical computer program

Claims

A voice interaction method applied to an interaction device, the method comprising: obtaining a first voice signal collected by an audio collection unit deployed at the interaction device, the interaction device being adapted to be worn on a finger of a user; and sending the first voice signal to a terminal device to trigger the terminal device or an audio playback unit connected to the terminal device to play a second voice signal generated based on the first voice signal. According to the method of claim 1, wherein the terminal device is configured to: in response to the first voice signal satisfying a preset condition, send the first voice signal to a server; and obtain the second voice signal generated based on the first voice signal from the server. According to the method of claim 2, wherein the server is configured to: convert the first voice signal into a first text; process the first text using a model to generate a second text; and convert the second text into the second voice signal. According to the method of claim 2, wherein the preset condition indicates that the first voice signal includes human voice content. According to the method of claim 1, further comprising: in response to a first preset operation on the interaction device, triggering the audio collection device to collect the first voice signal. According to the method of claim 5, wherein the first preset operation includes at least one of: an interaction operation on a button of the interaction device; a preset somatosensory action associated with the interaction device; a preset audio input to the audio collection device. According to the method of claim 6, further comprising: in response to the button remaining in a pressed state, enabling the audio collection device to collect the first voice signal. According to the method of claim 7, further comprising: after enabling the audio collection device to collect the first voice signal, sending the first voice signal to the terminal device based on a preset sending condition. According to the method of claim 8, wherein sending the first voice signal to the terminal device based on the preset sending condition includes: in response to the pressed state ending, sending the first voice signal to the terminal device; and / or in response to the content or duration of the first voice signal satisfying a preset rule, sending the first voice signal to the terminal device. According to the method of claim 1, wherein the terminal device is further configured to: based on device connection information, determine that the terminal device is not connected to a target audio device; and play the second voice signal using the terminal device. According to the method of claim 1, wherein the terminal device is further configured to: based on device connection information, determine that the terminal device is connected to a target audio device; and play the second voice signal using the audio playback unit in the target audio device. According to the method of claim 11, wherein the interaction device is deployed with an audio playback unit, the target audio device includes the interaction device; or the target audio device includes an external audio device connected to the terminal device. The method of claim 12, wherein the terminal device is further configured to: determine, based on the device connection information, that the terminal device is connected to the external audio device; and send the second voice signal to the external audio device for playing the second voice signal with the external audio device. The method of claim 13, wherein: during the collection of the first voice signal and / or within a preset time period when the second voice signal is played, an audio collection unit at the external audio device is disabled. The method of claim 12, wherein the terminal device is further configured to: determine, based on device connection information, that the terminal device is not connected to the external audio device and is connected to the interactive device with the audio playing unit deployed thereon; and send the second voice signal to the interactive device for playing the second voice signal with the audio playing unit deployed at the interactive device. The method of claim 12 or 13, wherein the external audio device comprises at least one of a mobile phone, earphones, a sound box, a watch, and a bracelet. The method of claim 1, further comprising: in response to receiving a second preset operation for the interactive device during the playing of the first voice signal, triggering the audio playing unit to stop playing the second voice signal. The method of claim 17, further comprising: in response to the second preset operation, collecting a third voice signal with the audio collection unit at the interactive device; and triggering the audio playing unit to play a fourth voice signal generated based on the third voice signal. The method of claim 1, further comprising: in response to receiving the first voice signal, controlling a target application at the terminal device to display text content corresponding to the first voice signal and / or the second voice signal. An interactive device adapted to wear a finger of a user, comprising: a collection module configured to obtain a first voice signal collected by an audio collection unit deployed at the interactive device adapted to wear the finger of the user; and a sending module configured to send the first voice signal to a terminal device to trigger the terminal device or an audio playing unit connected to the terminal device to play a second voice signal generated based on the first voice signal. The interactive device of claim 20, further comprising: a receiving module configured to receive a second voice signal sent from the terminal device, the second voice signal being generated by the terminal device based on the first voice signal; and a playing module configured to play the second voice signal at the interactive device. An electronic device, comprising: at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform the method according to any one of claims 1 to 19. ​ ​ ​ ​ A computer-readable storage medium having stored thereon computer-executable instructions that are executable by a processor to implement the method of any one of claims 1-19. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method of any one of claims 1-19.

Images