Interaction processing method, device and system and electronic equipment

Abstract

The invention discloses an interaction processing method, device and system and electronic equipment, which are applied to the electronic equipment and used for determining a current equipment interaction scene, and the equipment interaction scene at least comprises first equipment and the electronic equipment; the first audio data is audio data to be processed, processing the first audio data to obtain second audio data, determining a target device to output the second audio data at least based on the device interaction scene, the target device being an electronic device or a first device, and controlling the target device to play the second audio data.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to an interactive processing method, device, system and electronic device. Background Art

[0002] Wearable devices need to be thin, light and beautiful, with smaller battery capacity. In addition, they come into contact with the human body, which places higher requirements on the temperature rise on the device surface. Therefore, wearable devices usually do not perform complex calculations themselves, but instead place the calculation process on a host that is connected to the wearable device through a network, such as a mobile phone. Wearable devices use the computing power and network capabilities of the host to access computing capabilities to achieve functions such as voice processing.

[0003] However, in scenarios such as real-time voice processing, it usually happens that after the wearable device picks up the sound, the host connected to the wearable device through the network processes the picked up audio and then outputs it on the host side, which cannot meet the current actual scenario requirements. Summary of the invention

[0004] In view of this, the present application provides an interactive processing method, device, system and electronic device, and its specific solutions are as follows:

[0005] An interactive processing method, applied to an electronic device, comprising:

[0006] Determine a current device interaction scenario, where the device interaction scenario at least includes: a first device and the electronic device;

[0007] Obtaining first audio data, where the first audio data is audio data to be processed;

[0008] Processing the first audio data to obtain second audio data;

[0009] Determining a target device to which the second audio data is to be output based at least on the device interaction scenario, the target device being the electronic device or the first device;

[0010] The target device is controlled to play the second audio data.

[0011] Further, if the device interaction scenario is a conversation scenario between the first device and the electronic device:

[0012] The determining, at least based on the device interaction scenario, a target device to output the second audio data includes:

[0013] If it is determined that the first audio data is collected and output by the first device, based on the conversation scene between the first device and the electronic device, and the first device that collected the first audio data, determining that the target device is the electronic device, so as to control the electronic device to play the second audio data;

[0014] or,

[0015] If it is determined that the first audio data is collected by the electronic device, based on the conversation scene between the first device and the electronic device, and the electronic device that collected the first audio data, determining that the target device is the first device;

[0016] The second audio data is output to the first device so as to play the second audio data through the first device.

[0017] Further, if the device interaction scenario is a conversation scenario between the first device and the second device:

[0018] The determining, at least based on the device interaction scenario, a target device to output the second audio data includes:

[0019] If it is determined that the first audio data is collected and output by the first device, based on the conversation scene between the first device and the second device, and the first device that collected the first audio data, determining that the target device is the second device;

[0020] The second audio data is output to the second device so as to play the second audio data through the second device.

[0021] Furthermore, if the device interaction scenario is a scenario in which the first device performs audio processing through the electronic device:

[0022] Based on a scenario in which the first device performs audio processing through the electronic device and a first device that collects the first audio data, determining that the target device is the first device;

[0023] The second audio data is output to the first device so as to play the second audio data through the first device.

[0024] Furthermore, if the device interaction scenario is a scenario of translating audio data:

[0025] The processing of the first audio data to obtain second audio data includes:

[0026] Converting the first audio data into original language text data, wherein the first audio data is original language audio data;

[0027] Translating the original language text data to obtain target language text data;

[0028] The target language text data is converted into second audio data, where the second audio data is target language audio data.

[0029] Furthermore, determining the current device interaction scenario includes:

[0030] Determine the current device interaction scenario based on the input information;

[0031] or,

[0032] Obtaining initial audio data, wherein the initial audio data includes an audio sentence within a target duration;

[0033] A current device interaction scenario is determined based on audio parameters of the initial audio data and device information of collecting the initial audio data.

[0034] Furthermore, the determining the current device interaction scenario based on the audio parameters of the initial audio data and the device information for collecting the initial audio data includes:

[0035] If it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to the same object, the first device is determined based on the device information of collecting the initial audio data, and the current device interaction scenario is determined to be a scenario in which the first device performs audio processing through the electronic device;

[0036] If it is determined based on the audio parameters of the initial audio data that the audio sentence in the initial audio data corresponds to at least two objects, a first device and a second device are determined based on the device information of collecting the initial audio data, and a current device interaction scene is determined to be a conversation scene between the first device and the second device;

[0037] If it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to at least two objects, the first device and the electronic device are determined based on the device information of collecting the initial audio data, and the current device interaction scene is determined to be a conversation scene between the first device and the electronic device.

[0038] An interactive processing system, comprising:

[0039] A first device capable of at least playing audio data;

[0040] An electronic device, used to determine a current device interaction scenario, wherein the device interaction scenario at least includes: the first device and the electronic device; obtaining first audio data, wherein the first audio data is audio data to be processed; processing the first audio data to obtain second audio data; determining a target device to output the second audio data based at least on the device interaction scenario, wherein the target device is the electronic device or the first device; and controlling the target device to play the second audio data.

[0041] An interactive processing device, comprising:

[0042] A first determining unit, configured to determine a current device interaction scenario, wherein the device interaction scenario at least includes: a first device and an electronic device;

[0043] An obtaining unit, configured to obtain first audio data, where the first audio data is audio data to be processed;

[0044] a processing unit, configured to process the first audio data to obtain second audio data;

[0045] A second determining unit, configured to determine a target device to output the second audio data based at least on the device interaction scenario, the target device being the electronic device or the first device;

[0046] A control unit is used to control the target device to play the second audio data.

[0047] An electronic device, comprising:

[0048] An audio player capable of playing audio data;

[0049] A processor is used to determine a current device interaction scenario, wherein the device interaction scenario includes at least: a first device and the electronic device; obtaining first audio data, wherein the first audio data is audio data to be processed; processing the first audio data to obtain second audio data; determining a target device to output the second audio data based at least on the device interaction scenario, wherein the target device is the electronic device or the first device; and controlling the target device to play the second audio data. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 A flowchart of an interactive processing method disclosed in an embodiment of the present application;

[0052] Figure 2 A flowchart of an interactive processing method disclosed in an embodiment of the present application;

[0053] Figure 3 A flowchart of device interaction in a dialogue scenario between a first device and an electronic device disclosed in an embodiment of the present application;

[0054] Figure 4 A flowchart of an interactive processing method disclosed in an embodiment of the present application;

[0055] Figure 5 A flowchart of device interaction in a dialogue scenario between a first device and a second device disclosed in an embodiment of the present application;

[0056] Figure 6 A flowchart of an interactive processing method disclosed in an embodiment of the present application;

[0057] Figure 7 A schematic diagram of the structure of an interactive processing system disclosed in an embodiment of the present application;

[0058] Figure 8 A schematic diagram of the structure of an interactive processing device disclosed in an embodiment of the present application;

[0059] Fig. 9 A schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following describes the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation method section of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

[0061] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0062] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0063] The present application discloses an interactive processing method, which is applied to electronic equipment, and its flow chart is as follows: Figure 1 As shown, including:

[0064] Step S11: determining a current device interaction scenario, where the device interaction scenario at least includes: a first device and the electronic device;

[0065] Step S12: obtaining first audio data, where the first audio data is audio data to be processed;

[0066] Step S13: Process the first audio data to obtain second audio data;

[0067] Step S14: determining a target device to output the second audio data based at least on a device interaction scenario, where the target device is an electronic device or the first device;

[0068] Step S15: Control the target device to play the second audio data.

[0069] Wearable devices need to be thin, light and beautiful, with smaller battery capacity. In addition, they come into contact with the human body, which places higher requirements on the temperature rise on the device surface. Therefore, wearable devices usually do not perform complex calculations themselves. Instead, the calculation process is placed on the host side that is connected to the wearable device through a network, such as a mobile phone or a computer. Wearable devices use the computing power and network capabilities of the host side to access computing power and realize functions such as voice processing.

[0070] However, in scenarios such as real-time voice processing, it usually happens that after the wearable device picks up the sound, the host connected to the wearable device through the network processes the picked up audio and then outputs it on the host side, which cannot meet the current actual scenario requirements.

[0071] Based on this, in this solution, the current device interaction scenario is first determined, and after the first audio data to be processed is processed to obtain the second audio data, it is determined based on the current device interaction scenario whether the device to output the second audio data is the electronic device included in the device interaction scenario or the first device, and the second audio data is played through the determined device, so that the device that outputs the processed audio data is determined based on the current device interaction scenario, meets the current actual scenario requirements, improves the convenience of device interaction, and improves the user experience.

[0072] Electronic devices are devices with information processing capabilities and can perform complex calculations, such as AI functions, voice processing, etc. Electronic devices can be: smartphones, computers, etc.

[0073] The first device is a device that can collect and output information, and can perform simple operations, such as monitoring health status and outputting prompts when abnormalities are detected. Therefore, when the first device needs to perform complex operations, it can establish a connection with the electronic device and implement the execution of complex operations through interaction with the electronic device.

[0074] In the scenario where the first device is connected to the electronic device and data processing is performed through the electronic device, a variety of different device interaction scenarios may be included, such as: a conversation scenario between the first device and the second device, that is, a scenario where the first user, through the first device, talks with the second user, who uses the second device; another example: a scenario where the first device performs audio processing through the electronic device, etc. In different device interaction scenarios, the electronic device performs data processing.

[0075] In this embodiment, the data processed by the electronic device is audio data. It first determines the current device interaction scenario, then obtains the audio data to be processed, that is, the first audio data, and obtains the second audio data after processing it.

[0076] It is necessary to first determine the current device interaction scenario to determine that the current interaction scenario is between the first device and the electronic device, and determine what kind of processing operations the electronic device needs to perform to complete the interaction, such as: the electronic device only needs to transmit audio data, or the electronic device needs to determine the audio data related to it based on the audio data, such as: the electronic device generates a response to the first audio data based on the first audio data, or the electronic device converts the first audio data into an expression method, etc.

[0077] Therefore, only after determining the device interaction scenario can we determine what kind of processing needs to be performed on the audio data. For example, in the current interaction scenario, it is necessary to generate an answer to the first audio data based on the first audio data. Then, the electronic device's processing of the first audio data at least includes: analyzing the first audio data, and after the analysis is completed, querying based on the question information obtained from the analysis to obtain its answer information, converting the answer information into audio data, that is, obtaining the second audio data, etc. That is, after determining the current device interaction scenario, the first audio data obtained is processed based on the device interaction scenario to obtain the second audio data.

[0078] After obtaining the second audio data, the target device for outputting the second audio data can be determined based on the current device interaction scenario, and the second audio data can be output through the target device, and the target device is selected from the electronic device and the first device.

[0079] In different device interaction scenarios, the target device for outputting the second audio data is different, such as: in the first device interaction scenario, the electronic device is used as the target device, and the second audio data is played by the electronic device; in the second device interaction scenario, the first device is used as the target device, and the second audio data is played by the first device.

[0080] When different devices are selected as target devices, the subsequent processing of the electronic device is also different. If the electronic device is the target device, then after determining that the electronic device is the target device, the electronic device can directly output the second audio data through the audio player; if the first device is the target device, then after determining that the first device is the target device, the electronic device must first transmit the second audio data to the first device, and then the first device controls the audio player of the first device to play the second audio data.

[0081] The interactive processing method disclosed in this embodiment is applied to an electronic device to determine the current device interaction scenario, which includes at least a first device and an electronic device; obtain first audio data, which is audio data to be processed, process the first audio data to obtain second audio data, determine a target device to output the second audio data based at least on the device interaction scenario, the target device is an electronic device or the first device, and control the target device to play the second audio data. When this solution determines that the current device interaction scenario includes at least a first device and an electronic device, after processing the obtained first audio data to obtain the second audio data, the target device is selected from the electronic device and the first device based on the device interaction scenario, and the second audio data is played through the target device, thereby achieving the determination of the device for playing the processed audio data based on the current device interaction scenario, improving the convenience of device interaction and ensuring user experience.

[0082] This embodiment discloses an interactive processing method, and its flow chart is as follows: Figure 2 As shown, including:

[0083] Step S21: determining that the current device interaction scenario is a conversation scenario between the first device and the electronic device;

[0084] Step S22: obtaining first audio data collected and output by the first device, where the first audio data is audio data to be processed;

[0085] Step S23: Process the first audio data to obtain second audio data;

[0086] Step S24: based on the conversation scene between the first device and the electronic device, and the first device that collects the first audio data, determining that the target device to output the second audio data is the electronic device;

[0087] Step S25: Control the electronic device to play the second audio data.

[0088] If the device interaction scenario is a conversation scenario between the first device and the electronic device, that is, different users talk with the electronic device through the first device, such as: the first user uses the first device, the second user uses the electronic device, and the first user talks with the second user who uses the electronic device through the first device.

[0089] When determining that the current device interaction scenario is a conversation scenario between a first device and an electronic device, since in this scenario the first device can collect audio data, and the audio data collected by the first device is usually output by the first user, and the electronic device can also collect audio data, and the audio data collected by the electronic device is usually output by the second user, it is necessary to determine whether the first audio data obtained by the electronic device is collected by the first device or the electronic device.

[0090] If the first audio data is collected by an electronic device, then after the audio collector of the electronic device collects the first audio data, the first audio data is directly processed by the processor of the electronic device to obtain the second audio data; if the first audio data is collected by a first device, then after the first device collects the first audio data, it is first sent to the electronic device, and then the first audio data is processed by the processor of the electronic device to obtain the second audio data.

[0091] Since the current device interaction scenario is a conversation scenario between a first user through a first device and a second user using an electronic device, the device that plays the second audio data should be different from the device that collects the first audio data. For example, the first user outputs the first audio data. At this time, the first audio data output by the first user is what the second user wants to hear. Therefore, the electronic device is required to output the processed second audio data, that is, the target device is an electronic device.

[0092] After determining that the target device is an electronic device, the processor of the electronic device controls the audio player of the electronic device to play the second audio data, so that the second user can hear the second audio data.

[0093] Furthermore, since the current device interaction scenario is: a first user talks with a second user who uses an electronic device through a first device, there is a situation where the first device collects the first audio data and outputs it through the electronic device, and there is also a situation where the electronic device collects the first audio data and outputs it through the first device.

[0094] That is: if it is determined that the first audio data is collected by an electronic device, based on the conversation scenario between the first device and the electronic device, and the electronic device that collects the first audio data, the target device is determined to be the first device; the second audio data is output to the first device to play the second audio data through the first device.

[0095] If the first audio data is collected by an electronic device, then when the second audio data is output, it needs to be output through the first device. After obtaining the second audio data, the first device is controlled to play the second audio data, that is, the second audio data is first sent to the first device, and then the second audio data is played by the audio player of the first device.

[0096] like Figure 3 As shown, it is a flowchart of device interaction in a dialogue scenario between a first device and an electronic device, including: when the first device collects first audio data, the first device collects the first audio data, transmits the first audio data to the electronic device, the electronic device processes the first audio data to obtain second audio data, and the electronic device plays the second audio data; when the electronic device collects the first audio data, the electronic device collects the first audio data, the electronic device processes the collected first audio data to obtain second audio data, the electronic device transmits the second audio data to the first device, and the first device plays the second audio data.

[0097] The interactive processing method disclosed in this embodiment, which is applied to a conversation scenario between a first device and an electronic device, can implement a call between the first device and the electronic device through the HFP (Hands-Free Profile) protocol to ensure the call function between the devices.

[0098] In addition, for the music playback scenario, the interactive processing method disclosed in this embodiment can also be used, that is, after determining that the current device interaction scenario is a music playback scenario, the electronic device obtains the first audio data, processes it, and obtains the second audio data. At this time, based on the current music playback scenario, the first device is determined as the target device, and the second audio data is sent to the first device so that the second audio data is played through the first device.

[0099] For the music playback scenario, the transmission of audio data between the electronic device and the first device can be achieved through the A2DP (Advanced Audio Distribution Profile) protocol to achieve high-quality audio transmission.

[0100] The interactive processing method disclosed in this embodiment determines that the current device interaction scenario is a conversation scenario between a first device and an electronic device; obtains first audio data collected and output by the first device, the first audio data being the audio data to be processed; processes the first audio data to obtain second audio data; based on the conversation scenario between the first device and the electronic device, and the first device that collects the first audio data, determines that the target device to output the second audio data is the electronic device; and controls the electronic device to play the second audio data. In this solution, the device interaction scenario is determined to be a conversation scenario between the first device and the electronic device. If the first audio information collected and output by the first device is obtained, then after processing the first audio information to obtain the second audio information, the electronic device is controlled to play the second audio information, so as to enable different users to have conversations with the electronic device through the first device, thereby improving the convenience of device interaction and ensuring user experience.

[0101] This embodiment discloses an interactive processing method, and its flow chart is as follows: Figure 4 As shown, including:

[0102] Step S41: Determine that the current device interaction scenario is a conversation scenario between the first device and the second device;

[0103] Step S42: obtaining first audio data collected and output by the first device, where the first audio data is audio data to be processed;

[0104] Step S43: Process the first audio data to obtain second audio data;

[0105] Step S44: based on the conversation scene between the first device and the second device, and the first device that collects the first audio data, determining that the target device to output the second audio data is the second device;

[0106] Step S45: output the second audio data to the second device so as to play the second audio data through the second device.

[0107] If the device interaction scenario is a conversation scenario between a first device and a second device, that is, different users talk with the second device through the first device, at this time, the electronic device is only used to process the audio data transmitted between the first device and the second device, such as: the first user uses the first device, the second user uses the second device, and the first user talks with the second user who uses the second device through the first device. During the call, the electronic device processes the audio data during the call.

[0108] When determining that the current device interaction scenario is a conversation scenario between a first device and a second device, since in this scenario the first device can collect audio data, and the audio data collected by the first device is usually output by the first user, and the second device can also collect audio data, and the audio data collected by the second device is usually output by the second user, it is necessary to determine whether the first audio data obtained by the electronic device is collected by the first device or the second device.

[0109] If the first audio data is collected by the first device, then after the first device collects the first audio data, it is first sent to the electronic device, and then the processor of the electronic device processes the first audio data to obtain the second audio data; correspondingly, if the first audio data is collected by the second device, then after the second device collects the first audio data, it is also first sent to the electronic device, and then the processor of the electronic device processes the first audio data to obtain the second audio data.

[0110] Since the current device interaction scenario is a conversation scenario between a first user using a first device and a second user using a second device, the device that plays the second audio data should be different from the device that collects the first audio data. For example, the first user outputs the first audio data. At this time, the first audio data output by the first user is what the second user wants to hear. Therefore, the electronic device needs to process the first audio data, and then the second device outputs the processed second audio data, that is, the target device is the second device.

[0111] After determining that the target device is the second device, the electronic device controls the second device to output the second audio data, that is, the electronic device outputs the second audio data to the second device, and the second device plays the second audio data.

[0112] Furthermore, since the current device interaction scenario is: a first user talks with a second user who uses a second device through a first device, there is a situation where the first device collects the first audio data and outputs it through the second device, and there is also a situation where the second device collects the first audio data and outputs it through the first device.

[0113] That is: if it is determined that the first audio data is collected by the second device, based on the conversation scene between the first device and the second device, and the second device that collects the first audio data, determine that the target device is the first device; output the second audio data to the first device to play the second audio data through the first device.

[0114] If the first audio data is collected by the second device, then when the second audio data is output, it needs to be output through the first device. After obtaining the second audio data, the first device is controlled to play the second audio data, that is, the second audio data is first sent to the first device, and then the second audio data is played by the audio player of the first device.

[0115] like Figure 5 As shown, it is a flowchart of device interaction in a dialogue scenario between a first device and a second device, including: when the first device collects first audio data, the first device collects the first audio data, transmits the first audio data to the electronic device, the electronic device processes the first audio data to obtain second audio data, transmits the second audio data to the second device, and the second device plays the second audio data; when the second device collects the first audio data, the second device collects the first audio data, transmits the first audio data to the electronic device, the electronic device processes the collected first audio data to obtain second audio data, transmits the second audio data to the first device, and the first device plays the second audio data.

[0116] The interactive processing method disclosed in this embodiment, which is applied to a conversation scenario between a first device and a second device, can realize the transmission of call audio between the first device, the electronic device and the second device through the HFP (Hands-Free Profile) protocol to ensure the call function between the devices.

[0117] The interactive processing method disclosed in this embodiment determines that the current device interaction scenario is a conversation scenario between the first device and the second device; obtains the first audio data collected and output by the first device, the first audio data being the audio data to be processed; processes the first audio data to obtain the second audio data; based on the conversation scenario between the first device and the second device, and the first device that collects the first audio data, determines that the target device to output the second audio data is the second device; outputs the second audio data to the second device, so as to play the second audio data through the second device. When this scheme determines that the current device interaction scenario is a conversation scenario between the first device and the second device, if the first device collects the first audio data, the electronic device processes it to obtain the second audio data, and then outputs the second audio data through the second device, so as to realize the processing of the data transmitted between the first device and the second device by the electronic device, thereby ensuring the smooth interaction between the devices and improving the user experience.

[0118] Furthermore, this embodiment discloses an interaction processing method, which specifically includes:

[0119] Determine that the current device interaction scenario is a scenario in which the first device performs audio processing through an electronic device; obtain first audio data collected by the first device, the first audio data being the audio data to be processed; process the first audio data to obtain second audio data; determine that the target device is the first device based on the scenario in which the first device performs audio processing through the electronic device and the first device that collects the first audio data; output the second audio data to the first device so as to play the second audio data through the first device.

[0120] If the device interaction scenario is a scenario in which the first device performs audio processing through an electronic device, that is, the first device needs to process audio data, but the first device itself does not have the ability to process audio, therefore, the audio data to be processed is sent to the electronic device so that the audio data is processed by the electronic device. After the processing is completed, the second audio data obtained after the processing is sent to the first device so that the first device can play the second audio data.

[0121] When it is determined that the current device interaction scenario is a scenario in which the first device performs audio processing through the electronic device, it can be directly determined that the first audio data is obtained from the first device, and the target device is determined to be the first device.

[0122] The interactive processing method disclosed in this embodiment, when determining that the current device interaction scenario is a scenario in which the first device performs audio processing through an electronic device, can determine that the first device is collecting audio and the target device is also the first device. Therefore, after obtaining the first audio data output by the first device and processing it to obtain the second audio data, it is directly sent to the first device so that the first device can play it, thereby realizing the processing of the audio data by the first device through the electronic device, ensuring smooth interaction between devices and improving user experience.

[0123] This embodiment discloses an interactive processing method, and its flow chart is as follows: Figure 6 As shown, including:

[0124] Step S61: determining that the current device interaction scenario is a scenario for translating audio data, where the scenario includes at least a first device and an electronic device;

[0125] Step S62: obtaining first audio data, where the first audio data is audio data to be processed;

[0126] Step S63, converting the first audio data into original language text data, the first audio data being original language audio data;

[0127] Step S64, translating the original language text data to obtain the target language text data;

[0128] Step S65, converting the target language text data into second audio data, where the second audio data is the target language audio data;

[0129] Step S66: determining a target device to output the second audio data based at least on the device interaction scenario, where the target device is the electronic device or the first device;

[0130] Step S67: Control the target device to play the second audio data.

[0131] If the device interaction scenario is a scenario of translating audio data, then after the electronic device obtains the first audio data, it needs to translate the received first audio data, and after the translation is completed, output the translated second audio data to complete the translation of the audio data.

[0132] After the electronic device obtains the first audio data, when translating it, it can first determine the language currently corresponding to the first audio data, and determine the language currently corresponding to the first audio data as the original language. The first audio data is used as the original language audio data, and the language audio data into which the first audio data needs to be translated is determined, that is, the target language is determined.

[0133] Among them, determining the target language can be: when determining that the current device interaction scenario is a scenario for translating audio data, synchronously determining the original language to be translated and the target language to be translated from the original language; or, after determining that the current device interaction scenario is a scenario for translating audio data, determining the original language and the target language based on the current scenario; or, pre-setting the target language, as long as the current device interaction scenario is determined to be a scenario for translating audio data, then, no matter which original language the received first audio data corresponds to, its target language is pre-set.

[0134] After determining the target language, the first audio data is first converted from original language audio data to original language text data, that is, the audio data is converted into text data. At this time, the translation operation is not performed, only the data presentation form is switched; after obtaining the original language text data, the translation operation is performed to translate the original language text data into the target language text data; after obtaining the target language text data, it is also necessary to convert it into audio data, that is, to obtain the target language audio data after translation, and determine the target language audio data as the second audio data so that the second audio data can be played to complete the complete translation process.

[0135] Among them, if the current device interaction scenario is a scenario for translating audio data, then the current device interaction scenario can be more specifically: a scenario for translating audio data of a conversation conducted through a first device and an electronic device, that is, a first user talks with a second user who uses an electronic device through the first device, and the language of the audio used by the first user is different from the language of the audio used by the second user.

[0136] Then, after the first user outputs the first audio data through the first device, the first audio data is in the first language, and the first audio data in the first language is transmitted to the electronic device. However, the second user using the electronic device is not familiar with or cannot understand the first audio data in the first language. Therefore, the electronic device needs to translate the first audio data in the first language into second audio data in the second language, that is, first convert the first audio data in the first language into first text data in the first language, and then translate the first text data in the first language into second text data in the second language, and then convert the second text data in the second language into second audio data in the second language. Since the target device in the current scenario is an electronic device, the second audio data in the second language is played through the electronic device so that the second user can hear the audio corresponding to the language he is familiar with, so that he can clearly understand the content expressed by the first user.

[0137] Correspondingly, if the current device interaction scenario is a scenario of translating audio data, then the current device interaction scenario can be more specifically: a scenario of translating audio data of a conversation conducted through a first device and a second device, that is, a first user talks with a second user who uses a second device through a first device, and the language of the audio used by the first user is different from the language of the audio used by the second user. At this time, the first audio data output by the first device is obtained through the electronic device, and after translating it, the second audio data is obtained, and the second audio data is transmitted to the second device so that the second device plays the second audio data.

[0138] For example: after the first user outputs the first audio data through the first device, the first audio data is in the first language. Since it has been determined in advance that the first user and the second user do not speak the same language, the first audio data in the first language needs to be transmitted to the electronic device, and the electronic device needs to translate the first audio data in the first language into second audio data in the second language, that is, first convert the first audio data in the first language into first text data in the first language, and then translate the first text data in the first language into second text data in the second language, and then convert the second text data in the second language into second audio data in the second language. Since the target device in the current scenario is the second device, the electronic device transmits the second audio data in the second language to the second device, and plays the second audio data in the second language through the second device, so that the second user can hear the audio corresponding to the language he is familiar with, so as to understand the content expressed by the first user.

[0139] In addition, if the current device interaction scenario is a scenario for translating audio data, then the current device interaction scenario can be more specifically: a scenario in which the first device translates audio data through an electronic device, that is, the first user uses the first device to translate the first audio data collected by the first device through the electronic device.

[0140] At this time, the first user has audio or text in an unfamiliar language. In order to know the content expressed by these audio or text, the first user can input first audio data into the first device. The first audio data is obtained from the data to be translated, and then the first audio data is sent to the electronic device. The electronic device obtains the first audio data, translates it, and obtains second audio data, that is: converts the first audio data in the first language into first text data in the first language, and then translates the first text data in the first language into second text data in the second language, and then converts the second text data in the second language into second audio data in the second language.

[0141] Afterwards, it is necessary to determine whether the target device in the current scenario is the electronic device or the first device. If the target device is the electronic device, the electronic device can directly play the second audio data in the second language, and the first user can clearly understand the content expressed by the data to be translated through the second audio data in the second language played by the electronic device; if the target device is the first device, the electronic device sends the second audio data in the second language to the first device, and the first device plays the second audio data in the second language, and the first user can clearly understand the content expressed by the data to be translated through the second audio data in the second language played by the first device.

[0142] Furthermore, in the interaction processing method disclosed in this embodiment, determining the current device interaction scenario may be specifically as follows:

[0143] Determine the current device interaction scenario based on input information; or obtain initial audio data, where the initial audio data includes audio sentences within a target duration, and determine the current device interaction scenario based on audio parameters of the initial audio data and device information for collecting the initial audio data.

[0144] Relevant scene information can be directly input into the electronic device, so that the electronic device directly determines the current device interaction scene based on the input information.

[0145] Alternatively, the method may be: inputting initial audio data into the electronic device in advance, and determining the current device interaction scenario by analyzing relevant information of the initial audio data.

[0146] Among them, the initial audio data is different from the first audio data. The first audio data is audio data that needs to be processed based on the current device interaction scenario, while the initial audio data does not need to be processed based on the current device interaction scenario and is only used to confirm the current device interaction scenario.

[0147] In addition, the initial audio data may specifically include: audio data composed of audio sentences output by the object corresponding to the interactive device, or, instead of the audio sentences output by the object corresponding to the interactive device, the audio data of the interactive device itself is used as the audio sentence to form the initial audio data. The duration of the initial audio data is relatively short, and its duration is shorter than the target duration, as long as the electronic device can determine the interactive device.

[0148] Specifically, if it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to the same object, the first device is determined based on the device information for collecting the initial audio data, and the current device interaction scene is determined to be a scene in which the first device performs audio processing through the electronic device; if it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to at least two objects, the first device and the second device are determined based on the device information for collecting the initial audio data, and the current device interaction scene is determined to be a conversation scene between the first device and the second device; if it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to at least two objects, the first device and the electronic device are determined based on the device information for collecting the initial audio data, and the current device interaction scene is determined to be a conversation scene between the first device and the electronic device.

[0149] The audio parameters of the initial audio data may be identification information of the audio data, through which it may be determined whether the objects outputting the audio sentences constituting the initial audio data are the same; or, the audio parameters of the initial audio data may be timbre information of the audio data, through which it may be determined whether the objects outputting the audio sentences constituting the initial audio data are the same.

[0150] If they are the same, it indicates that there is only one object in the current scene. If they are not the same, it indicates that the current scene includes at least two objects.

[0151] In addition, it is also necessary to determine the device information for collecting the initial audio data, that is, to determine whether the initial audio data is collected by the first device and then output to the electronic device, or is collected by the electronic device itself, or the audio sentences included in the initial audio data are collected by different devices, such as: the audio sentences included in the initial audio data are collected by the first device and the second device, or, are collected by the first device and the electronic device.

[0152] Based on the above information, the current device interaction scenario can be determined, that is, if it is determined that the object that outputs the audio sentences that constitute the initial audio data is the same, and the initial audio data is collected by the same device, such as: the initial audio data is collected by the first device, then it can be determined that the current device interaction scenario is a scenario in which the first device performs audio processing through an electronic device.

[0153] Among them, when the current device interaction scenario is a scenario in which the first device performs audio processing through an electronic device, whether the processing of the audio data by the electronic device is translation or conversion of the expression method, etc., can be further determined based on the operation of the object (user) on the first device. For example: the translation operation is determined based on the operation of the object on the first device, then the current device interaction scenario is: the scenario in which the first device performs audio translation through an electronic device.

[0154] In addition, if it is determined that there are at least two objects that output the audio sentences that constitute the initial audio data, and the first device and the second device can be determined based on the device information of the initial audio data, then the current device interaction scene can be directly determined as a conversation scene between the first device and the second device; correspondingly, if the first device and the electronic device can be determined based on the device information of the initial audio data, then the current device interaction scene can be directly determined as a conversation scene between the first device and the electronic device.

[0155] Similarly, when the current device interaction scenario is a conversation scenario between different devices, whether the processing required by the electronic device for the audio data is translation or conversion of the expression method, etc., can be further determined based on the operation of the object (user) on the first device.

[0156] The interactive processing method disclosed in this embodiment determines that the current device interaction scenario is a scenario for translating audio data, and the scenario includes at least a first device and an electronic device; obtains first audio data, and the first audio data is the audio data to be processed; converts the first audio data into original language text data, and the first audio data is original language audio data; translates the original language text data to obtain target language text data; converts the target language text data into second audio data, and the second audio data is target language audio data; determines the target device to output the second audio data at least based on the device interaction scenario, and the target device is the electronic device or the first device; controls the target device to play the second audio data. When the current device interaction scenario is determined to be a scenario for translating audio data, after the electronic device obtains the first audio data, it is necessary to first convert the first audio data into original language text data, and then translate it into target language text data based on the original language text data, and then convert the target language text data into target language audio data, thereby realizing the translation of audio data, ensuring smooth interaction between devices, and improving user experience.

[0157] Furthermore, the first device is a wearable AI device, which may be in the form of earphones, bracelets, pendants, etc. It should be noted that, in the process of the first device interacting with the electronic device, if there are multiple first devices in different forms interacting with the electronic device at the same time, then the data collected by the first device in the form of earphones is preferentially selected to interact with the electronic device to ensure that the first audio data collected by the first device can be clearer, or the first device in the form of earphones is preferentially selected to play the information interacting with the electronic device to ensure that the second audio data played by the first device can be more clearly heard by the user using the first device.

[0158] This embodiment discloses an interactive processing system, and its structural diagram is shown in FIG. Figure 7 As shown, including:

[0159] A first device 71 and an electronic device 72.

[0160] Wherein, the first device 71 is at least capable of playing audio data;

[0161] The electronic device 72 is used to determine the current device interaction scenario, which at least includes: a first device and an electronic device; obtaining first audio data, which is audio data to be processed; processing the first audio data to obtain second audio data; determining a target device to output the second audio data based at least on the device interaction scenario, which is the electronic device or the first device; and controlling the target device to play the second audio data.

[0162] The interactive processing system disclosed in this embodiment is implemented based on the interactive processing method disclosed in the above embodiment, which will not be described in detail here.

[0163] The interactive processing system disclosed in this embodiment determines the current device interaction scenario, which includes at least a first device and an electronic device; obtains first audio data, which is audio data to be processed, processes the first audio data to obtain second audio data, determines a target device to output the second audio data based at least on the device interaction scenario, the target device is the electronic device or the first device, and controls the target device to play the second audio data. When this solution determines that the current device interaction scenario includes at least a first device and an electronic device, after processing the obtained first audio data to obtain the second audio data, the target device is selected from the electronic device and the first device based on the device interaction scenario, and the second audio data is played through the target device, thereby achieving the determination of the device for playing the processed audio data based on the current device interaction scenario, improving the convenience of device interaction and ensuring user experience.

[0164] This embodiment discloses an interactive processing device, and its structural diagram is shown in FIG. Figure 8 As shown, including:

[0165] A first determining unit 81 , an obtaining unit 82 , a processing unit 83 , a second determining unit 84 and a control unit 85 .

[0166] The first determining unit 81 is used to determine the current device interaction scenario, and the device interaction scenario at least includes: a first device and an electronic device;

[0167] The obtaining unit 82 is used to obtain first audio data, where the first audio data is audio data to be processed;

[0168] The processing unit 83 is used to process the first audio data to obtain second audio data;

[0169] The second determining unit 84 is used to determine a target device to output the second audio data based at least on the device interaction scenario, where the target device is the electronic device or the first device;

[0170] The control unit 85 is used to control the target device to play the second audio data.

[0171] Furthermore, if the device interaction scenario is a conversation scenario between the first device and the electronic device:

[0172] The second determining unit is used for:

[0173] If it is determined that the first audio data is collected and output by the first device, based on the conversation scenario between the first device and the electronic device, and the first device that collects the first audio data, the target device is determined to be the electronic device, so as to control the electronic device to play the second audio data; or, if it is determined that the first audio data is collected by the electronic device, based on the conversation scenario between the first device and the electronic device, and the electronic device that collects the first audio data, the target device is determined to be the first device; the second audio data is output to the first device, so as to play the second audio data through the first device.

[0174] Furthermore, if the device interaction scenario is a conversation scenario between the first device and the second device:

[0175] The second determining unit is used for:

[0176] If it is determined that the first audio data is collected and output by the first device, based on the conversation scenario between the first device and the second device, and the first device that collects the first audio data, determine that the target device is the second device; output the second audio data to the second device so that the second audio data is played through the second device.

[0177] Furthermore, if the device interaction scenario is a scenario in which the first device performs audio processing through the electronic device:

[0178] The second determining unit is used for:

[0179] Based on a scenario in which the first device performs audio processing through an electronic device and a first device that collects first audio data, the target device is determined to be the first device; and second audio data is output to the first device so as to play the second audio data through the first device.

[0180] Furthermore, if the device interaction scenario is a scenario of translating audio data:

[0181] The processing unit is used to:

[0182] The first audio data is converted into original language text data, the first audio data is the original language audio data; the original language text data is translated to obtain target language text data; the target language text data is converted into second audio data, the second audio data is the target language audio data.

[0183] Further, the first determining unit is used for:

[0184] Determine the current device interaction scenario based on input information; or obtain initial audio data, where the initial audio data includes audio sentences within a target duration; determine the current device interaction scenario based on audio parameters of the initial audio data and device information for collecting the initial audio data.

[0185] Further, the first determining unit is used for:

[0186] If it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to the same object, the first device is determined based on the device information of collecting the initial audio data, and the current device interaction scene is determined to be a scene in which the first device performs audio processing through the electronic device; if it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to at least two objects, the first device and the second device are determined based on the device information of collecting the initial audio data, and the current device interaction scene is determined to be a conversation scene between the first device and the second device; if it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to at least two objects, the first device and the electronic device are determined based on the device information of collecting the initial audio data, and the current device interaction scene is determined to be a conversation scene between the first device and the electronic device.

[0187] The interactive processing device disclosed in this embodiment is implemented based on the interactive processing method disclosed in the above embodiment, which will not be described in detail here.

[0188] The interactive processing device disclosed in this embodiment determines the current device interaction scenario, which includes at least a first device and an electronic device; obtains first audio data, which is audio data to be processed, processes the first audio data to obtain second audio data, determines a target device to output the second audio data based at least on the device interaction scenario, the target device is an electronic device or the first device, and controls the target device to play the second audio data. When this solution determines that the current device interaction scenario includes at least a first device and an electronic device, after processing the obtained first audio data to obtain the second audio data, the target device is selected from the electronic device and the first device based on the device interaction scenario, and the second audio data is played through the target device, thereby achieving the determination of the device for playing the processed audio data based on the current device interaction scenario, improving the convenience of device interaction and ensuring user experience.

[0189] This embodiment discloses an electronic device, and its structural diagram is as follows: Fig. 9 As shown, including:

[0190] Audio player 91 and processor 92.

[0191] Among them, the audio player 91 is capable of playing audio data;

[0192] Processor 92 is used to determine the current device interaction scenario, which includes at least: a first device and an electronic device; obtaining first audio data, which is audio data to be processed; processing the first audio data to obtain second audio data; determining a target device to output the second audio data based at least on the device interaction scenario, which is an electronic device or the first device; and controlling the target device to play the second audio data.

[0193] The electronic device disclosed in this embodiment is implemented based on the interactive processing method disclosed in the above embodiments, which will not be described in detail here.

[0194] The electronic device disclosed in this embodiment determines the current device interaction scenario, which includes at least a first device and an electronic device; obtains first audio data, which is audio data to be processed, processes the first audio data to obtain second audio data, determines a target device to output the second audio data based at least on the device interaction scenario, the target device is the electronic device or the first device, and controls the target device to play the second audio data. When this solution determines that the current device interaction scenario includes at least a first device and an electronic device, after processing the obtained first audio data to obtain the second audio data, the target device is selected from the electronic device and the first device based on the device interaction scenario, and the second audio data is played through the target device, thereby achieving the determination of the device for playing the processed audio data based on the current device interaction scenario, improving the convenience of device interaction and ensuring user experience.

[0195] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0196] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0197] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0198] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

Claims

1. An interactive processing method, applied to an electronic device, comprising: Determine a current device interaction scenario, where the device interaction scenario at least includes: a first device and the electronic device; Obtaining first audio data, where the first audio data is audio data to be processed; Processing the first audio data to obtain second audio data; Determining a target device to which the second audio data is to be output based at least on the device interaction scenario, the target device being the electronic device or the first device; The target device is controlled to play the second audio data.

2. The method according to claim 1, if the device interaction scenario is a conversation scenario between the first device and the electronic device: The determining, at least based on the device interaction scenario, a target device to output the second audio data includes: If it is determined that the first audio data is collected and output by the first device, based on the conversation scene between the first device and the electronic device, and the first device that collected the first audio data, determining that the target device is the electronic device, so as to control the electronic device to play the second audio data; or, If it is determined that the first audio data is collected by the electronic device, based on the conversation scene between the first device and the electronic device, and the electronic device that collected the first audio data, determining that the target device is the first device; The second audio data is output to the first device so as to play the second audio data through the first device.

3. The method according to claim 1, if the device interaction scenario is a conversation scenario between the first device and the second device: The determining, at least based on the device interaction scenario, a target device to output the second audio data includes: If it is determined that the first audio data is collected and output by the first device, based on the conversation scene between the first device and the second device, and the first device that collected the first audio data, determining that the target device is the second device; The second audio data is output to the second device so as to play the second audio data through the second device.

4. The method according to claim 1, if the device interaction scenario is a scenario in which the first device performs audio processing through the electronic device: Based on a scenario in which the first device performs audio processing through the electronic device and a first device that collects the first audio data, determining that the target device is the first device; The second audio data is output to the first device so as to play the second audio data through the first device.

5. The method according to claim 1, if the device interaction scenario is a scenario of translating audio data: The processing of the first audio data to obtain second audio data includes: Converting the first audio data into original language text data, wherein the first audio data is original language audio data; Translating the original language text data to obtain target language text data; The target language text data is converted into second audio data, where the second audio data is target language audio data.

6. The method according to claim 1, wherein determining the current device interaction scenario comprises: Determine the current device interaction scenario based on the input information; or, Obtaining initial audio data, wherein the initial audio data includes an audio sentence within a target duration; A current device interaction scenario is determined based on audio parameters of the initial audio data and device information of collecting the initial audio data.

7. The method according to claim 6, wherein determining the current device interaction scenario based on the audio parameters of the initial audio data and the device information for collecting the initial audio data comprises: If it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to the same object, the first device is determined based on the device information of collecting the initial audio data, and the current device interaction scenario is determined to be a scenario in which the first device performs audio processing through the electronic device; If it is determined based on the audio parameters of the initial audio data that the audio sentence in the initial audio data corresponds to at least two objects, a first device and a second device are determined based on the device information of collecting the initial audio data, and a current device interaction scene is determined to be a conversation scene between the first device and the second device; If it is determined based on the audio parameters of the initial audio data that the audio sentences in the initial audio data correspond to at least two objects, the first device and the electronic device are determined based on the device information of collecting the initial audio data, and the current device interaction scene is determined to be a conversation scene between the first device and the electronic device.

8. An interactive processing system, comprising: A first device capable of at least playing audio data; An electronic device, used to determine a current device interaction scenario, wherein the device interaction scenario at least includes: the first device and the electronic device; obtaining first audio data, wherein the first audio data is audio data to be processed; processing the first audio data to obtain second audio data; determining a target device to output the second audio data based at least on the device interaction scenario, wherein the target device is the electronic device or the first device; and controlling the target device to play the second audio data.

9. An interactive processing device, comprising: A first determining unit, configured to determine a current device interaction scenario, wherein the device interaction scenario at least includes: a first device and an electronic device; An obtaining unit, configured to obtain first audio data, where the first audio data is audio data to be processed; a processing unit, configured to process the first audio data to obtain second audio data; A second determining unit, configured to determine a target device to output the second audio data based at least on the device interaction scenario, the target device being the electronic device or the first device; A control unit is used to control the target device to play the second audio data.

10. An electronic device comprising: An audio player capable of playing audio data; A processor is used to determine a current device interaction scenario, wherein the device interaction scenario includes at least: a first device and the electronic device; obtaining first audio data, wherein the first audio data is audio data to be processed; processing the first audio data to obtain second audio data; determining a target device to output the second audio data based at least on the device interaction scenario, wherein the target device is the electronic device or the first device; and controlling the target device to play the second audio data.

Images