Conversation uplink data determination method and device, equipment, medium and program product

Abstract

The invention is suitable for the technical field of Bluetooth earphones, and provides a call uplink data determination method and device, equipment, a medium and a program product, and the method comprises the steps: collecting a first audio signal of a user through a microphone configured on an earphone accessory in a process that the user uses an earphone connected with communication equipment to carry out voice call; acquiring a second audio signal of the user through a microphone configured on the earphone; performing audio detection on the first audio signal to obtain audio information of the first audio signal, the audio information at least comprising signal strength and voice definition; and determining to select the first audio signal or the second audio signal as call uplink data of the communication equipment according to the signal strength and the voice definition. According to the method, invalid identification of the audio signal can be avoided, accurate selection of the call uplink data can be realized according to the detected signal strength and voice definition, and the voice call experience of a user is improved.

Description

Technical Field

[0001] The present application belongs to the technical field of Bluetooth headsets, and in particular, relates to a method, device, equipment, medium and program product for determining call uplink data. Background Art

[0002] At present, more and more users use Bluetooth headsets for voice calls. Using the speakers and microphones of Bluetooth headsets can well protect privacy.

[0003] However, in some special scenarios such as meetings, when users use the microphone of Bluetooth headsets to make voice calls, due to the distance between the microphone and the mouth, the user needs to emit sound at a certain sound pressure level for the microphone to effectively recognize it. Otherwise, the audio signal cannot be recognized or the recognition accuracy is poor, which seriously affects the user's voice call experience. Summary of the invention

[0004] The embodiments of the present application provide a method, apparatus, device, medium and program product for determining call uplink data, which can avoid invalid recognition of audio signals, achieve accurate selection of call uplink data, and improve the user's voice call experience.

[0005] In a first aspect, an embodiment of the present application provides a method for determining call uplink data, including:

[0006] When a user uses a headset connected to a communication device to make a voice call, a first audio signal of the user is collected by a microphone configured in a headset accessory, and a second audio signal of the user is collected by a microphone configured in the headset, wherein the headset accessory is an auxiliary device used in conjunction with the headset and establishes a communication connection with the headset;

[0007] Performing audio detection on the first audio signal to obtain audio information of the first audio signal, where the audio information at least includes signal strength and speech clarity;

[0008] According to the signal strength and the voice clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device, so that the communication device uses the call uplink data for voice call.

[0009] In a second aspect, an embodiment of the present application provides a device for determining call uplink data, including:

[0010] A collection module, used for collecting a first audio signal of the user through a microphone configured in an earphone accessory and a second audio signal of the user through a microphone configured in the earphone when the user uses an earphone connected to the communication device to make a voice call, wherein the earphone accessory is an auxiliary device used in conjunction with the earphone and establishes a communication connection with the earphone;

[0011] An audio detection module, configured to perform audio detection on the first audio signal to obtain audio information of the first audio signal, where the audio information includes at least signal strength and speech clarity;

[0012] The selection module is used to determine whether to select the first audio signal or the second audio signal as the call uplink data of the communication device according to the signal strength and the voice clarity, so that the communication device uses the call uplink data for voice call.

[0013] In a third aspect, an embodiment of the present application provides a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in any one of the first aspects when executing the computer program.

[0014] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of the first aspects is implemented.

[0015] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a terminal device, enables the terminal device to execute any of the methods described in the first aspect above.

[0016] The embodiment of the present application provides a method, device, equipment, medium and program product for determining call uplink data, the method comprising: in the process of a user using a headset connected to a communication device to make a voice call, collecting the user's first audio signal through a microphone configured in the headset accessory, and collecting the user's second audio signal through a microphone configured in the headset, the headset accessory is an auxiliary device used in conjunction with the headset, and a communication connection is established with the headset; performing audio detection on the first audio signal to obtain audio information of the first audio signal, the audio information at least including signal strength and voice clarity; according to the signal strength and voice clarity, determining to select the first audio signal or the second audio signal as the call uplink data of the communication device, so that the communication device uses the call uplink data for voice call. Using the above technical solution, the headset accessory is equipped with a microphone, which can avoid invalid recognition of the audio signal, and by performing audio detection on the first audio signal collected by the microphone of the headset accessory, the call uplink data can be accurately selected according to the detected signal strength and voice clarity, thereby improving the user's voice call experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 This is a schematic diagram of the structure of a headset connection provided by an embodiment of the present application;

[0019] Figure 2 It is a flowchart of a method for determining call uplink data provided by an embodiment of the present application;

[0020] Figure 3 It is a structural diagram of a method for determining call uplink data provided by an embodiment of the present application;

[0021] Figure 4 is a flowchart of a method for determining call uplink data provided by another embodiment of the present application;

[0022] Figure 5 It is a structural diagram of a method for determining call uplink data provided by another embodiment of the present application;

[0023] Figure 6 It is a structural block diagram of a device for determining call uplink data provided by an embodiment of the present application;

[0024] Figure 7 It is a structural diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0025] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0026] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0027] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0028] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0029] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0030] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0031] It can be considered that in order to solve the problem that the microphone cannot effectively identify the audio signal, so that the user can make a voice call with a very low voice in a quiet scene such as a meeting, the headset of this embodiment can be connected to a headset accessory for communication. Furthermore, the headset accessory can be configured with a microphone, and the user can place the headset accessory closer to the mouth according to the needs, so that the user can make a voice call with a very low voice through the microphone, thereby optimizing the user experience. Among them, the headset of this embodiment can be a Bluetooth headset, and the headset accessory can refer to an auxiliary device used in conjunction with the Bluetooth headset, such as a headset accessory can include a ring, a smart bracelet, etc.

[0032] Figure 1 is a schematic diagram of a headphone connection structure provided by an embodiment of the present application, such as Figure 1As shown, the headset can establish communication connections with the mobile phone call application and the headset accessory respectively. Specifically, a call voice link can be established between the headset and the mobile phone, and the downlink data of the mobile phone can be wirelessly transmitted to the speaker of the headset for playback; the headset is equipped with a microphone, and the voice recognized by the microphone can be transmitted to the mobile phone through a wireless protocol and transmitted to the remote user. At the same time, the headset accessory can also be equipped with a microphone to pick up the user's voice.

[0033] In this embodiment, the microphone configured in the headphone accessory and the microphone configured in the headphone can both collect the user's voice and be used for uplink voice calls. Therefore, this embodiment provides a method for determining call uplink data, which can specifically determine the call uplink data according to different switching strategies and actual call situations.

[0034] Figure 2 It is a flowchart of a method for determining call uplink data provided in an embodiment of the present application. As an example but not a limitation, the method can be applied to a terminal device.

[0035] S101. When a user uses a headset connected to a communication device to make a voice call, a first audio signal of the user is collected by a microphone configured in the headset accessory, and a second audio signal of the user is collected by a microphone configured in the headset. The headset accessory is an auxiliary device used in conjunction with the headset and establishes a communication connection with the headset.

[0036] The first audio signal and the second audio signal may be considered as audio signals collected by the headphone accessory and the headphone respectively, and are only used to distinguish different objects, which is not further limited in this embodiment.

[0037] S102: Perform audio detection on the first audio signal to obtain audio information of the first audio signal, where the audio information at least includes signal strength and speech clarity.

[0038] Audio information may refer to information related to the first audio signal. The audio information may include signal strength and speech clarity, and may also include other information characterizing features of the first audio signal. The signal strength may be used to characterize the energy of the first audio signal, and the speech clarity may be understood as the intelligibility of the first audio signal, such as the accuracy with which a listener can understand the first audio signal.

[0039] S103: Determine, based on signal strength and voice clarity, whether to select the first audio signal or the second audio signal as call uplink data of the communication device, so that the communication device uses the call uplink data for a voice call.

[0040] In this embodiment, the headset can simultaneously receive the first audio signal and the second audio signal, and determine whether the user is using the microphone attached to the headset to make a call through voice detection, thereby selecting a certain audio signal as the call uplink data of the communication device to determine the call uplink data.

[0041] Exemplarily, this step can be performed by performing audio detection on the first audio signal to obtain the signal strength and voice clarity of the first audio signal, and selecting the call uplink data of the communication device according to the specific values ​​of the signal strength and voice clarity. For example, it can be determined by judging whether the signal strength and voice clarity meet the voice call conditions. The specific content of the voice call conditions can be determined by empirical values.

[0042] Alternatively, this embodiment can also determine the call uplink data based on signal strength and voice clarity in combination with other information. The other information can be determined according to actual needs. For example, the other information may include whether the first audio signal contains a trigger word, or the user's hand movement data, etc.

[0043] In some embodiments, after performing audio detection on the first audio signal to obtain audio information of the first audio signal, the method further includes:

[0044] calculating an audio correlation between the first audio signal and the second audio signal;

[0045] Determining, according to the signal strength and the voice clarity, to select the first audio signal or the second audio signal as call uplink data of the communication device includes:

[0046] According to the audio correlation, signal strength and voice clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device.

[0047] The audio correlation may be considered as the similarity between the first audio signal and the second audio signal.

[0048] In a specific implementation, the reliability of the first audio signal can be further reflected by calculating the audio correlation between the first audio signal and the second audio signal. For example, in practical applications, the second audio signal has higher reliability and can truly reflect the user's voice content. If the calculated audio correlation is higher than the correlation threshold, it means that the first audio signal collected by the microphone of the headphone accessory is largely consistent with the user's voice content; if the calculated audio correlation is lower than the correlation threshold, it means that the first audio signal collected by the microphone of the headphone accessory is largely inconsistent with the user's voice content, and the reliability of the first audio signal is not high. Therefore, the specific content of the audio correlation can be integrated to improve the accuracy of the call uplink data and further ensure the user experience.

[0049] Figure 3 is a structural diagram of a method for determining call uplink data provided by an embodiment of the present application, such as Figure 3 As shown, the headset can simultaneously receive voice from the headset microphone and from the ring microphone (such as the first audio signal and the second audio signal), and use an algorithm to determine whether the user is using the ring microphone for a call. Specifically, the built-in detection module of the headset detects the energy and intelligibility of the voice in the headset microphone and the ring microphone respectively. Then the decision module can determine whether the user is using the ring for a call by determining the correlation between the ring voice (such as the first audio signal) and the headset voice (such as the second audio signal), the energy and intelligibility of the ring voice, and send the determination result to the selection module to determine the call uplink data. If the energy, intelligibility and voice correlation of the ring voice all meet the voice call conditions, it can be considered that the user is using the ring for a voice call, and the microphone voice can be automatically used as the call uplink data; if at least one of the energy, intelligibility and voice correlation of the ring voice does not meet the voice call conditions, it can be determined that the user is not using the ring microphone, and the headset microphone voice can be used for uplink.

[0050] The present embodiment provides a method for determining call uplink data. When a user uses a headset connected to a communication device to make a voice call, a microphone configured in a headset accessory collects a first audio signal of the user, and a microphone configured in the headset collects a second audio signal of the user. The headset accessory is an auxiliary device used in conjunction with the headset, and a communication connection is established with the headset; audio detection is performed on the first audio signal to obtain audio information of the first audio signal, and the audio information at least includes signal strength and voice clarity; according to the signal strength and voice clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device, so that the communication device uses the call uplink data for voice calls. By using this method, the headset accessory is equipped with a microphone, which can avoid invalid recognition of the audio signal, and by performing audio detection on the first audio signal collected by the microphone of the headset accessory, the call uplink data can be accurately selected according to the signal strength and voice clarity obtained by the detection, thereby improving the user's voice call experience.

[0051] In some embodiments, the method further comprises:

[0052] During a voice call by a user using a headset connected to a communication device, obtaining a call switching operation performed by the user on a preset component, where the preset component includes at least one of a physical button, a touch button, and a pressure sensor;

[0053] In response to the call switching operation, the call uplink data of the communication device is switched from the first audio signal to the second audio signal, or the call uplink data of the communication device is switched from the second audio signal to the first audio signal.

[0054] The call switching operation may be used to switch call uplink data of the communication device.

[0055] In this embodiment, the user can actively switch the microphone to be used to determine the uplink data of the call. For example, the user can actively switch the microphone to be used through the earphone accessories and / or preset components configured on the earphone. The preset components can be pre-configured components and can include at least one of physical buttons, touch buttons and pressure sensors. For example, the touch buttons on the earphones can be mainly operated through capacitive touch sensing, resistive touch sensing and acceleration sensor-based technologies; the pressure sensor can determine whether the user performs a call switching operation by detecting the user's click or press operation.

[0056] Taking the preset component as a physical button as an example, the process of the user actively switching the microphone to be used is explained: when the user establishes a wireless connection between the mobile phone and the headset, and the mobile phone enters the call mode, the mobile phone can automatically identify the headset connection status and switch the uplink and downlink voice to the headset speaker and the headset microphone. When the user wants to use the microphone of the headset accessory to make a call, the headset accessory can trigger the button configured on the headset accessory so that the headset accessory can obtain this call switching operation and switch to the recording microphone. After the switch is successful, the call uplink data of the communication device can be switched from the second audio signal to the first audio signal. Furthermore, when the user is using the microphone of the headset accessory, the user can switch back to the microphone of the headset by triggering the button again. For example, the headset accessory can respond to this call switching operation and send a corresponding instruction to the headset to switch the call uplink data of the communication device from the first audio signal to the second audio signal. On this basis, the effective switching of the microphone can be quickly realized, and the accurate selection of the call uplink data can be realized, thereby improving the user's voice call experience.

[0057] Figure 4 This is a flowchart of a method for determining call uplink data provided by another embodiment of the present application. This embodiment further optimizes the method of selecting the first audio signal or the second audio signal as the call uplink data of the communication device according to the signal strength and voice clarity as follows: obtaining the motion recognition result obtained by the earphone accessory recognizing the user's hand motion data; determining the selection of the first audio signal or the second audio signal as the call uplink data of the communication device according to the motion recognition result, signal strength and voice clarity. Figure 4 As shown, the method includes:

[0058] S201. When a user uses a headset connected to a communication device to make a voice call, a first audio signal of the user is collected by a microphone configured in the headset accessory, and a second audio signal of the user is collected by a microphone configured in the headset. The headset accessory is an auxiliary device used in conjunction with the headset and establishes a communication connection with the headset.

[0059] S202: Perform audio detection on the first audio signal to obtain audio information of the first audio signal, where the audio information at least includes signal strength and speech clarity.

[0060] S203: Obtain a motion recognition result obtained by the headphone accessory recognizing the user's hand motion data.

[0061] Among them, the action recognition result can be considered as the action result obtained by identifying the user's hand action data, which is used to characterize the user's action; the hand action data can refer to data related to the user's hand action, such as motion trajectory, hand posture and other data. By identifying the user's hand action data, the corresponding action recognition result of the user can be obtained. The specific process of identifying the action recognition result is not limited here. For example, the user's hand action data can be disassembled first, and then the user's action recognition result can be obtained by identifying the disassembled data, or the action recognition result can be obtained by performing certain calculations on the disassembled data. This embodiment does not limit this.

[0062] In some embodiments, obtaining a motion recognition result obtained by the headphone accessory recognizing the hand motion data of the user includes:

[0063] Acquiring hand motion data of the user collected by the headphone accessory before collecting the first audio signal, wherein the headphone accessory is worn on the hand of the user;

[0064] The behavior training model is used to recognize the hand motion data to obtain the user's motion recognition results.

[0065] The behavior training model can be understood as a pre-trained behavior model, which can be used to identify hand motion data to obtain the user's motion recognition results. The specific training process of the behavior training model will not be further expanded here, as long as the behavior training model can be obtained.

[0066] In a specific implementation, the user's hand motion data collected by the headphone accessory before collecting the first audio signal can be obtained. For example, the headphone accessory can be worn on the user's hand, and the headphone accessory can be integrated with a 3-axis or 6-axis motion sensor for real-time or periodic collection of the user's hand motion data. Then, a behavior training model can be used to identify the collected hand motion data. For example, after collecting the user's hand motion data, the collected hand motion data can be input into the behavior training model in real time to output the user's motion recognition result.

[0067] S204: Determine, based on the action recognition result, signal strength, and voice clarity, whether to select the first audio signal or the second audio signal as call uplink data of the communication device, so that the communication device uses the call uplink data for a voice call.

[0068] After obtaining the user's action recognition result, as well as the signal strength and voice clarity of the first audio signal through the above steps, the first audio signal and the second audio signal can be selected according to the specific content of the above data, and the selected audio signal can be used as the call uplink data of the communication device. The specific selection strategy is not limited. Different selection strategies can correspond to different call uplink data. For example, the call uplink data of the communication device can be directly selected by judging whether the action recognition result recognizes the first preset action, or by measuring the specific size of the signal strength and voice clarity. It can also be based on judging whether the action recognition result recognizes the first preset action, and at the same time measure the specific size of the signal strength and voice clarity, so as to achieve accurate selection of call uplink data. The first preset action can be a pre-configured user action used to indicate that the user wants to use the headset accessory for voice calls. The specific content can be preset by the user or relevant personnel.

[0069] In some embodiments, determining to select the first audio signal or the second audio signal as call uplink data of the communication device according to the action recognition result, the signal strength, and the voice clarity includes:

[0070] If it is recognized that the hand motion data includes a first preset motion, and the signal strength and voice clarity both meet the voice call conditions, selecting the first audio signal as the call uplink data of the communication device;

[0071] If it is recognized that the hand motion data does not include the first preset motion, and / or the signal strength and voice clarity do not meet the voice call conditions, the second audio signal is selected as the call uplink data of the communication device.

[0072] In this embodiment, the voice call conditions can be used to select the call uplink data of the communication device. The specific content may include, for example, the call conditions that the audio information needs to meet, such as the signal strength needs to be higher than the strength threshold, the voice clarity needs to be greater than the clarity threshold, etc. The strength threshold and the clarity threshold can be determined by empirical values.

[0073] In a specific implementation, the specific process of selecting call uplink data may, for example, include: if it is recognized that the hand motion data contains a first preset motion, and the signal strength and voice clarity both meet the voice call conditions, it means that the user has activated the headphone accessory for a voice call, and the first audio signal collected by the headphone accessory can meet the call conditions, then the first audio signal can be selected as the call uplink data of the communication device; correspondingly, if it is recognized that the hand motion data does not contain the first preset motion, and / or the signal strength and voice clarity both do not meet the voice call conditions, it can be considered that the user has not activated the headphone accessory for a voice call, and / or the first audio signal collected by the headphone accessory does not meet the call conditions, at this time, the second audio signal collected by the headphone microphone can be selected as the call uplink data of the communication device.

[0074] Furthermore, this embodiment can also prompt the user that he is currently using the headphone accessory to make a voice call after selecting the first audio signal as the call uplink data of the communication device, such as instructing the headphone accessory to display prompt information on the display area, or playing the headphone prompt sound through the headphone, to further enhance the user experience.

[0075] The present embodiment provides a method for determining call uplink data. When a user uses a headset connected to a communication device to make a voice call, a first audio signal of the user is collected by a microphone configured in the headset accessory, and a second audio signal of the user is collected by a microphone configured in the headset. The headset accessory is an auxiliary device used in conjunction with the headset and has a communication connection with the headset. The first audio signal is detected to obtain audio information of the first audio signal, and the audio information at least includes signal strength and voice clarity. The action recognition result obtained by the headset accessory for recognizing the user's hand motion data is obtained. According to the action recognition result, signal strength and voice clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device, so that the communication device uses the call uplink data for voice calls. By using this method, by obtaining the action recognition result obtained by the headset accessory for recognizing the user's hand motion data, the accuracy of the call uplink data can be further improved, and the user's voice call experience can be improved.

[0076] In some embodiments, after selecting the first audio signal as call uplink data of the communication device, the method further includes:

[0077] If it is recognized that the hand motion data includes a second preset action, the second audio signal is selected as the uplink call data of the communication device, wherein the first preset action is used to represent the action of the user wanting to use the microphone of the headphone accessory to make a voice call, and the second preset action is used to represent the action of the user wanting to end the voice call using the microphone of the headphone accessory.

[0078] In this embodiment, the first preset action can be used to represent the action of the user wanting to use the microphone of the headphone accessory to make a voice call, and the second preset action is used to represent the action of the user wanting to end the voice call using the microphone of the headphone accessory. The specific content of the first preset action and the second preset action can be configured by the user or relevant personnel according to needs.

[0079] Optionally, the headphone accessory includes a ring, and the first preset action includes an action of the palm wearing the ring covering a predetermined body part of the user, and the second preset action includes an action of removing the palm wearing the ring from the predetermined body part. Wherein, if the predetermined body part may be the user's mouth, the first preset action may include an action of the palm wearing the ring covering the user's mouth, and the second preset action may include an action of removing the palm wearing the ring from the user's mouth. On this basis, the user can reduce the influence of the distance between the microphone and the mouth by controlling the action of the ring, thereby ensuring effective recognition of the audio signal.

[0080] It can be considered that, in the process of a user using a headset connected to a communication device to make a voice call, the call uplink data determination method provided in this embodiment is performed in real time or periodically. Therefore, after the first audio signal is currently selected as the call uplink data of the communication device, the above-mentioned call uplink data determination method can be continued to be executed to re-identify the user's action recognition result. If the hand action data is identified to contain the second preset action, it means that the user wants to end the voice call using the headset accessory, then this embodiment can select the second audio signal as the call uplink data of the communication device;

[0081] On the contrary, if the hand motion data continues to be recognized to include the first preset motion, and the signal strength and voice clarity both meet the voice call conditions, then it means that the current user is still using the headphone accessory for a voice call. At this time, the first audio signal can continue to be selected as the call uplink data of the communication device.

[0082] In some embodiments, before using the behavior training model to recognize the hand motion data to obtain the user's motion recognition result, the method further includes:

[0083] The neural network model is trained using multiple pairs of training data to obtain a behavior training model, wherein the training data at least includes: a first preset action and an action recognition result corresponding to the first preset action; a second preset action and an action recognition result corresponding to the second preset action.

[0084] Specifically, this embodiment can train the user's usage behavior of the headphone accessories, such as collecting multiple pairs of training data to train the neural network model. Specifically, it can collect multiple action trajectories of palms turning over and covering the mouth, collect multiple action trajectories of palms being taken away from the mouth, and collect other types of action trajectories corresponding to the palms, and train the neural network model based on the large amount of collected training data to generate a behavior training model, which can be used to detect whether to start a ring call and whether to end a ring call.

[0085] Figure 5 is a structural diagram of a method for determining call uplink data provided by another embodiment of the present application, such as Figure 5 As shown, the call uplink data of the communication device can be determined by a combined judgment method, that is, the hand movement posture and voice detection can be combined to further determine whether the user is using the ring for a voice call. More specifically, the ring can collect hand movement postures through motion sensors, and use AI algorithms to detect hand movement postures to decide whether to start or stop the ring voice call (that is, collect the user's hand movement data through the earphone accessories; use the behavior training model to identify the hand movement data to obtain the user's movement recognition results). For example, after detecting that the hand movement posture is a preset hand movement, the ring can be voice monitored and voice detection can be performed, such as detecting whether the ring microphone has voice data through a voice detection algorithm, or detecting whether the voice data meets the voice call conditions; the policy management module can combine the hand movement detection and voice detection results to determine whether the user wants to make a ring call, thereby determining the call uplink data of the communication device (that is, according to the movement recognition results, signal strength and voice clarity, determine to select the first audio signal or the second audio signal as the call uplink data of the communication device).

[0086] In addition, the voice channel can be further switched according to the result, such as turning off the headset microphone and enabling the ring microphone for calls, or turning off the ring microphone and enabling the headset microphone for calls. When the ring microphone is enabled for calls, a prompt tone and indicator light can be given to let the user know clearly that the microphone has been switched.

[0087] Corresponding to the method for determining call uplink data in the above embodiment, Figure 6 This is a structural block diagram of a device for determining call uplink data provided by an embodiment of the present application. For the sake of convenience of explanation, only the parts related to the embodiment of the present application are shown.

[0088] Reference Figure 6 , the device comprises:

[0089] The collection module 301 is used to collect the first audio signal of the user through the microphone configured in the earphone accessory and the second audio signal of the user through the microphone configured in the earphone when the user uses the earphone connected to the communication device to make a voice call, and the earphone accessory is an auxiliary device used in conjunction with the earphone and establishes a communication connection with the earphone;

[0090] An audio detection module 302 is used to perform audio detection on the first audio signal to obtain audio information of the first audio signal, where the audio information at least includes signal strength and speech clarity;

[0091] The selection module 303 is used to determine whether to select the first audio signal or the second audio signal as the call uplink data of the communication device according to the signal strength and the voice clarity, so that the communication device uses the call uplink data to make a voice call.

[0092] The present embodiment provides a device for determining call uplink data. When a user uses a headset connected to a communication device to make a voice call, a collection module collects a first audio signal of the user through a microphone configured in a headset accessory, and collects a second audio signal of the user through a microphone configured in the headset. The headset accessory is an auxiliary device used in conjunction with the headset and establishes a communication connection with the headset. The audio detection module performs audio detection on the first audio signal to obtain audio information of the first audio signal, and the audio information at least includes signal strength and voice clarity. The selection module determines to select the first audio signal or the second audio signal as the call uplink data of the communication device according to the signal strength and voice clarity, so that the communication device uses the call uplink data for voice call. With the device, the headset accessory is equipped with a microphone, which can avoid invalid recognition of the audio signal, and by performing audio detection on the first audio signal collected by the microphone of the headset accessory, the call uplink data can be accurately selected according to the signal strength and voice clarity obtained by the detection, thereby improving the user's voice call experience.

[0093] Optionally, the selection module includes:

[0094] An acquisition unit, used to acquire a motion recognition result obtained by the headphone accessory recognizing the user's hand motion data;

[0095] The selection unit is used to determine whether to select the first audio signal or the second audio signal as the call uplink data of the communication device according to the action recognition result, signal strength and voice clarity.

[0096] Optionally, the acquisition unit is specifically used for:

[0097] Acquiring hand motion data of the user collected by the headphone accessory before collecting the first audio signal, wherein the headphone accessory is worn on the hand of the user;

[0098] The behavior training model is used to recognize the hand motion data to obtain the user's motion recognition results.

[0099] Optionally, the selection unit includes:

[0100] A first selection subunit is used to select the first audio signal as the call uplink data of the communication device if it is recognized that the hand motion data contains a first preset motion and the signal strength and voice clarity both meet the voice call conditions;

[0101] The second selection subunit is used to select the second audio signal as the call uplink data of the communication device if it is recognized that the hand motion data does not contain the first preset motion, and / or the signal strength and voice clarity do not meet the voice call conditions.

[0102] Optionally, the selection unit further includes:

[0103] The third selection subunit is used to select the second audio signal as the uplink call data of the communication device after selecting the first audio signal as the uplink call data of the communication device if it is recognized that the hand movement data contains a second preset action, wherein the first preset action is used to represent the action of the user to use the microphone of the headphone accessory to make a voice call, and the second preset action is used to represent the action of the user to end the voice call using the microphone of the headphone accessory.

[0104] Optionally, the headphone accessory includes a ring, the first preset action includes an action of covering a predetermined body part of the user with a palm wearing the ring, and the second preset action includes an action of removing the palm wearing the ring from the predetermined body part.

[0105] Optionally, the device for determining call uplink data provided by this embodiment further includes:

[0106] a calculation module, configured to calculate an audio correlation between the first audio signal and the second audio signal after performing audio detection on the first audio signal to obtain audio information of the first audio signal;

[0107] The selection module is specifically used for:

[0108] According to the audio correlation, signal strength and voice clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device.

[0109] Optionally, the device for determining call uplink data provided by this embodiment further includes:

[0110] An acquisition module, used to acquire a call switching operation performed by a user on a preset component during a voice call using a headset connected to a communication device, wherein the preset component includes at least one of a physical button, a touch button, and a pressure sensor;

[0111] The switching module is used to switch the call uplink data of the communication device from the first audio signal to the second audio signal, or switch the call uplink data of the communication device from the second audio signal to the first audio signal in response to the call switching operation.

[0112] Optionally, the selection unit further includes at least one of the following:

[0113] A display subunit, configured to instruct the headset accessory to display prompt information on the display area after selecting the first audio signal as call uplink data of the communication device;

[0114] The playing subunit is used to play the earphone prompt tone through the earphone after selecting the first audio signal as the call uplink data of the communication device, wherein the prompt information and / or the earphone prompt tone is used to prompt the user that the earphone accessory is currently using the voice call.

[0115] Optionally, the acquisition unit is further specifically configured to:

[0116] Before using the behavior training model to identify the hand motion data and obtain the user's motion recognition result, the neural network model is trained using multiple pairs of training data to obtain the behavior training model. The training data at least includes: a first preset action, and the action recognition result corresponding to the first preset action; a second preset action, and the action recognition result corresponding to the second preset action.

[0117] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0118] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0119] The present application also provides a terminal device, Figure 7 is a schematic diagram of the structure of a terminal device provided by an embodiment of the present application, such as Figure 7 As shown, the terminal device includes: at least one processor 401, a memory 402, an input device 403, an output device 404, and a computer program stored in the memory 402 and executable on at least one processor 401. When the processor 401 executes the computer program, the steps in any of the above-mentioned method embodiments are implemented.

[0120] The input device 403 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the terminal device. The output device 404 may include a display device such as a display screen.

[0121] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by the processor 401, the steps in the above-mentioned method embodiments can be implemented.

[0122] An embodiment of the present application provides a computer program product. When the computer program product runs on a mobile terminal, the mobile terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0123] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can be executed by the processor 401. The steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include at least: any entity or device that can carry the computer program code to the device / terminal device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0124] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0125] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0126] In the embodiments provided in the present application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0127] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0128] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for determining call uplink data, characterized in that: include: When a user uses a headset connected to a communication device to make a voice call, a first audio signal of the user is collected by a microphone configured in a headset accessory, and a second audio signal of the user is collected by a microphone configured in the headset, wherein the headset accessory is an auxiliary device used in conjunction with the headset and has a communication connection with the headset; Performing audio detection on the first audio signal to obtain audio information of the first audio signal, where the audio information includes at least signal strength and speech clarity; According to the signal strength and the voice clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device, so that the communication device uses the call uplink data to perform a voice call.

2. The method for determining call uplink data according to claim 1, characterized in that: The step of determining, according to the signal strength and the voice clarity, to select the first audio signal or the second audio signal as the call uplink data of the communication device includes: Obtaining a motion recognition result obtained by the headphone accessory recognizing the hand motion data of the user; According to the action recognition result, the signal strength and the voice clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device.

3. The method for determining call uplink data according to claim 2, characterized in that: The obtaining of the motion recognition result obtained by the headphone accessory recognizing the hand motion data of the user includes: Acquiring hand motion data of the user collected by the headphone accessory before collecting the first audio signal, wherein the headphone accessory is worn on the hand of the user; The hand motion data is recognized using a behavior training model to obtain a motion recognition result of the user.

4. The method for determining call uplink data according to claim 2, characterized in that: The determining, according to the action recognition result, the signal strength, and the voice clarity, to select the first audio signal or the second audio signal as the call uplink data of the communication device includes: If it is recognized that the hand motion data includes a first preset motion, and both the signal strength and the voice clarity meet the voice call condition, selecting the first audio signal as the call uplink data of the communication device; If it is recognized that the hand motion data does not include the first preset motion, and / or the signal strength and the voice clarity do not meet the voice call conditions, the second audio signal is selected as the call uplink data of the communication device.

5. The method for determining call uplink data according to claim 4, characterized in that: After selecting the first audio signal as call uplink data of the communication device, the method further includes: If it is recognized that the hand motion data includes a second preset action, the second audio signal is selected as the uplink call data of the communication device, wherein the first preset action is used to represent the action of the user wanting to use the microphone of the headphone accessory to make a voice call, and the second preset action is used to represent the action of the user wanting to end the voice call using the microphone of the headphone accessory.

6. The method for determining call uplink data according to claim 5, characterized in that: The headphone accessory includes a ring, the first preset action includes an action of covering a predetermined body part of the user with the palm wearing the ring, and the second preset action includes an action of removing the palm wearing the ring from the predetermined body part.

7. The method for determining call uplink data according to claim 1, characterized in that: After performing audio detection on the first audio signal to obtain audio information of the first audio signal, the method further includes: calculating an audio correlation between the first audio signal and the second audio signal; The step of determining, according to the signal strength and the voice clarity, to select the first audio signal or the second audio signal as the call uplink data of the communication device includes: According to the audio correlation, the signal strength, and the speech clarity, it is determined to select the first audio signal or the second audio signal as the call uplink data of the communication device.

8. The method for determining call uplink data according to claim 1, characterized in that: The method further comprises: During a voice call by the user using a headset connected to a communication device, obtaining a call switching operation performed by the user on a preset component, wherein the preset component includes at least one of a physical button, a touch button, and a pressure sensor; In response to the call switching operation, the call uplink data of the communication device is switched from the first audio signal to the second audio signal, or the call uplink data of the communication device is switched from the second audio signal to the first audio signal.

9. The method for determining call uplink data according to claim 4, characterized in that: After selecting the first audio signal as the call uplink data of the communication device, the method further includes at least one of the following: Instructing the headphone accessory to display prompt information on the display area; An earphone prompt tone is played through the earphone, wherein the prompt information and / or the earphone prompt tone is used to prompt the user that the user is currently using the earphone accessory for a voice call.

10. The method for determining call uplink data according to claim 3, characterized in that: Before the hand motion data is recognized by using the behavior training model to obtain the user's motion recognition result, the method further includes: The neural network model is trained using multiple pairs of training data to obtain the behavior training model, wherein the training data at least includes: a first preset action and an action recognition result corresponding to the first preset action; a second preset action and an action recognition result corresponding to the second preset action.

11. A device for determining call uplink data, characterized in that: include: A collection module, used for collecting a first audio signal of the user through a microphone configured in an earphone accessory and a second audio signal of the user through a microphone configured in the earphone when the user uses an earphone connected to a communication device to make a voice call, wherein the earphone accessory is an auxiliary device used in conjunction with the earphone and has a communication connection with the earphone; an audio detection module, configured to perform audio detection on the first audio signal to obtain audio information of the first audio signal, wherein the audio information includes at least signal strength and speech clarity; A selection module is used to determine whether to select the first audio signal or the second audio signal as the call uplink data of the communication device according to the signal strength and the voice clarity, so that the communication device uses the call uplink data to make a voice call.

12. A terminal device comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the terminal device implements the method according to any one of claims 1 to 10.

13. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

14. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, enables the method according to any one of claims 1 to 10 to be performed.

Images