Call method and related device

Abstract

The application provides a call method and related equipment, and relates to the technical field of terminal equipment. The call method comprises the following steps: in response to a first operation of a first user, displaying a first volume control interface and a second volume control interface, the first volume control interface corresponding to a second user in call with the first user, the second volume control interface corresponding to a third user in call with the first user, the first volume control interface comprising a first control, and the second volume control interface comprising a second control; in response to a second operation of the first user on the first control, adjusting the call volume of the second user, and / or in response to a second operation of the first user on the second control, adjusting the call volume of the third user. By using the method, the electronic equipment can adjust the call volume of one or more specified users in response to user operation during the call, solve the problem that the volume adjustment mode of the existing electronic equipment is too single, and improve the call experience of the user.

Description

TECHNICAL FIELD

[0001] The present application belongs to the field of terminal devices, and relates to communication technology, in particular to a call method and related equipment. BACKGROUND

[0002] With the development of terminal technology, the functions of electronic devices are becoming richer and richer, and in particular, the call function (for example, audio call or audio and video call) gradually becomes a relatively common function of electronic devices.

[0003] In the related art, in the process of using an electronic device to make a call, if the played call audio includes the voice of one or more users, the volume of all voices is adjusted when the call volume is adjusted using a volume adjustment control or a volume adjustment key, and the volume adjustment mode is too single, which cannot adapt to different call scenarios. SUMMARY

[0004] In view of the above, it is necessary to provide a call method and related equipment, which can solve the problem that the volume adjustment mode of an electronic device is too single.

[0005] In a first aspect, the present application provides a call method applied to a first electronic device, which can include: in response to a first operation of a first user, displaying a first volume control interface and a second volume control interface, the first volume control interface corresponding to a second user, the second volume control interface corresponding to a third user, the first volume control interface including a first control, and the second volume control interface including a second control; in response to a second operation of the first user on the first control, adjusting the call volume of the second user, and / or in response to a second operation of the first user on the second control, adjusting the call volume of the third user.

[0006] By adopting the above technical solution, the first user can adjust the call volume of the second user through the first volume control interface and adjust the call volume of the third user through the second volume control interface, so that the user can intuitively adjust the call volume of one or more specified users, overcoming the problem that the existing technology can only adjust the volume of all voices at the same time and cannot adjust the volume of some voices individually.

[0007] In a possible implementation manner, the first volume control interface further includes a third control, the third control being used to trigger muting or unmuting, and the call method further includes: in response to a third operation of the first user on the third control, the third control being switched from a first state to a second state, the first state being used to indicate that the second user is not muted, and the second state being used to indicate that the second user is muted.

[0008] By adopting the technical scheme, the first user can also mute the second user through the first volume control interface, and by configuring the third control corresponding to each volume control interface, the first user can directly mute one or more specified users, thereby achieving suppression of interfering human voices and playing only the speaking voice of the user who wants to be heard.

[0009] In a possible implementation, the first state is an unselected state, and the second state is a selected state.

[0010] By adopting the technical scheme, the first user can be significantly reminded of whether the electronic device currently mutes one or more users.

[0011] In a possible implementation, the second operation is a sliding operation, and the method further includes: in response to the first user performing the second operation on the first control, adjusting the speaking volume of the second user, including: in response to the first user performing a sliding operation on the first control in a first direction, increasing the speaking volume of the second user; and in response to the first user performing a sliding operation on the first control in a second direction, decreasing the speaking volume of the second user, the first direction being opposite to the second direction; and in response to the first user performing the second operation on the second control, adjusting the speaking volume of the third user, including: in response to the first user performing a sliding operation on the second control in the first direction, increasing the speaking volume of the third user; and in response to the first user performing a sliding operation on the second control in the second direction, decreasing the speaking volume of the third user.

[0012] By adopting the technical scheme, the first user can increase or decrease the speaking volume of one or more specified users through a sliding operation, and the first user can intuitively know the current speaking volume of each user.

[0013] In a possible implementation, the first volume control interface further includes a user identifier corresponding to the second user, and the method further includes: in a case where the played audio call data includes the audio call data of the second user, displaying the user identifier in a first style; and in a case where the played audio call data does not include the audio call data of the second user, displaying the user identifier in a second style, the first style being different from the second style.

[0014] By adopting the technical scheme, the user identifier is displayed in different styles, and the user identifier in different styles represents whether the played audio call data includes the audio call data of the corresponding user, thereby enabling the first user to intuitively know the user corresponding to the current speaking voice, and facilitating subsequent volume adjustment or muting operation on a specified user.

[0015] In a possible implementation, in response to the first operation of the first user, the first volume control interface and the second volume control interface are displayed, including: in response to the first operation of the first user, a call interface is displayed, and the call interface includes the first volume control interface and the second volume control interface.

[0016] By adopting the technical solution described above, each volume control interface is displayed in the call interface, without the need to additionally configure a display area on the display screen for each volume control interface, and without causing the call interface to be blocked.

[0017] In a possible implementation, in response to the first operation of the first user, the first volume control interface and the second volume control interface are displayed, including: in response to the first operation of the first user, a call interface and a volume control window are displayed, the volume control window partially overlaps the call interface, and the volume control window includes the first volume control interface and the second volume control interface.

[0018] By adopting the technical solution described above, the call interface and the volume control window are independently designed, which is compatible with the current call interface display scheme, and the volume control window can be set to have an expanded state and a folded state in the future, thereby enriching the display mode of the volume control interface.

[0019] In a possible implementation, the first operation includes an operation of answering a call, or an operation of making a call, or an operation of joining a conference.

[0020] By adopting the technical solution described above, the electronic device can adjust / mute the call volume of a specified user or users after making a call, answering a call, or joining a conference, thereby improving the call experience of the user.

[0021] In a possible implementation, the call interface includes a call interface based on a cellular network, or a call interface based on Voice over Internet Protocol (VoIP).

[0022] By adopting the technical solution described above, the first user can adjust the volume or mute a specified user or users according to the actual call scene requirement during the call process based on the cellular network or the call process based on VoIP, thereby improving the call experience of the user.

[0023] In a possible implementation, the first electronic device includes a preset storage area, and the call method further includes: in a case where the first electronic device establishes a call, extracting voiceprint information from received downlink call data, and storing the voiceprint information in the preset storage area; and in response to a second operation on the first control, performing volume adjustment processing on audio call data of a second user included in the downlink call data based on the voiceprint information stored in the preset storage area.

[0024] The technical solution can support extraction, identification and storage of voiceprint information of downlink call data in a call, and can further perform volume adjustment processing on audio call data corresponding to a specified voiceprint in a personalized manner, thereby achieving volume adjustment or muting for one or more specified users and improving the call experience of the user.

[0025] In a possible implementation, the first electronic device includes a first audio signal processing link and a second audio signal processing link, and the call method further includes: extracting voiceprint information from the downlink call data using the first audio signal processing link, and assigning a unique voiceprint number to each extracted voiceprint information, wherein the voiceprint information and the corresponding voiceprint number are stored in a preset storage area; in response to the second operation on the first control, obtaining a voiceprint number of a second user and volume adjustment information corresponding to the second operation, and based on the volume adjustment information and the voiceprint number of the second user, performing volume adjustment processing on audio call data of the second user included in the downlink call data using the second audio signal processing link.

[0026] The technical solution can support extraction, identification and storage of voiceprint information of downlink call data in a call, and can further perform volume adjustment processing on audio call data corresponding to a specified voiceprint in a personalized manner, thereby achieving volume adjustment or muting for one or more specified users and improving the call experience of the user.

[0027] In a possible implementation, the first electronic device further includes a third audio signal processing link, and the call method further includes: displaying the voiceprint number in the corresponding volume control interface using the third audio signal processing link.

[0028] The technical solution can support extraction, identification and storage of voiceprint information of downlink call data in a call, and can further perform volume adjustment processing on audio call data corresponding to a specified voiceprint in a personalized manner, thereby achieving volume adjustment or muting for one or more specified users and improving the call experience of the user.

[0029] In a possible implementation, the first electronic device stores the extracted voiceprint information and the corresponding voiceprint number in the preset storage area when establishing a call, and the call method further includes: deleting the voiceprint information and the voiceprint number stored in the preset storage area when the call ends.

[0030] The technical solution can support extraction, identification and storage of voiceprint information of downlink call data in a call, and can further perform volume adjustment processing on audio call data corresponding to a specified voiceprint in a personalized manner, thereby achieving volume adjustment or muting for one or more specified users and improving the call experience of the user.

[0031] In a possible implementation, a call connection is established between the first electronic device and the second electronic device, the first electronic device corresponds to the first user, and the second electronic device corresponds to the second user and the third user.

[0032] With the technical solution, the first user can adjust the call volume of the specified one or more users through the volume control interface, and the other specified one or more users can be users who use one electronic device to call the first user together.

[0033] In a possible implementation, a call connection is established among the first electronic device, the second electronic device, and the third electronic device, the first electronic device corresponds to the first user, the second electronic device corresponds to the second user, and the third electronic device corresponds to the third user.

[0034] With the technical solution, the first user can adjust the call volume of the specified one or more users through the volume control interface, and the other specified one or more users can be users who use one electronic device to call the first user together.

[0035] In a second aspect, the present application provides an electronic device, which comprises a display screen, a memory, and a processor; the display screen and the memory are coupled with the processor; the memory is configured to store program instructions; and the processor is configured to read the program instructions stored in the memory to implement the call method of the first aspect and possible implementation manners thereof.

[0036] In a third aspect, the present application provides a computer-readable storage medium, which stores computer-readable instructions; when the computer-readable instructions are executed by a processor, the call method of the first aspect and possible implementation manners thereof is implemented.

[0037] In a fourth aspect, the present application provides a computer program product, which contains computer-readable instructions; when the computer-readable instructions are executed by a processor, the call method of the first aspect and possible implementation manners thereof is implemented.

[0038] In a fifth aspect, the present application provides a chip system, which is coupled with a memory; the chip system is configured to read and execute a computer program stored in the memory to implement the call method of the first aspect and possible implementation manners thereof.

[0039] In addition, the technical effects brought by the second aspect to the fifth aspect can be referred to the description of the methods of the above-mentioned method part, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0040] FIG. 1A is a schematic diagram of a call scenario provided by an embodiment of the present application;

[0041] FIG. 1B is a schematic diagram of a call scenario provided by another embodiment of the present application;

[0042] FIG. 2A is a schematic diagram of an application scenario of a call method provided by an embodiment of the present application;

[0043] FIG. 2B is a schematic diagram of an application scenario of a call method provided by another embodiment of the present application;

[0044] FIG. 3A is a set of user interface schematic diagrams provided by an embodiment of the present application;

[0045] FIG. 3B is a set of user interface schematic diagrams provided by another embodiment of the present application;

[0046] FIG. 4 is a set of user interface schematic diagrams provided by yet another embodiment of the present application;

[0047] FIG. 5 is a hardware and software architecture diagram of an electronic device provided by an embodiment of the present application;

[0048] FIG. 6 is an interaction flow diagram of internal hardware and software modules of an electronic device in a VoIP call scenario provided by an embodiment of the present application;

[0049] FIG. 7 is an interaction flow diagram of internal hardware and software modules of an electronic device in a VoIP call scenario provided by another embodiment of the present application;

[0050] FIG. 8 is a hardware and software architecture diagram of an electronic device provided by another embodiment of the present application;

[0051] FIG. 9 is an interaction flow diagram of internal hardware and software modules of an electronic device in a cellular call scenario provided by an embodiment of the present application;

[0052] FIG. 10 is an interaction flow diagram of internal hardware and software modules of an electronic device in a cellular call scenario provided by another embodiment of the present application;

[0053] FIG. 11 is a hardware architecture diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0054] In the following, the technical solutions in the embodiments of the present application will be described with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all the other embodiments obtained by a person of ordinary skill in the art without creative work fall within the scope of the present application.

[0055] Hereinafter, the terms "first", "second" are used only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the words "exemplary", "or", "for example" are used to mean example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the words "exemplary", "or", "for example" are intended to present the relevant concept in a specific manner.

[0056] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs. The terms used in the specification of the present application are only for the purpose of describing the specific embodiments and are not intended to limit the present application. It should be understood that, in the present application, unless otherwise specified, " / " means or. For example, A / B can mean A or B. In the present application, "and / or" is only a description of the relationship between the associated objects, which means that there can be three relationships. For example, A and / or B can mean that A exists alone, A and B exist together, and B exists alone. "At least one" means one or more. "Multiple" means two or more than two. For example, at least one of a, b or c can mean a, b, c, a and b, a and c, b and c, a, b and c seven cases. It should be understood that the order of the steps shown in the flowchart herein can be changed, and some can be omitted.

[0057] In order to understand the embodiments of the present application, first, the technical terms related to the present application are introduced:

[0058] User interface (UI): is the medium interface for interaction and information exchange between application or operating system and user, which realizes the conversion between internal form of information and form that user can accept. User interface is source code written by specific computer language such as java, extensible markup language (XML), etc. Interface source code is parsed, rendered on electronic device, and finally presented as content that user can recognize. Commonly used form of user interface is graphic user interface (GUI), which refers to user interface related to computer operation displayed in graphic mode. It can be visual interface elements such as text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, Widget displayed in display screen of electronic device.

[0059] Application (APP): is a software program that can realize one or more specific functions. For example, call application, instant messaging application, video application, audio application, image shooting application, cloud desktop application, etc.

[0060] As shown in FIG. 1A , a call scenario provided by an embodiment of the present application, the call scenario includes a first electronic device 100 and a second electronic device 200. The first electronic device 100 and the second electronic device 200 can be devices with call function, and the embodiment of the present application does not limit the device type of the first electronic device 100 and the second electronic device 200. For example, the first electronic device 100 and the second electronic device 200 can be a mobile phone, a tablet computer, a personal computer, a Voice over Internet Protocol (VoIP) phone, etc. FIG. 1A Taking the case that the first electronic device 100 and the second electronic device 200 are both smart phones and the first electronic device 100 and the second electronic device 200 realize voice transmission based on VoIP technology, user A uses the first electronic device 100, and user B uses the second electronic device 200, for example, FIG. 1A , the call scenario shown is a call in an office scenario, and there is environmental noise (for example, the sound of a colleague C of user A knocking the keyboard) and interfering human voice (for example, the speaking voice of colleague C) around user A. In this case, the call voice of user A heard by user B is mixed with environmental noise and interfering human voice during the call between user B and user A, and user B may not be able to hear what user A said, which affects the call experience of user B. That is FIG. 1A , in order to let user B hear the voice of user A more clearly, there is a need for noise reduction of environmental noise and interfering human voice.

[0061] For example, again, FIG. 1B For example, the first electronic device 100 and the second electronic device 200 are both smart phones, and the first electronic device 100 and the second electronic device 200 implement voice transmission based on a cellular network. In this case, there is environmental noise and interfering human voice around the user A, which causes the user B to hear the voice of the user A mixed with environmental noise and interfering human voice during the conversation with the user A, and the user B may not be able to hear what the user A said, affecting the conversation experience of the user B. That is FIG. 1B As shown in the conversation scenario, in order to let the user B hear the voice of the user A more clearly, there is also a need for noise reduction of environmental noise and interfering human voice.

[0062] In order to reduce the interference of the surrounding environmental noise and improve the conversation quality, the electronic device generally defaults to turn on the environmental noise reduction algorithm to automatically reduce the environmental noise. The electronic device lacks the noise reduction capability for interfering human voice, and in the process of the user conversing with the other party, if the other party is in a conversation scenario with interfering human voice, the user may still not be able to hear the voice of the other party.

[0063] Please refer to FIG. 2A A scene schematic diagram of a conversation method applicable to the embodiments of the present application. The scene includes the first electronic device 100 and the second electronic device 200. The first electronic device 100 and the second electronic device 200 can be devices with conversation function, and the embodiments of the present application do not limit the device type of the first electronic device 100 and the second electronic device 200. For example, the first electronic device 100 and the second electronic device 200 can be a mobile phone, a tablet computer, a personal computer, a VoIP phone, etc.

[0064] For example, the first electronic device 100 and the second electronic device 200 are both smart phones, and the first electronic device 100 and the second electronic device 200 can be installed with an application that can perform conversation. The first electronic device 100 can initiate a request to establish a conversation connection with the second electronic device 200 in response to the operation of the first user, and the second electronic device 200 can confirm the establishment of the conversation connection with the first electronic device 100 in response to the operation of the second user, so that the first user and the second user can perform conversation through the first electronic device 100 and the second electronic device 200. The implementation of the conversation can be based on the Internet or the operator network, and the embodiments of the present application do not limit this. In order to let one user hear the voice of the other user more clearly, the first electronic device 100 and / or the second electronic device 200 can have a need for noise reduction of environmental noise and interfering human voice.

[0065] Please refer to FIG. 2BFIG. 1 is a schematic diagram of a scenario of a call method applicable to an embodiment of the present application. The scenario can be a scenario in which a first user participates in a multi-person online conference. For example, the first user participates in a multi-person online conference through a first electronic device 100. FIG. 2B Taking the first electronic device 100 as a tablet computer as an example, the first electronic device 100 can be installed with an application (for example, an online conference application) that can perform multi-person call. The first electronic device 100 can join the multi-person online conference and establish a call connection with electronic devices of other participating users (for example, a second user and a third user participate in the multi-person online conference through a second electronic device 200, and access the conference through an account of the second user, and a fourth user and a fifth user participate in the multi-person online conference through a third electronic device 300, and access the conference through an account of the fourth user) in response to an operation of the first user, so that the first user can perform online conference call with other users through the first electronic device 100. The implementation of the online conference call can be based on the Internet or an operator network, and the embodiments of the present application do not limit this. In order to let the first user hear the voice of a certain participant or certain participants more clearly, the first electronic device 100 can have a need for noise reduction of environmental noise and interfering voices.

[0066] The call scenario can generally be divided into a single-person call scenario and a multi-person call scenario. In the single-person call scenario, a user is more concerned about hearing the voice of the other party. Therefore, in the single-person call scenario, for the sound data received by the electronic device, the electronic device can be configured to consider all voiceprints other than the voiceprint of the other party as interfering voices, that is, the electronic device can process the received sound data to only retain the sound data corresponding to the voiceprint of the other party. For example, in the single-person call scenario, since the speaking volume of the other party is generally larger than the volume of the interfering voices, and the speaking duration is also longer, the user voiceprint with relatively large speaking volume and relatively long duration can be identified as the voiceprint of the other party.

[0067] In the multi-person call scenario, a user can be more concerned about the voice of a certain user or certain users, and the definition of interfering voices is relatively ambiguous. A user can only adjust the volume of all other users by adjusting the volume of the electronic device used by the user, and cannot separately adjust the volume of a certain user or certain users, or mute a certain user or certain users.

[0068] Therefore, the embodiments of the present application provide a call method, so that the electronic device has the ability to reduce the noise of interfering voices, meets the call noise reduction needs of a user that the speaking voice of the other party has interfering voices, and has the ability to adjust the volume of a certain user or certain users.

[0069] The following will be described in combination with FIG. 3Aintroducing that the electronic device adjusts the volume and / or mutes some or all users in response to user operations in a call scenario.

[0070] As shown in FIG. 3A , taking a tablet as an example of the electronic device (the electronic device in the embodiments of the present application can be the first electronic device 100 or the second electronic device 200 in FIG. 2A , or the first electronic device 100 or the second electronic device 200 or the third electronic device 300 in FIG. 2B ), a call interface 111 displayed by the electronic device can include a call adjustment area 1111 and a call control area 1112.

[0071] As shown in FIG. 3A , the electronic device can display a number of volume control interfaces 1113 corresponding to the number of recognized user voice prints in the call adjustment area 1111 during a call. Each volume control interface 1113 corresponds to a user voice print, and each user voice print corresponds to a user voice. FIG. 3A Taking an example of displaying four volume control interfaces 1113, the four volume control interfaces 1113 correspond to four user voices. Each volume control interface 1113 can include a mute control 1114 and a volume adjustment control 1115. The mute control 1114 can be used to mute the corresponding user voice, and the volume adjustment control 1115 can be used to adjust the volume of the corresponding user voice. For example, if the mute control 1114 in a volume control interface 1113 is selected (for example, FIG. 3A , as shown in the figure, the mute control 1114 in the volume control interface 1113 corresponding to user 3 and user 4 is selected), it indicates that the user voice corresponding to the volume control interface 1113 is muted. If the mute control 1114 in a volume control interface 1113 is not selected (for example, FIG. 3A , as shown in the figure, the mute control 1114 in the volume control interface 1113 corresponding to user 1 and user 2 is not selected), it indicates that the user voice corresponding to the volume control interface 1113 is not muted, and the user voice corresponding to the volume control interface 1113 can be normally played by the electronic device. FIG. 3A , as shown in the figure, a possible display style of the mute control 1114 is shown. The display style of the mute control 1114 can be set according to actual needs, which is not limited in the embodiments of the present application.

[0072] Each volume control interface 1113 is independent of each other, and a user of the electronic device can independently control each volume control interface 1113. For example, the user of the electronic device can perform a check operation on the mute control 1114 in one or more volume control interfaces 1113, so that the electronic device mutes the user voice corresponding to the one or more volume control interfaces 1113, and realizes the suppression of one or more interfering voices.

[0073] FIG. 3A Taking the volume adjustment control 1115 as an example of a sliding adjustment, the user of the electronic device can adjust the volume of the user voice corresponding to the volume control interface 1113 by sliding the volume adjustment control 1115 in the volume control interface 1113. For example, if the sliding operation on the volume adjustment control 1115 is from left to right, the volume of the user voice corresponding to the volume control interface 1113 is increased, and if the sliding operation on the volume adjustment control 1115 is from right to left, the volume of the user voice corresponding to the volume control interface 1113 is decreased. It can be understood that FIG. 3A The display style of the volume adjustment control 1115 shown is one possible display style, and the display style of the volume adjustment control 1115 can be set according to actual needs, and the embodiments of the present application are not limited thereto.

[0074] In some embodiments, the volume control interface 1113 can also display corresponding user identification information (for example, FIG. 3A The user 1, the user 2, the user 3, and the user 4 shown are convenient for the user of the electronic device to visually distinguish the recognized user voiceprints, and are convenient for subsequent mute operation or volume adjustment operation on the specified user voice. For example, the user identification information can be a user voiceprint number, or can be generated based on the user voiceprint number. For another example, the user identification information can also be generated based on the user voiceprint number and the call access identifier, and the call access identifier can be an account / number identifier accessing the call, etc.

[0075] In some embodiments, when a user is speaking, the user identification information in the volume control interface 1113 corresponding to the user can also be displayed in the form of highlighting / flashing, etc., so as to visually distinguish the current speaking user for the user of the electronic device.

[0076] In some embodiments, when the mute control 1114 in the volume control interface 1113 of a speaking user is checked, the user identification information of the user can not be displayed in the form of highlighting / flashing, etc. In other embodiments, when the mute control 1114 in the volume control interface 1113 of a speaking user is checked, the user identification information of the user can still be displayed in the form of highlighting / flashing, etc.

[0077] In some embodiments, the volume control interface 1113 may also display a sound waveform diagram of the corresponding user's speaking volume, so that the user of the electronic device can more accurately distinguish the user currently speaking, and facilitate subsequent mute or volume adjustment operations for the specified user's voice. The sound waveform diagram of the user's speaking volume can be a sound waveform diagram generated by the user's electronic device based on the speaking volume collected by the microphone. The sound waveform diagram can be uploaded by the user's electronic device to a server (e.g., a server for a conferencing application) via the Internet, so that other users' electronic devices can display the sound waveform diagram of the user's speaking volume on the volume control interface 1113.

[0078] For example, when there are multiple users speaking, the user of the electronic device can determine the user with the loudest voice based on the sound waveform displayed on each volume control interface 1113, so as to adjust the volume of the user with the loudest voice to further highlight the voice of the user with the loudest voice, or to mute other users with relatively quieter voices.

[0079] In some embodiments, when a mute control 1114 in a volume control interface 1113 is selected, the sound waveform in that volume control interface 1113 can be hidden. In other embodiments, when a mute control 1114 in a volume control interface 1113 is selected, the sound waveform in that volume control interface 1113 can still be displayed normally.

[0080] The call control area 1112 may include one or more controls. For example, the call control area 1112 may include a microphone control, a hang-up control, a speaker control, a camera control, etc. The microphone control can be used to enable or disable the microphone, the hang-up control is used to exit the call, the speaker control is used to enable hands-free calling, mute, and switching the sound playback channel, etc., and the camera control can be used to enable or disable the camera. FIG. 3A The example provided illustrates a call control area 1112 that includes a microphone control, a hang-up control, and a speaker control. The number and functions of the controls included in the call control area 1112 can be set according to actual call needs, and this embodiment does not limit this.

[0081] In some embodiments, such as FIG. 3B As shown, the volume control interface 1113 can also display the user's avatar. Without voiceprint gender recognition, each volume control interface 1113 can display the same default avatar. For example... FIG. 3AAs shown, in the case of performing voiceprint gender recognition, each volume control interface 1113 can display a default avatar of the corresponding gender. For example, user 1 and user 2 are recognized as male voiceprints, and a default male avatar is used; user 3 and user 4 are recognized as female voiceprints, and a default female avatar is used.

[0082] It can be understood that the user avatar displayed by the volume control interface 1113 can also be an account avatar of an access call, and the embodiments of the present application do not limit this.

[0083] In some embodiments, the call adjustment area 1111 can also be designed as a window independent of the call interface 111. In this case, the electronic device can display the call adjustment area 1111 together when displaying the call interface 111. The call adjustment area 1111 can also be set to have a folded state and an unfolded state to reduce the blocking effect on the call interface 111. For example, when the call adjustment area 1111 is in the folded state, the call adjustment area 1111 is displayed in the top middle area of the display screen, and the electronic device can respond to the user's operation of clicking the call adjustment area 1111 to change the call adjustment area 1111 from the folded state to the unfolded state. In other possible embodiments, the electronic device can also respond to the user's operation of clicking the call adjustment area 1111 to display the call adjustment area 1111 in the unfolded state in the form of jumping display or pop-up display. For example, the call adjustment area 1111 in the folded state occupies a smaller screen display area, and the call adjustment area 1111 does not display the volume control interface 1113; the call adjustment area 1111 in the unfolded state occupies a larger screen display area, and the call adjustment area 1111 displays the volume control interface 1113 corresponding to all user voiceprints.

[0084] In FIG. 3B With FIG. 4 In the above embodiments, the volume control interface 1113 is displayed in an array mode, and if the number of user voiceprints recognized by the electronic device changes during the call, the content displayed by the call adjustment area 1111 will change greatly, affecting the user's interface viewing experience. For example, in order to make the call adjustment area 1111 display the volume control interface 1113 corresponding to each recognized user voiceprint, the operation of updating the call adjustment area 1111 includes adding the volume control interface 1113 corresponding to the newly recognized user voiceprint and adjusting the interface size / interface arrangement of the previously displayed volume control interface 1113, resulting in a large change in the content displayed by the call adjustment area 1111.

[0085] As shown, the volume control interface 1113 can also be displayed in a list mode, compared to FIG. 3A the volume control interface 1113 displayed in the array mode. FIG. 3B With FIG. 4The content displayed in the call adjustment area 1111 changes relatively little even when the number of user voiceprints changes, thus improving the user's viewing experience. For example, in list mode, the volume control interface 1113 occupies a small area. For newly recognized user voiceprints, a new volume control interface 1113 corresponding to the newly recognized user voiceprint can be added directly to the call adjustment area 1111 without adjusting the previously displayed volume control interface 1113. Therefore, the content displayed in the call adjustment area 1111 changes relatively little.

[0086] In some embodiments, in list mode, the volume control interface 1113 may display corresponding user identification information but not user avatar, or the volume control interface 1113 may display both corresponding user identification information and user avatar. FIG. 5 to FIG. 10 The following example illustrates the volume control interface 1113, which displays the corresponding user identification information but does not show the user avatar.

[0087] To gain a clearer understanding of the implementation details of call methods on electronic devices, the following section combines... FIG. 5 This section describes the process by which various software and hardware components in an electronic device work together to enable a phone call. Details are as follows:

[0088] The operating system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application uses the layered architecture Android system as an example to illustrate the software structure of the electronic device. FIG. 5 As shown, a layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. Taking the Android system as an example, in some implementations, the Android system is divided into four layers, from top to bottom: the application layer (Apk), the application framework layer (Framework), the hardware abstraction layer (HAL), and the kernel layer (Kernel).

[0089] The application layer can include a series of application packages. For example, an application package can include applications such as calling applications, gallery applications, interface applications, and system applications. Calling applications can include applications that support voice calls as well as applications that support video calls. FIG. 5 Taking a voice call application as an example, the first voice call application is an application that realizes voice calls based on VoIP technology.

[0090] The application framework layer provides an application programming interface (API) and a programming framework for the applications of the application layer. For example, the application framework layer can include a gain issuing module, an audio track module (AudioTrack), an audio processing module (AudioFlinger), and a voiceprint reporting module. The gain issuing module can generate gain adjustment information corresponding to a volume setting instruction issued by the first call application based on the volume setting instruction, and issue the gain adjustment information to the hardware abstraction layer.

[0091] In some embodiments, the downlink call data can include audio call data of one or more user voiceprints. The volume setting instruction can carry a voiceprint number to indicate that the audio call data of the specified voiceprint number is to be adjusted in volume / muted, that is, to adjust the call volume of the specified user or to mute the specified user.

[0092] In some embodiments, the volume setting instruction can also not carry a voiceprint number, in which case it can be used to adjust the volume of the downlink call data, that is, to adjust the volume of all other users (except the user of the electronic device).

[0093] The audio track module can be used to manage and play audio resources. The audio processing module can be used to be responsible for audio mixing, management of input / output stream devices, and processing and transmission of audio streams. The audio track module can serve as a producer of audio call data, and the audio processing module can serve as a consumer of audio call data. The audio track module and the audio processing module cooperate to implement audio playback and management functions. The voiceprint reporting module can be used to report the voiceprint number reported by the hardware abstraction layer to the first call application, so that the first call application can display user identification information. For example, the user identification information can be generated based on the voiceprint number or be the voiceprint number.

[0094] The hardware abstraction layer includes a message issuing module, a pass-through module (OutWrite pass-through), and a message reporting module. The message issuing module can be used to issue the gain adjustment information issued by the gain issuing module to the audio driver of the kernel layer. The pass-through module is used to pass through the downlink call data issued by the audio processing module to the audio driver, that is, the pass-through module directly transmits the downlink call data issued by the audio processing module to the audio driver without additional processing of the downlink call data, and only serves to transfer the downlink call data between different layers. The downlink call data referred to in the embodiments of the present application can refer to the audio call data received by the electronic device and sent by the server. The message reporting module can be used to report the voiceprint number reported by the audio driver to the voiceprint reporting module.

[0095] The kernel layer can include audio drivers, display drivers, and the like. The kernel layer can also include programs closely related to hardware, such as interrupt handlers, device drivers, and the like, and can also include basic, common, and frequently running modules, such as clock management modules, process scheduling modules, and the like, and can also include critical data structures. The kernel layer can be disposed in a processor or fixed in an internal memory.

[0096] The hardware layer can include a display screen, an audio module, a speaker, a microphone, and the like. The audio module can include an audio codec and a digital signal processor (DSP). The digital signal processor can also be an audio digital signal processor (ADSP).

[0097] FIG. 5 Taking the audio module including the digital signal processor as an example, the digital signal processor can be divided into multiple functional units, for example, the digital signal processor includes a gain control unit, a voiceprint extraction unit, a voiceprint recognition unit, a gain processing unit, and a storage unit. The voiceprint extraction unit is configured to extract voiceprint information from downlink call data, and the voiceprint extraction unit can also configure different voiceprint numbers for each extracted voiceprint information. The extracted voiceprint information and the voiceprint number corresponding to the voiceprint information can be saved to the storage unit. After the call ends, the voiceprint information and the voiceprint number stored in the storage unit can be deleted. That is, the storage unit is configured to temporarily store the voiceprint information and the voiceprint number corresponding to the voiceprint information in a call process. After the call ends, the voiceprint information and the voiceprint number stored in the storage unit have no value, and the voiceprint information and the voiceprint number stored in the storage unit can be deleted to save the storage space of the storage unit.

[0098] The voiceprint recognition unit can identify the user voiceprint based on the voiceprint information stored in the storage unit to determine the user corresponding to the extracted voiceprint information. The gain processing unit is configured to perform gain processing on the downlink call data or on the audio call data of a specified voiceprint.

[0099] The gain control unit can transmit the gain adjustment information and the voiceprint number issued by the message issuing module to the voiceprint recognition unit, and the voiceprint recognition unit identifies the user voiceprint corresponding to the voiceprint number in the downlink call data, and then the gain processing unit can perform gain processing on the audio call data corresponding to the voiceprint number in the downlink call data based on the gain adjustment information.

[0100] FIG. 6The plurality of audio links are illustrated as audio link 1, audio link 2, audio link 3 and audio link 4. The audio link 1 is used to play the downlink call data, the audio link 2 is used to adjust the volume of the audio call data of the specified voiceprint, the audio link 3 is used to extract and save the voiceprint information of the downlink call data, and the audio link 4 is used to extract and display the voiceprint information of the downlink call data.

[0101] The audio link 1, the audio link 2, the audio link 3 and the audio link 4 are described in detail below.

[0102] During the call process, the electronic device can receive the downlink call data issued by the server based on the Internet, and the downlink call data can be transmitted to the loudspeaker via the audio link 1 to realize playing the downlink call data by the loudspeaker. Specifically, on the side of the electronic device, the first call application can send the downlink call data to the audio track module, and the audio track module transmits the downlink call data to the audio processing module for processing. For example, the audio track module can write the downlink call data to the shared memory, and the audio processing module reads the downlink call data from the shared memory. The audio processing module can perform processing such as mixing, resampling, sound effect setting, etc. on the downlink call data. The downlink call data processed by the audio processing module is transmitted to the audio driver by the transparent transmission module, and the audio driver can transmit the downlink call data processed by the audio processing module to the voiceprint extraction unit. The voiceprint extraction unit is used to extract the voiceprint information from the downlink call data. The voiceprint information extracted by the voiceprint extraction unit can be stored in the storage unit.

[0103] The voiceprint extraction unit can also transmit the downlink call data processed by the audio processing module to the voiceprint recognition unit. The voiceprint recognition unit is used to recognize the voiceprint information contained in the downlink call data to determine which user voiceprints are contained in the downlink call data. For example, the voiceprint recognition unit can read the voiceprint information stored in the storage unit, and perform voiceprint matching on the voiceprint information contained in the downlink call data based on the read voiceprint information to determine which user voiceprints are contained in the downlink call data. The voiceprint recognition unit can also transmit the downlink call data processed by the audio processing module to the gain processing unit, and the gain processing unit can perform gain processing on the specified audio call data in the downlink call data based on the voiceprint recognition result of the voiceprint recognition unit. The specified audio call data can refer to the audio call data matched with the user voiceprint in the voiceprint recognition result.

[0104] The downlink call data processed by the gain processing unit can be transmitted to the audio codec for decoding and digital-to-analog conversion to drive the loudspeaker to produce sound.

[0105] In some embodiments, the downlink call data processed by the audio codec can also be used to drive the receiver to produce sound, or drive an external earphone to produce sound.

[0106] During the call, the electronic device can also adjust the volume of the audio call data of the specified voiceprint through the audio link ②. Specifically, the first call application can respond to the user's operation of adjusting the volume of the specified voiceprint (for example, the user performs a sliding operation on the volume adjustment control in a certain volume control interface), and issue a volume setting instruction to the gain issuing module. For example, the volume setting instruction can include volume adjustment information and the voiceprint number of the specified voiceprint.

[0107] In some embodiments, since the volume control interface corresponds to each voiceprint number, the first call application can know the voiceprint number corresponding to each volume control interface, and when the user performs a sliding operation on the volume adjustment control in a certain volume control interface, the volume setting instruction issued by the first call application can carry the voiceprint number corresponding to the volume control interface.

[0108] The gain issuing module can generate corresponding gain adjustment information based on the volume setting instruction, and the gain adjustment information can also include the voiceprint number of the specified voiceprint. The gain issuing module can transmit the gain adjustment information to the message issuing module. The message issuing module transmits the gain adjustment information to the gain control unit through the audio driver. The gain control unit transmits the gain adjustment information to the voiceprint recognition unit. The voiceprint recognition unit can be used to identify the user voiceprint corresponding to the voiceprint number in the downlink call data, and then the gain processing unit can perform gain processing on the audio call data corresponding to the voiceprint number in the downlink call data based on the gain adjustment information. The downlink call data processed by the gain processing unit can be transmitted to the audio codec, and the audio codec can perform decoding and digital-to-analog conversion to drive the loudspeaker to produce sound.

[0109] During the call, the electronic device can also extract and save the voiceprint information of the downlink call data through the audio link ③. Specifically, the first call application can send the downlink call data to the audio track module, and the audio track module can pass the downlink call data to the audio processing module for processing. For example, the audio processing module can perform mixing, resampling, sound effect setting and other processing on the downlink call data. The downlink call data processed by the audio processing module is transmitted to the audio driver by the transparent transmission module, and the audio driver can transmit the downlink call data processed by the audio processing module to the voiceprint extraction unit. The voiceprint extraction unit is used to extract voiceprint information from the downlink call data. The voiceprint extraction unit can also set a unique voiceprint number for the extracted voiceprint information. The voiceprint extraction unit can store the extracted voiceprint information and the voiceprint number corresponding to the voiceprint information in the storage unit. For example, before storing a certain voiceprint information and the voiceprint number corresponding to the voiceprint information in the storage unit, the voiceprint extraction unit can first determine whether the storage unit has stored the voiceprint information and the voiceprint number corresponding to the voiceprint information. If the storage unit does not store the voiceprint information and the voiceprint number corresponding to the voiceprint information, the voiceprint extraction unit can store the extracted voiceprint information and the voiceprint number corresponding to the voiceprint information in the storage unit. If the storage unit has stored the voiceprint information and the voiceprint number corresponding to the voiceprint information, the voiceprint extraction unit will not store the voiceprint information and the voiceprint number corresponding to the voiceprint information in the storage unit again, avoiding repeated storage of voiceprint information and saving storage space of the storage unit. After the call ends, the voiceprint extraction unit can also control the storage unit to clear the voiceprint information and voiceprint number stored in the call process.

[0110] During the call, the electronic device can also extract and display the voiceprint information of the downlink call data through the audio link ④. Specifically, the first call application can send the downlink call data to the audio track module, and the audio track module can pass the downlink call data to the audio processing module for processing. For example, the audio processing module can perform mixing, resampling, sound effect setting and other processing on the downlink call data. The downlink call data processed by the audio processing module is transmitted to the audio driver by the transparent transmission module, and the audio driver can transmit the downlink call data processed by the audio processing module to the voiceprint extraction unit. The voiceprint extraction unit is used to extract voiceprint information from the downlink call data. The voiceprint extraction unit can also set a unique voiceprint number for the extracted voiceprint information. The voiceprint extraction unit can also report the voiceprint number of the extracted voiceprint information to the message reporting module through the audio driver. The message reporting module reports the voiceprint number to the voiceprint reporting module, and the voiceprint reporting module reports the voiceprint number to the first call application, so that the first call application can display the corresponding volume control interface in the call adjustment area based on the voiceprint number reported by the voiceprint reporting module, and / or display the user identification information in the volume control interface in the form of highlighting / flashing.

[0111] For example, if the voiceprint number reported by the voiceprint reporting module is a new voiceprint number (e.g., a voiceprint number that has not been reported previously in the current call process), the first call application can add a volume control interface corresponding to the voiceprint number in the call adjustment area based on the voiceprint number reported by the voiceprint reporting module, and display the user identification information in the volume control interface in the form of highlighting / flashing, etc., to visually represent that the user corresponding to the volume control interface is speaking, and to perform a mute or volume adjustment operation on the user corresponding to the volume control interface. If the voiceprint number reported by the voiceprint reporting module is a voiceprint number that has been reported previously, it is represented that the volume control interface corresponding to the voiceprint number has been displayed in the call adjustment area previously, and the first call application can display the user identification information in the volume control interface in the form of highlighting / flashing based on the reported voiceprint number, to visually represent that the user corresponding to the volume control interface is speaking.

[0112] It can be understood that the above software structure is only exemplary and does not constitute a limitation on the software structure of the electronic device, and in other embodiments, the electronic device can also have more or less structures, which are not limited in the present application.

[0113] In order to more intuitively understand the process of cooperation between the above-mentioned software modules to realize the call function of the electronic device, the following will take the interactive diagram shown in FIG. 7 and FIG. 6 as an example to introduce the processing process of the electronic device based on VoIP technology to realize the call.

[0114] As shown in FIG. 3A , it is an interactive process of each software and hardware module to realize the playing of downlink call data and the extraction and display of voiceprint information.

[0115] 601: The first call application displays a call interface in response to the operation of the user.

[0116] In some embodiments, the first call application can refer to an application that realizes a call function based on VoIP technology, and the call function can include a voice call function and / or a video call function. The first call application can display a call interface in response to the operation of the user on the interface thereof. For example, the operation of the user can refer to the operation of making a call, the operation of answering a call, or the operation of joining an online conference, etc.

[0117] As shown in FIG. 7 , the call interface can include a call adjustment area and a call control area. The call adjustment area can also be a window independent of the call interface.

[0118] 602: The first call application sends the downlink call data to the audio track module.

[0119] In some embodiments, the first call application can receive the downlink call data issued by the server in the case that the electronic device accesses the Internet.

[0120] 603: The audio track module sends the downlink call data to the audio processing module.

[0121] 604: The audio processing module processes the downlink call data.

[0122] In some embodiments, the audio processing module can perform one or more of the following processing on the downlink call data: mixing, resampling, sound effect setting, etc.

[0123] 605: The audio processing module sends the processed downlink call data to the pass-through module.

[0124] 606: The pass-through module sends the downlink call data to the audio driver.

[0125] 607: The audio driver sends the downlink call data to the voiceprint extraction unit.

[0126] 608: The voiceprint extraction unit extracts the voiceprint information of the user from the downlink call data, and configures a corresponding voiceprint number for the extracted voiceprint information.

[0127] In some embodiments, the voiceprint extraction unit can extract the voiceprint information of the user from the downlink call data using a related voiceprint extraction algorithm. One voiceprint information corresponds to one voiceprint number, and different voiceprint information corresponds to different voiceprint numbers.

[0128] 609: The voiceprint extraction unit stores the voiceprint information and the voiceprint number corresponding to the voiceprint information in the storage unit.

[0129] 610: The voiceprint extraction unit sends the downlink call data to the voiceprint recognition unit.

[0130] The interaction flow 610 and the interaction flow 609 of the embodiments of the present application can be executed in parallel, or the interaction flow 610 can be executed before the interaction flow 609.

[0131] 611: The voiceprint recognition unit reads the voiceprint information from the storage unit, and performs voiceprint recognition on the downlink call data based on the read voiceprint information.

[0132] In some embodiments, the voiceprint recognition unit can read the voiceprint information stored in the storage unit, and perform voiceprint matching on the voiceprint information contained in the downlink call data based on the read voiceprint information, to determine which user voiceprints are contained in the downlink call data.

[0133] 612: The voiceprint recognition unit sends the downlink call data and the voiceprint recognition result to the gain processing unit.

[0134] 613: The gain processing unit performs gain processing on the downlink call data based on the voiceprint recognition result.

[0135] In some embodiments, the gain processing unit can perform gain processing on specified audio call data in the downlink call data based on the voiceprint recognition result of the voiceprint recognition unit. The specified audio call data can refer to audio call data that matches the user voiceprint in the voiceprint recognition result, and other non-matching audio call data can not be gain-processed, and the influence of noise interference can be reduced.

[0136] 614: The gain processing unit sends the processed downlink call data to the audio codec.

[0137] 615: The audio codec processes the downlink call data to drive the speaker to sound.

[0138] In some embodiments, the audio codec can perform decoding and digital-to-analog conversion processing on the downlink call data to obtain an analog audio signal for driving the speaker to sound.

[0139] In some embodiments, the downlink call data processed by the audio codec can also be used to drive the receiver to sound, or to drive the external earphone to sound.

[0140] 616: The voiceprint extraction unit reports the voiceprint number corresponding to the extracted voiceprint information to the audio driver.

[0141] The interaction process 616 of the embodiments of the present application can be executed in parallel with the interaction process 609, or the interaction process 616 can be executed before the interaction process 609.

[0142] 617: The audio driver reports the voiceprint number to the message reporting module.

[0143] 618: The message reporting module reports the voiceprint number to the voiceprint reporting module.

[0144] 619: The voiceprint reporting module reports the voiceprint number to the first call application.

[0145] 620: The first call application updates the call interface based on the voiceprint number.

[0146] In some embodiments, if the voiceprint number reported by the voiceprint reporting module is a new voiceprint number, the first call application can add a volume control interface corresponding to the voiceprint number in the call adjustment area based on the voiceprint number reported by the voiceprint reporting module, and display the user identification information in the volume control interface in the form of highlighting / flashing, etc. If the voiceprint number reported by the voiceprint reporting module is a voiceprint number that has been reported previously, indicating that the volume control interface corresponding to the voiceprint number has been displayed in the call adjustment area previously, the first call application can display the user identification information in the volume control interface in the form of highlighting / flashing, etc. based on the reported voiceprint number.

[0147] As shown in FIG. 3A , an interactive process for implementing volume adjustment of audio call data of a specified voiceprint by various software and hardware modules.

[0148] 701: The first call application displays a call interface in response to a first operation of a user.

[0149] The interactive process 701 of the embodiments of the present application is similar to the interactive process 601 of the foregoing embodiments, and thus will not be described again here to avoid repetition.

[0150] 702: The first call application issues a volume setting instruction to the gain issuing module in response to a second operation of the user on the call interface.

[0151] In some embodiments, the second operation can be an operation of the user to adjust the volume of a specified voiceprint. For example, the volume setting instruction can include volume adjustment information and a specified voiceprint number corresponding to the specified voiceprint. As shown in FIG. 8 , when the user performs a sliding operation on the volume adjustment control in a certain volume control interface, the first call application can issue a volume setting instruction containing volume adjustment information and a specified voiceprint number to the gain issuing module.

[0152] 703: The gain issuing module generates corresponding gain adjustment information based on the volume setting instruction.

[0153] In some embodiments, the gain adjustment information can include a gain adjustment value and a specified voiceprint number.

[0154] In some embodiments, when the user performs a sliding operation on the volume adjustment control in a certain volume control interface, the first call application can also issue a volume setting instruction containing a gain adjustment value and a specified voiceprint number to the gain issuing module, that is, the interactive process 703 can be omitted.

[0155] 704: The gain issuing module sends the gain adjustment information to the message issuing module.

[0156] 705: The message issuing module sends the gain adjustment information to the audio driver.

[0157] 706: The audio driver sends the gain adjustment information to the gain control unit.

[0158] 707: The gain control unit sends the gain adjustment information to the voiceprint recognition unit.

[0159] 708: The voiceprint recognition unit reads the voiceprint information and the voiceprint number from the storage unit, and determines the voiceprint information corresponding to the specified voiceprint number in the gain adjustment information based on the read voiceprint information and the voiceprint number.

[0160] 709: The voiceprint recognition unit sends the voiceprint information corresponding to the specified voiceprint number to the gain processing unit.

[0161] 710: The gain processing unit performs gain processing on the audio call data corresponding to the voiceprint information in the downlink call data based on the voiceprint information corresponding to the specified voiceprint number.

[0162] In some embodiments, the gain processing unit performs gain processing on the audio call data corresponding to the voiceprint information in the downlink call data based on the voiceprint information corresponding to the specified voiceprint number, to highlight or weaken the speaking voice of a specified user.

[0163] 711: The gain processing unit sends the processed downlink call data to the audio codec.

[0164] The interaction flow 711 of the embodiments of the present application is similar to the interaction flow 614 of the foregoing embodiments, and thus will not be described here again to avoid repetition.

[0165] 712: The audio codec processes the downlink call data to drive the loudspeaker to emit sound.

[0166] The interaction flow 712 of the embodiments of the present application is similar to the interaction flow 615 of the foregoing embodiments, and thus will not be described here again to avoid repetition.

[0167] Please refer to FIG. 8 Take the call application at the application layer as the second call application, which is an application for realizing voice call based on a cellular network.

[0168] The application framework layer includes a gain issuing module and a voiceprint reporting module. The gain issuing module can generate gain adjustment information corresponding to a volume setting instruction issued by the second call application based on the volume setting instruction, and issue the gain adjustment information to the hardware abstraction layer.

[0169] In some embodiments, the volume setting instruction can carry a voiceprint number to indicate that the audio call data of the specified voiceprint number is to be adjusted in volume / muted, i.e., to adjust the call volume of a specified user or mute the specified user.

[0170] In some embodiments, the volume setting command may not carry a voiceprint number. In this case, it can be used to adjust the volume of downlink call data, that is, to adjust the volume of all other users (except the user of the electronic device).

[0171] The voiceprint reporting module can be used to report the voiceprint ID reported by the hardware abstraction layer to the second call application, enabling the second call application to display user identification information. For example, the user identification information can be generated based on the voiceprint ID, or it can be the voiceprint ID itself.

[0172] The hardware abstraction layer includes a message sending module and a message reporting module. The message sending module can be used to send the gain adjustment information sent by the gain sending module to the audio driver in the kernel layer. The message reporting module can be used to report the voiceprint number reported by the audio driver to the voiceprint reporting module.

[0173] The kernel layer may contain audio drivers, display drivers, etc.

[0174] The hardware layer can include displays, audio modules, speakers, microphones, etc.

[0175] FIG. 5 Taking an audio module that includes a digital signal processor as an example, the digital signal processor may include a gain control unit, a voiceprint extraction unit, a voiceprint recognition unit, a gain processing unit, and a storage unit. A description of each functional unit in the digital signal processor can be found above; to avoid repetition, it will not be repeated here.

[0176] Compared to FIG. 8 , FIG. 8 The electronic devices included are modems, which exchange signals with base stations to enable functions such as making and receiving phone calls, sending and receiving text messages. The modem is independent of the Android system.

[0177] In some embodiments, the modem may include a protocol processing unit and a decoding unit. The protocol processing unit may be used to demodulate and parse the downlink call data transmitted by the base station. The decoding unit may be used to decode and verify the downlink call data processed by the protocol processing unit.

[0178] FIG. 9 Multiple audio links are illustrated: audio link ⑤, audio link ⑥, audio link ⑦, and audio link ⑧. Audio link ⑤ is used to play downlink call data; audio link ⑥ is used to adjust the volume of audio call data for a specified voiceprint; audio link ⑦ is used to extract and save the voiceprint information of downlink call data; and audio link ⑧ is used to extract and display the voiceprint information of downlink call data.

[0179] The audio link 5, the audio link 6, the audio link 7 and the audio link 8 are described in detail as follows.

[0180] During the call, the electronic device can receive the downlink call data issued by the base station based on the modem, and the downlink call data can be transmitted to the loudspeaker via the audio link 5 to realize playing the downlink call data by the loudspeaker. Specifically, on the side of the electronic device, the protocol processing unit is configured to demodulate and protocol analyze the downlink call data. The downlink call data processed by the protocol processing unit is decoded and checked by the decoding unit. The downlink call data processed by the decoding unit is transmitted to the voiceprint extraction unit. The voiceprint extraction unit is configured to extract voiceprint information from the downlink call data. The voiceprint information extracted by the voiceprint extraction unit can be stored in the storage unit.

[0181] The voiceprint extraction unit can also transmit the downlink call data processed by the decoding unit to the voiceprint recognition unit. The voiceprint recognition unit is configured to recognize the voiceprint information contained in the downlink call data to determine which user voiceprints are contained in the downlink call data. For example, the voiceprint recognition unit can read the voiceprint information stored in the storage unit, and perform voiceprint matching on the voiceprint information contained in the downlink call data based on the read voiceprint information to determine which user voiceprints are contained in the downlink call data. The voiceprint recognition unit can also transmit the downlink call data processed by the decoding unit to the gain processing unit, and the gain processing unit can perform gain processing on the specified audio call data in the downlink call data based on the voiceprint recognition result of the voiceprint recognition unit. The specified audio call data can refer to the audio call data matched with the user voiceprint in the voiceprint recognition result.

[0182] The downlink call data processed by the gain processing unit can be transmitted to the audio codec for decoding and digital-to-analog conversion to drive the loudspeaker to produce sound.

[0183] In some embodiments, the downlink call data processed by the audio codec can also be used to drive the receiver to produce sound, or to drive the external earphone to produce sound.

[0184] During the call, the electronic device can also adjust the volume of the audio call data of the specified voiceprint through the audio link ⑥. Specifically, the second call application can respond to the user's operation of adjusting the volume of the specified voiceprint (for example, the user performs a sliding operation on the volume adjustment control in a certain volume control interface) and issue a volume setting instruction to the gain issuing module. For example, the volume setting instruction can include volume adjustment information and the voiceprint number of the specified voiceprint. The gain issuing module can generate corresponding gain adjustment information based on the volume setting instruction, and the gain adjustment information can also include the voiceprint number of the specified voiceprint. The gain issuing module can transmit the gain adjustment information to the message issuing module. The message issuing module transmits the gain adjustment information to the gain control unit through the audio driver. The gain control unit transmits the gain adjustment information to the voiceprint recognition unit. The voiceprint recognition unit can be used to identify the user voiceprint corresponding to the voiceprint number in the downlink call data, and then the gain processing unit can perform gain processing on the audio call data corresponding to the voiceprint number in the downlink call data based on the gain adjustment information. The downlink call data processed by the gain processing unit can be transmitted to the audio codec for decoding and digital-to-analog conversion to drive the loudspeaker to sound.

[0185] During the call, the electronic device can also extract and save the voiceprint information of the downlink call data through the audio link ⑦. Specifically, the protocol processing unit is used to demodulate, protocol analyze and process the downlink call data. The downlink call data processed by the protocol processing unit is decoded, checked and processed by the decoding unit. The downlink call data processed by the decoding unit is transmitted to the voiceprint extraction unit. The voiceprint extraction unit is used to extract voiceprint information from the downlink call data. The voiceprint extraction unit can also set a unique voiceprint number for the extracted voiceprint information. The voiceprint extraction unit can store the extracted voiceprint information and the voiceprint number corresponding to the voiceprint information in the storage unit. After the call ends, the voiceprint extraction unit can also control the storage unit to clear the voiceprint information and voiceprint number stored in the current call process.

[0186] During the call, the electronic device can also extract and display the voiceprint information of the downlink call data through the audio link ⑧. Specifically, the protocol processing unit is configured to demodulate and protocol analyze the downlink call data. The downlink call data processed by the protocol processing unit is decoded and checked by the decoding unit. The downlink call data processed by the decoding unit is transmitted to the voiceprint extraction unit. The voiceprint extraction unit is configured to extract the voiceprint information from the downlink call data. The voiceprint extraction unit can also set a unique voiceprint number for the extracted voiceprint information. The voiceprint extraction unit can also report the voiceprint number of the extracted voiceprint information to the message reporting module through the audio driver. The message reporting module reports the voiceprint number to the voiceprint reporting module, and the voiceprint reporting module reports the voiceprint number to the second call application, so that the second call application can display the corresponding volume control interface in the call adjustment area based on the voiceprint number reported by the voiceprint reporting module, and / or highlight / flash the user identification information in the volume control interface.

[0187] For example, if the voiceprint number reported by the voiceprint reporting module is a new voiceprint number, the second call application can add a volume control interface corresponding to the voiceprint number in the call adjustment area based on the voiceprint number reported by the voiceprint reporting module, and highlight / flash the user identification information in the volume control interface, so as to visually represent that the user corresponding to the volume control interface is speaking, and to perform mute or volume adjustment operation on the user corresponding to the volume control interface. If the voiceprint number reported by the voiceprint reporting module is a voiceprint number that has been reported previously, indicating that the volume control interface corresponding to the voiceprint number has been displayed in the call adjustment area previously, the second call application can highlight / flash the user identification information in the volume control interface based on the reported voiceprint number, so as to visually represent that the user corresponding to the volume control interface is speaking.

[0188] It can be understood that the above software structure is only exemplary and does not constitute a limitation on the software structure of the electronic device. In other embodiments, the electronic device can also have more or less structures, and the present application does not limit this.

[0189] In order to more intuitively understand the process of cooperation between the above-mentioned software modules to realize the call function of the electronic device, the following will take the interaction diagram shown in FIG. 10 and FIG. 9 as an example to introduce the processing process of the electronic device based on the cellular network to realize the call.

[0190] As shown in FIG. 3A , it is the interaction process of each software and hardware module to realize the playing of downlink call data and the extraction and display of voiceprint information.

[0191] 901: The second call application displays a call interface in response to the user's operation.

[0192] In some embodiments, the second call application can be an application that implements a call function based on a cellular network, which can include a voice call function and / or a video call function. The second call application can display a call interface in response to a user operation on an interface thereof.

[0193] As shown in FIG. 8, the call interface can include a call adjustment area and a call control area. The call adjustment area can also be a window independent of the call interface. FIG. 10

[0194] 902: The protocol processing unit acquires downlink call data and processes the downlink call data.

[0195] In some embodiments, after the call link is established, the modem can receive downlink call data issued by the base station. The protocol processing unit in the modem can process the downlink call data, such as demodulation and protocol analysis.

[0196] 903: The protocol processing unit sends the processed downlink call data to the decoding unit.

[0197] 904: The decoding unit processes the downlink call data.

[0198] In some embodiments, the decoding unit can process the downlink call data, such as decoding and checking.

[0199] 905: The decoding unit sends the processed downlink call data to the voiceprint extraction unit.

[0200] 906: The voiceprint extraction unit extracts voiceprint information of a user from the downlink call data and configures a corresponding voiceprint number for the extracted voiceprint information.

[0201] In some embodiments, the voiceprint extraction unit can extract the voiceprint information of the user from the downlink call data by using a related voiceprint extraction algorithm. One voiceprint information corresponds to one voiceprint number, and different voiceprint information corresponds to different voiceprint numbers.

[0202] 907: The voiceprint extraction unit stores the voiceprint information and the voiceprint number corresponding to the voiceprint information in the storage unit.

[0203] 908: The voiceprint extraction unit sends the downlink call data to the voiceprint recognition unit.

[0204] The interaction process 908 and the interaction process 907 of the embodiments of the present application can be executed simultaneously, or the interaction process 908 can be executed before the interaction process 907.

[0205] ​909: The voiceprint recognition unit reads the voiceprint information from the storage unit, and performs voiceprint recognition on the downlink call data based on the read voiceprint information.

[0206] In some embodiments, the voiceprint recognition unit can read the voiceprint information stored by the storage unit, perform voiceprint matching on the voiceprint information contained in the downlink call data based on the read voiceprint information, so as to determine which user voiceprints are contained in the downlink call data.

[0207] 910: The voiceprint recognition unit sends the downlink call data and the voiceprint recognition result to the gain processing unit.

[0208] 911: The gain processing unit performs gain processing on the downlink call data based on the voiceprint recognition result.

[0209] In some embodiments, the gain processing unit can perform gain processing on specified audio call data in the downlink call data based on the voiceprint recognition result of the voiceprint recognition unit. The specified audio call data can refer to the audio call data matched with the user voiceprints in the voiceprint recognition result, and other unmatched audio call data can not be gain-processed, so as to reduce the interference of noise.

[0210] 912: The gain processing unit sends the processed downlink call data to the audio codec.

[0211] 913: The audio codec processes the downlink call data to drive the loudspeaker to emit sound.

[0212] In some embodiments, the audio codec can perform decoding and digital-to-analog conversion processing on the downlink call data to obtain an analog audio signal used to drive the loudspeaker to emit sound.

[0213] In some embodiments, the downlink call data processed by the audio codec can also be used to drive the receiver to emit sound, or drive the external earphone to emit sound.

[0214] 914: The voiceprint extraction unit reports the voiceprint number corresponding to the extracted voiceprint information to the audio driver.

[0215] The interaction process 914 of the embodiments of the present application can be executed in parallel with the interaction process 907, or the interaction process 914 can be executed before the interaction process 907.

[0216] 915: The audio driver reports the voiceprint number to the message reporting module.

[0217] 916: The message reporting module reports the voiceprint number to the voiceprint reporting module.

[0218] 917: The voiceprint reporting module reports the voiceprint number to the second call application.

[0219] 918: The second call application updates the call interface based on the voiceprint number.

[0220] In some embodiments, if the voiceprint number reported by the voiceprint reporting module is a new voiceprint number, the second call application can add a volume control interface corresponding to the voiceprint number in the call adjustment area based on the voiceprint number reported by the voiceprint reporting module, and display the user identification information in the volume control interface in the form of highlighting / flashing, etc. If the voiceprint number reported by the voiceprint reporting module is a voiceprint number that has been reported previously, indicating that the volume control interface corresponding to the voiceprint number has been displayed in the call adjustment area previously, the second call application can display the user identification information in the volume control interface in the form of highlighting / flashing based on the reported voiceprint number.

[0221] As shown in FIG. 3A , an interactive process for implementing volume adjustment of audio call data of a specified voiceprint by various software and hardware modules.

[0222] 1001: The second call application displays a call interface in response to a first operation of a user.

[0223] The interactive process 1001 of the embodiments of the present application is similar to the interactive process 901 of the foregoing embodiments, and thus will not be described again here to avoid repetition.

[0224] 1002: The second call application issues a volume setting instruction to the gain issuing module in response to a second operation of a user on the call interface.

[0225] In some embodiments, the second operation can be an operation of the user to adjust the volume of a specified voiceprint. For example, the volume setting instruction can include volume adjustment information and a specified voiceprint number corresponding to the specified voiceprint. As shown in FIG. 11 , when the user performs a sliding operation on the volume adjustment control in a certain volume control interface, the first call application can issue a volume setting instruction containing volume adjustment information and a specified voiceprint number to the gain issuing module.

[0226] 1003: The gain issuing module generates corresponding gain adjustment information based on the volume setting instruction.

[0227] In some embodiments, the gain adjustment information can include a gain adjustment value and a specified voiceprint number.

[0228] In some embodiments, when the user performs a sliding operation on the volume adjustment control in a certain volume control interface, the second call application can also issue a volume setting instruction containing a gain adjustment value and a specified voiceprint number to the gain issuing module, that is, the interactive process 1003 can be omitted.

[0229] 1004: The gain issuing module sends the gain adjustment information to the message issuing module.

[0230] 1005: The message issuing module sends the gain adjustment information to the audio driver.

[0231] 1006: The audio driver sends the gain adjustment information to the gain control unit.

[0232] 1007: The gain control unit sends the gain adjustment information to the voiceprint recognition unit.

[0233] 1008: The voiceprint recognition unit reads the voiceprint information and the voiceprint number from the storage unit, and determines the voiceprint information corresponding to the specified voiceprint number in the gain adjustment information based on the read voiceprint information and the voiceprint number.

[0234] 1009: The voiceprint recognition unit sends the voiceprint information corresponding to the specified voiceprint number to the gain processing unit.

[0235] 1010: The gain processing unit performs gain processing on the audio call data corresponding to the voiceprint information in the downlink call data based on the voiceprint information corresponding to the specified voiceprint number.

[0236] In some embodiments, the gain processing unit performs gain processing on the audio call data corresponding to the voiceprint information in the downlink call data based on the voiceprint information corresponding to the specified voiceprint number, to highlight or weaken the speaking voice of a specified user.

[0237] 1011: The gain processing unit sends the processed downlink call data to the audio codec.

[0238] The interaction flow 1011 of the embodiments of the present application is similar to the interaction flow 912 of the foregoing embodiments, and thus will not be described here again to avoid repetition.

[0239] 1012: The audio codec processes the downlink call data to drive the loudspeaker to emit sound.

[0240] The interaction flow 1012 of the embodiments of the present application is similar to the interaction flow 913 of the foregoing embodiments, and thus will not be described here again to avoid repetition.

[0241] Reference is made to FIG. 11As shown, the first electronic device 100 related to the embodiments of the present application is introduced below. The first electronic device 100 in the embodiments of the present application can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a large screen, a smart television, a netbook, and a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) \ virtual reality (VR) device, and the like, which includes a speaker (or a receiver, or a headset interface) and a display screen. The embodiments of the present application do not specially limit the specific form of the electronic device. Please refer to FIG. 11 , ​ FIG. 1 is a structural schematic diagram of the first electronic device 100 provided by the embodiments of the present application. It can be understood that the second electronic device 200 and the third electronic device can have the same or different structure as the first electronic device 100.

[0242] The first electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like.

[0243] The microphone 170C can be used to collect sound signals so that the other party can hear the speaking voice of the user of the first electronic device 100. The audio module 170 can include an audio codec and an audio digital signal processor. The audio digital signal processor can be used to realize the functions of extracting voiceprint information, identifying user voiceprint, and gain control of audio call data. The audio codec can be used to realize the decoding and digital-to-analog conversion of audio call data.

[0244] In some embodiments, the call scenario can include a hand-held call mode, a headset call mode, and a speakerphone call mode. The speaker 170A can be used to play the voice of the other party in the speakerphone call mode. The receiver 170B can be used to play the voice of the other party in the hand-held call mode. The earphone interface 170D is used to access the earphone to play the voice of the other party through the accessed earphone in the earphone call mode.

[0245] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0246] In addition, an operating system runs on the above-mentioned components. For example, the iOS operating system developed by Apple Inc., the Android open source operating system developed by Google Inc., the Windows operating system developed by Microsoft Corporation, etc.

[0247] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0248] The memory in the processor 110 can also be provided for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. Avoiding repeated access, reducing the waiting time of the processor 110, thus improving the efficiency of the system.

[0249] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0250] The wireless communication function of the first electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0251] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the first electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with tuning switches.

[0252] The mobile communication module 150 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied on the first electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert the signals into electromagnetic waves radiated by the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be arranged in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be arranged in the same device.

[0253] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the first electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be transmitted from the processor 110, frequency-modulate them, amplify them, and radiate them as electromagnetic waves via the antenna 2.

[0254] In some embodiments, the antenna 1 and the mobile communication module 150 of the first electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the first electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0255] The first electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0256] The display screen 194 is configured to display images, videos, and the like. The display screen 194 can also be configured to display a call interface and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oled, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the first electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1. In some embodiments, the display screen 194 can be a touch screen. That is, the display screen 194 can include a touch sensor 180K.

[0257] The internal memory 121 can include one or more random access memories (RAMs) and one or more non-volatile memories (NVMs). The random access memory can include a static random-access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM, such as a fifth generation DDR SDRAM commonly referred to as a DDR5 SDRAM), or the like; the non-volatile memory can include a magnetic disk storage device, a flash memory.

[0258] The flash memory can include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to operation principles, and can include single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to storage unit potential order, and can include universal flash storage (UFS) and embedded multi media Card (eMMC), etc. according to storage specifications.

[0259] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (for example, machine instructions) of an operating system or other programs running, and can also be used to store data of users and application programs, etc.

[0260] The non-volatile memory can also store executable programs and data of users and application programs, etc., and can be loaded into the random access memory in advance for direct reading and writing by the processor 110.

[0261] The external memory interface 120 can be used to connect an external non-volatile memory, to realize the expansion of the storage capacity of the first electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to realize the data storage function.

[0262] The call method in the above embodiments can be implemented in the first electronic device 100 with the above hardware structure.

[0263] The embodiment also provides a computer readable storage medium, which stores computer instructions, and when the computer instructions run on the first electronic device 100, the first electronic device 100 executes the related method steps to realize the call method in the above embodiments.

[0264] The embodiment also provides a computer program product, which, when running on a computer, causes the computer to execute the above related steps to realize the call method in the above embodiments.

[0265] The embodiment also provides a chip system, which is coupled with a memory, and the chip system is used to read and execute a computer program stored in the memory to realize the call method in the above embodiments.

[0266] Those skilled in the art can clearly understand the above-mentioned technical solutions from the description of the above-embodiment, and for the convenience and brevity of description, only the above-mentioned division of functional modules is taken as an example, and in actual application, the above-mentioned functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0267] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiment described above is only illustrative, for example, the division of the module or unit is only a logical function division, and in actual implementation, there can be another division way, for example, a plurality of units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0268] The unit described as a separate component can or can not be physically separated, and the component shown as a unit can be one physical unit or multiple physical units, that is, it can be located in one place or distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0269] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0270] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application essentially or say the part that contributes to the prior art or all or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions to make a device (which can be a single-chip microcomputer, a chip, etc.) or a processor execute all or part of the steps of the method of the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and various program code storage media.

[0271] The above examples are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing examples, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing examples, or make equivalent replacements for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A communication method applied to a first electronic device, characterized in that, The first electronic device includes a first audio signal processing link and a second audio signal processing link, and the method includes: In response to a first operation by a first user, a first volume control interface and a second volume control interface are displayed. The first volume control interface corresponds to the second user, and the second volume control interface corresponds to the third user. The first volume control interface includes a first control, and the second volume control interface includes a second control. Based on the first audio signal processing link, voiceprint information is extracted from the received downlink call data, and a corresponding voiceprint number is configured for each extracted voiceprint information. In response to a second operation by the first user on the first control, the call volume of the second user is adjusted, and / or, in response to a second operation by the first user on the second control, the call volume of the third user is adjusted; The step of adjusting the call volume of the second user in response to the second user's second operation on the first control includes: In response to the second operation on the first control, the voiceprint number of the second user and the volume adjustment information corresponding to the second operation are obtained, and based on the volume adjustment information and the voiceprint number of the second user, the second audio signal processing link is used to perform volume adjustment processing on the audio call data of the second user contained in the downlink call data.

2. The call method as described in claim 1, characterized in that, The first volume control interface further includes a third control, which is used to trigger mute or unmute, and the method further includes: In response to a third operation by the first user on the third control, the third control transitions from a first state to a second state, wherein the first state indicates that the second user is not muted and the second state indicates that the second user is muted.

3. The call method as described in claim 2, characterized in that, The first state is the unselected state, and the second state is the selected state.

4. The call method as described in claim 1, characterized in that, The second operation is a swipe operation. The step of adjusting the call volume of the second user in response to the second user's second operation on the first control includes: In response to the first user's sliding operation on the first control along the first direction, the call volume of the second user is increased; In response to the first user's sliding operation on the first control along a second direction, the call volume of the second user is reduced, wherein the first direction is opposite to the second direction; The step of adjusting the call volume of the third user in response to the second operation of the first user on the second control includes: In response to the first user's sliding operation on the second control along the first direction, the call volume of the third user is increased; In response to the first user's sliding operation on the second control along the second direction, the call volume of the third user is reduced.

5. The call method as described in any one of claims 1 to 4, characterized in that, The first volume control interface also includes a user identifier corresponding to the second user, and the method further includes: When the audio call data being played includes the audio call data of the second user, the user identifier is displayed in a first style; If the audio call data being played does not include the audio call data of the second user, the user identifier is displayed in a second style, which is different from the first style.

6. The call method as described in claim 1, characterized in that, The response to the first user's first operation, displaying a first volume control interface and a second volume control interface, includes: In response to the first user's first operation, a call interface is displayed, the call interface including the first volume control interface and the second volume control interface.

7. The call method as described in claim 1, characterized in that, The response to the first user's first operation, displaying a first volume control interface and a second volume control interface, includes: In response to the first user's first operation, a call interface and a volume control window are displayed, the volume control window partially overlapping the call interface, and the volume control window includes the first volume control interface and the second volume control interface.

8. The call method as described in claim 6 or 7, characterized in that, The first operation includes answering a phone call, making a phone call, or joining a meeting.

9. The call method as described in claim 6 or 7, characterized in that, The call interface includes a cellular network-based call interface or an Internet Protocol Voice over IP (VoIP)-based call interface.

10. The call method as described in claim 9, characterized in that, The first electronic device further includes a preset storage area, in which the voiceprint information and the corresponding voiceprint number are stored. The step of adjusting the volume of the audio call data of the second user contained in the downlink call data using the second audio signal processing link, based on the volume adjustment information and the second user's voiceprint number, includes: Based on the voiceprint ID of the second user and the voiceprint information and voiceprint ID stored in the preset storage area, the voiceprint information of the second user is determined; Based on the volume adjustment information and the voiceprint information of the second user, the second audio signal processing link is used to perform volume adjustment processing on the audio call data of the second user contained in the downlink call data.

11. The call method as described in claim 1, characterized in that, The first electronic device further includes a third audio signal processing link, and the method further includes: The third audio signal processing link is used to display the voiceprint number on the corresponding volume control interface.

12. The call method as described in claim 10, characterized in that, When the first electronic device establishes a call, it stores the voiceprint information and the corresponding voiceprint number in the preset storage area. The method further includes: When the call ends, delete the voiceprint information and voiceprint number stored in the preset storage area.

13. The call method as described in any one of claims 1 to 4, characterized in that, A call connection is established between the first electronic device and the second electronic device, wherein the first electronic device corresponds to the first user, and the second electronic device corresponds to the second user and the third user.

14. The call method as described in any one of claims 1 to 4, characterized in that, A call connection is established between the first electronic device, the second electronic device, and the third electronic device, wherein the first electronic device corresponds to the first user, the second electronic device corresponds to the second user, and the third electronic device corresponds to the third user.

15. An electronic device, characterized in that, The electronic device includes a display screen, a memory, and a processor; The display screen and the memory are both coupled to the processor; The memory is used to store program instructions; The processor is configured to read the program instructions stored in the memory to implement the call method as described in any one of claims 1 to 14.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-readable instructions, which, when executed by a processor, implement the call method as described in any one of claims 1 to 14.

17. A computer program product, the computer program product comprising computer-readable instructions, characterized in that, When the computer-readable instructions are executed by the processor, the call method as described in any one of claims 1 to 14 is implemented.

Images