Voice communication method and electronic equipment

By receiving and processing the spatial position information of the session end in a voice call and performing spatial playback of audio data, the problem of overlapping audio and image positions in voice calls is solved, the authenticity and efficiency of the call is improved, and low-cost hardware is realized Dependency.

CN119071394APending Publication Date: 2024-12-03BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310632881.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-31
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In a voice call scenario, the overlap of audio and video positions of the voice information on the conversation end leads to auditory fatigue, affecting the call efficiency.

Method used

By receiving voice call information from different session ends, determining its spatial position information, and performing spatial playback of the audio data based on the relative orientation information, enhancing the directional sense of the audio data and realizing the auditory spatial sense.

Benefits of technology

It improves the authenticity and user experience of voice calls, reduces hardware dependence, and has lower costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071394A_ABST
    Figure CN119071394A_ABST
Patent Text Reader

Abstract

The invention relates to a voice communication method and electronic equipment. The voice call method comprises the following steps: receiving voice call information from different session ends; determining spatial position information of a session end corresponding to the voice call information, wherein the spatial position information is relative azimuth information of the session end relative to a home terminal; according to the relative azimuth information of the session end relative to the home end, performing spatial playback processing on the audio data of the voice call information; and playing the audio data subjected to spatial playback processing for voice communication. According to the method, the sense of direction of the audio data of the voice call information can be increased, the sense of auditory space of the voice call information is realized, the sense of reality of the voice call is increased, the user experience of the voice call is improved, and the method is low in dependence on hardware and easy to implement. And only a dual-track earphone or a dual-track loudspeaker is needed to be arranged at the playing end, so that the implementation cost is relatively low.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of voice call technology, and in particular to a voice call method and electronic equipment. Background Art

[0002] With the rapid expansion of the application scope of voice calls, its applicable scenarios cover a wide range. Online remote conferencing is one of the main applications of voice calls, which can be seen everywhere from government agencies to various enterprises. In related technologies, each session end in a voice call scenario usually uses relatively simple audio hardware such as headphones or simple speakers or single microphones for uplink and downlink calls. During the call, the sound and image positions of the sounds heard by any session end from other different session ends will overlap. Without paying attention to the notes of other session ends, it is difficult to distinguish the voice call information from different session ends, which will cause auditory fatigue to the participants, thereby affecting the efficiency of voice calls. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a voice call method and an electronic device.

[0004] According to a first aspect of an embodiment of the present disclosure, a voice call method is provided, including:

[0005] Receive voice call information from different session ends;

[0006] Determine spatial position information of the conversation end corresponding to the voice call information, where the spatial position information is relative position information of the conversation end relative to the local end;

[0007] Performing spatial playback processing on the audio data of the voice call information according to the relative position information of the conversation end relative to the local end;

[0008] The audio data after the spatial playback processing is played to conduct a voice call.

[0009] In an exemplary embodiment, the spatial replaying of the audio data of the voice call information includes:

[0010] According to the relative position information, sound effect rendering processing is performed on the channel of the audio data to achieve a strong or weak effect on the channel that conforms to the relative position information.

[0011] In an exemplary embodiment, the receiving of voice call information from different conversation ends includes:

[0012] Receive voice call information from different conversation parties at the offline site, and / or,

[0013] Receive voice call information from different conversation ends through the online network.

[0014] In an exemplary embodiment, determining the spatial location information of the conversation end corresponding to the voice call information includes:

[0015] Determine the conversation end corresponding to the voice call information;

[0016] The determined spatial location information of the session end is matched from the pre-configured spatial location information of each session end.

[0017] In an exemplary embodiment, the determined spatial location information of the session end includes one or more of the following spatial location information:

[0018] the determined distance of the session end relative to the local end;

[0019] a horizontal angle of the determined conversation end relative to the local end;

[0020] The determined elevation angle of the conversation end relative to the local end.

[0021] In an exemplary embodiment, performing sound effect rendering processing on the channel of the audio data according to the relative position information includes:

[0022] By using a sound effect localization algorithm, the left and right channel data of the audio data are rendered according to the sound rendering degree at different directions and / or positions corresponding to the relative orientation information, so as to achieve a strong or weak effect on the channel that conforms to the relative orientation information.

[0023] In an exemplary embodiment, the sound rendering degree includes complex sound pressure;

[0024] The method of using a sound effect localization algorithm to render left and right channel data of the audio data according to the sound rendering degrees at different directions and / or positions corresponding to the relative position information includes:

[0025] Determine left and right channel rendering coefficients according to the complex sound pressures generated in the left and right channels by the audio data at different directions and / or positions corresponding to the relative orientation information and the complex sound pressures generated at a reference center point;

[0026] The left and right channel data of the audio data are rendered according to the left and right channel rendering coefficients.

[0027] In an exemplary embodiment, determining the left and right channel rendering coefficients according to the complex sound pressure generated by the audio data in the left and right channels and the complex sound pressure generated at a reference center point includes:

[0028] The ratio of the complex sound pressure generated by the audio data in the left channel to the complex sound pressure generated at the reference center point is used as the left channel rendering coefficient;

[0029] The ratio of the complex sound pressure generated by the audio data in the right channel to the complex sound pressure generated at the reference center point is used as the right channel rendering coefficient.

[0030] According to a second aspect of an embodiment of the present disclosure, there is provided an electronic device, characterized in that it includes:

[0031] An audio receiver configured to receive voice call information from different session ends;

[0032] A processor, configured to execute the method as described in the first aspect of the embodiment of the present disclosure;

[0033] The audio player is configured to play the audio data after the spatial playback processing to make a voice call.

[0034] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0035] processor;

[0036] a memory for storing processor-executable instructions;

[0037] The processor is configured to execute the method as described in the first aspect of the embodiment of the present disclosure.

[0038] The above-mentioned method of the present disclosure has the following beneficial effects: the method of the present disclosure can increase the sense of direction of the audio data of the voice call information, realize the auditory spatial sense of the voice call information, thereby increasing the realism of the voice call and improving the user experience of the voice call, and the method of the present disclosure has low dependence on hardware, and only requires a dual-channel headset or a dual-channel speaker on the playback end, and the implementation cost is low.

[0039] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0041] Figure 1 is a flow chart of a voice call method according to an exemplary embodiment;

[0042] Figure 2 is a schematic diagram of a remote conference according to an exemplary embodiment;

[0043] Figure 3 is a schematic diagram showing spatial position information according to an exemplary embodiment;

[0044] Figure 4 is a flow chart of a method for rendering left and right channel data of audio data according to an exemplary embodiment;

[0045] Figure 5 is a block diagram of an electronic device for voice calls according to an exemplary embodiment;

[0046] Figure 6 The invention is a block diagram of an electronic device for voice calls according to an exemplary embodiment. DETAILED DESCRIPTION

[0047] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0048] In an exemplary embodiment of the present disclosure, in order to overcome the problems in the related art, a voice call method is provided, which receives voice call information from different conversation ends, determines the spatial position information of the conversation end corresponding to the voice call information, and the spatial position information is the relative orientation information of the conversation end relative to the local end. According to the relative orientation information of the conversation end relative to the local end, the audio data of the voice call information is spatially replayed, and the audio data after the spatial replay processing is played to make a voice call. In the present disclosure, the audio data of the voice call information of the conversation end is spatially replayed through the relative orientation information of the conversation end relative to the local end, which can increase the sense of direction of the audio data, realize the auditory spatial sense of the voice call information, and thus increase the realism of the voice call. In addition, the method in the present disclosure has low dependence on hardware, and only requires a dual-channel headset or a dual-channel speaker at the playback end, so the implementation cost is relatively low.

[0049] In an exemplary embodiment of the present disclosure, a voice call method is provided. Figure 1 is a flow chart of a voice call method according to an exemplary embodiment. Figure 1 As shown, the voice call method includes the following steps:

[0050] Step S101, receiving voice call information from different conversation ends;

[0051] Step S102, determining the spatial position information of the conversation end corresponding to the voice call information, where the spatial position information is the relative position information of the conversation end relative to the local end;

[0052] Step S103, performing spatial playback processing on the audio data of the voice call information according to the relative position information of the conversation end relative to the local end;

[0053] Step S104, playing the audio data after spatial playback processing to conduct a voice call.

[0054] The method disclosed in the present invention is applied to any one of a plurality of session ends for conducting voice calls, and the session end may be an electronic device with a voice call function, such as a smart phone, a tablet, a computer, etc. The control button corresponding to the voice call method disclosed in the present invention may be set on the session end, and the method disclosed in the present invention may be used to conduct a voice call when the button is turned on. The control button corresponding to the voice call method disclosed in the present invention may be added to the system settings of the session end, and when the user turns on the voice call, the voice call method disclosed in the present invention may be used by calling the system settings; it may also be added to the application settings of an application with a voice call function in the session end, and whether the application uses the voice call method disclosed in the present invention may be set through the application settings. Among them, the voice call may be a remote online meeting scenario or a daily voice chat scenario.

[0055] In step S101, the session ends participating in the voice call include at least two different session ends, any one of which can be used as the local session end, and the voice call information of different session ends includes audio data collected by each session end. Figure 2 is a schematic diagram of a voice call scenario according to an exemplary embodiment. Figure 2 As shown, each session end collects the user's voice call information through a microphone and transmits it to the local session end. The local session end receives the voice call information of other session ends and plays it through a speaker or earphone. Since the session end usually uses a microphone or a single microphone when collecting the user's voice call information, the audio data of the collected voice call information is mono audio data, that is, the audio data of the left and right channels are the same.

[0056] In an exemplary embodiment, when voice call information from different session ends is received, the voice call information from the different session ends is received at an offline site and / or the voice call information from the different session ends is received through an online network.

[0057] Voice call scenarios include offline voice call scenarios and online voice call scenarios. In offline voice call scenarios, the local session end and all session ends are in the same offline site, and receive voice call information from different session ends in the offline site. Voice call information from other different session ends in the site can be received through the network, and voice call information from other different session ends in the site can also be collected through microphones. In online voice call scenarios, the local session end and other session ends are in different offline sites, and voice call information from different session ends is received through the online network. When offline voice call scenarios and online voice call scenarios exist at the same time, the local session end and some session ends are in the same offline site, and voice call information from the part of the session ends is received in the offline site. At the same time, the local session end and the rest of the session ends are in different offline sites, and voice call information from the rest of the session ends is received through the online network.

[0058] In step S102, the spatial position information is the relative orientation information of the conversation end relative to the local end, and the relative orientation information is the relative position relationship between the conversation end and the local conversation end in the spatial coordinate system. When determining the spatial position information of the conversation end that receives the voice call information, the spatial position information of different conversation ends can be pre-configured in the local conversation end, and the spatial position information of the conversation end corresponding to the voice call information can be matched therefrom; or the spatial position information of different conversation ends can be set by the user when making a voice call; or the default spatial position information of different conversation ends can be pre-configured in the local conversation end, and the default spatial position information of the conversation end corresponding to the voice call information can be matched therefrom, and the user can modify the default spatial position information when making a voice call.

[0059] In an exemplary embodiment, the conversation end corresponding to the voice call information is determined, and the spatial location information of the determined conversation end is matched from the pre-configured spatial location information of each conversation end.

[0060] After receiving the voice call information, determine the session end corresponding to the voice call information. If the voice call information of different session ends is received through the network, determine the corresponding session end through the network address of the received voice call information; if the voice call information of different session ends is collected on-site, identify the session end corresponding to the collected voice call information through a voice recognition algorithm.

[0061] The spatial location information of each session end is pre-configured in the session end of the local end. For example, the session ends participating in the voice call include the session end of the local end, session end a and session end b, and the spatial location information pre-configured in the session end of the local end includes spatial location information 1 and spatial location information 2. After determining the session end corresponding to the voice call information, the spatial location information of the determined session end is matched from the spatial location information of each pre-configured session end. The matching method can be the default automatic matching method. For example, the session end corresponding to the voice call information is session end a, and the default session end a matches the pre-configured spatial location information 1; the matching method can be set by the user. For example, the session end corresponding to the voice call information is session end a, and the user sets session end a to match the pre-configured spatial location information 2. It should be noted that after the session ends complete the matching of the spatial location information, the user can edit and modify the spatial location information of each session end at any time.

[0062] In one example, the determined spatial location information of the session end includes one or more of the following spatial location information:

[0063] The determined distance of the session end relative to the local end;

[0064] The determined horizontal angle of the conversation end relative to the local end;

[0065] The determined altitude angle of the session end relative to the local end.

[0066] With the local session end as the center, the horizontal direction as the x-axis, and the vertical direction as the y-axis, a spatial coordinate system is established. Figure 3 is a schematic diagram showing spatial position information according to an exemplary embodiment. Figure 3 As shown, point O represents the location point of the local session end, point S represents the location point of the session end corresponding to the determined voice call information, angle θ represents the horizontal angle of the determined session end relative to the local end, angle φ represents the altitude angle of the determined session end relative to the local end, and r represents the distance between the determined session end and the local end. For example, when the spatial location information includes the above three parameters, the spatial location information of the determined session end relative to the local end is expressed as (distance, horizontal angle, altitude angle). If the determined session end is 1 meter to the right of the local end in the horizontal direction, the spatial location information of the determined session end is (1 meter, 0 degrees, 90 degrees).

[0067] In step S103, the method for spatially replaying the audio data of the voice call information may adopt any spatial replay technology, such as reconstructing the physical sound field of the audio data of the voice call information, or adopting the approximate replay of psychoacoustics and physical sound fields, or rendering the audio data of the voice call information using a sound effect localization algorithm.

[0068] In an exemplary embodiment, sound effect rendering processing is performed on the channel of the audio data according to the relative position information to achieve a strong or weak effect on the channel that conforms to the relative position information.

[0069] Since the strength effects of audio data with different relative orientation information on the left and right channels are different, that is, the auditory perception of the left and right channels is different, therefore, in order to achieve the strength effects on the channels that conform to the relative orientation information, sound effect rendering processing is performed on the channels of the audio data according to the relative orientation information. For example, if session end a is 1 meter to the left of this end in the horizontal direction, the audio signal of the audio data of session end a on the left channel is strong. In order to make the audio data of the received voice call information conform to the strength effects on the left and right channels, it is necessary to perform sound effect rendering processing on the channels of the audio data of session end a so that the audio signal strength of its left channel is higher than the audio signal strength of the right channel.

[0070] Pre-configure sound effect rendering processing methods corresponding to different relative position information at the local conversation end, match the sound effect rendering method of the conversation end in the pre-configured sound effect rendering processing method according to the determined relative position information of the conversation end of the received voice call information, and perform sound effect rendering processing on the channel of the audio data based on the matched sound effect rendering method.

[0071] In an exemplary embodiment, a sound effect localization algorithm is used to render left and right channel data of audio data according to the degree of sound rendering at different directions and / or positions corresponding to the relative orientation information, so as to achieve a strong or weak effect on the channel that conforms to the relative orientation information.

[0072] The different directions and / or positions corresponding to the relative position information may be represented by the distance and horizontal angle, altitude angle relative to the local end, or the distance and other types of spatial angles relative to the local end. The sound rendering degree at different directions and / or positions corresponding to the relative position information is also different. The sound rendering degree is a known parameter in the sound effect positioning algorithm, for example, it may be a sound rendering coefficient. When the rendering coefficient is large, the higher the rendering degree, the higher the intensity of the audio signal. It may also be other sound rendering related parameters. The sound rendering degrees corresponding to different directions and / or positions corresponding to the relative position information are pre-configured in the local session end. After determining the relative position information of the session end corresponding to the voice call information, the sound rendering degree corresponding to the session end is matched from the pre-configured sound rendering degree. The determined sound rendering degree of the session end is used as the input of the sound effect positioning algorithm, and the left and right channel data of the audio data are rendered, and the audio data with the strong and weak effects on the channel that conform to the relative position information is output. Among them, the sound effect positioning algorithm is any algorithm that can render the left and right channel data of the audio data so that the rendered audio data has a sense of space, such as the head-related transfer function (HRTF).

[0073] In step S104, the audio signal strength of the audio data after spatial playback processing on the left and right channels is different. Therefore, when playing the audio data after spatial playback processing, it is necessary to play it through dual-channel headphones or dual-channel speakers to hear the voice call information with a sense of direction.

[0074] In an exemplary embodiment of the present disclosure, voice call information is received from different conversation ends, the relative position information of the conversation end corresponding to the voice call information relative to the local end is determined, and according to the relative position information of the conversation end relative to the local end, the audio data of the voice call information is spatially replayed, and the audio data after the spatial replay processing is played for voice calls. This can increase the sense of direction of the audio data of the voice call information, achieve an auditory spatial sense of the voice call information, and thus increase the realism of the voice call. In addition, the method of the present disclosure has low dependence on hardware, and only requires a dual-channel headset or a dual-channel speaker at the playback end, so the implementation cost is low.

[0075] In an exemplary embodiment, the sound rendering level includes a complex sound pressure. Figure 4 is a flow chart of a method for rendering left and right channel data of audio data according to an exemplary embodiment. Figure 4 As shown, the following steps are included:

[0076] Step S401, determining left and right channel rendering coefficients according to the complex sound pressures generated in the left and right channels by the audio data at different directions and / or positions corresponding to the relative orientation information and the complex sound pressures generated at the reference center point;

[0077] Step S402: Render the left and right channel data of the audio data according to the left and right channel rendering coefficients.

[0078] In step S401, the complex sound pressure includes a real part and an imaginary part, which respectively represent the amplitude information and phase information of the audio data, and the complex sound pressure information generated by audio data with different relative orientation information and different frequencies is different. The complex sound pressure can be measured by simulating a human head in an experiment. The simulated human head includes a structure for measuring the complex sound pressure, and the complex sound pressure generated in the left ear canal, the complex sound pressure generated in the right channel, and the complex sound pressure generated at the reference center point by audio data with different relative orientation information and different frequencies is measured respectively, wherein the reference center point is the center point of the line connecting the left ear and the right ear of the simulated human head; the complex sound pressure can also be obtained by formula calculation or predicted by algorithms such as neural networks.

[0079] In the experiment, after respectively measuring the complex sound pressure generated in the left ear canal, the complex sound pressure generated in the right channel and the complex sound pressure generated at the reference center point by simulating a human head at different directions and / or positions and different frequencies corresponding to the relative orientation information, the complex sound pressure mapping relationship between the relative orientation information and the frequency of the audio data and the complex sound pressure is obtained according to the experimental data. The complex sound pressure mapping relationship can be a mapping relationship table or a functional relationship. The complex sound pressure mapping relationship is pre-stored in the conversation end. After determining the conversation end of the voice call information, the relative orientation information and frequency of the audio data of the voice call information of the conversation end are determined, and the complex sound pressure corresponding to the audio data is obtained by matching the complex sound pressure mapping relationship.

[0080] In one example, the relative position information is provided by Indicates, where r represents the distance of the determined session end relative to the local end, in meters (m), and θ represents the horizontal angle of the determined session end relative to the local end, in degrees (°). Indicates the elevation angle of the determined session end relative to the local end, in degrees (°). The complex sound pressure generated by the audio data in the left channel is measured by P L Indicates that the complex sound pressure generated by the audio data in the right channel is expressed by P R Indicates that the complex sound pressure generated by the audio at the reference center point is expressed by P O The complex sound pressure mapping relationship table pre-stored in the session end includes: spatial position information 1 (0.5-0.8, 0-45, 0-10) and frequency f1~f2 corresponding to P L 1. P R 1. P O 1, spatial position information 2 (0.8-1, 45-90, 0-10) and frequency f1~f2 corresponding to P L 2. P R 2. P O2. When the frequency of the audio data is between f1 and f2, and the relative position information is in the interval corresponding to the spatial position 2, through the complex sound pressure mapping relationship table, it can be known that the complex sound pressure generated by the audio data in the left channel is P L 2. The complex sound pressure generated in the right channel is P R 2. The complex sound pressure generated at the reference center point is P O 2.

[0081] In an exemplary embodiment, the ratio of the complex sound pressure generated by the audio data in the left channel to the complex sound pressure generated at the reference center point is used as the left channel rendering coefficient; the ratio of the complex sound pressure generated by the audio data in the right channel to the complex sound pressure generated at the reference center point is used as the right channel rendering coefficient.

[0082] The complex sound pressure generated by the audio data in the left channel is recorded as The complex sound pressure generated by the audio data in the right channel is recorded as The complex sound pressure generated by the audio data at the reference center point is recorded as P o (r,f), then the left channel rendering coefficient H L and the right channel rendering coefficient H R Respectively expressed as:

[0083]

[0084]

[0085] Where r represents the distance between the conversation end corresponding to the audio data and the local end, θ represents the horizontal angle between the conversation end corresponding to the audio data and the local end, It indicates the elevation angle of the conversation end corresponding to the audio data relative to the local end, and f indicates the frequency of the audio data.

[0086] In step S402, the audio data of the voice call information received from different conversation ends is time domain audio data, that is, audio data that changes with time, and the duration of receiving the time domain audio data is an empirical value, which is determined according to actual needs. For the convenience of data processing, the received time domain audio data is converted into frequency domain audio data through Fourier transform to obtain the spectrum of the audio data. The spectrum of the left and right channel data of the audio data is rendered by the left and right channel rendering coefficients, and the product of the spectrum of the audio data and the left channel rendering coefficient is used as the spectrum of the left channel after rendering, and the product of the spectrum of the audio data and the right channel rendering coefficient is used as the spectrum of the right channel after rendering, thereby obtaining the spectrum of the left and right channel data after rendering, that is, obtaining the frequency domain data of the left and right channel data after rendering, and converting the frequency domain data of the left and right channel data after rendering into time domain data through inverse Fourier transform, that is, obtaining the audio data to be played. Among them, data that is convenient for audio rendering can also be obtained by other means, which is not limited by the present disclosure.

[0087] In this embodiment, the mono audio data is converted into a dual-channel audio signal by using the left and right channel rendering coefficients corresponding to the relative orientation information. The operation is simple, the dependence on the hardware system of the electronic device is low, no additional hardware structure is required, and the implementation cost is low.

[0088] In an exemplary embodiment of the present disclosure, an electronic device is provided. Figure 5 is a block diagram of an electronic device for voice calls according to an exemplary embodiment. Figure 5 As shown, including:

[0089] The audio receiver 501 is configured to receive voice call information from different conversation ends;

[0090] The processor 502 is configured to execute the method in the above embodiment of the present disclosure;

[0091] The audio player 503 is configured to play the audio data after the spatial playback processing to make a voice call.

[0092] The audio receiver 501 may be a signal receiving device in an electronic device or a microphone, and the audio player 503 may be a dual-channel speaker or a dual-channel headset.

[0093] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0094] Figure 6 It is a block diagram of an electronic device 600 for voice calls according to an exemplary embodiment.

[0095] Reference Figure 6 , the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .

[0096] The processing component 602 generally controls the overall operation of the electronic device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.

[0097] The memory 604 is configured to store various types of data to support operations on the electronic device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0098] The power supply component 606 provides power to the various components of the electronic device 600. The power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.

[0099] The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the electronic device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0100] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the electronic device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.

[0101] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0102] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the electronic device 600, the relative positioning of the components, such as the display and keypad of the electronic device 600, and the sensor assembly 614 can also detect the position change of the electronic device 600 or a component of the electronic device 600, the presence or absence of contact between the user and the electronic device 600, the orientation or acceleration / deceleration of the electronic device 600, and the temperature change of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0103] The communication component 616 is configured to facilitate wired or wireless communication between the electronic device 600 and other devices. The electronic device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0104] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0105] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, and the instructions can be executed by a processor 620 of an electronic device 600 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0106] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0107] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A voice call method, It is characterized in that include: Receive voice call information from different session ends; Determine spatial position information of the conversation end corresponding to the voice call information, where the spatial position information is relative position information of the conversation end relative to the local end; Performing spatial playback processing on the audio data of the voice call information according to the relative position information of the conversation end relative to the local end; The audio data after the spatial playback processing is played to conduct a voice call.

2. The voice call method according to claim 1, It is characterized in that The spatial replaying of the audio data of the voice call information includes: According to the relative position information, sound effect rendering processing is performed on the channel of the audio data to achieve a strong or weak effect on the channel that conforms to the relative position information.

3. The voice call method according to claim 1, It is characterized in that The receiving of voice call information from different conversation terminals includes: Receive voice call information from different conversation parties at the offline site, and / or, Receive voice call information from different conversation ends through the online network.

4. The voice call method according to claim 1, It is characterized in that The determining the spatial location information of the conversation end corresponding to the voice call information includes: Determine the conversation end corresponding to the voice call information; The determined spatial location information of the session end is matched from the pre-configured spatial location information of each session end.

5. The voice call method according to claim 4, It is characterized in that The determined spatial location information of the session end includes one or more of the following spatial location information: the determined distance of the session end relative to the local end; a horizontal angle of the determined conversation end relative to the local end; The determined elevation angle of the conversation end relative to the local end.

6. The voice call method according to claim 2, It is characterized in that The performing sound effect rendering processing on the sound channel of the audio data according to the relative position information comprises: By using a sound effect localization algorithm, the left and right channel data of the audio data are rendered according to the sound rendering degree at different directions and / or positions corresponding to the relative orientation information, so as to achieve a strong or weak effect on the channel that conforms to the relative orientation information.

7. The voice call method according to claim 6, It is characterized in that The sound rendering degree includes complex sound pressure; The method of using a sound effect localization algorithm to render left and right channel data of the audio data according to the sound rendering degrees at different directions and / or positions corresponding to the relative position information includes: Determine left and right channel rendering coefficients according to the complex sound pressures generated in the left and right channels by the audio data at different directions and / or positions corresponding to the relative orientation information and the complex sound pressures generated at a reference center point; The left and right channel data of the audio data are rendered according to the left and right channel rendering coefficients.

8. The voice call method according to claim 7, It is characterized in that Determining left and right channel rendering coefficients according to the complex sound pressure generated by the audio data in the left and right channels and the complex sound pressure generated at a reference center point includes: The ratio of the complex sound pressure generated by the audio data in the left channel to the complex sound pressure generated at the reference center point is used as the left channel rendering coefficient; The ratio of the complex sound pressure generated by the audio data in the right channel to the complex sound pressure generated at the reference center point is used as the right channel rendering coefficient.

9. An electronic device, It is characterized in that include: An audio receiver configured to receive voice call information from different session ends; A processor, configured to execute the method according to any one of claims 1 to 8; The audio player is configured to play the audio data after the spatial playback processing to make a voice call.

10. An electronic device, It is characterized in that include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method as claimed in any one of claims 1 to 8.