Electronic device, method, and non-transitory computer-readable storage medium for controlling function related to call connection

Abstract

According to an embodiment, a method performed by an electronic device may comprise an operation of establishing a call connection between the electronic device and at least one external electronic device through a communication circuit of the electronic device. The method may comprise an operation of transmitting, to the at least one external electronic device through the communication circuit, an audio signal to which a function for echo cancellation is applied, on the basis of acquiring the audio signal from a microphone of the electronic device, while the call connection is established. The method may comprise an operation of identifying a notification message generated from a software application executed for the call connection, while the function for echo cancellation is activated. The method may comprise an operation of deactivating the function for echo cancellation on the basis of identifying the notification message.

Description

Electronic device, method, and non-transitory computer-readable storage medium for controlling functions related to call connection

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable storage media for controlling functions related to call connections.

[0002] An electronic device may provide a service for transmitting and receiving audio and video signals to external electronic devices located in different locations for real-time communication. Users of the electronic device may utilize the service to communicate with other users located in different locations.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] According to one embodiment, an electronic device (e.g., electronic device (210)) may include a speaker (e.g., speaker (212)), a microphone (e.g., microphone (213)), a communication circuit (e.g., communication circuit (214)), a memory for storing instructions, and a processor (e.g., processor (211)). The instructions, when executed by the processor, may cause the electronic device to establish a call connection between the electronic device and at least one external electronic device through the communication circuit. The instructions, when executed by the processor, may cause the electronic device to transmit, to the at least one external electronic device, an audio signal to which an echo cancellation function has been applied based on obtaining an audio signal from the microphone while the call connection is established. The instructions, when executed by the processor, may cause the electronic device to identify a notification message generated from a software application executed for the call connection while the echo cancellation function is activated. The instructions, when executed by the processor, may cause the electronic device to deactivate the echo cancellation function based on identifying the notification message.

[0005] According to one embodiment, a method performed by an electronic device may include establishing a call connection between the electronic device and at least one external electronic device via a communication circuit of the electronic device. The method may include transmitting, via the communication circuit, an audio signal to which an echo cancellation function has been applied based on obtaining an audio signal from a microphone of the electronic device while the call connection is established, the audio signal to which an echo cancellation function has been applied, to the at least one external electronic device. The method may include identifying a notification message generated from a software application executed for the call connection while the echo cancellation function is activated. The method may include disabling the echo cancellation function based on identifying the notification message.

[0006] According to one embodiment, a non-transitory computer readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by a processor of an electronic device having a speaker, a microphone, and a communication circuit, cause the electronic device to establish a call connection between the electronic device and at least one external electronic device via the communication circuit. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to transmit, through the communication circuit, an audio signal to which an echo cancellation function has been applied based on obtaining an audio signal from the microphone while the call connection is established, to the at least one external electronic device. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to identify a notification message generated from a software application executed for the call connection while the echo cancellation function is activated. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to disable the echo cancellation function based on identifying the notification message.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.

[0008] FIG. 2A illustrates an example of the operation of an electronic device, at least one external electronic device, and a server when a call connection between the electronic device and at least one external electronic device is performed for broadcasting an audio signal or a video signal.

[0009] FIG. 2b is a simplified block diagram of an electronic device according to one embodiment.

[0010] Figure 3 illustrates an example of the operation of a sign language signal processing circuit and a transmission signal processing circuit.

[0011] Figure 4 is a flowchart of the operation of an electronic device for disabling a function for echo cancellation.

[0012] Figure 5 is a flowchart of the operation of an electronic device for disabling a function for echo cancellation.

[0013] Figure 6 illustrates the operation of an electronic device for disabling the function for echo cancellation.

[0014] Figure 7 illustrates the operation of an electronic device for disabling the function for echo cancellation.

[0015] Figure 8 is a flowchart of the operation of an electronic device for disabling a function for echo cancellation.

[0016] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0017] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0018] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0019] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0020] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0021] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0022] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0023] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0024] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0025] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0026] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0027] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0028] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0029] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., the electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0030] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0031] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0032] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0033] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0034] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0035] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0036] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0037] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0038] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0039] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0040] According to one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1) may establish a call connection with at least one external electronic device (e.g., electronic device (102) or electronic device (104) of FIG. 1) via a server (e.g., server (108) of FIG. 1). While the call connection with the at least one external electronic device is established, the electronic device may output a first audio signal received from the at least one external electronic device using a speaker. While the first audio signal received from the at least one external electronic device is output using the speaker, the electronic device may obtain a second audio signal from a user of the electronic device using a microphone of the electronic device. While the second audio signal is being obtained, the first audio signal output through the speaker may also be obtained through the microphone. Accordingly, the electronic device may perform a function for echo cancellation to remove the first audio signal obtained through the microphone.

[0041] However, when an electronic device performs a broadcast for at least one external electronic device through a server, the electronic device may not receive an audio signal (or a video signal) from the at least one external electronic device. If an audio signal (or a video signal) is not received from at least one external electronic device, the echo cancellation function may not need to be performed. Accordingly, the electronic device may disable the echo cancellation function depending on whether a broadcast is being performed. In the following description, technical features for identifying whether a broadcast is being performed in an electronic device and disabling the echo cancellation function will be described.

[0042] FIG. 2A illustrates an example of the operation of an electronic device, at least one external electronic device, and a server when a call connection between the electronic device and at least one external electronic device is performed for broadcasting an audio signal or a video signal.

[0043] Referring to FIG. 2A, the electronic device (210) can obtain an audio signal and / or a video signal from a user. The electronic device (210) can transmit the audio signal and / or the video signal obtained through the server (230) to at least one external electronic device (220). The electronic device (210) can obtain the audio signal and / or the video signal obtained from at least one external electronic device (220) through the server (230).

[0044] According to one embodiment, the server (230) may be used to establish a connection between the electronic device (210) and at least one external electronic device (220). For example, the electronic device (210) may establish a call connection with at least one external electronic device (220) via the server (230).

[0045] For example, the server (230) may provide a call service using VoIP (voice over internet protocol). The server (230) may receive a message for call connection from the electronic device (210). Based on the received message, the server (230) may provide a path for call connection. When the call target is an external electronic device (220-1), the server (230) may provide a path for call connection between the electronic device (210) and the external electronic device (220-1). For example, when the call target is not specified, such as in a live broadcast, the server may provide a path for call connection so that at least one external electronic device (220) can connect to the electronic device (210).

[0046] According to one embodiment, at least one external electronic device (220) may output audio signals and / or video signals acquired from the electronic device (210) using a software application for call connection. For example, each of the at least one external electronic device (220) may receive audio signals and / or video signals acquired from the electronic device (210) from the server (230). Each of the at least one external electronic device (220) may provide the received audio signals and / or video signals through an interface of the software application.

[0047] For example, when a call connection is established between an electronic device (210) and at least one external electronic device (220), the electronic device (210) can receive an audio signal acquired from the at least one external electronic device (220). Using the call connection between the electronic device (210) and the at least one external electronic device (220), the electronic device (210) can output a first audio signal received from the at least one external electronic device (220) using a speaker. While the first audio signal is being output through the speaker, the electronic device (210) can acquire a second audio signal (or a second audio signal generated by the user) from a user of the electronic device (210) using a microphone. While the second audio signal is being acquired, the first audio signal output through the speaker can also be acquired through the microphone. The electronic device (210) can perform a function for echo cancellation to remove the first audio signal.

[0048] For example, the electronic device (210) can perform a noise removal function. The electronic device (210) can remove noise included in the second audio signal through the noise removal function.

[0049] According to one embodiment, a user can perform a live broadcast. The electronic device (210) can provide a service related to the live broadcast through a software application. The electronic device (210) can display a user interface (251) related to the software application for the live broadcast through a display (e.g., the display (216) of FIG. 2B). The user of the electronic device (210) can change setting information for the live broadcast by using at least one object included in the user interface (251). For example, the user interface (251) can include an object (252) for blocking the sound, an object (253) for blocking the screen transmission, an object (254) for changing the shooting direction of the camera (or switching the camera), and / or an object (255) for setting a background effect.

[0050] For example, the user interface (251) may include an area (260) for displaying a notification message. For example, the notification message may be used to display text data received from at least one external electronic device (220). For example, the notification message may indicate that a call connection is established for broadcasting an audio signal and / or a video signal to at least one external electronic device (220).

[0051] For example, at least one user of at least one external electronic device (220) may express his / her thoughts and / or feelings through text. The electronic device (210) may transmit a video signal captured by the user of the electronic device (210) and / or an audio signal recorded by the user of the electronic device (210) to at least one external electronic device (220). For example, the area (260) may be referred to as a chat window.

[0052] For example, the user interface (251) may include an object (261) indicating that a live broadcast is in progress. The user interface (251) may include an object (262) indicating the number of at least one external electronic device (220) to which audio signals and / or video signals acquired from the electronic device (210) are transmitted. The object (262) may indicate the number of users watching the live broadcast. The user interface (251) may include an object (253) for ending the live broadcast.

[0053] According to one embodiment, a call connection may be established for broadcasting (or live broadcasting) of audio signals and / or video signals acquired from the electronic device (210). When the electronic device (210) broadcasts the audio signals and / or video signals, the electronic device (210) may transmit the audio signals and / or video signals to the server (230). However, the electronic device (210) may not receive the audio signals and / or video signals from the server (230). For example, when a live broadcasting transmission service is provided from the electronic device (210), audio signals and / or video signals regarding a user who is the subject of the live broadcast may be transmitted to at least one external electronic device (220) via the server (230).

[0054] On the other hand, at least one external electronic device (220) may provide a live broadcast reception service. For example, the external electronic device (220-1) (or the external electronic device (220-2)) may not obtain an audio signal and / or a video signal from the user of the external electronic device (220-1) (or the external electronic device (220-2)). The external electronic device (220-1) may not transmit an audio signal and / or a video signal to the server (230). The electronic device (210) may not receive an audio signal and / or a video signal obtained from the at least one external electronic device (220).

[0055] For example, if an audio signal and / or a video signal acquired from at least one external electronic device (220) is not received, the electronic device (210) may deactivate the function for echo cancellation. By deactivating the function for echo cancellation, the electronic device (210) may reduce power consumption of the electronic device (210). In the following specification, a specific operation of the electronic device (210) for deactivating the function for echo cancellation when an audio signal and / or a video signal acquired from at least one external electronic device (220) is not received will be described. The same reference numerals described in the following specification may represent the same description.

[0056] FIG. 2b is a simplified block diagram of an electronic device according to one embodiment.

[0057] Referring to FIG. 2B, the electronic device (210) may include a processor (211), a speaker (212), a microphone (213), a communication circuit (214), a camera (215), and / or a display (216). Depending on the embodiment, the electronic device (210) may include at least one of the processor (211), the speaker (212), the microphone (213), the communication circuit (214), the camera (215), and the display (216). For example, at least some of the processor (211), the speaker (212), the microphone (213), the communication circuit (214), the camera (215), and the display (216) may be omitted depending on the embodiment. For example, if a call connection is performed for broadcasting an audio signal, the electronic device (210) may not include the camera (215) and / or the display (216). The electronic device (210) may include only a processor (211), a speaker (212), a microphone (213), and a communication circuit (214). For example, if a call connection is performed for broadcasting audio signals and video signals, the electronic device (210) may include all of the processor (211), the speaker (212), the microphone (213), the communication circuit (214), the camera (215), and the display (216). For example, the electronic device (201) may include at least some of the components of the electronic device (101) of FIG. 1. Although not illustrated, the electronic device (201) may include various components in addition to the processor (211), the speaker (212), the microphone (213), the communication circuit (214), the camera (215), and the display (216).

[0058] According to one embodiment, the processor (211) may correspond to the processor (120) of FIG. 1. The processor (211) may be operatively or operably coupled with or connected with the speaker (212), the microphone (213), the communication circuit (214), the camera (215), and the display (216). The processor (211) being operatively or operably coupled with the speaker (212), the microphone (213), the communication circuit (214), the camera (215), and the display (216) may mean that the processor (211) can control the speaker (212), the microphone (213), the communication circuit (214), the camera (215), and the display (216). For example, a speaker (212), a microphone (213), a communication circuit (214), a camera (215), and a display (216) may be controlled by the processor (211).

[0059] Although illustrated based on different blocks, the embodiment is not limited thereto, and some of the hardware of FIG. 2B (e.g., at least a portion of the processor (211), speaker (212), microphone (213), communication circuit (214), camera (215), and display (216)) may be included in a single integrated circuit, such as a system on a chip (SoC).

[0060] According to one embodiment, the processor (211) may include at least one processor. For example, the processor (211) may include a main processor that performs high-performance processing and a secondary processor that performs low-power processing.

[0061] According to one embodiment, the processor (211) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), and / or a central processing unit (CPU).

[0062] For example, the processor (211) may include an application processor, a supplementary processor (e.g., a sensor hub, a microcontroller unit (MCU)), a central processor unit (CPU), a neural processing unit (NPU), a graphic processing unit (GPU), and / or a processor for IoT (e.g., a processor integrated with a communication module).

[0063] According to one embodiment, the electronic device (210) may include a speaker (212). For example, the speaker (212) may be used to output (or provide) sound. The processor (212) may receive an audio signal received from an external electronic device and output the received audio signal through the speaker (212). For example, the speaker (212) may correspond to the audio output module (155) of FIG. 1.

[0064] According to one embodiment, the electronic device (210) may include a sign language signal processing circuit (e.g., a sign language signal processing circuit (310) of FIG. 3). For example, the processor (211) may process an audio signal through sign language signal processing and output the processed audio signal through the speaker (212). For example, the sign language signal processing circuit may be used to process an audio signal received from at least one external electronic device (220). The sign language signal processing circuit may be used to adjust the tone and / or volume of the audio signal. For example, the sign language signal processing circuit may be included in the processor (211). For example, functions related to the sign language signal processing circuit may be performed in the processor (211). A specific example of the operation of the sign language signal processing circuit will be described later with reference to FIG. 3.

[0065] According to one embodiment, the electronic device (210) may include a microphone (213). The microphone (213) may identify an electrical signal corresponding to vibration in the atmosphere. For example, the processor (210) may obtain an audio signal (e.g., the user's voice) from a user using the microphone (213). The processor (211) may transmit the audio signal obtained from the user to at least one external electronic device (220).

[0066] According to one embodiment, the electronic device (210) may include a transmission signal processing circuit (e.g., a transmission signal processing circuit (320) of FIG. 3). For example, the processor (211) may obtain an audio signal from a user using a microphone (213). The processor (211) may transmit the obtained audio signal to at least one external electronic device (220) (or server (230)) using the transmission signal processing circuit. For example, the transmission signal processing circuit may be used to process an audio signal to be transmitted to at least one external electronic device (220). The transmission signal processing circuit may be used to adjust the tone and / or volume of the audio signal. For example, the transmission signal processing circuit may be included in the processor (211). For example, a function related to the transmission signal processing circuit may be performed in the processor (211). A specific example of the operation of the transmission signal processing circuit will be described later with reference to FIG. 3.

[0067] According to one embodiment, the electronic device (210) may include a communication circuit (214). The communication circuit (214) may correspond to at least a portion of the communication module (190) of FIG. 1. For example, the communication circuit (214) may be used for various radio access technologies (RATs). For example, the communication circuit (214) may be used to perform Bluetooth communication, wireless local area network (WLAN) communication, Zigbee communication, near field communication (NFC), ultra wide band (UWB) communication, UWB communication, or ANT+ communication. For example, the communication circuit (214) may be used to perform cellular communication.

[0068] For example, the communication circuit (214) may be used to establish a connection with at least one external electronic device (220) via the server (230). The processor (211) may use the communication circuit (214) to establish a call connection with at least one external electronic device (220) using a voice over internet protocol (VoIP) call path provided via the server (230). According to an embodiment, the communication circuit (214) may be configured to be integrated with the processor (211).

[0069] According to one embodiment, the electronic device (210) may include a camera (215). For example, the camera (215) may correspond to at least a portion of the camera module (180) of FIG. 1. For example, the camera (215) may include at least one camera. For example, the camera (215) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The plurality of optical sensors included in the camera (215) may be arranged in the form of a two-dimensional array. The camera (215) may acquire the electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate two-dimensional frame data corresponding to light reaching the optical sensors of the two-dimensional array. For example, photographic data captured using the camera (215) may mean one (a) two-dimensional frame data acquired from the camera (215). For example, video data captured using a camera (215) may mean a sequence of multiple two-dimensional frame data acquired from the camera (215).

[0070] According to one embodiment, the electronic device (210) may include a display (216). For example, the display (216) may correspond to the display module (160) of FIG. 1. For example, the display (216) may output visualized information to a user. The display (216) may include a liquid crystal display (LCD), a plasma display panel (PDP), one or more light emitting diodes (LEDs), and / or one or more organic light emitting diodes (OLEDs). According to one embodiment, the display (216) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the display (216).

[0071] Figure 3 illustrates an example of the operation of a sign language signal processing circuit and a transmission signal processing circuit.

[0072] Referring to FIG. 3, a processor (211) of an electronic device (210) may receive an audio signal acquired from at least one external electronic device (220) from a server (230). The processor (211) may perform processing on the audio signal using a sign language signal processing circuit (310). For example, the sign language signal processing circuit (310) may include a gain management unit, a filter, a limiter, and / or a dynamic range control (DRC). The gain management unit may be used to perform tuning on an audio signal received from the server (230). The filter may be used to identify a designated frequency band (e.g., a frequency band for a voice signal) in the received audio signal. The limiter may be used to limit the output of an audio signal output through a speaker (212) and / or an audio signal acquired through a microphone (213). The DRC may be used to dynamically change the size of an output audio signal with respect to an input audio signal. The processor (211) can output an audio signal processed through the sign language signal processing circuit (310) through the speaker (212). The processor (211) can output an analog signal through the speaker (212).

[0073] The processor (211) of the electronic device (210) can obtain an audio signal obtained from the surroundings of the electronic device (210) through the microphone (213). The processor (211) can obtain an analog signal through the microphone (213). For example, the obtained audio signal may include an audio signal regarding speech of a user of the electronic device (210). For example, the electronic device (210) can perform processing on the audio signal obtained in the electronic device (210). For example, the audio signal can be processed using the speech processing circuit (320). For example, the speech processing circuit (320) can include an echo canceller (321) and / or a noise canceller (322). Although not illustrated, the speech processing circuit (320) may further include a gain management unit, a filter, a limiter, and / or a dynamic range control (DRC).

[0074] For example, the echo canceller (321) can be used to remove an audio signal output through a speaker (212) from among audio signals acquired through a microphone (213). The echo canceller (321) can identify an audio signal acquired from at least one external electronic device (220) from a sign language signal processing circuit (310). The echo canceller (321) can identify a portion related to an audio signal acquired from at least one external electronic device (220) from among audio signals acquired through the microphone (213). The echo canceller (321) can remove a portion (or echo) related to an audio signal acquired from at least one external electronic device (220) from among audio signals acquired through the microphone (213).

[0075] For example, a noise remover (322) may be used to remove noise from an audio signal acquired through a microphone (213). Since the microphone (213) acquires audio signals surrounding the electronic device (210), the acquired audio signals may include noise. Accordingly, the processor (211) may use the noise remover (322) to remove noise included in the audio signal.

[0076] For example, the processor (211) can change the setting information for the echo canceler (321) and the noise canceler (322) by changing the parameters for the echo canceler (321) and the noise canceler (322). The parameters for the echo canceler (321) and the noise canceler (322) can be referred to as ECNS (echo canceler and noise suppressor) parameters.

[0077] For example, when the function for echo cancellation is activated, echo (or at least a portion of the echo) can be removed from the audio signal through the echo canceller (321). When the function for echo cancellation is deactivated, echo may not be removed from the audio signal through the echo canceller (321). In the following specification, when echo is removed from the audio signal through the echo canceller (321), the function for echo cancellation will be described as being activated. The function for echo cancellation may be referred to as a function for echo reduction. The function for noise cancellation may be referred to as a function for noise reduction.

[0078] For example, if the noise removal function is activated, noise (or at least a portion of the noise) may be removed from the audio signal through the noise remover (322). If the noise removal function is deactivated, noise may not be removed from the audio signal through the noise remover (322). In the following description, if noise is removed from the audio signal through the noise remover (322), the noise removal function will be described as being activated.

[0079] The processor (211) can transmit an audio signal processed through the transmission processing circuit (320) to the server (230). The server (230) can transmit the received audio signal to at least one external electronic device (220). For example, the server (230) can transmit an audio signal received from the electronic device (210) to at least one external electronic device (220) using a path (e.g., a VoIP call path) for a created (or opened) call connection.

[0080] Figure 4 is a flowchart of the operation of an electronic device for disabling a function for echo cancellation.

[0081] Referring to FIG. 4, in operation 410, the processor (211) of the electronic device (210) may establish a call connection between the electronic device (210) and at least one external electronic device (220). For example, the processor (211) may establish a call connection between the electronic device (210) and at least one external electronic device (220) via the server (230).

[0082] For example, a call connection may be established for broadcasting an audio signal obtained from an electronic device (210). The audio signal may be transmitted to at least one external electronic device (220) via a server (230). For example, a call connection may be established for transmitting a live broadcast performed from an electronic device (210).

[0083] For example, the processor (211) may request a call connection for broadcasting an audio signal to the server (230). The server (230) may establish a call connection network for broadcasting the audio signal. The server (230) may identify a request for receiving the broadcast received from at least one external electronic device (220). Based on the request, the server (230) may establish a path for a call connection between the electronic device (210) and at least one external electronic device (220).

[0084] In operation 420, the processor (211) may transmit an audio signal to which an echo cancellation function is applied to at least one external electronic device (220). For example, the processor (211) may activate the echo cancellation function based on the establishment of a call connection between the electronic device (210) and at least one external electronic device (220). The processor (211) may activate the noise cancellation function as well as the echo cancellation function based on the establishment of a call connection between the electronic device (210) and at least one external electronic device (220).

[0085] For example, the processor (211) may obtain an audio signal about a user of the electronic device (210) using a microphone (213). The audio signal may include the user's voice, a sound caused by the user, and / or a sound recorded by the user.

[0086] For example, the processor (211) may apply a function for echo cancellation to an audio signal obtained using a microphone (213). The processor (211) may transmit the audio signal to which the function for echo cancellation has been applied to at least one external electronic device (220) via the server (230). As an example, the processor (211) may apply a function for echo cancellation to an audio signal obtained using a microphone (213) based on an audio signal received from the server (230). The processor (211) may apply a function for echo cancellation to an audio signal obtained using a microphone (213) by excluding a portion related to an audio signal received from the server (230) from the audio signal obtained using the microphone (213).

[0087] For example, the processor (211) may apply a function for echo cancellation and a function for noise cancellation to the acquired audio signal. The processor (211) may transmit the audio signal to which the function for echo cancellation and the function for noise cancellation have been applied to at least one external electronic device (220) via the server (230).

[0088] At operation 430, the processor (211) may identify a notification message generated from a software application running for a call connection while the function for echo cancellation is activated.

[0089] For example, the software application may be used to provide a service for broadcasting audio signals and / or video signals. The software application may be used to provide a live broadcasting service. The software application may be used to provide a service for simultaneously transmitting audio signals and / or video signals to at least one external electronic device (220).

[0090] For example, the notification message may indicate that a call connection is established for broadcasting audio signals and / or video signals from at least one external electronic device (220). As an example, the processor (211) may identify a notification message provided through a software application.

[0091] For example, the processor (211) may identify a notification message within a user interface for a software application indicating that a call connection is established for broadcasting audio and / or video signals. The notification message may include an object indicating that a live broadcast is in progress. The notification message may indicate a notification regarding a function related to the live broadcast (e.g., a function to share a live broadcast address, a function to invite a live broadcast, and / or a function to end a live broadcast).

[0092] For example, the processor (211) may include a notification message for displaying text data received from at least one external electronic device (220). The notification message may be used to display text data received from at least one external electronic device (220). One of the at least one external electronic device (220) may transmit the text data to the electronic device (210) via the server (230). Based on receiving the text data, the electronic device (210) may display the text data within an area for displaying a notification message within a user interface for a software application. The notification message may be referenced as a chat message.

[0093] In one embodiment, the processor (211) may identify that a specified notification message is provided to a user through a software application. For example, the processor (211) may identify that a notification message indicating an external user's entry into a live broadcast is displayed within a user interface of the software application. For example, the processor (211) may identify that a chat message is displayed within a user interface of the software application while an audio signal acquired from the electronic device (210) is transmitted to at least one external electronic device (220) (or server (230)).

[0094] In operation 440, the processor (211) may disable the function for echo cancellation. For example, the processor (211) may disable the function for echo cancellation based on identifying the notification message.

[0095] According to one embodiment, the processor (211) may identify, based on identifying the notification message, that a call connection with at least one external electronic device (220) is established for broadcasting an audio signal and / or a video signal to the at least one external electronic device (220). The processor (211) may identify, based on identifying the notification message, that a call connection with at least one external electronic device (220) is established for transmitting a live broadcast.

[0096] For example, when a live broadcast is transmitted from the electronic device (210), the processor (211) may not receive an audio signal from at least one external electronic device (220) (or server (230)). Since the audio signal is not received from at least one external electronic device (220) (or server (230)), the audio signal may not be output through the speaker (212) of the electronic device (210). Therefore, a function for echo cancellation may not be required. The processor (211) may disable the function for echo cancellation. The processor (211) may not apply the function for echo cancellation to an audio signal acquired through the microphone (213). For example, the processor (211) may set the operation mode of the electronic device (210) for call connection to an operation mode in which the function for echo cancellation is disabled. As the function for echo cancellation is disabled, the power consumption of the electronic device (210) may be reduced. For example, an operating mode with echo cancellation disabled may be referred to as a power-saving mode, while an operating mode with echo cancellation enabled may be referred to as a default mode.

[0097] According to one embodiment, even when the function for echo cancellation is disabled, the processor (211) may acquire an audio signal using the microphone (213) and transmit the acquired audio signal to at least one external electronic device (220). The processor (211) may apply a function for noise cancellation to the audio signal acquired using the microphone (213). The processor (211) may additionally allocate resources for the function for noise cancellation based on the deactivation of the function for echo cancellation. For example, the processor (211) may allocate a first resource to the function for echo cancellation and a second resource to the function for noise cancellation when the function for echo cancellation is enabled. The first resource may refer to a resource related to hardware (e.g., the processor (211), a memory) or software allocated for the function for echo cancellation. The second resource may refer to a resource related to hardware (e.g., the processor (211), a memory) or software allocated for the function for noise cancellation.

[0098] The processor (211) may stop allocating the first resource based on disabling the function for echo cancellation. The processor (211) may additionally allocate at least a portion of the first resource for a function for noise cancellation. The processor (211) may perform the function for noise cancellation through at least a portion of the first resource and the second resource based on disabling the function for echo cancellation. As the processor (211) additionally allocates the resource for the function for noise cancellation, the processor (211) may increase the length of the time interval of the audio signal for noise cancellation. The processor (211) may identify a noise signal for the audio signal based on the audio signal of the first time interval and remove the noise signal from the audio signal. As the resource for the function for noise cancellation is additionally allocated, the processor (211) may identify a noise signal for the audio signal based on the audio signal of the second time interval, which is longer than the first time interval. The processor (211) may remove the noise signal for the audio signal.

[0099] When a noise signal is identified based on an audio signal in a second time interval that is longer than the first time interval, the noise signal can be identified more accurately. Therefore, the performance of the noise removal function can be improved.

[0100] In FIG. 4, the operation of disabling the echo cancellation function is described as being performed based on identifying a notification message, but is not limited thereto. According to an embodiment, the processor (211) may disable the echo cancellation function based on the execution of an application. When a live broadcast is transmitted through the application, the processor (210) may disable the echo cancellation function for the live broadcast.

[0101] Figure 5 is a flowchart of the operation of an electronic device for disabling a function for echo cancellation.

[0102] Referring to FIG. 5, in operation 510, the processor (211) may establish a call connection between the electronic device (210) and at least one external electronic device (220). Operation 510 may correspond to operation 410 of FIG. 4.

[0103] In operation 520, the processor (211) may transmit an audio signal to which an echo cancellation function is applied to at least one external electronic device (220). Operation 520 may correspond to operation 420 of FIG. 4.

[0104] At operation 530, the processor (211) can identify whether an audio signal is received from at least one external electronic device (220) during a specified time period while a function for echo cancellation is activated.

[0105] For example, the processor (211) may identify whether an audio signal is received from at least one external electronic device (220) during a specified time period to identify whether a call connection is established for broadcasting an audio signal and / or a video signal.

[0106] In operation 540, if an audio signal is received from at least one external electronic device (220) during a specified time period, the processor (211) may maintain the activation of the function for echo cancellation. For example, the processor (211) may maintain the activation of the function for echo cancellation based on identifying that an audio signal is received from at least one external electronic device (220) during a specified time period.

[0107] For example, the processor (211) may identify that a call connection is not established for transmission of a live broadcast if an audio signal is received from at least one external electronic device (220) during a specified time period. The processor (211) may maintain the activation of a function for echo cancellation.

[0108] For example, the processor (211) may identify that an audio signal obtained from at least one external electronic device (220) is output through the speaker (212) simultaneously with the transmission of a live broadcast when an audio signal is received from at least one external electronic device (220) during a specified time period. As an example, a software application may provide a service in which the electronic device (210) and the external electronic device (220-1) transmit a live broadcast together. The processor (211) may identify that a live broadcast of the external electronic device (220-1) is also transmitted while the electronic device (210) provides a service for transmitting a live broadcast. The processor (211) may maintain the activation of a function for echo cancellation based on the fact that the electronic device (210) and the external electronic device (220-1) transmit a live broadcast together.

[0109] In operation 550, if an audio signal is not received from at least one external electronic device (220) for a specified period of time, the processor (211) may disable the function for echo cancellation. For example, the processor (211) may disable the function for echo cancellation based on identifying that an audio signal is not received from at least one external electronic device (220) for a specified period of time. Operation 550 may correspond to operation 440 of FIG. 4 .

[0110] For example, the processor (211) may identify that a call connection has been established for transmission of a live broadcast if no audio signal is received from at least one external electronic device (220) for a specified period of time. The processor (211) may disable a function for echo cancellation.

[0111] Although not shown, even if an audio signal is received from at least one external electronic device (220), the audio signal may not be output through the speaker (212). If an audio signal is not output through the speaker (212) even if an audio signal is received from at least one external electronic device (220), the processor (211) may disable the function for echo cancellation.

[0112] For example, the electronic device (210) may be connected to a wearable device (e.g., earphones or earbuds) for outputting an audio signal. The processor (211) may output an audio signal through the wearable device. When the audio signal is output through the wearable device, the signal output through the wearable device may not be acquired through the microphone (213). Accordingly, even when an audio signal is received from at least one external electronic device (220), the processor (211) may disable the function for echo cancellation based on the fact that the audio signal is output through the wearable device connected to the electronic device (210).

[0113] For example, even if the electronic device (210) receives an audio signal from at least one external electronic device (220), the electronic device (210) may not output the audio signal through the speaker (212) based on the setting information of the software application. The processor (211) may set mute for the audio signal received from at least one external electronic device (220). If mute is set for the audio signal received from at least one external electronic device (220), the processor (211) may not output the audio signal through the speaker (212). Accordingly, the processor (211) may deactivate the function for echo cancellation when mute is set for the audio signal received from at least one external electronic device (220).

[0114] Figure 6 illustrates the operation of an electronic device for disabling the function for echo cancellation.

[0115] Referring to FIG. 6, in state (610), the electronic device (210) can provide a service related to live broadcasting through a software application. The processor (211) can display a user interface (251) related to the software application for call connection through the display (216). The user interface (251) can display at least one object for changing setting information for live broadcasting. For example, the user interface (251) can include an object (252) for blocking the sound of the call, an object (253) for blocking the screen transmission, an object (254) for changing the direction of the camera, and / or an object (255) for setting a background effect.

[0116] For example, the user interface (251) may include an area (260) for displaying notification messages (261, 262, 263). For example, the notification message (263) may be used to display text data received from at least one external electronic device (220). For example, the notification messages (261, 262) may indicate that a call connection is established for broadcasting an audio signal and / or a video signal to at least one external electronic device (220). The processor (211) may identify that the call connection is established for live broadcasting (or broadcasting of an audio signal) based on the notification messages (261, 262, 263). For example, the area (260) may be referred to as a chat window.

[0117] For example, the user interface (251) may include an object (261) indicating that a live broadcast is in progress. The user interface (251) may include an object (262) indicating the number of at least one external electronic device (220) to which audio signals and / or video signals acquired from the electronic device (210) are transmitted. The object (262) may indicate the number of users watching the live broadcast. The user interface (251) may include an object (253) for ending the live broadcast.

[0118] According to one embodiment, the processor (211) may change the state of the electronic device (210) from state (610) to state (620) based on identifying at least one of a plurality of notification messages generated from a software application. For example, the processor (211) may change the state of the electronic device (210) from state (610) to state (620) based on at least one of notification message (261), notification message (262), and / or notification message (263).

[0119] According to one embodiment, the processor (211) may identify whether an audio signal is received from at least one external electronic device (220) during a specified time period (e.g., 1 minute or 3 minutes). For example, the processor (211) may change the state of the electronic device (210) from state (610) to state (620) based on identifying that no audio signal is received from at least one external electronic device (220) during the specified time period. For example, the processor (211) may maintain the state of the electronic device (210) at state (610) based on identifying that an audio signal is received from at least one external electronic device (220) during the specified time period. The processor (211) may maintain the activation of a function for echo cancellation based on identifying that an audio signal is received from at least one external electronic device (220) during the specified time period.

[0120] In state (620), the processor (211) may display a visual object (650) via the display (216) to indicate whether to disable the function for echo cancellation by overlaying it on the user interface (251) (or screen) for the software application.

[0121] For example, the visual object (650) may be displayed in the form of a pop-up window. The visual object (650) may include an object (651) for disabling a function for echo cancellation and an object (652) for maintaining the activation of the echo cancellation function. Although not illustrated, the visual object (650) may include text indicating that the battery consumption of the electronic device (210) is reduced when the function for echo cancellation is disabled. The processor (211) may provide a notification indicating that the battery consumption is reduced when the function for echo cancellation is disabled through the visual object (650).

[0122] For example, the processor (211) may keep the function for echo cancellation active based on the input for the visual object (652). The processor (211) may deactivate the function for echo cancellation based on the input for the visual object (651). The processor (211) may change the state of the electronic device (210) from state (620) to state (630) in response to the input for the visual object (651).

[0123] In state (630), the processor (211) can overlay a user interface (251) (or screen) for the software application to disable the function for echo cancellation and display a visual object (660) for setting the intensity for the function for noise cancellation.

[0124] For example, the visual object (660) may be displayed in the form of a pop-up window. The visual object (660) may include at least one element (661, 662, 663, 664) for disabling the function for echo cancellation and setting the intensity of the function for noise cancellation.

[0125] For example, the visual object (660) may display an element (661) for setting the operating mode of the electronic device (210) to a first operating mode (e.g., broadcast mode). In the first operating mode, the function for echo cancellation may be disabled, and the intensity for the function for noise cancellation may be set to the default intensity.

[0126] For example, the visual object (660) may display an element (662) for setting the operating mode of the electronic device (210) to a second operating mode (e.g., food mode). In the second operating mode, the function for echo cancellation may be disabled, and the intensity of the function for noise cancellation may be set to a lower intensity than the default intensity.

[0127] For example, the visual object (660) may display an element (663) for setting the operating mode of the electronic device (210) to a third operating mode (e.g., focus mode). In the third operating mode, the function for echo cancellation may be disabled, and the intensity of the function for noise cancellation may be set to a higher intensity than the default intensity.

[0128] For example, the visual object (660) may display an element (663) for setting the operating mode of the electronic device (210) to a fourth operating mode (e.g., a user-defined mode). The user of the electronic device (210) may set the fourth operating mode. Whether or not to activate and the intensity of each of the echo cancellation function and / or the noise cancellation function may be set by the user of the electronic device (210). The fourth operating mode may be set by the user of the electronic device (210) in which whether or not to activate and the intensity of each of the echo cancellation function and / or the noise cancellation function are set.

[0129] For example, the processor (211) may set the operating mode of the electronic device (210) to an operating mode according to the selected element based on identifying a selection (or input) for an element (661) to an element (664) and identifying an input for a visual object (665). In response to identifying an input for a visual object (665), the processor (211) may change the state of the electronic device (210) from state (630) to state (640). For example, the processor (211) may keep the function for echo cancellation activated in response to identifying an input for a visual object (666).

[0130] Although not shown, the processor (211) may display information on battery consumption according to each of the first to fourth operation modes on the visual object (660). For example, the higher the intensity of the noise removal function, the higher the battery consumption. The processor (211) may provide a notification indicating that the second operation mode among the first to third operation modes has the lowest battery consumption. The processor (211) may provide a notification indicating that the third operation mode among the first to third operation modes has the highest battery consumption.

[0131] In state (640), the processor (211) may display an object (671) to indicate an operation mode of the electronic device (210) set according to elements (661) to (664) within an area (670) for indicating setting information regarding the electronic device (210). For example, the object (671) may indicate that a function for echo cancellation is disabled.

[0132] In state (640), an example in which an object (671) is displayed within an area (670) is illustrated, but is not limited thereto. For example, the object (671) may be displayed as an overlay on a user interface (251) of a software application. For example, the object (671) may be displayed on at least a portion of the user interface (251).

[0133] Although not shown, while the operation mode of the electronic device is set to one of the first operation mode to the fourth operation mode, the processor (211) may receive an audio signal from at least one external electronic device (220) (or one of the at least one external electronic device (220)) through the server (230). The processor (211) may set the operation mode of the electronic device (210) to a default mode based on receiving the audio signal from the at least one external electronic device (220) (or one of the at least one external electronic device (220). For example, while the function for echo cancellation is disabled, the processor (211) may receive an audio signal from at least one external electronic device (220) (or one of the at least one external electronic device (220)) through the server (230). The processor (211) may activate the function for echo cancellation based on receiving the audio signal from the at least one external electronic device (220) (or one of the at least one external electronic device (220). For example, the processor (211) may change the state of the electronic device (210) from state (640) to state (610) based on receiving an audio signal from at least one external electronic device (220) (or one of the at least one external electronic device (220).

[0134] Figure 7 illustrates the operation of an electronic device for disabling the function for echo cancellation.

[0135] Referring to FIG. 7, in state (710), the electronic device (210) can provide a service related to live broadcasting through a software application. The processor (211) can display a user interface (251) related to the software application for call connection through the display (216). The user interface (251) can display at least one object for changing setting information for live broadcasting. For example, the user interface (251) can include an object (252) for blocking sound, an object (253) for blocking screen transmission, an object (254) for changing the direction of the camera, and / or an object (255) for setting a background effect. For example, the user interface (251) can include an area (260) for displaying a notification message.

[0136] For example, the user interface (251) may include an object (261) indicating that a live broadcast is in progress. The user interface (251) may include an object (262) indicating the number of at least one external electronic device (220) to which audio signals and / or video signals acquired from the electronic device (210) are transmitted. The object (262) may indicate the number of users watching the live broadcast. The user interface (251) may include an object (253) for ending the live broadcast.

[0137] According to one embodiment, the processor (211) may set the operation mode of the electronic device (210) to a first operation mode while the live broadcasting operation is performed on the electronic device (210). For example, the first operation mode may correspond to the first operation mode regarding the element (661) of FIG. 6. The first operation mode may be referred to as a broadcast mode. The processor (211) may display an object (671) to indicate the operation mode of the electronic device (210). For example, the object (671) may indicate that the operation mode of the electronic device (210) is the first operation mode. The object (671) may indicate that a function for echo cancellation is disabled.

[0138] According to one embodiment, a software application may provide a service for conducting a live broadcast with other users during a live broadcast. The processor (211) may request an invitation to the live broadcast from an external electronic device (220-1). Based on the external electronic device (220-1) responding to the invitation to the live broadcast, the processor (211) may change the state of the electronic device (210) from state (710) to state (720).

[0139] In state (720), the processor (211) can provide broadcast content according to an audio signal and / or a video signal acquired from an external electronic device (220-1) in an area (721) of a user interface (251) of a software application. The processor (211) can acquire the audio signal and / or the video signal acquired from the external electronic device (220-1) through the server (230). The processor (211) can provide broadcast content based on the acquired audio signal and / or the video signal. Accordingly, the processor (211) can provide broadcast content according to the audio signal and / or the video signal acquired from the electronic device (210) and broadcast content according to the audio signal and / or the video signal acquired from the external electronic device (220-1) together.

[0140] For example, when broadcast content according to an audio signal and / or a video signal obtained from an electronic device (210) and broadcast content according to an audio signal and / or a video signal obtained from an external electronic device (220-1) are provided together, the processor (211) can output the audio signal obtained from the external electronic device (220-1) through a speaker (212).

[0141] The processor (211) can obtain an audio signal (hereinafter, a first audio signal) generated by a user of the electronic device (210) through the microphone (213). The processor (211) can obtain an audio signal (hereinafter, a second audio signal) output through the speaker (212) through the microphone (213). Accordingly, the processor (211) can obtain the first audio signal and the second audio signal through the microphone (213). The processor (211) can re-activate a function for echo cancellation to remove the second audio signal. The processor (211) can activate the function for echo cancellation based on the acquisition of an audio signal and / or a video signal acquired from an external electronic device (220-1). In response to activating the function for echo cancellation, the processor (211) can not display the object (671).

[0142] According to one embodiment, the processor (211) may identify that the provision of broadcast content based on audio signals and / or video signals acquired from the external electronic device (220-1) has been discontinued. Based on identifying that the provision of broadcast content based on audio signals and / or video signals acquired from the external electronic device (220-1) has been discontinued, the processor (211) may change the state of the electronic device (210) from state (720) to state (730).

[0143] In state (730), since the provision of broadcast content based on the audio signal and / or video signal acquired from the external electronic device (220-1) is stopped, the processor (211) may not receive the audio signal and / or video signal from the external electronic device (220-1). Therefore, the processor (211) may deactivate the function for echo cancellation again. The processor (211) may set the operation mode of the electronic device (210) to the first operation mode. The processor (211) may display an object (671) to indicate that the operation mode of the electronic device (210) is the first operation mode. The processor (211) may display an object (671) to indicate that the function for echo cancellation is deactivated. State (730) may correspond to state (710).

[0144] Figure 8 is a flowchart of the operation of an electronic device for disabling a function for echo cancellation.

[0145] Referring to FIG. 8, in operation 810, the processor (211) may identify whether the remaining battery capacity of the electronic device (210) is within a specified range while the echo cancellation function is activated. For example, the processor (211) may identify whether the remaining battery capacity is less than a specified remaining capacity. For example, while the echo cancellation function is activated, the processor (211) may allocate resources for the echo cancellation function. The processor (211) may identify whether the remaining battery capacity is within a specified range to determine whether to release the allocated resources.

[0146] In operation 820, if the battery level is within a specified range while the echo cancellation function is activated, the processor (211) may deactivate the echo reduction function. For example, the processor (211) may deactivate the echo reduction function based on identifying that the battery level is within a specified range while the echo cancellation function is activated. The processor (211) may deactivate the echo reduction function to reduce battery consumption. The processor (211) may deactivate the echo reduction function by releasing resources allocated for the echo reduction function.

[0147] In operation 830, if the battery level is not within a specified range while the echo cancellation function is activated, the processor (211) may maintain the activation of the echo cancellation function. For example, the processor (211) may maintain the activation of the echo reduction function based on identifying that the battery level is not within a specified range while the echo cancellation function is activated.

[0148] According to one embodiment, an electronic device (e.g., electronic device (210)) may include a speaker (e.g., speaker (212)), a microphone (e.g., microphone (213)), a communication circuit (e.g., communication circuit (214)), a memory storing instructions and including one or more storage media, and at least one processor (e.g., processor (211)) including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to establish a call connection between the electronic device and at least one external electronic device via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to transmit, to the at least one external electronic device, an audio signal having an echo cancellation function applied thereto based on obtaining an audio signal from the microphone while the call connection is established. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify a notification message generated from a software application executed for the call connection while the echo cancellation function is activated. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to deactivate the echo cancellation function based on identifying the notification message.

[0149] According to one embodiment, the notification message may be used to display text data received from one of the at least one external electronic device.

[0150] In one embodiment, the notification message may indicate that the call connection is established for broadcasting the audio signal to the at least one external electronic device.

[0151] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to additionally allocate resources for a noise cancellation function based on disabling the echo cancellation function.

[0152] According to one embodiment, the electronic device may include a display (e.g., display (216)) and a camera (e.g., camera (215)). The call connection may be established to transmit a video signal acquired through the camera together with the audio signal to the at least one external electronic device through the communication circuit.

[0153] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, in response to identifying the notification message, display, through the display, a visual object superimposed on a screen relating to the software application, indicating whether to disable the echo cancellation function.

[0154] According to one embodiment, the visual object may include at least one element for setting the strength of a function for noise removal.

[0155] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify that no audio signal is received from the at least one external electronic device during a specified time period while the function for echo cancellation is activated. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to deactivate the function for echo cancellation based on identifying that no audio signal is received from the at least one external electronic device during the specified time period.

[0156] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify that an audio signal is received from one of the at least one external electronic device while the echo cancellation function is disabled. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to activate the echo cancellation function based on the audio signal received from one of the at least one external electronic device.

[0157] According to one embodiment, the electronic device may include a battery. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify that the remaining capacity of the battery is within a specified range while the echo cancellation function is activated. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to deactivate the echo cancellation function based on identifying that the remaining capacity of the battery is within the specified range.

[0158] According to one embodiment, a method performed by an electronic device may include establishing a call connection between the electronic device and at least one external electronic device via a communication circuit of the electronic device. The method may include transmitting, via the communication circuit, an audio signal to which an echo cancellation function has been applied based on obtaining an audio signal from a microphone of the electronic device while the call connection is established, the audio signal to which an echo cancellation function has been applied, to the at least one external electronic device. The method may include identifying a notification message generated from a software application executed for the call connection while the echo cancellation function is activated. The method may include disabling the echo cancellation function based on identifying the notification message.

[0159] According to one embodiment, the notification message may be used to display text data received from one of the at least one external electronic device.

[0160] In one embodiment, the notification message may indicate that the call connection is established for broadcasting the audio signal to the at least one external electronic device.

[0161] In one embodiment, the method may include an operation of additionally allocating resources for a noise cancellation function based on disabling the function for echo cancellation.

[0162] According to one embodiment, the call connection may be established to transmit a video signal acquired through a camera of the electronic device together with the audio signal to the at least one external electronic device through the communication circuit.

[0163] In one embodiment, the method may include, in response to identifying the notification message, displaying, via a display of the electronic device, a visual object overlaid on a screen relating to the software application, indicating whether to disable the echo cancellation feature.

[0164] According to one embodiment, the visual object may include at least one element for setting the strength of a function for noise removal.

[0165] According to one embodiment, the method may include an operation of identifying that no audio signal is received from the at least one external electronic device during a specified time period while the function for echo cancellation is activated. The method may include an operation of disabling the function for echo cancellation based on identifying that the audio signal is not received from the at least one external electronic device during the specified time period.

[0166] According to one embodiment, the method may include an operation of identifying that an audio signal is received from one of the at least one external electronic device while the function for echo cancellation is disabled. The method may include an operation of activating the function for echo cancellation based on the audio signal received from one of the at least one external electronic device.

[0167] According to one embodiment, a non-transitory computer readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by at least one processor of an electronic device having a speaker, a microphone, and a communication circuit, cause the electronic device to establish a call connection between the electronic device and at least one external electronic device via the communication circuit. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to transmit, through the communication circuit, an audio signal to which an echo cancellation function has been applied based on obtaining an audio signal from the microphone while the call connection is established, to the at least one external electronic device. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to identify a notification message generated from a software application executed for the call connection while the echo cancellation function is activated. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to disable the echo cancellation function based on identifying the notification message.

[0168] According to the above-described embodiment, when a live broadcast is transmitted from an electronic device, unnecessary resource waste can be prevented by disabling the echo cancellation function. The electronic device can release the resources allocated to the echo cancellation function. As the resources allocated to the echo cancellation function are released, power consumption and heat generation can be reduced. Furthermore, the duration for which a call connection is maintained can be increased. According to the embodiment, the electronic device can improve the performance of the noise cancellation function by additionally allocating the resources to the noise cancellation function.

[0169] Electronic devices according to embodiments disclosed herein may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.

[0170] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0171] In one embodiment of this document, the term "module" used may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0172] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0173] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0174] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, speaker; microphone; communication circuit; A memory storing instructions and including one or more storage media; and At least one processor comprising a processing circuit, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Through the above communication circuit, a call connection is established between the electronic device and at least one external electronic device, While the call connection is established, based on obtaining an audio signal from the microphone, transmitting the audio signal to which an echo cancellation function is applied, through the communication circuit, to the at least one external electronic device; While the function for the above echo cancellation is activated, identify the notification message generated from the software application executed for the call connection, Based on identifying the above notification message, causing the function for echo cancellation to be disabled, Electronic devices.

2. In the first paragraph, the notification message is: Used to display text data received from at least one of the above external electronic devices, Electronic devices.

3. In paragraph 1, the notification message is: Indicating that the call connection is established for broadcasting the audio signal to the at least one external electronic device, Electronic devices.

4. In the first paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Further causing the electronic device to allocate additional resources for the noise cancellation function based on disabling the function for the above echo cancellation, Electronic devices.

5. In the first paragraph, the electronic device, display; and Including more cameras, The above call connection is, Established to transmit a video signal acquired through the camera together with the audio signal to the at least one external electronic device through the communication circuit, Electronic devices.

6. In the fifth paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: In response to identifying the above notification message, further causing the display to display a visual object overlaid on the screen of the software application to indicate whether the function for echo cancellation is to be disabled. Electronic devices.

7. In the 6th paragraph, the visual object is, comprising at least one element for setting the strength of a function for noise removal, Electronic devices.

8. In the first paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While the function for echo cancellation is activated, it is identified that no audio signal is received from the at least one external electronic device for a specified period of time, Further causing the function for echo cancellation to be disabled based on identifying that the audio signal is not received from the at least one external electronic device for the specified time period. Electronic devices.

9. In the 8th paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While the function for said echo cancellation is disabled, identifying that an audio signal is received from one of said at least one external electronic device; Further causing the function for echo cancellation to be activated based on the audio signal received from at least one of the external electronic devices. Electronic devices.

10. In the first paragraph, the electronic device, Including more batteries, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While the function for the above echo cancellation is activated, it is identified that the remaining battery capacity is within a specified range, Causing the function for echo cancellation to be disabled based on identifying that the remaining battery capacity is within the specified range. Electronic devices.

11. In a method performed by an electronic device, An operation of establishing a call connection between the electronic device and at least one external electronic device through a communication circuit of the electronic device; While the call connection is established, an operation of transmitting the audio signal to which an echo cancellation function is applied, through the communication circuit, to the at least one external electronic device based on obtaining the audio signal from the microphone of the electronic device; An action for identifying a notification message generated from a software application executed for the call connection while the function for the above echo cancellation is activated; and Based on identifying the above notification message, including an action to disable the function for echo cancellation, method.

12. In paragraph 11, the notification message is: Used to display text data received from at least one of the above external electronic devices, method.

13. In paragraph 11, the notification message is: Indicating that the call connection is established for broadcasting the audio signal to the at least one external electronic device, method.

14. In the 11th paragraph, the method, Based on disabling the function for the above echo cancellation, further comprising an operation of additionally allocating resources for the function for noise cancellation. method.

15. In a non-transitory computer readable storage medium storing one or more programs, the one or more programs, when executed by at least one processor of an electronic device having a speaker, a microphone, and a communication circuit, Through the above communication circuit, a call connection is established between the electronic device and at least one external electronic device, While the call connection is established, based on obtaining an audio signal from the microphone, transmitting the audio signal to which an echo cancellation function is applied, through the communication circuit, to the at least one external electronic device; While the function for the above echo cancellation is activated, identify the notification message generated from the software application executed for the call connection, instructions for causing the electronic device to disable the function for echo cancellation based on identifying the notification message; Non-transitory computer-readable storage medium.

Images