Electronic device, method, and non-transitory computer-readable recording medium for adjusting volume of audio signal

Abstract

Disclosed is an electronic device. The electronic device may acquire a first audio signal from an external electronic device via a communication circuit. The electronic device may identify a second audio signal generated by the electronic device. The electronic device may acquire an input for adjusting audio volume while outputting first audio based on the first audio signal and second audio based on the second audio signal. The electronic device may adjust, on the basis of the input, the volume of at least one audio selected from the first audio or the second audio.

Description

Electronic device, method, and non-transitory computer-readable recording medium for controlling the volume of an audio signal

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable recording media for controlling the volume of an audio signal.

[0002] An electronic device can establish a call with another electronic device via a communication circuit. The electronic device can output sound based on an audio signal acquired from the other electronic device during the call connection. The electronic device can adjust the volume of the sound output through the speaker during the call connection.

[0003] An electronic device is disclosed. The electronic device may include a communication circuit. The electronic device may include at least one processor. The electronic device may include a memory comprising one or more storage media storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a first audio signal from an external electronic device via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify a second audio signal generated by the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain an input for adjusting the intensity of audio while outputting first audio based on the first audio signal and second audio based on the second audio signal. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to adjust the intensity of at least one audio selected from the first audio or the second audio based on the input.

[0004] A method is disclosed. The method may include an operation of obtaining a first audio signal from an external electronic device via the communication circuit. The method may include an operation of identifying a second audio signal generated by the electronic device. The method may include an operation of obtaining an input for adjusting the intensity of audio while outputting first audio based on the first audio signal and second audio based on the second audio signal. The method may include an operation of adjusting the intensity of at least one audio selected from the first audio or the second audio based on the input.

[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by the at least one processor, can cause the electronic device to obtain a first audio signal from an external electronic device via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, can cause the electronic device to identify a second audio signal generated by the electronic device. The instructions, when individually or collectively executed by the at least one processor, can cause the electronic device to obtain an input for adjusting the intensity of audio while outputting first audio based on the first audio signal and second audio based on the second audio signal. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to adjust the intensity of at least one audio selected from the first audio or the second audio based on the input.

[0006] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0007] FIG. 2A is a block diagram of an electronic device according to one embodiment.

[0008] FIG. 2b is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0009] FIG. 3A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0010] FIG. 3b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0011] FIG. 4A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0012] FIG. 4b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0013] FIG. 4c is a diagram illustrating time overlap of audio signals output from an electronic device according to one embodiment.

[0014] FIG. 4d illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0015] FIG. 5 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0016] FIG. 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0017] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0018] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0019] FIG. 9 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0020] FIG. 10A is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0021] FIG. 10b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0022] FIG. 11 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0023] FIG. 12 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0024] FIG. 13 illustrates an example of another electronic device according to one embodiment.

[0025] FIG. 14 illustrates an example of an electronic device according to one embodiment.

[0026] FIG. 15A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0027] FIG. 15b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0028] FIG. 16 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0029] FIG. 17 is a diagram illustrating the structure of a generative AI model of an electronic device according to one embodiment.

[0030] FIG. 18 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0031] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0032] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0033] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0034] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0035] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0036] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0037] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0038] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0039] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0040] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0041] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0042] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0043] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0045] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0046] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0047] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0048] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0049] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, a loss coverage (e.g., 664 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for realizing URLLC.

[0050] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0051] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0052] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0053] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0054] FIG. 2A is a block diagram of an electronic device according to one embodiment.

[0055] In one embodiment, the electronic device (101) of FIG. 2A may correspond to the electronic device (101) of FIG. 1. Referring to FIG. 2A, the electronic device (101) may include a processor (120), a memory (130), an input module (150), a display (260), a speaker (270), and a communication circuit (290).

[0056] In one embodiment, the processor (120) may be used to execute the operations of the electronic device (101) exemplified in the descriptions of FIGS. 5 to 11. For example, the processor (120) may include at least a portion of the processor (120) of FIG. 1 or may correspond to at least a portion of the processor (120) of FIG. 1. For example, the processor (120) may include one or more processors, including an application processor (AP) and / or a communication processor (CP). For example, the processor (120) may be implemented as a single chip, such as a system on chip (SoC), or may be implemented as multiple chips. For example, the processor (120) may be implemented as a single integrated circuit or may be implemented as multiple integrated circuits. For example, the processor (120) may be distributedly arranged within the electronic device (101).

[0057] In one embodiment, the memory (130) may (at least temporarily) store instructions for executing operations of the electronic device (101) exemplified in the descriptions of FIGS. 5 to 11. The instructions may be executed by the processor (120). The instructions may be included in one or more programs (140) stored in the memory (130) (e.g., a phone application (APP) (210), an artificial intelligence (AI) module (220), and an audio framework (230)). For example, the memory (130) may include at least a portion of the memory (130) of FIG. 1 (or at least a portion of the non-volatile memory (134)) or may correspond to at least a portion of the memory (130) of FIG. 1 (or at least a portion of the non-volatile memory (134)). For example, the memory (130) may include a main memory (e.g., a random access memory (RAM), a register for the processor (120), a cache for the processor (120), a register for the communication circuit (290), a buffer (or soft buffer) for the communication circuit (290), and / or an auxiliary memory (e.g., a hard disk drive (HDD), a solid state drive (SSD)) of the electronic device (101) within the electronic device (101). For example, the memory (130) may be implemented as a single chip or may be implemented as multiple chips. For example, the memory (130) may be implemented as one integrated circuit or may be implemented as multiple integrated circuits. For example, the memory (130) may be distributedly arranged within the electronic device (101).

[0058] In one embodiment, the phone APP (210), the AI ​​module (220), and the audio framework (230) may be executed by the processor (120). Depending on the embodiment, the AI ​​module (220) may be included as a part of the phone APP (210), but is not limited thereto. Depending on the embodiment, the AI ​​module (220) may be a separate software module distinct from the phone APP (210).

[0059] In one embodiment, the phone APP (210) may generate a screen for providing a call function to the user. In one embodiment, the phone APP (210) may display the screen through the display (260). In one embodiment, the screen of the phone APP (210) may include a screen for obtaining an input (e.g., a touch input to the phone APP (210)) for establishing a connection (or session) for a phone call between the electronic device (101) and another electronic device (e.g., electronic devices (102, 103)). In one embodiment, the screen of the phone APP (210) may include a screen for obtaining an input (e.g., an input via a keypad) of setting information for the call. In one embodiment, the screen of the phone APP (210) may include a visual object (or image) (or icon) (or button) associated with at least one function (e.g., call assistance, speech to text (STT), text to speech (TTS), or real-time translation) while a call is connected. In one embodiment, the phone APP (210) may transmit a signal to the audio framework (230) indicating that real-time translation is activated based on a request for real-time translation (and / or text call).

[0060] In one embodiment, the phone APP (210) may request real-time translation from the AI ​​module (220) based on a request for real-time translation (and / or text call). In one embodiment, the phone APP (210) may record an audio signal obtained from another electronic device (102) during a call. In one embodiment, the phone APP (210) may record an audio signal during a call based on a request for real-time translation (and / or text call). In one embodiment, the phone APP (210) may transmit the audio signal to the AI ​​module (220). However, the present invention is not limited thereto. For example, the phone APP (210) may transmit an audio signal (or data of an audio signal) obtained from another electronic device (102) during a call to the AI ​​module (220) based on a request for real-time translation (and / or text call).

[0061] In one embodiment, the AI ​​module (220) can identify a utterance included in an audio signal. In one embodiment, the AI ​​module (220) can convert the utterance included in the audio signal into text using an automatic speech recognition (ASR) model. In one embodiment, the AI ​​module (220) can translate the utterance included in the audio signal. In one embodiment, the AI ​​module (220) can translate the utterance included in the audio signal based on a request from a phone APP (210). In one embodiment, the AI ​​module (220) can convert the translated utterance into an audio signal. In one embodiment, the AI ​​module (220) can convert the translated utterance into an audio signal using a text-to-speech (TTS) model. In one embodiment, the AI ​​module (220) can output an audio signal including the translated utterance through a speaker (270) and / or a speaker (275). In FIG. 2A, the AI ​​module (220) is illustrated as being included in the electronic device (101), but this is merely an example. According to an embodiment, the AI ​​module (220) may be included in a server (e.g., the server (108) of FIG. 1) external to the electronic device (101). For example, the AI ​​module (220) may be stored in the memory of the server. In this case, the electronic device (101) may transmit text extracted from an audio signal to the server via a communication circuit (e.g., the communication module (190) of FIG. 1). Thereafter, the electronic device (101) may receive translated text information from the server via the communication circuit. Additionally, the electronic device (101) may transmit the audio signal together with the text extracted from the audio signal to the server in order to obtain the translated text information.

[0062] In one embodiment, the AI ​​module (220) may perform talkback on a conversation displayed through the phone APP (210). In one embodiment, the talkback may include a function of converting the conversation displayed through the phone APP (210) into an audio signal using a text-to-speech (TTS) model and outputting the audio signal through the speaker (270) and / or the speaker (275).

[0063] In one embodiment, the audio framework (230) can set the sound intensity (or volume) of the audio signal output from the phone APP (210) and / or the AI ​​module (220). In one embodiment, the volume setting can be described with reference to FIGS. 5 to 11.

[0064] In one embodiment, the audio framework (230) may output audio signals obtained from the phone APP (210) and / or the AI ​​module (220) at a set volume through the speaker (270) and / or the speaker (275). In one embodiment, the speaker (270) and / or the speaker (275) may be referred to as an audio output device. In one embodiment, the speaker (270) may include the speaker of the audio output module (155) of FIG. 1 and the receiver of the audio output module (155) of FIG. 1. In one embodiment, the speaker (275) may be a separate device from the electronic device (101). In one embodiment, the speaker (275) may be an electronic device that is connectable to the electronic device (101) via a wired and / or wireless network. In one embodiment, the speaker (275) may be included in wireless earphones (1310, 1320) as exemplified by the identification symbol (1301) of FIG. 13. In one embodiment, the speaker (275) may be included in an infotainment system of a vehicle as exemplified by the identification symbol (1305) of FIG. 13, but is not limited thereto. In one embodiment, the speaker (275) may be included in a soundbar, wired earphones, a headset, an earset, and / or headphones.

[0065] In one embodiment, the audio framework (230) may output audio signals obtained from the phone APP (210) and / or the AI ​​module (220), respectively. However, the present invention is not limited thereto. In one embodiment, the audio framework (230) may synthesize and output audio signals obtained from the phone APP (210) and / or the AI ​​module (220) into a single audio signal. In this case, in one embodiment, the audio framework (230) may set the volumes of the audio signal obtained from the phone APP (210) and the audio signal obtained from an application other than the phone APP (210) (e.g., the AI ​​module (220)), and then synthesize the audio signals into a single audio signal.

[0066] In one embodiment, the input module (150) may include at least two physical keys (e.g., buttons) for obtaining user input. In one embodiment, a signal may be generated to request the performance of a first function by pressing (or pushing) one of the at least two physical keys (e.g., buttons). In one embodiment, a signal may be generated to request the performance of a second function opposite to the first function by pressing (or pushing) another of the at least two physical keys (e.g., buttons). For example, the first function may be a function for increasing the loudness (or volume) of an audio signal output. For example, the second function may be a function for decreasing the loudness (or volume) of an audio signal output. For example, the input module (150) may correspond to at least a portion of the input module (150) of FIG. 1. The keys for obtaining user input are not limited to physical volume keys. For example, an input module (150) for obtaining user input may include a button, a wheel, a side touch, or a pressure sensor. For example, the user input may be obtained through a user interface (UI) for controlling the volume on the display (260). For example, the user input may include various types of input. For example, the user input may include voice, motion (or gesture), or pattern (e.g., touch pattern).

[0067] In one embodiment, the display (260) can display visual content. For example, the display (260) can include at least a portion of the display module (160) of FIG. 1 or can correspond to at least a portion of the display module (160) of FIG. 1.

[0068] In one embodiment, the speaker (270) may convert an audio signal (or an electrical signal) into sound. For example, the speaker (270) may correspond to at least a portion of the audio module (170) and / or the sound output module (155) of FIG. 1.

[0069] In one embodiment, the communication circuit (290) may be used to support a phone call between the electronic device (101) and another electronic device (e.g., the electronic device (102)). In one embodiment, the communication circuit (290) may be used to support a one-to-one phone call between the electronic device (101) and one electronic device (e.g., the electronic devices (102, 103)). In one embodiment, the communication circuit (290) may be used to support a multi-party call (or group call) between the electronic device (101) and multiple electronic devices (e.g., the electronic devices (102, 103)). For example, the communication circuit (290) may include at least a portion of the communication module (190) (or the wireless communication module (192)) of FIG. 1, or may correspond to at least a portion of the communication module (190) (or the wireless communication module (192)) of FIG. 1. For example, the communication circuit (290) may include a communication circuit for a long-distance communication network. For example, the communication circuit (290) may be used to establish a communication link. For example, the communication circuit (290) may be implemented as a single chip or as multiple chips. For example, the communication circuit (290) may be implemented as a single integrated circuit or as multiple integrated circuits. For example, the communication circuit (290) may be distributed within the electronic device (101).

[0070] In one embodiment, the other electronic devices (102, 103) may be devices for call connection with the electronic device (101). For example, the other electronic devices (102, 103) may include a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance capable of call connection with the electronic device (101).

[0071] FIG. 2b is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0072] For the description of Fig. 2b, reference may be made to Fig. 1 and Fig. 2a.

[0073] Referring to FIG. 2b, at operation 241, the phone APP (210) may notify the audio framework (230) that a call has been initiated (or a call has been received) (or a call has been connected).

[0074] In operation 243, the audio framework (230) may set the volume of the audio output device (279) for the first audio signal obtained from the phone APP (210) to a first volume. In one embodiment, the audio output device (279) may include a speaker (270) and / or a speaker (275).

[0075] In operation 245, the phone APP (210) may notify the audio framework (230) that translation is being performed. The phone APP (210) may notify the audio framework (230) that translation is being performed based on a request for real-time translation (and / or text call). The phone APP (210) may notify the audio framework (230) that translation is being performed based on a request for real-time translation from the AI ​​module (220).

[0076] In operation 247, the phone APP (210) may transmit call voice recording data to the ASR model (221) of the AI ​​module (220). In one embodiment, the call voice recording data may be data in which a first utterance included in a first audio signal is recorded. In one embodiment, the phone APP (210) may record an audio signal during a call based on a request for real-time translation (and / or text call). In one embodiment, the recorded audio signal during a call may be referred to as call voice recording data. In operation 247, the call voice recording data is exemplified as being provided to the AI ​​module (220), but this is merely an example. For example, the phone APP (210) may transmit an audio signal (or data of an audio signal) obtained from another electronic device (102) during a call to the AI ​​module (220) based on a request for real-time translation (and / or text call).

[0077] In one embodiment, the ASR model (221) of the AI ​​module (220) can identify an utterance included in an audio signal. The ASR model (221) can convert the utterance included in the first audio signal into text. In operation 249, the ASR model (221) can transmit the call voice text data (or the text converted from the utterance included in the audio signal) to the translation engine (223). In operation 251, the translation engine (223) can translate the text included in the audio signal. In operation 253, the translation engine (223) can transmit the translated text to the TTS engine (225). The TTS engine (225) can generate a second audio signal based on the translated text. In operation 255, the TTS engine (225) can transmit the second audio signal based on the translated text to the audio framework (230).

[0078] In operation 257, the audio framework (230) can determine a second volume for a second audio signal obtained from the TTS engine (225). In operation 259, the audio framework (230) can set the volume of the audio output device (279) for the second audio signal obtained from the TTS engine (225) to the second volume.

[0079] Hereinafter, with reference to FIGS. 3a and 3b, an operation of an electronic device (101) setting real-time translation at a time other than a call connection is described.

[0080] FIG. 3A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 3B illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0081] For the explanation of FIGS. 3A and 3B, reference may be made to FIGS. 1, 2A, and 2B. Reference numeral (301) in FIG. 3A may illustrate a screen (310) of a phone APP (210) displayed on a display (260). Reference numeral (303) in FIG. 3A may illustrate a menu (330) superimposed (or displayed) on the screen (310). Reference numeral (305) in FIG. 3B may illustrate a screen (350) of a phone APP (210) displayed on a display (260). Reference numeral (307) in FIG. 3B may illustrate a screen (370) of a phone APP (210) displayed on a display (260).

[0082] In one embodiment, the electronic device (101) may display a screen (310) on the display (260) based on the execution of the phone APP (210). In one embodiment, the screen (310) may be displayed on the display (260) based on the execution of the phone APP (210) by the processor (120). In one embodiment, the screen (310) may include buttons (or visual objects) (or texts) (or images) (or menus) (e.g., keypad, recents, contacts)) for changing tabs displayed on the display (260). In one embodiment, the screen (310) may include buttons (or visual objects) (or texts) (or images) (or menus) (315) related to settings.

[0083] In one embodiment, the electronic device (101) may obtain user input for a button (315) on the screen (310). In one embodiment, the electronic device (101) may, in response to the user input of selecting the button (315), overlay (or display) a menu (or pop-up window) (330) on the screen (310). In one embodiment, the menu (330) may include buttons (or visual objects) (or texts) (or images) (or menus) related to speed dial numbers, open to keypad, or settings.

[0084] In one embodiment, the electronic device (101) may obtain a user input for a button (335) on a menu (330). In one embodiment, the electronic device (101) may switch the screen (310) in response to the user input of selecting the button (335). In one embodiment, the electronic device (101) may switch to a screen (350) for call setup in response to the user input of selecting the button (335). In one embodiment, the screen (350) may include buttons (or visual objects) (or texts) (or images) (or menus) for setting up call assist (e.g., text call, live translate), but is not limited thereto. In one embodiment, the screen (350) may include buttons for setting call protection and buttons for other call settings (e.g., call background, caller information, call notifications, and ringtones).

[0085] In one embodiment, the electronic device (101) may obtain a user input for a button (355) on a screen (350). In one embodiment, the electronic device (101) may display a screen (370) on the display (260) for setting real-time translation in response to the user input of selecting the button (355). In one embodiment, the screen (370) may include a button (or visual object) (or text) (or image) (or menu) (375) for setting real-time translation on / off.

[0086] In one embodiment, the electronic device (101) may obtain a user input for a button (375). In one embodiment, the electronic device (101) may activate or deactivate real-time translation in response to the user input selecting the button (375). In one embodiment, after the real-time translation is activated, the electronic device (101) may translate utterances included in an audio signal obtained from another electronic device (102) based on the establishment of a call connection.

[0087] Hereinafter, with reference to FIGS. 4a, 4b, 4c, and 4d, the operation of the electronic device (101) setting up real-time translation during a call connection is described.

[0088] FIG. 4A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 4B illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 4C is a diagram illustrating the time overlap of audio signals output from an electronic device according to an embodiment. FIG. 4D illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0089] For the description of FIGS. 4a, 4b, 4c, and 4d, reference may be made to FIGS. 1, 2a, 2b, 3a, and 3b.

[0090] Reference numeral (401) of FIG. 4A may illustrate a screen (410) of a phone APP (210) displayed on a display (260). Reference numeral (402) of FIG. 4A may illustrate menus (420, 425) displayed on the screen (410). Reference numeral (403) of FIG. 4B may illustrate a screen (430) of a phone APP (210) displayed on the display (260). Reference numeral (404) of FIG. 4B may illustrate a menu overlaid (or displayed) on the screen (430). Reference numeral (405) of FIG. 4B may illustrate a menu overlaid (or displayed) on the screen (430). Reference numeral (406) of FIG. 4B may illustrate a menu (460) overlaid (or displayed) on the screen (430). Reference numeral (407) of FIG. 4c may illustrate the superposition of audio signals output during a call connection. Reference numeral (408) of FIG. 4d may illustrate a menu (480) superimposed (or displayed) on a screen (410). Reference numeral (409) of FIG. 4d may illustrate a menu (490) superimposed (or displayed) on a screen (410).

[0091] In one embodiment, the electronic device (101) may display a screen (410) on the display (260) indicating that a call is connected with another electronic device (102). In one embodiment, the screen (410) may be displayed on the display (260) based on the processor (120) executing the phone APP (210). In one embodiment, the screen (410) may display information about the other party to the call. In one embodiment, the screen (410) may include a button (or a visual object) (or texts) (or an image) (or a menu) (415) for setting up call assistance during the call connection. However, the present invention is not limited thereto. In one embodiment, the screen (410) may include buttons for executing various call functions (e.g., video call, Bluetooth, speaker, mute, keypad).

[0092] In one embodiment, the electronic device (101) may obtain a user input for a button (415). In one embodiment, in response to a user input selecting the button (415), the electronic device (101) may overlay (or display) buttons (or visual objects) (or texts) (or images) (or menus) for a text call or a live translate on the screen (410).

[0093] In one embodiment, the electronic device (101) may obtain a user input for a button (425). In one embodiment, in response to the user input of selecting the button (425), the electronic device (101) may display a screen (430) on the display (260) that displays the user's speech of the electronic device (101) and the speech of another user of another electronic device (102). In one embodiment, the screen (430) may include buttons (or visual objects) (or texts) (or images) (or menus) (431, 432) for setting a translation language. In one embodiment, the screen (430) may include buttons (or visual objects) (or texts) (or images) (or menus) (435) for additional settings related to real-time translation. In one embodiment, the screen (430) may include a dialogue log based on speeches of the user and another user.

[0094] In one embodiment, the electronic device (101) can obtain a user input for a button (431). In one embodiment, the electronic device (101) can, in response to a user input selecting the button (431), overlay (or display) a menu (404) for setting a different language for another user on the screen (430). In one embodiment, the electronic device (101) can obtain a user input for a button (432). In one embodiment, the electronic device (101) can, in response to a user input selecting the button (432), overlay (or display) a menu (405) for setting a language for another user on the screen (430). In one embodiment, real-time translation can be performed by the AI ​​module (220) of the electronic device (101). In one embodiment, through real-time translation, a user's utterance obtained through a microphone (e.g., input module (150) or audio module (170)) of the electronic device (101) may be translated into another user's language. For example, the English text "I'm using translator" (441) may be displayed to indicate that real-time translation is in use. For example, the user's Korean utterance "Shall we meet at Gangnam station tomorrow?" (442) may be translated into the English text "Can we meet at Gangnam station tomorrow?" (443). In one embodiment, through real-time translation, another user's utterance obtained through the communication circuit (290) of the electronic device (101) may be translated into the user's language. For example, the other user's English utterance "okay, how about 7pm?" may be translated into the Korean text "Okay, how about 7pm?"

[0095] In one embodiment, the electronic device (101) may obtain a user input for a button (435). In one embodiment, in response to the user input of selecting the button (435), the electronic device (101) may overlay (or display) a menu (460) on the screen (430) that includes buttons (or visual objects) (or texts) (or images) (or menus) (461, 465) for additional settings related to real-time translation. The menu (460) is exemplified as including only buttons (461, 465) for setting whether to output a utterance translated from another user's utterance and for setting whether to transmit the user's utterance. However, the present invention is not limited thereto. For example, the menu (460) may include a button for setting whether to mute the first audio signal. For example, when the first audio signal is muted, another user's speech of another electronic device (102) may not be output from the electronic device (101), and a second audio signal may be output. For example, when the first audio signal is muted, the electronic device (101) may output only the audio signal for outputting the Korean text "Okay, how about 7pm?" (452) among the audio signal for outputting the English speech of another user "Okay, how about 7pm?" (451) and the audio signal for outputting the Korean text "Okay, how about 7pm?" (452) through the speaker (270) (or the speaker (275)).

[0096] In one embodiment, the electronic device (101) may obtain a user input for a button (461). In one embodiment, the electronic device (101) may, in response to a user input selecting the button (461), set whether to output a utterance translated from another user's utterance. In one embodiment, while the output of the translated utterance is activated, the electronic device (101) may output the other user's translated utterance through the speaker (270) or the speaker (275). In one embodiment, while the output of the translated utterance is deactivated, the electronic device (101) may not output the other user's translated utterance through the speaker (270) or the speaker (275).

[0097] In one embodiment, the electronic device (101) can obtain a user input for the button (465). In one embodiment, the electronic device (101) can set whether to transmit the user's speech in response to the user input of selecting the button (465). In one embodiment, while the button (465) is activated, the electronic device (101) can transmit only the translated speech of the user to the other electronic device (102) through the communication circuit (290) without transmitting the user's speech. For example, while the button (465) is activated, the electronic device (101) can transmit an audio signal to the other electronic device (102) for outputting the text "can we meet at Gangnam station tomorrow?" among the user's Korean speech "shall we meet at Gangnam station tomorrow?" and the translated English text "can we meet at Gangnam station tomorrow?" In one embodiment, while the button (465) is deactivated, the electronic device (101) can transmit the user's utterance and the user's translated utterance to another electronic device (102) via the communication circuit (290). For example, while the button (465) is deactivated, the electronic device (101) can transmit audio signals to another electronic device (102) for outputting the user's Korean utterance "Shall we meet at Gangnam station tomorrow?" and the translated English text "Can we meet at Gangnam station tomorrow?", but is not limited thereto.

[0098] In one embodiment, when outputting a translated speech of another user through the speaker (270) or the speaker (275), an audio signal of another user of another electronic device (102) (hereinafter, a first audio signal), an audio signal including a speech translated from a speech included in the first audio signal (hereinafter, a second audio signal), and / or an audio signal generated by another application running on the electronic device (101) (hereinafter, a third audio signal) may be overlapped (or overlapped). For example, referring to FIG. 4C, while the first audio signal is output during the period t1 to t3, a second audio signal translated from the first audio signal may be output during the period t2 to t4. Accordingly, the first audio signal and the second audio signal may be overlapped (or overlapped) during the period t2 to t3. In addition, depending on the situation, when the third audio signal is generated, the first audio signal and the second audio signal may not be clearly conveyed to the user due to the third audio signal. Accordingly, the user may request that the second audio signal be louder when real-time translation is requested.

[0099] Additionally, depending on the call environment, the user may want to adjust the volume of the first audio signal, the second audio signal, and / or the third audio signal. For example, when the call is important (or the call is focused), the user may operate the screen (410) on the input module (150) and / or the display (260) to adjust the volume of the first audio signal or the second audio signal. Accordingly, the electronic device (101) may adjust the volume of the first audio signal, the second audio signal, and the third audio signal by the input for adjusting the volume during the call connection. For example, the electronic device (101) may adjust the volume of the first audio signal, the second audio signal, and the third audio signal based on identifying a press (or push) on a physical key for adjusting the volume. Referring to reference numeral (408) of FIG. 4D, the electronic device (101) may display a visual object (or user interface (UI)) (480) on the display (260) indicating that the volume of the first audio signal is adjusted based on identifying a press (or push) on a physical key for adjusting the volume. In one embodiment, the user may selectively control the volume of the first audio signal, the second audio signal, or the third audio signal through additional user input to a button (or visual object) (or text) (or image) (or menu) (485) for additional volume setting on the visual object (480).

[0100] Hereinafter, with reference to FIGS. 5 to 9, an operation of an electronic device (101) appropriately setting the intensity of an audio signal will be described. Hereinafter, with reference to FIGS. 10a, 10b, and 11, an operation of an electronic device (101) adjusting the intensity of audio signals desired by a user through a single user input will be described in detail.

[0101] FIG. 5 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0102] For the explanation of FIG. 5, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0103] The operations of FIG. 5 can be performed by the electronic device (101). The operations of FIG. 5 can be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130).

[0104] Referring to FIG. 5, in operation 510, the electronic device (101) may connect (or establish) a call. In one embodiment, the electronic device (101) may connect (or establish) a call with another electronic device (102) based on accepting a call connection request from the other electronic device (102). In one embodiment, the electronic device (101) may connect (or establish) a call with another electronic device (102) based on transmitting a call connection request to the other electronic device (102).

[0105] In operation 520, the electronic device (101) may set (or identify) (or determine) a call volume and a media volume during a call connection. In one embodiment, the electronic device (101) may set a call volume (or intensity) at which an audio signal (hereinafter, a first audio signal) of another user of another electronic device (102) is output. In one embodiment, the electronic device (101) may set a media volume (or intensity) at which other audio signals generated by one or more applications other than the phone APP (210) are output. For example, some of the other audio signals may be generated by the AI ​​module (220). For example, the AI ​​module (220) may generate an audio signal (hereinafter, a second audio signal) including a translated utterance from a utterance included in the first audio signal.

[0106] For example, some of the other audio signals may be generated by applications for games. For example, some of the other audio signals may be generated by applications for multimedia playback (e.g., video playback applications and / or music playback applications). For example, some of the other audio signals may be audio signals for notifications and / or alarms. For example, audio signals for notifications and / or alarms may be generated by a specific type of application (e.g., map applications, navigation applications). For example, some of the other audio signals may be audio signals for notifications and / or alarms. Hereinafter, audio signals other than the first audio signal or the second audio signal generated (or output) during a call connection may be referred to as third audio signals.

[0107] In one embodiment, the electronic device (101) may set the volume of a first sound according to a first audio signal to be lower than the volume of a second sound according to a second audio signal. For example, the volume of the second sound may be higher than the volume of the first sound by a specified offset (e.g., 2 dB) (or, a specified step). For example, the relationship between the volume of the second sound and the volume of the first sound may be set as shown in Table 1 below.

[0108] Volume Step 1st Sound 123...N-2N-1N 2nd Sound M-N+1M-N+2M-N+3...M-2M-1M

[0109] Referring to Table 1, the difference between the volume of the second sound and the volume of the first sound may be MN. For example, during a call, if the volume intensity of the first sound is 1 level, the volume intensity of the second sound may be M-N+1 levels. For example, during a call, if the volume intensity of the first sound is N levels, the volume intensity of the second sound may be M levels. However, the present invention is not limited thereto. Here, N may be the number of levels by which the volume intensity of the first audio signal may be adjusted during a call. Here, M may be the number of levels by which the volume intensity of the second audio signal may be adjusted at a time other than a call. Referring to Table 1, during a call connection, the number of levels by which the volume intensity of the second sound is adjusted may be set to be equal to (or less than) the number of levels by which the volume intensity of the first sound is adjusted. For example, when N is 8 and M is 15, the difference in volume levels between the first sound and the second sound may be 7. For example, if the volume intensity of the first sound is 1 level, the volume intensity of the second sound may be 8 levels. For example, if the volume intensity of the first sound is 8 levels, the volume intensity of the second sound may be 15 levels. However, this is not limited thereto.

[0110] In one embodiment, the electronic device (101) may change (or limit) the number of steps by which the intensity of the second sound can be adjusted during a call connection to the number of steps by which the intensity of the first sound can be adjusted. In one embodiment, the range of the intensity (or range of volume) of the second sound may be adjusted to N steps out of a total of steps (i.e., M steps). For example, when the importance of the second sound is high, the range of the intensity of the second sound may be adjusted to have a range of 8 to 15 steps out of 15 steps. For example, when the importance of the second sound is low, the range of the intensity of the second sound may be adjusted to have a range of 1 to 8 steps out of 15 steps. For example, the importance of the second sound may be determined based on a priority. For example, the priority may be described with reference to Table 2 below, but is not limited thereto. In an embodiment, when the range of the intensity of the second sound is adjusted to 8, the range of the intensity of the second sound may be set to 8 consecutive steps among 15 steps (e.g., 1 to 8, 2 to 9, 3 to 10, ..., 6 to 13, 7 to 14, or 8 to 15). However, the present invention is not limited thereto. When the range of the intensity of the second sound is adjusted to 8, the range of the intensity of the second sound may be set to 8 non-consecutive steps among 15 steps (e.g., 1, 3, 5, 7, 9, 11, 13, or 15). However, the present invention is not limited thereto.

[0111] In one embodiment, the electronic device (101) can change the difference between the volume of the second sound and the volume of the first sound during a call. For example, the electronic device (101) can increase the difference during a time period in which the output of the second audio signal and the output of the first audio signal overlap (or can overlap). For example, the electronic device (101) can decrease the intensity of the volume at which the first audio signal is output during a time period in which the output of the first audio signal and the output of the second audio signal overlap (or can overlap) compared to an intensity in a time period other than the time period. For example, the electronic device (101) can increase the intensity of the volume of the second sound and / or decrease the intensity of the volume of the first sound during the time period. However, the present invention is not limited thereto.

[0112] In one embodiment, the electronic device (101) may set the volume of the first sound according to the first audio signal to be greater than the volume of the third sound according to the third audio signal. For example, the volume of the third sound may be less than the volume of the first sound by a specified offset (e.g., 2 dB) (or a specified step). For example, the difference between the volume of the first sound and the volume of the third sound may be the same as the difference between the volume of the second sound and the volume of the first sound. However, the present invention is not limited thereto. For example, the difference between the volume of the first sound and the volume of the third sound may be greater than the difference between the volume of the second sound and the volume of the first sound.

[0113] In one embodiment, the electronic device (101) may set the call volume and media volume based on the state of the media or the attribute information of the audio during a call connection. Hereinafter, the operation of the electronic device (101) setting the call volume and media volume based on the state of the media or the attribute information of the audio may be described with reference to FIG. 6.

[0114] In one embodiment, the electronic device (101) may set the volume based on the priority of the call and / or media during a call connection. Hereinafter, the operation of the electronic device (101) setting the call volume and media volume based on the priority of the call and / or media may be described with reference to FIG. 7.

[0115] In one embodiment, the electronic device (101) may set the call volume and media volume based on the audio output device from which the audio signal is output during a call connection. In one embodiment, the electronic device (101) may set the call volume and media volume based on the maximum volume of the audio output device from which the audio signal is output during a call connection. Hereinafter, the operation of the electronic device (101) setting the call volume and media volume based on the audio output device may be described with reference to FIG. 8 or FIG. 9.

[0116] In one embodiment, the operations of FIG. 5 may also be applied when the call connection is a multi-party call connection. For example, the electronic device (101) may set the volume of the first audio signal obtained from the electronic device (102) to be the same as the volume of the audio signal obtained from the electronic device (103). For example, the electronic device (101) may set the volume of the second audio signal for the first audio signal obtained from the electronic device (102) to be the same as the volume of the audio signal including the utterance translated from the utterance included in the audio signal obtained from the electronic device (103). However, this is not limited thereto. For example, the electronic device (101) may set the volume of the first audio signal obtained from the electronic device (102) to be different from the volume of the audio signal obtained from the electronic device (103). For example, the electronic device (101) can set the volume of the second audio signal for the first audio signal obtained from the electronic device (102) differently from the volume of the audio signal including the utterance translated from the utterance included in the audio signal obtained from the electronic device (103).

[0117] FIG. 6 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0118] For the description of FIG. 6, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0119] The operations of FIG. 6 can be performed by the electronic device (101). The operations of FIG. 6 can be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130).

[0120] Actions 610 and 620 of FIG. 6 may be included in action 520 of FIG. 5.

[0121] In the description of FIG. 6, the first audio signal may refer to an audio signal of another user obtained during a call connection with another electronic device (102). The second audio signal may refer to an audio signal including utterances translated from utterances included in the first audio signal. The third audio signal may refer to an audio signal other than the first audio signal or the second audio signal.

[0122] Referring to FIG. 6, in operation 610, the electronic device (101) may identify the status of media output during a call connection. In one embodiment, the media may include an application (or content played by the application) that generates a second audio signal and / or a third audio signal during the call connection. In one embodiment, the status of the media may indicate whether the application that generates the third audio signal is in the foreground (or background), whether a designated function is being executed, and / or whether there is user interaction. For example, an application running in the foreground may include that the execution screen of the application is displayed on the display (260). For example, an application running in the background may include that a screen related to the execution of the application is not displayed on the display (260). For example, a designated function of the application may include a route guidance function through a designated type of application (e.g., a map application, a navigation application). For example, a user interaction with the application may include a touch input on the execution screen of the application. In one embodiment, the state of the media may indicate whether the application provides a user interface (UI) (or user experience (UX)). In one embodiment, the state of the media may indicate the priority of the volume output by the application. In one embodiment, the state of the media may indicate whether the application has acquired focus. In one embodiment, the state of the media may indicate whether the user's interaction (or gaze) is located on the application's running screen. However, the present invention is not limited thereto.

[0123] In operation 620, the electronic device (101) can set the call volume and media volume based on the state of the media.

[0124] In one embodiment, the electronic device (101) may set the volume of a third audio signal generated by an application running in the foreground to be (by a specified offset (e.g., 2 dB)) (or a specified step) louder than the volume of the first audio signal. In one embodiment, the electronic device (101) may set the volume of a third audio signal generated by an application running in the background to be (by a specified offset (e.g., 2 dB)) (or a specified step) lower than the volume of the first audio signal. For example, the volume of a third audio signal generated by an application (e.g., a game application, a video playback application, and / or a music playback application) may be set differently depending on whether the application runs in the foreground or the background. For example, the electronic device (101) may set the volume of the third audio signal to be (by a specified offset (e.g., 2 dB)) (or a specified step) lower than the volume of the first audio signal when the application generating the third audio signal is running in the background during a phone connection. For example, the electronic device (101) may set the volume of the third audio signal to be higher when the application generating the third audio signal is running in the foreground during a phone call than when it is running in the background.

[0125] In one embodiment, the electronic device (101) may set the volume of a third audio signal generated by an application (e.g., a map application, a navigation application) that executes a designated function (e.g., route guidance) to be (by a designated offset (e.g., 2 dB)) (or a designated step) louder than the volume of the first audio signal. In one embodiment, the electronic device (101) may set the volume of the third audio signal to be (by a designated offset (e.g., 2 dB)) (or a designated step) louder than the volume of the first audio signal, regardless of whether the application is running in the background or the foreground, when the application (e.g., a map application, a navigation application) provides a designated function (e.g., route guidance) to the user. In one embodiment, the electronic device (101) may set the volume of the third audio signal to be lower (by a specified offset (e.g., 2 dB)) (or a specified step) than the volume of the first audio signal, regardless of whether the application is running in the background or foreground, when the application (e.g., a map application, a navigation application) does not provide a specified function (e.g., route guidance) to the user.

[0126] In one embodiment, the electronic device (101) may set the volume of a third audio signal generated by an application in which a user interaction occurs (e.g., an input is input) to be greater than the volume of the first audio signal (by a specified offset (e.g., 2 dB)) (or a specified step). In one embodiment, the electronic device (101) may set the volume of a third audio signal generated by an application in which a user interaction occurs among applications running in the foreground to be greater than the volumes of other third audio signals generated by other applications.

[0127] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0128] For the explanation of FIG. 7, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0129] The operations of FIG. 7 can be performed by the electronic device (101). The operations of FIG. 7 can be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130).

[0130] Referring to FIG. 7, in operation 710, the electronic device (101) can identify a priority according to type based on attribute information of an audio signal output during a call connection.

[0131] PriorityType of audio signalOffset1STREAM_ACCESSIBILITY+2dB1STREAM_ASSISTANT+2dB2STREAM_DTMF0 dB2STREAM_ALARM0 dB3STREAM_NOTIFICATION-2dB3STREAM_MUSIC-2dB

[0132] Referring to Table 2, if the type of the audio signal is STREAM_ACCESSIBILITY or STREAM_ASSISTANT, it may have a higher priority than the priority of the first audio signal. If the type of the audio signal is STREAM_DTMF or STREAM_ALARM, it may have the same priority as the priority of the first audio signal. If the type of the audio signal is STREAM_NOTIFICATION or STREAM_MUSIC, it may have a lower priority than the priority of the first audio signal. In one embodiment, STREAM_ACCESSIBILITY may represent a part of the second audio signal generated by the AI ​​module (220) (e.g., talkback). In one embodiment, STREAM_ASSISTANT may represent another part of the second audio signal generated by the AI ​​module (220) (e.g., call translation). In one embodiment, STREAM_DTMF may represent a dial tone signal. In one embodiment, STREAM_ALARM may represent a third audio signal indicating an alarm generated by the application. In one embodiment, STREAM_NOTIFICATION may represent a third audio signal indicating a notification generated by the application. In one embodiment, STREAM_MUSIC may represent a third audio signal generated by the playing of music (or video) (or background music) by the application.

[0133] In operation 720, the electronic device (101) may determine whether the priority of the media has a higher priority than the call. The media may refer to other types of audio signals that may occur during a call. For example, the electronic device (101) may determine that the priority of the second audio signal generated by the AI ​​module (220) is higher than the priority of the first audio signal. For example, the electronic device (101) may determine that the priority of the third audio signal generated by an application other than the AI ​​module (e.g., a game application, a music application) is lower than the priority of the first audio signal.

[0134] In operation 720, if the priority of the media has a higher priority than the call, the electronic device (101) may perform operation 730. In operation 720, if the priority of the media has a lower priority than the call, the electronic device (101) may perform operation 740.

[0135] In operation 730, the electronic device (101) may set the media volume higher than the call volume. For example, the electronic device (101) may set the volume of the second audio signal higher (by a specified offset (e.g., 2 dB)) (or by a specified step) than the volume of the first audio signal.

[0136] For example, as shown in Table 1, the electronic device (101) can set the volume intensity of the second sound according to the second audio signal to M-N+1 steps when the volume intensity of the first sound according to the first audio signal is at level 1. For example, as shown in Table 1, the electronic device (101) can set the volume intensity of the second sound according to the second audio signal to M steps when the volume intensity of the first sound according to the first audio signal is at level N.

[0137] In operation 740, the electronic device (101) may set the media volume lower than the call volume. For example, the electronic device (101) may set the volume of the third audio signal lower (by a specified offset (e.g., 2 dB)) (or a specified step) than the volume of the first audio signal. For example, the electronic device (101) may set the relationship between the volume of the third sound according to the third audio signal and the volume of the first sound as shown in Table 3 below.

[0138] Volume level 1st sound 123...N-2N-1N 3rd sound 012...N-3N-2N-1

[0139] Referring to Table 3, the difference between the volume of the first sound and the volume of the third sound may be 1. For example, during a call, if the volume intensity of the first sound is at level 1, the volume intensity of the third sound may be at level 0. For example, during a call, if the volume intensity of the first sound is at level N, the volume intensity of the third sound may be at level N-1. However, the present invention is not limited thereto. Here, N may be the number of steps by which the volume intensity of the first audio signal may be adjusted during a call. Here, the number of steps by which the volume intensity of the third audio signal may be adjusted during a time period other than a call connection may be greater than or equal to N. Referring to Table 3, during a call connection, the number of steps by which the volume intensity of the third sound is adjusted may be set to be equal to (or less than) the number of steps by which the volume intensity of the first sound is adjusted.

[0140] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0141] For the description of FIG. 8, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0142] The operations of FIG. 8 can be performed by the electronic device (101). The operations of FIG. 8 can be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130).

[0143] Referring to FIG. 8, in operation 810, the electronic device (101) may identify an audio output device. In one embodiment, the electronic device (101) may identify a speaker from which first to third audio signals are output. For example, the electronic device (101) may identify a speaker (270) from which the first to third audio signals are output among one or more speakers included in the electronic device (101). For example, the electronic device (101) may identify a speaker (275) connected to the electronic device (101) by wire and / or wirelessly.

[0144] In operation 820, the electronic device (101) can set the call volume and media volume based on the audio output device. For example, when the electronic device (101) outputs the first to third audio signals based on the speaker (275) that is wirelessly connected to the electronic device (101) (e.g., connected via a Bluetooth network), the electronic device (101) can set the volume of the sounds according to the first to third audio signals to the maximum value. For example, the electronic device (101) can set the speaker (275) to change its own volume by transmitting a volume setting event to the speaker (275) that is wirelessly connected to the electronic device (101) (e.g., connected via a Bluetooth network).

[0145] As described above, when audio signals are output through a speaker (275) that is wirelessly connected to the electronic device (101) (e.g., connected via a Bluetooth network), in order to resolve (or reduce) the overlap between the decrease in the intensity of the audio signal by the electronic device (101) and the decrease in the intensity of the audio signal by the speaker (275), the volume inside the electronic device (101) can be set to maximum.

[0146] FIG. 9 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0147] For the explanation of FIG. 9, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0148] The operations of FIG. 9 can be performed by the electronic device (101). The operations of FIG. 9 can be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130).

[0149] Referring to FIG. 9, in operation 910, the electronic device (101) may identify the maximum volume of the audio output device. The maximum volume may be set differently for each audio output device. For example, the maximum volume of a speaker (270) included within the electronic device (101) may be lower than the maximum volume of a speaker (275) wirelessly connected to the electronic device (101). In one embodiment, the maximum volume may be set to reduce an audio signal acquired through a microphone provided in the audio output device from being transmitted as an echo to another electronic device (102).

[0150] In operation 920, the electronic device (101) may set the media volume to be lower than the maximum volume. For example, the electronic device (101) may set the volume of sounds according to the first to third audio signals output based on the audio output device to be lower than the maximum volume. For example, the electronic device (101) may limit the volume of the second audio signal to the maximum volume when the volume of the second audio signal, which is set higher (by a specified offset (e.g., 2 dB)) (or a specified step) than the volume of the first audio signal, exceeds the maximum volume of the audio output device. For example, the electronic device (101) may set the volume of the second audio signal to the maximum volume as shown in Table 4 below, taking the maximum volume into consideration.

[0151] Volume Steps First Sound 123...N-2N-1N Second Sound M-N+1M-N+2M-N+3...M-2M-1M Maximum Volume M-2 Adjusted Second Sound M-N+1M-N+2M-N+3...M-2M-2M-2

[0152] Referring to Table 4, the maximum volume of the audio output device can be set to M-2. Accordingly, depending on the difference between the volume of the second sound and the volume of the first sound (e.g., MN), the volume of the second audio signal can be limited to the maximum volume at volume steps exceeding M-2 (i.e., M-1, M).

[0153] As described above, the electronic device (101) can reduce echo transmitted to another electronic device (102) by adjusting the volume of a plurality of audio signals below the maximum volume.

[0154] FIG. 10A is a flowchart illustrating the operation of an electronic device according to an embodiment. FIG. 10B illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0155] For the description of FIGS. 10a and 10b, reference may be made to FIGS. 1, 2a, 2b, 3a, 3b, 4a, 4b, 4c, and 4d.

[0156] The operations of FIG. 10A may be performed by the electronic device (101). The operations of FIG. 10A may be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130). Reference numeral (1001) of FIG. 10B may exemplify a menu (1002) that is overlapped (or displayed) on the screen (410). Reference numeral (1003) of FIG. 10B may exemplify a menu (490) that is overlapped (or displayed) on the screen (410).

[0157] Referring to FIG. 10A, in operation 1010, the electronic device (101) may connect (or establish) a call. In one embodiment, the electronic device (101) may connect (or establish) a call with another electronic device (102) based on accepting a call connection request from the other electronic device (102). In one embodiment, the electronic device (101) may connect (or establish) a call with another electronic device (102) based on transmitting a call connection request to the other electronic device (102).

[0158] In operation 1020, the electronic device (101) may identify an input for volume control. For example, the input for volume control may include a press (or push) on the input module (150), but is not limited thereto. For example, the input for volume control may include a touch input for a menu for adjusting the volume of the first audio signal.

[0159] Referring to reference numeral (1001) of FIG. 10B, the electronic device (101) may display a visual object (or UI) (1002) on the display (260) indicating that the volume of the first audio signal and the volume of the second audio signal are adjusted based on identifying a press (or push) on a physical key for adjusting the volume. In one embodiment, the visual object (or UI) (1002) may include an icon indicating that the call volume is adjusted and an icon indicating that the translation volume is adjusted.

[0160] Referring to reference numeral (1003) of FIG. 10B, the electronic device (101) may display a visual object (491) for adjusting the volume of a first audio signal and a visual object (1004) for adjusting the volume of a second audio signal on a menu (490) displayed by an additional user input on the display (260). In one embodiment, the visual object (1004) may include an icon indicating that the translation volume is adjusted. In one embodiment, the visual object (491) may include an icon indicating that the call volume is adjusted.

[0161] In operation 1030, the electronic device (101) can adjust call volume and media volume. The electronic device (101) can adjust the volume of the first audio signal and the second audio signal based on the input for volume control. The electronic device (101) can adjust the volume of the first to third audio signals based on the input for volume control.

[0162] In one embodiment, the electronic device (101) may adjust the volume of the first audio signal and the second audio signal at different intervals based on the input for volume control. For example, the electronic device (101) may adjust the volume of the first audio signal by one of N steps based on the input for volume control. For example, the electronic device (101) may adjust the volume of the second audio signal by one of M steps based on the input for volume control. In one embodiment, N may be 8 and M may be 15, but is not limited thereto. In one embodiment, the electronic device (101) may change the displays (1004, 491) of the visual objects so that the extent to which the visual object (491) increases is greater than the extent to which the visual object (1004) increases, based on the input for volume control. but is not limited thereto. In one embodiment, the electronic device (101) may change the display of visual objects (1004, 491) based on an input for volume control such that the amount by which the visual object (491) increases is smaller than the amount by which the visual object (1004) increases.

[0163] Operations 1020 and 1030 of FIG. 10A may be performed in the electronic device (101) based on obtaining an input for volume adjustment before a call connection after the electronic device (101) requests a call from another electronic device (102). Operations 1020 and 1030 of FIG. 10A may be performed in the electronic device (101) based on obtaining an input for volume adjustment before a call connection after the other electronic device (102) requests a call from the electronic device (101).

[0164] As described above, the electronic device (101) can increase user convenience by controlling the volume of multiple audio signals with a single input.

[0165] FIG. 11 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0166] For the description of FIG. 11, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0167] The operations of FIG. 11 can be performed by the electronic device (101). The operations of FIG. 11 can be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130).

[0168] Actions 1110, 1120, and 1130 of FIG. 11 may be included in action 1030 of FIG. 10a.

[0169] Referring to FIG. 11, in operation 1020, the electronic device (101) may identify an input for volume control. For example, the input for volume control may include a press (or push) on the input module (150), but is not limited thereto. For example, the input for volume control may include a touch input on a menu (480) for adjusting the volume of the first audio signal.

[0170] In operation 1110, the electronic device (101) can determine whether the input for volume control is an input for increasing the volume. For example, the electronic device (101) can determine that the input for volume control is an input for increasing the volume based on a press (or push) on a first physical button of the input module (150). For example, the electronic device (101) can determine that the input for volume control is an input for decreasing the volume based on a press (or push) on a second physical button that is distinct from the first physical button of the input module (150). However, the present invention is not limited thereto. For example, the electronic device (101) can determine that the input for volume control is an input for increasing the volume based on a drag input in a first direction on the menu (480). For example, the electronic device (101) may determine that an input for volume control is an input for decreasing the volume based on a drag input in a second direction opposite to the first direction for the menu (480).

[0171] In operation 1120, the electronic device (101) can increase the call volume and media volume. The electronic device (101) can increase the volumes of the first audio signal and the second audio signal by a step according to the input. The electronic device (101) can increase the volumes of the first audio signal and the second audio signal by an offset according to the input.

[0172] In one embodiment, the electronic device (101) may limit the increased volume to the maximum volume when the increased volume of the first audio signal or the second audio signal exceeds the maximum volume of the audio output device.

[0173] In operation 1130, the electronic device (101) may reduce the call volume and media volume. The electronic device (101) may reduce the volumes of the first audio signal and the second audio signal by a step according to the input. The electronic device (101) may reduce the volumes of the first audio signal and the second audio signal by an offset according to the input.

[0174] In one embodiment, the electronic device (101) may mute the first audio signal or the second audio signal when the reduced volume of the first audio signal or the second audio signal is the minimum volume.

[0175] In one embodiment, the operations of FIG. 11 may also be applied when the call connection is a multi-party call connection. For example, the electronic device (101) may increase or decrease the volume of a first audio signal obtained from the electronic device (102) and the volume of an audio signal obtained from the electronic device (103) based on an input for volume control. For example, the electronic device (101) may increase or decrease the volume of a second audio signal associated with the electronic device (102) and the volume of an audio signal including a utterance translated from a utterance included in an audio signal obtained from the electronic device (103) based on an input for volume control.

[0176] FIG. 12 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0177] For the description of FIG. 12, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0178] In the description of FIG. 12, the first audio signal may refer to an audio signal of another user obtained during a call connection with another electronic device (102). The second audio signal may refer to an audio signal including a utterance translated from the utterance included in the first audio signal. The third audio signal may refer to an audio signal other than the first audio signal or the second audio signal.

[0179] Referring to FIG. 12, a plurality of areas (1211, 1213, 1215) set on the display (260) of the electronic device (101) during a call are exemplified. The electronic device (101) of FIG. 12 may include a large-screen display or a flexible (e.g., foldable or rollable) display.

[0180] In one embodiment, the electronic device (101) may display screens (1220, 1230) of a phone APP (210) in at least one area (1211, 1213) among a plurality of areas (1211, 1213, 1215) during a call. In one embodiment, the electronic device (101) may display a screen (1240) of an application (e.g., a music application) other than the phone APP (210) in at least one area (1215) among a plurality of areas (1211, 1213, 1215) during a call.

[0181] In one embodiment, the electronic device (101) may adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on the priority among the first audio signal, the second audio signal, or the third audio signal during a call. In one embodiment, the electronic device (101) may adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on the priority among the first audio signal, the second audio signal, or the third audio signal during a call while the third audio signal is output by another application (e.g., a music application). In one embodiment, the adjustment of the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal may refer to the operations of FIGS. 5 to 11.

[0182] In one embodiment, the electronic device (101) may obtain an input for adjusting the volume level of a first audio signal during a call. In one embodiment, the electronic device (101) may obtain an input for adjusting the volume level of a first audio signal while a third audio signal is output by another application (e.g., a music application) during a call.

[0183] In one embodiment, the electronic device (101) can adjust the volume of the first audio signal and the volume of the second audio signal based on an input for adjusting the volume level of the first audio signal. In one embodiment, the electronic device (101) can adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on an input for adjusting the volume level of the first audio signal. In one embodiment, the electronic device (101) can adjust the volume based on a maximum volume set for an audio output device (e.g., speaker (270), speaker (275)). For example, the electronic device (101) can adjust the volume of the first audio signal, the second audio signal, or the third audio signal below a maximum volume of the first audio signal, the second audio signal, or the third audio signal set for the audio output device (e.g., speaker (270), speaker (275)).

[0184] As described above, the electronic device (101) can increase user convenience by controlling the volume of multiple audio signals with a single input. Furthermore, as described above, the electronic device (101) can reduce echo transmitted to another electronic device (102) by controlling the volume of multiple audio signals below the maximum volume.

[0185] FIG. 13 illustrates an example of another electronic device according to one embodiment.

[0186] For the description of FIG. 13, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0187] In the description of FIG. 13, the first audio signal may refer to an audio signal of another user obtained during a call connection with another electronic device (102). The second audio signal may refer to an audio signal including utterances translated from utterances included in the first audio signal. The third audio signal may refer to an audio signal other than the first audio signal or the second audio signal.

[0188] Reference numerals (1301, 1305) of FIG. 13 may represent audio output devices (e.g., speakers (275)). For example, referring to reference numeral (1301), the audio output device (e.g., speakers (275)) may be an electronic device (e.g., earphones, earbuds, headphones) (1310, 1320) that can be worn on a user's ears. However, the present invention is not limited thereto. For example, referring to reference numeral (1305), the audio output device (e.g., speakers (275)) may be an infotainment system of a vehicle in which a user can ride.

[0189] In one embodiment, the electronic device (101) may output a first audio signal, a second audio signal, or a third audio signal through an audio output device (e.g., a speaker (275)) during a call.

[0190] In one embodiment, the electronic device (101) may adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on the priority among the first audio signal, the second audio signal, or the third audio signal during a call. In one embodiment, the electronic device (101) may adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on the priority among the first audio signal, the second audio signal, or the third audio signal during a call while the third audio signal is output by another application (e.g., a navigation application). In one embodiment, the adjustment of the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal may refer to the operations of FIGS. 5 to 11.

[0191] In one embodiment, the electronic device (101) may obtain an input for adjusting the volume level of the first audio signal during a call. In one embodiment, the input for adjusting the volume level of the first audio signal may include a direct input to the electronic device (101) (e.g., a touch input on the display (260), a press input to the input module (150). In one embodiment, the input for adjusting the volume level of the first audio signal may include an indirect input to the electronic device (101) (e.g., a direct input to an audio output device (e.g., a speaker (275)).

[0192] In one embodiment, the electronic device (101) can adjust the volume of the first audio signal and the volume of the second audio signal based on an input for adjusting the volume level of the first audio signal. In one embodiment, the electronic device (101) can adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on an input for adjusting the volume level of the first audio signal. In one embodiment, the electronic device (101) can adjust the volume based on a maximum volume set for an audio output device (e.g., speaker (270), speaker (275)). For example, the electronic device (101) can adjust the volume of the first audio signal, the second audio signal, or the third audio signal below a maximum volume of the first audio signal, the second audio signal, or the third audio signal set for the audio output device (e.g., speaker (275)).

[0193] As described above, the electronic device (101) can increase user convenience by controlling the volume of multiple audio signals with a single input. Furthermore, as described above, the electronic device (101) can reduce echo transmitted to another electronic device (102) by controlling the volume of multiple audio signals below the maximum volume.

[0194] FIG. 14 illustrates an example of an electronic device according to one embodiment.

[0195] For the description of FIG. 14, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0196] In the description of FIG. 14, the first audio signal may refer to an audio signal of another user obtained during a call connection with another electronic device (102). The second audio signal may refer to an audio signal including a utterance translated from the utterance included in the first audio signal. The third audio signal may refer to an audio signal other than the first audio signal or the second audio signal.

[0197] Reference numerals (1401, 1405) of FIG. 14 may indicate a wearable device in which the electronic device (101) is worn on a part of the user's body. For example, referring to reference numeral (1401), the electronic device (101) may be an electronic device (e.g., a smartwatch) that can be worn on the user's hand. However, the present invention is not limited thereto. For example, referring to reference numeral (1405), the electronic device (101) may be a wearable device (e.g., a head mounted display (HMD)) that can be worn on the user's face. In one embodiment, a wearable device that can be worn on the user's face may provide the user with augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality.

[0198] In one embodiment, the electronic device (101) may adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on the priority among the first audio signal, the second audio signal, or the third audio signal during a call. In one embodiment, the electronic device (101) may adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on the priority among the first audio signal, the second audio signal, or the third audio signal during a call while the third audio signal is output by another application (e.g., a music application). In one embodiment, the adjustment of the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal may refer to the operations of FIGS. 5 to 11.

[0199] In one embodiment, the electronic device (101) may obtain an input for adjusting the volume level of a first audio signal during a call. In one embodiment, the input for adjusting the volume level of the first audio signal may include a gesture (e.g., a hand gesture) and / or a touch input. In one embodiment, the input for adjusting the volume level of the first audio signal may include a button input for a controller linked to the electronic device (101).

[0200] In one embodiment, the electronic device (101) can adjust the volume of the first audio signal and the volume of the second audio signal based on an input for adjusting the volume level of the first audio signal. In one embodiment, the electronic device (101) can adjust the volume of the first audio signal, the volume of the second audio signal, and the volume of the third audio signal based on an input for adjusting the volume level of the first audio signal. In one embodiment, the electronic device (101) can adjust the volume based on a maximum volume set for an audio output device (e.g., speaker (270), speaker (275)). For example, the electronic device (101) can adjust the volume of the first audio signal, the second audio signal, or the third audio signal below a maximum volume of the first audio signal, the second audio signal, or the third audio signal set for the audio output device (e.g., speaker (270), speaker (275)).

[0201] As described above, the electronic device (101) can increase user convenience by controlling the volume of multiple audio signals with a single input. Furthermore, as described above, the electronic device (101) can reduce echo transmitted to another electronic device (102) by controlling the volume of multiple audio signals below the maximum volume.

[0202] FIG. 15A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 15B illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0203] In one embodiment, the electronic device (101) may receive a first audio signal from a first application (e.g., a phone APP) using the communication circuit (290). The path for receiving the first audio signal from the first application (e.g., a phone APP) using the communication circuit (290) may be referred to as a first sound path. For example, the first sound path may be a path through which the other party's call voice (or first audio) is obtained through the communication circuit (290). For example, the first audio signal may be an audio signal of a voice call stream type. For example, the first sound path may be a path for receiving the first audio signal from a first function (e.g., a call function) of an arbitrary application (e.g., a phone APP).

[0204] In one embodiment, the electronic device (101) may receive a first volume control input while playing the first audio signal through the speaker (270, or 275). For example, the electronic device (101) may receive the first volume control input through the input module (150).

[0205] In one embodiment, the electronic device (101) may control the volume of the first audio signal within a first volume range based on receiving a first volume control input. For example, the first volume range may be described with reference to Table 5 below.

[0206] Step 12345678Output 51586572798693100

[0207] Referring to Table 5, the electronic device (101) may increase the volume level by 1 based on the first volume control input for increasing the volume. For example, if the volume level is 4, the electronic device (101) may change the volume level to 5 based on the first volume control input for increasing the volume. Accordingly, the first audio signal may be output at a volume corresponding to 79% (79% of the maximum volume) through the speaker (270 or 275).

[0208] For example, referring to FIG. 15A, reference numeral (1501) may illustrate a situation in which the electronic device (101) reproduces the first audio signal through the speaker (270, or 275) with only the first application activated. For example, reference numeral (1501) may display a menu (480) indicating a volume level on the screen (410) as the electronic device (101) obtains a first volume control input.

[0209] For example, reference numeral (1501) may illustrate a situation where the volume level is 4. The electronic device (101) may change the volume level to 5 based on a first volume control input for increasing the volume. Accordingly, referring to reference numeral (1503), the volume level may be changed from 4 to 5.

[0210] In one embodiment, the electronic device (101) may, while playing the first audio signal, acquire a second audio signal from a second application (e.g., AI module (220)), and play the second audio signal together with the first audio signal through the speaker (270 or 275). The path for receiving the second audio signal from the second application (e.g., AI module (220)) may be referred to as a second sound path. For example, the second sound path may be a path for generating a translated voice (or second audio) from the TTS engine (225). In one embodiment, the first sound path and the second sound path may be software signal paths. For example, the second audio signal may be an audio signal of a music stream type or an accessibility stream type. For example, the second sound path may be a path for receiving the second audio signal from a second function (e.g., a translation function) of an arbitrary application (e.g., a phone APP). According to an embodiment, the first sound path and the second sound path may be paths through which audio signals generated by different functions of the same application are transmitted, but are not limited thereto.

[0211] In one embodiment, the electronic device (101) may receive a second volume control input while playing the first audio signal and the second audio signal through the speaker (270, or 275). For example, the electronic device (101) may receive the second volume control input through the input module (150).

[0212] In one embodiment, the electronic device (101) may control the volume of the first audio signal within a second volume range and control the volume of the second audio signal within a third volume range based on receiving a second volume control input. Based on the relationship between the first priority of the first audio signal and the second priority of the second audio signal, the upper and lower limits of the second volume range may be determined (or changed). For example, when the first priority is greater than or equal to the second priority, the second volume range may have a volume range of Table 5. For example, when the first priority is less than the second priority, the second volume range may have a volume range of Table 6 below.

[0213] Step 12345678 Output 4451586572798693

[0214] Referring to Table 6, when the first priority is lower than the second priority, the volume of the first audio signal of the electronic device (101) may be set to have an output of one volume level lower than the same volume level of Table 5. The electronic device (101) may increase the volume level by 1 based on the second volume control input for increasing the volume. For example, when the volume level is 4, the electronic device (101) may change the volume level to 5 based on the second volume control input for increasing the volume. Accordingly, the first audio signal may be output at a volume corresponding to 72% (72% of the maximum volume) through the speaker (270 or 275).

[0215] Based on the relationship between the first priority of the first audio signal and the second priority of the second audio signal, the upper and lower limits of the third volume range can be determined (or changed). For example, when the second priority is lower than the first priority, the third volume range can have the volume range of Table 7 below. For example, when the second priority is the same as the first priority, the third volume range can have the volume range of Table 8 below. For example, when the second priority is higher than the first priority, the third volume range can have the volume range of Table 9 or Table 10 below.

[0216] Step 12345678 Output 4448525660646872

[0217] Referring to Table 7, when the second priority is lower than the first priority (e.g., when the second audio signal is a notification signal and / or a music playback signal), the volume of the second audio signal of the electronic device (101) may be set to have a range of the first 8 steps among 15 steps according to the media volume table.

[0218] Step 346810111315 Output 52566472808492100

[0219] Referring to Table 8, when the second priority is the same as the first priority (e.g., when the second audio signal is an alarm signal), the volume table may be set so that the volume of the second audio signal of the electronic device (101) is at a level equivalent to the output intensity of each volume step of the first audio signal among 15 steps according to the media volume table. However, the present invention is not limited thereto. For example, when the second priority is the same as the first priority, the volume of the second audio signal of the electronic device (101) may be set to have a volume range according to Table 5. For example, when the second priority is the same as the first priority, the volume of the second audio signal of the electronic device (101) may be set to have a range of steps 3 to 15 among 15 steps according to the media volume table.

[0220] Step 89101112121212Output 7276808488888888

[0221] Referring to Table 9, when the second priority is higher than the first priority (e.g., when the second audio signal is a call translation signal), and when the second audio signal is output to a speaker (or in speaker mode) rather than a receiver, the volume of the second audio signal of the electronic device (101) may be set to have a range of 8 to 12 steps among 15 steps according to the media volume table. In an embodiment, when the second audio signal is output to a speaker (or in speaker mode) rather than a receiver, the maximum output may be limited to a designated output (e.g., 88%). In order to prevent echo from being transmitted to the other party through the speaker mode, the output may be limited to a designated output (e.g., 88%).

[0222] Step 89101112131415Output 72768084889296100

[0223] Referring to Table 10, when the second priority is higher than the first priority (e.g., when the second audio signal is a call translation signal), and when the second audio signal is output to the receiver (or, when the second audio signal is output through the external speaker (275)), the volume of the second audio signal of the electronic device (101) may be set to have a range of 8 to 15 steps among 15 steps according to the media volume table. In some embodiments, when the second audio signal is output to the receiver, the maximum output may not be limited. However, the present invention is not limited thereto.

[0224] For example, referring to FIG. 15B, reference numeral (1505) may illustrate a situation in which the electronic device (101) reproduces the first audio signal and the second audio signal through the speaker (270, or 275) while the first application and the second application are activated. For example, reference numeral (1505) may display a menu (491, 495) indicating a volume level on the screen (430) as the electronic device (101) obtains a second volume control input.

[0225] For example, reference numeral (1505) may illustrate a situation in which the volume level of the first audio signal is 4 and the volume level of the second audio signal is 11. The electronic device (101) may change the volume level of the first audio signal to 5 and the volume level of the second audio signal to 12 based on a second volume control input for increasing the volume. Accordingly, referring to reference numeral (1507), the volume levels displayed through the menus (491, 495) may be changed from 4 to 5 and from 11 to 12, respectively.

[0226] Depending on the embodiment, the first priority and the second priority may be determined with reference to Table 2.

[0227] Depending on the embodiment, various volume tables may be provided. For example, different volume tables may be provided depending on the type of audio signal (e.g., music, alarm, notification) and the audio output device (e.g., earpiece, Bluetooth, USB headset).

[0228] According to an embodiment, the electronic device (101) can control the volume of the first audio signal within a volume range as shown in Table 11 or Table 12 below.

[0229] Step 1 2 3 4 5 6 6 6 Output 5 1 5 8 6 5 7 2 7 9 8 6 8 6 6

[0230] Referring to Table 11, when the first audio signal is output to a speaker (or speaker mode) rather than a receiver, the maximum output of the volume of the first audio signal of the electronic device (101) may be limited to a specified output (e.g., 86%).

[0231] Step 12345432 Output 5158657279726558

[0232] Referring to Table 12, the electronic device (101) can increase the output of the volume of the first audio signal when the volume control input is continuously input, and then decrease it after a certain output.

[0233] According to an embodiment, a table for outputting the volume of the first audio signal among Table 5, Table 6, Table 11, or Table 12 may be determined according to a pre-specified condition. In addition, a table for outputting the volume of the second audio signal among Table 7, Table 8, Table 9, or Table 10 may be determined according to a pre-specified condition. However, the present invention is not limited thereto. The range of the volume of the first audio signal and / or the second audio signal may be dynamically generated based on a generative AI model. According to an embodiment, the range of the volume of the first audio signal and / or the second audio signal may be determined by a sound path through which the audio signal is generated (or an app that generates the audio signal). According to an embodiment, the range of the volume of the first audio signal and / or the second audio signal may be determined according to a pre-specified priority. However, the present invention is not limited thereto.

[0234] According to an embodiment, when the number of audio signals output through the speaker (270, or 275) is 3 or more, the audio signals may be output through various combinations of Tables 5 to 10. For example, when a first audio signal is a call voice signal, a second audio signal is a call translation signal, and a third audio signal is a notification signal, and the audio signals are output through a speaker (or speaker mode) other than a receiver, each of the first to third audio signals may be output in the volume ranges of Tables 5, 9, and 7. For example, when a first audio signal is a call voice signal, a second audio signal is a call translation signal, and a third audio signal is a notification signal, and the audio signals are output through a receiver, each of the first to third audio signals may be output in the volume ranges of Tables 5, 10, and 7.

[0235] In some embodiments, when the priorities of the first audio signal and the second audio signal are the same, the first audio signal and the second audio signal may be output in the same volume range (e.g., the volume range according to Table 5).

[0236] In some embodiments, based on the second volume control input, the volume of both the first audio signal and the second audio signal may not be adjusted. For example, the electronic device (101) may identify an application whose volume is to be adjusted based on the priority among applications that are running (or generating audio signals). For example, while a sub-application is running, the volume of the main application may not be adjusted based on the second volume control input. Thereafter, based on the sub-application being terminated, the volume of the main application may be adjusted based on the second volume control input. For example, the sub-application may be an application that generates a low-priority audio signal. For example, the main application may be an application that generates a high-priority audio signal.

[0237] For example, if the main application is a call application and the sub-application is an AI module, the electronic device (101) can only adjust the volume of the second audio signal based on the second volume control input. In this case, the volume of the first audio signal may not be adjusted. However, this is not limited thereto. If the main application is a call application and the sub-application is an AI module, the electronic device (101) can only increase the volume of the second audio signal based on the second volume control input for increasing the volume and not adjust the volume of the first audio signal. If the main application is a call application and the sub-application is an AI module, the electronic device (101) can maintain the volume of the second audio signal and only decrease the volume of the first audio signal based on the second volume control input for decreasing the volume.

[0238] For example, if the main application is a game application and the sub-application is a call application, the electronic device (101) can only adjust the volume of the audio signal of the call application based on the second volume control input. In this case, the volume of the audio signal of the game application may not be adjusted.

[0239] FIG. 16 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0240] Referring to reference numeral (1603) of FIG. 16, the electronic device (101) may, by executing any application, display a screen (1620) indicating that a phone call connection request has been received while displaying a screen (1610). For example, the screen (1620) may include an icon (1621) for displaying a screen providing a translation function and an icon (1625) for displaying a general phone screen.

[0241] Referring to reference numeral (1601) of FIG. 16, based on obtaining an input for selecting an icon (1621), the electronic device (101) may display the screen (430). Referring to reference numeral (1605) of FIG. 16, based on obtaining an input for selecting an icon (1625), the electronic device (101) may display the screen (410). However, the present invention is not limited thereto. For example, the electronic device (101) may display a previously displayed screen based on obtaining an input for connecting a call. For example, the electronic device (101) may preferentially display the screen (430) based on obtaining an input for connecting a call.

[0242] FIG. 17 is a diagram illustrating the structure of a generative AI model of an electronic device according to one embodiment.

[0243] FIG. 17 may be described with reference to FIG. 1, FIG. 2a, or FIG. 2b.

[0244] In one embodiment, a user interface (UI) (1710) may be an element for interaction between an electronic device (101) and a user. For example, the UI (1710) may be an element for receiving (or acquiring) a user's input. For example, the UI (1710) may be an element for providing (or outputting) a result of the user's input.

[0245] In one embodiment, the UI (1710) may be a graphical UI (GUI) for user interaction (e.g., acquisition of touch input and / or display of results) via the display (260). In one embodiment, the UI (1710) may be a voice UI (VUI) (or an auditory UI (AUI)) for user interaction (e.g., acquisition of voice signals and / or output of audio signals) via the audio output module (155) (or the audio module (170)). In one embodiment, the UI (1710) may be a natural UI (NUI) for user interaction (e.g., acquisition of user gestures or gaze) via the camera module (180). In one embodiment, the UI (1710) may be a physical UI (PUI) (or a tangible UI (TUI)) for user interaction (e.g., input to a physical button) via the input module (150).

[0246] In one embodiment, the UI (1710) may be configured for interaction between the electronic device (101) and the user for the purpose of querying the user and / or responding to the query. In one embodiment, the UI (1710) may receive user input. For example, the user input may include natural language input (e.g., voice signal input, and / or text input), and / or input for selecting (or indicating) content (e.g., images and / or videos). The user input may also be in a mixed form of the above-described natural language, images, sounds, and context information. The user input may also be in a non-natural language form, such as selecting a menu.

[0247] In one embodiment, the UI (1710) may identify (or obtain) information about the context related to the time (or situation) at which the user's input is obtained, for the purpose of the user's inquiry and / or response to the inquiry. In one embodiment, the information about the context may include additional information at the time of the user input. For example, the additional information may include information about the application currently being used by the user or location information of the user (or the electronic device (101)).

[0248] In one embodiment, the electronic device (101) may output the results of a generative AI model (1750) to the user via a UI (1710). In one embodiment, the output may be in the form of natural language or specific content. In one embodiment, the output may be provided in a form requested by the user (e.g., an action).

[0249] In one embodiment, the UI (1710) may transmit information about the user's input and / or context to an artificial intelligence (AI) framework (1720). In one embodiment, the AI ​​framework (1720) may obtain information about the user's input and / or context from the UI (1710).

[0250] In one embodiment, the AI ​​framework (1720) may coordinate and / or control each of the components (e.g., interface management element (1721), prompt design element (1723), or output modification element (1725)) necessary to perform a task according to the user's intent identified based on the user's query (or query included in the user input).

[0251] In one embodiment, the AI ​​framework (1720) may transmit user input obtained from the UI (1710) to a prompt design element (1723).

[0252] In one embodiment, the prompt design element (1723) may generate a prompt suitable for inputting user input into a generative AI model (1750) (e.g., a large language model (LLM) and / or a larger multimodal model (LMM)).

[0253] In one embodiment, the prompt design element (1723) may be an AI component that utilizes a machine learning algorithm or neural network. Accordingly, the prompt design element (1723) may change the prompt generated through learning.

[0254] In one embodiment, the prompt design element (1723) may access a knowledge element (or knowledge repository (1730)) containing user preference data, a prompt library, and prompt examples based on user input to generate a prompt, and pass the generated prompt to a generative AI model (1750) (e.g., an LLM and / or LMM).

[0255] In one embodiment, the interface management element (1721) can communicate with external elements. In one embodiment, the interface management element (1721) can obtain additional information from external elements when there is a request for additional information when passing user input (or a prompt based on user input) as input to the generative AI model (1750). In one embodiment, the interface management element (1721) can establish a channel for communicating with the outside of the AI ​​framework (1720) through an application programming interface (API), and can enable the AI ​​framework (1720) to access various data sources (e.g., a knowledge repository (1730)) through the established channel. In addition, the interface management element (1721) can request the service element (1740) through the API to perform an action that performs the user input as a final result rather than an intermediate result when the application and / or service needs to perform the action. Information obtained from external elements may be used to generate prompts in the prompt design element (1723) along with user input or may be passed as input to the generative AI model (1750).

[0256] In one embodiment, the output modification component (1725) can fine-tune the output from the generative AI model (1750). For example, the output modification component (1725) can verify (e.g., verify for relevance, bias, and / or harmfulness) the content generated by the generative AI model (1750) (e.g., LLM and / or LMM). In addition, the output modification component (1725) can determine to what extent the output result matches the result desired by the user and, if additional adjustment is needed, can perform additional tasks for additional adjustment. Additionally, the output modification component (1725) can provide the user with hints to prevent (or reduce) undesired output.

[0257] In one embodiment, a generative AI model (1750) may generally refer to an artificial intelligence neural network that generates new types of data based on user input information. The generative AI model (1750) may include a model that generates images and / or a model that generates language. The model that generates images may include a generative adversarial network (GAN), a variational autoencoder (VAE), and / or a diffusion-based generative model that uses a VAE and a transformer architecture. The model that generates language may be a model trained to output statistically most appropriate output values ​​based on input values. For example, the model that generates language may include a model such as CHAT-GPT 3 or CHAT-GPT 4. In addition, the generative AI model (1750) may be an LMM that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding thereto.

[0258] FIG. 18 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0259] For the description of FIG. 18, reference may be made to FIG. 1, FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b, FIG. 4a, FIG. 4b, FIG. 4c, and FIG. 4d.

[0260] The operations of FIG. 18 can be performed by the electronic device (101). The operations of FIG. 18 can be performed by the electronic device (101) by the processor (120) of the electronic device (101) executing instructions stored in the memory (130).

[0261] Referring to FIG. 18, in operation 1810, the electronic device (101) can output audio through a speaker (270 or 275).

[0262] In one embodiment, the electronic device (101) may receive a first audio signal from a first application (e.g., a phone APP (210)) using the communication circuit (290). In one embodiment, the electronic device (101) may output a first audio corresponding to the first audio signal through a speaker (270 or 275).

[0263] In one embodiment, the electronic device (101) may obtain a second audio signal from a second application (e.g., an AI module (220), a video playback application, and / or a music playback application) while outputting the first audio. In one embodiment, the electronic device (101) may output a second audio corresponding to the second audio signal through a speaker (270 or 275) while outputting the first audio.

[0264] In operation 1820, the electronic device (101) may receive a volume control input during audio output. For example, the volume control input may include a press (or push) on the input module (150), but is not limited thereto. For example, the volume control input may include a touch input on a menu (480) for adjusting the volume of the audio.

[0265] In operation 1830, the electronic device (101) may determine whether volume adjustment of different audios is required. In one embodiment, the electronic device (101) may determine whether volume adjustment of different audios is required based on the number, type, and / or priority of audios output through the speaker (270 or 275). However, the present invention is not limited thereto.

[0266] For example, the electronic device (101) may determine that volume control of different audios is not necessary when the number of audios output through the speaker (270 or 275) is one (e.g., when only the first audio is output). For example, the electronic device (101) may determine that volume control of different audios is necessary when the number of audios output through the speaker (270 or 275) is two or more (e.g., when the first audio and the second audio are output).

[0267] In operation 1830, if volume control of different audios is required, the electronic device (101) may perform operation 1840. In operation 1830, if volume control of different audios is not required, the electronic device (101) may perform operation 1850.

[0268] In operation 1840, the electronic device (101) can control the volume of audios within different volume ranges. For example, the electronic device (101) can control the volume of the first audio within a first volume range. For example, the electronic device (101) can control the volume of the second audio within a second volume range.

[0269] In operation 1850, the electronic device (101) can control the volume of the audio within a volume range. For example, the electronic device (101) can control the volume of the first audio within a third volume range based on the first volume control input.

[0270] In one embodiment, each of the first volume range and the third volume range may be divided into the same N volume steps. In one embodiment, the second volume range may be included within a fourth volume range of the volume of the second audio while the second audio is output without the first audio.

[0271] In one embodiment, the upper and lower limits of the first volume range can be determined based on a relationship between a first priority of the first audio and a second priority of the second audio.

[0272] In one embodiment, based on the second priority of the second audio being higher than the first priority of the first audio, the second volume range may have a volume range with a reduced minimum and maximum value of the third volume range. In one embodiment, based on the second priority not being higher than the first priority, the second volume range may be the same as the third volume range.

[0273] Based on the type of speaker from which the first audio and the second audio are output, the upper and lower limits of the first volume range can be changed.

[0274] As described above, the electronic device (101) may include a communication circuit (290). The electronic device (101) may include at least one processor (120). The electronic device (101) may include a memory (130) including one or more storage media that store instructions. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to establish a call connection with an external electronic device (102) via the communication circuit (290). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain a first audio signal from the external electronic device (102) via the communication circuit (290) during the call connection. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to translate a first utterance included in the first audio signal into a second utterance in a designated language. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set a first volume level at which the first audio signal is output to be lower than a second volume level at which a second audio signal including the second utterance is output.

[0275] As described above, the electronic device (101) may include a communication circuit (290). The electronic device (101) may include at least one processor (120). The electronic device (101) may include a memory (130) including one or more storage media that store instructions. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to establish a call connection with an external electronic device (102) via the communication circuit (290). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain a first audio signal from the external electronic device (102) via the communication circuit (290) during the call connection. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain an input for adjusting the volume level during the call connection. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to adjust, based on the input, the volume level of the first volume of the first audio signal and / or the volume level of the second volume of a second audio signal output together with the first audio signal.

[0276] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain an input for adjusting the intensity of the first volume. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to adjust the intensity of the first volume and the intensity of the second volume based on the input.

[0277] The electronic device (101) may include a physical button (150). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain the input based on the pressing of the physical button (150).

[0278] In one embodiment, during the call connection, the number of steps in which the intensity of the second volume is adjusted may be changed to be less than or equal to the number of steps in which the intensity of the first volume is adjusted.

[0279] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to increase the intensity of the second volume at which the second audio signal is output during a time interval in which a first output of the first audio signal and a second output of the second audio signal overlap or a time interval that can overlap, compared to the intensity of the second volume at which the second audio signal is output in a time interval other than the time interval. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to decrease the intensity of the volume at which the audio signal is output during a time interval in which a first output of the audio signal and a second output of the other audio signal overlap or a time interval that can overlap, compared to the intensity of the volume at which the audio signal is output in a time interval other than the time interval.

[0280] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify an audio signal output device from which the first audio signal and the second audio signal are output. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of the first volume and the intensity of the second volume to intensities defined for the identified audio signal output device.

[0281] The electronic device (101) may include a speaker (270). In one embodiment, when the audio signal output device is an external speaker (275) of the electronic device (101), the maximum volume of the second volume may be set to be lower than the maximum volume of the second volume when the audio signal output device is the speaker (270).

[0282] In one embodiment, during the call connection, the intensity of the second volume may be set to the lower of the intensity of the second volume plus a specified first offset or a specified maximum intensity.

[0283] The above instructions, when executed individually or collectively by the at least one processor (120), may cause the electronic device (101) to set the intensity of a third volume of a third audio signal of a designated type, distinct from the first audio signal or the second audio signal, to be lower than the intensity of the first volume during the call connection.

[0284] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify an application requesting output of the third audio signal during the call connection. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of the third volume to be greater than the intensity of the first volume based on the application running in the foreground. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of the third volume to be less than the intensity of the first volume based on the application running in the background.

[0285] As described above, the method may be performed by an electronic device (101) including a communication circuit (290). The method may include an operation of establishing a call connection with an external electronic device (102) through the communication circuit (290). The method may include an operation of obtaining a first audio signal from the external electronic device (102) through the communication circuit (290) during the call connection. The method may include an operation of translating a first utterance included in the first audio signal into a second utterance in a specified language. The method may include an operation of setting a level of a first volume at which the first audio signal is output to be lower than a level of a second volume at which a second audio signal including the second utterance is output.

[0286] As described above, the method may be performed by an electronic device (101) including a communication circuit (290). The method may include an operation of establishing a call connection with an external electronic device (102) through the communication circuit (290). The method may include an operation of obtaining a first audio signal from the external electronic device (102) through the communication circuit (290) during the call connection. The method may include an operation of obtaining an input for adjusting the intensity of a volume during the call connection. The method may include an operation of adjusting, based on the input, the intensity of a first volume of the first audio signal and / or the intensity of a second volume of a second audio signal output together with the first audio signal.

[0287] The method may include an operation of obtaining an input for adjusting the intensity of the first volume. The method may include an operation of adjusting the intensity of the first volume and the intensity of the second volume based on the input.

[0288] The method may include an operation of obtaining the input based on a physical button (150) of the electronic device (101) being pressed.

[0289] In one embodiment, during the call connection, the number of steps in which the intensity of the second volume is adjusted may be changed to be less than or equal to the number of steps in which the intensity of the first volume is adjusted.

[0290] The method may include an operation of increasing, during a time period in which a first output of the first audio signal and a second output of the second audio signal overlap, the intensity of the second volume at which the second audio signal is output more than the intensity of the second volume at which the second audio signal is output in a time period other than the time period. The method may include an operation of decreasing, during a time period in which a first output of the audio signal and a second output of the other audio signal overlap, the intensity of the volume at which the audio signal is output more than the intensity of the volume at which the audio signal is output in a time period other than the time period.

[0291] The method may include an operation of identifying an audio signal output device from which the first audio signal and the second audio signal are output. The method may include an operation of setting the intensity of the first volume and the intensity of the second volume to intensities defined for the identified audio signal output device.

[0292] In one embodiment, when the audio signal output device is an external speaker (275) of the electronic device (101), the maximum volume of the second volume may be set to be lower than the maximum volume of the second volume when the audio signal output device is a speaker (270) of the electronic device (101).

[0293] During said call connection, said intensity of said first volume may be set to the lower intensity of said intensity of said second volume plus a specified first offset or a specified maximum intensity.

[0294] The method may include an operation of setting the intensity of a third volume, during the call connection, of a third audio signal of a designated type that is distinct from the first audio signal or the second audio signal, to be lower than the intensity of the first volume.

[0295] The method may include an operation of identifying an application requesting output of the third audio signal during the call connection. The method may include an operation of setting the intensity of the third volume to be greater than the intensity of the first volume based on whether the application is operating in the foreground. The method may include an operation of setting the intensity of the third volume to be less than the intensity of the first volume based on whether the application is operating in the background.

[0296] As described above, a non-transitory computer readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by the at least one processor (120), can cause the electronic device (101) to establish a call connection with an external electronic device (102) via the communication circuit (290). The instructions, when individually or collectively executed by the at least one processor (120) of the electronic device (101) including the communication circuit (290), can cause the electronic device (101) to obtain a first audio signal from the external electronic device (102) via the communication circuit (290) during the call connection. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to translate a first utterance included in the first audio signal into a second utterance in a designated language. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set a first volume level at which the first audio signal is output to be lower than a second volume level at which a second audio signal including the second utterance is output.

[0297] As described above, a non-transitory computer readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by the at least one processor (120), can cause the electronic device (101) to establish a call connection with an external electronic device (102) via the communication circuit (290). The instructions, when individually or collectively executed by the at least one processor (120), can cause the electronic device (101) to obtain a first audio signal from the external electronic device (102) via the communication circuit (290) during the call connection. The instructions, when individually or collectively executed by the at least one processor (120), can cause the electronic device (101) to obtain an input for adjusting the intensity of a volume during the call connection. The above instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to adjust the intensity of a first volume of the first audio signal and / or the intensity of a second volume of a second audio signal output together with the first audio signal, based on the input.

[0298] As described above, the electronic device (101) may include a speaker, a communication circuit (290), at least one processor (120); and a memory (130) including one or more storage media storing instructions. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a first audio signal from a first application using the communication circuit. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to output first audio based on the first audio signal through the speaker. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a first volume control input while outputting the first audio through the speaker. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control the volume of the first audio within a first volume range based on the first volume control input. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to output second audio through the speaker based on obtaining a second audio signal from a second application while outputting the first audio.The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control the volume of the first audio within a second volume range and to control the volume of the second audio within a third volume range based on receiving a second volume control input while outputting the first audio and the second audio through the speaker.

[0299] Each of the first volume range and the second volume range is divided into N volume steps, where N can be an integer.

[0300] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a third volume control input while outputting the second audio through the speaker without outputting the first audio. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control the volume of the second audio within a fourth volume range that includes the third volume range, based on the third volume control input.

[0301] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control the volume of the second audio signal within a fourth volume range that includes a third volume range, based on receiving a third volume control input while playing the second audio signal through the speaker without the first audio signal.

[0302] The third volume range may be divided into N volume steps, which are the same as the first volume range and the second volume range. The fourth volume range may be divided into M volume steps, which are greater than N. N and M may be integers. The upper limit of the fourth volume range may be greater than the upper limit of the third volume range, or the lower limit of the fourth volume range may be less than the lower limit of the third volume range.

[0303] Based on the relationship between the first priority of the first audio signal and the second priority of the second audio signal, the upper and lower limits of the third volume range can be determined.

[0304] Based on the second priority of the second audio being higher than the first priority of the first audio, the second volume range may have a volume range in which the upper and lower limits of the first volume range are reduced. Based on the second priority not being higher than the first priority, the second volume range may be the same as the first volume range.

[0305] Based on the type of speaker from which the first audio and the second audio are output, the upper and lower limits of the third volume range can be changed.

[0306] The first audio signal may be obtained from the other party's electronic device via the first application. The second audio signal may correspond to a translation of the first utterance included in the first audio signal.

[0307] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control the volume of the first audio and the volume of the second audio such that the volume of the first audio controlled within the second volume range is lower than the volume of the second audio controlled within the third volume range, based on the second volume control input.

[0308] The first application may be an application for obtaining the first audio signal from the other party's electronic device through the communication circuit (290) during a call connection with the other party's electronic device. The second application may be an application for generating a second audio signal representing a translation of the speech included in the first audio signal.

[0309] As described above, the electronic device (101) may include a speaker, at least one processor (120), and a memory (130) including one or more storage media storing instructions. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a first audio signal from a first application through a first pass. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a second audio signal from a second application through a second pass. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control the volume of the first audio within a first volume range and to control the volume of the second audio within a second volume range based on receiving a volume control input while outputting first audio based on the first audio signal and second audio based on the second audio signal through the speaker.

[0310] The first volume range and the second volume range are divided into N volume steps, where N can be an integer.

[0311] Based on the relationship between the first priority of the first audio signal and the second priority of the second audio signal, the upper and lower limits of the second volume range can be changed.

[0312] Based on the type of speaker through which the first audio signal and the second audio signal are reproduced, the upper and lower limits of the second volume range can be changed.

[0313] As described above, the electronic device (101) may include a speaker, at least one processor (120), and a memory (130) including one or more storage media storing instructions. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive a first audio signal from a first application using the communication circuit. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to control a volume of the first audio within a first volume range based on receiving a first volume control input while outputting first audio based on the first audio signal through the speaker. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to, while outputting the first audio, output second audio through the speaker based on obtaining a second audio signal from a second application, the second audio based on the second audio signal together with the first audio. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to, while outputting the first audio and the second audio through the speaker, control the volume of the second audio within a second volume range without adjusting the volume of the first audio, based on receiving a second volume control input.

[0314] As described above, the electronic device (101) may include a communication circuit (290), at least one processor (120), and a memory (130) including one or more storage media storing instructions. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain a first audio signal from an external electronic device (102) via the communication circuit (290). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify a second audio signal generated by the electronic device (101). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to obtain an input for adjusting the intensity of audio while outputting first audio based on the first audio signal and second audio based on the second audio signal. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to adjust the intensity of at least one audio selected from the first audio or the second audio based on the input.

[0315] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to translate a first utterance included in the first audio signal into a second utterance in a designated language. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of the first audio to be less than the intensity of the second audio including the second utterance.

[0316] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to increase the intensity of the second audio while maintaining the intensity of the first audio based on the input being for increasing the intensity of the audio.

[0317] Based on the input for reducing the intensity of the above audio, it is possible to cause the intensity of the above first audio to be reduced while maintaining the intensity of the above second audio.

[0318] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to adjust the intensity of the second audio instead of adjusting the intensity of the first audio based on the input, based on the second audio representing a translation of utterance included in the first audio signal.

[0319] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify an audio signal output device from which the first audio and the second audio are output. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of the first audio and the intensity of the second audio to intensities defined for the identified audio signal output device.

[0320] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of a third audio signal based on a third audio signal of a specified type that is distinct from the first audio signal or the second audio signal to be less than the intensity of the first audio while the first audio is being output.

[0321] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to identify an application requesting output of the third audio while the first audio is being output. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of the third audio to be greater than the intensity of the first volume based on the application running in the foreground. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to set the intensity of the third audio to be less than the intensity of the first audio based on the application running in the background.

[0322] A method of an electronic device (101) including a communication circuit (290) may include an operation of obtaining a first audio signal from an external electronic device (102) through the communication circuit (290). The method may include an operation of identifying a second audio signal generated by the electronic device (101). The method may include an operation of obtaining an input for adjusting the intensity of audio while outputting first audio based on the first audio signal and second audio based on the second audio signal. The method may include an operation of adjusting the intensity of at least one audio selected from the first audio or the second audio based on the input.

[0323] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0324] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0325] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0326] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0327] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., by download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0328] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, speaker, Communication circuit (290), at least one processor (120); and A memory (130) including one or more storage media storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Receive a first audio signal from a first application using the above communication circuit, Through the above speaker, output a first audio based on the first audio signal, While outputting the above first audio through the above speaker, receiving the first volume control input, Based on the first volume control input, the volume of the first audio is controlled within a first volume range, While outputting the first audio, based on obtaining a second audio signal from a second application, output the second audio through the speaker, While outputting the first audio and the second audio through the speaker, based on receiving a second volume control input, Controlling the volume of the first audio within a second volume range, causing the volume of the second audio to be controlled within a third volume range; Electronic devices.

2. In claim 1, Each of the above first volume range and the above second volume range is divided into N volume steps, The above N is an integer, Electronic devices.

3. In claim 1 or claim 2, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: While outputting the second audio through the speaker without outputting the first audio, a third volume control input is received, Based on the third volume control input, causing the volume of the second audio to be controlled within a fourth volume range including the third volume range. Electronic devices.

4. In claim 3, The third volume range is divided into N volume steps identical to the first volume range and the second volume range, The above fourth volume range is divided into M volume steps greater than N, The upper limit of the fourth volume range is greater than the upper limit of the third volume range, or the lower limit of the fourth volume range is less than the lower limit of the third volume range, The above N and M are integers Electronic devices.

5. In any one of claims 1 to 4, Based on the relationship between the first priority of the first audio and the second priority of the second audio, the upper and lower limits of the third volume range are determined. Electronic devices.

6. In any one of claims 1 to 5, Based on the second priority of the second audio being higher than the first priority of the first audio, the second volume range has a volume range with reduced upper and lower limits of the first volume range, Based on the above second priority not being higher than the above first priority, the second volume range is the same as the first volume range. Electronic devices.

7. In any one of claims 1 to 6, Based on the type of the speaker through which the first audio and the second audio are output, the upper and lower limits of the third volume range are changed. Electronic devices.

8. In any one of claims 1 to 7, The above first audio signal is obtained from the other party's electronic device through the first application, The second audio signal corresponds to a translation of the first utterance included in the first audio signal. Electronic devices.

9. In any one of claims 1 to 8, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on the second volume control input, causing the volume of the first audio and the volume of the second audio to be controlled so that the volume of the first audio controlled within the second volume range is lower than the volume of the second audio controlled within the third volume range. Electronic devices.

10. In any one of claims 1 to 9, The above first application is an application for obtaining the first audio signal from the counterpart electronic device through the communication circuit (290) during a call connection with the counterpart electronic device. The second application is an application for generating a second audio signal representing a translation of the utterance included in the first audio signal. Electronic devices.

11. In electronic devices, Communication circuit (290), at least one processor (120); and A memory (130) including one or more storage media storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Obtaining a first audio signal from an external electronic device (102) through the above communication circuit (290), Identifying a second audio signal generated by the electronic device (101), While outputting first audio based on the first audio signal and second audio based on the second audio signal, an input for adjusting the intensity of the audio is acquired, Based on said input, causing the intensity of at least one audio selected from said first audio or said second audio to be adjusted. Electronic devices.

12. In claim 11, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Translate a first utterance included in the first audio signal into a second utterance in a specified language, causing said intensity of said first audio to be set to be less than said intensity of said second audio including said second utterance; Electronic devices.

13. In claim 11 or claim 12, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on the input for increasing the intensity of the above audio, while maintaining the intensity of the first audio, increasing the intensity of the second audio, Based on the input for reducing the intensity of the above audio, causing the intensity of the above first audio to be reduced while maintaining the intensity of the above second audio, Electronic devices.

14. In any one of claims 11 to 13, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on the input, causing the intensity of the second audio to be adjusted instead of the intensity of the first audio, based on the second audio representing a translation of the utterance included in the first audio signal. Electronic devices.

15. In any one of claims 11 to 14, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Identify an audio signal output device from which the first audio and the second audio are output, Causing said intensity of said first audio and said intensity of said second audio to be set to intensities defined for said identified audio signal output device. Electronic devices.

Images