Electronic device for processing sound source, operating method therefor, and storage medium

Abstract

This electronic device may comprise a speaker, at least one processor, and a memory storing instructions. The instructions, when executed individually or collectively by the at least one processor, may instruct the electronic device to: separate a sound source into a plurality of sound objects; identify a user input designating each of a plurality of gain values corresponding to each of the plurality of sound objects; apply the plurality of gain values to each of the plurality of sound objects and mix the applied results so as to generate a mixed signal corresponding to the sound source; identify whether the plurality of gain values satisfy a condition for applying a pre-stored dynamic range control curve; on the basis of the plurality of gain values satisfying the condition, control the speaker to reproduce a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal; and on the basis of the plurality of gain values not satisfying the condition, control the speaker to reproduce a second analog signal generated by applying, to the mixed signal, a dynamic range control curve generated on the basis of at least some of the plurality of gain values. Other embodiments are also possible.

Description

Electronic device for performing sound source processing, method of operation thereof, and storage medium

[0001] The present disclosure relates to an electronic device for performing sound source processing, a method of operation thereof, and a storage medium.

[0002] In the field of audio processing, techniques for efficiently controlling the dynamic range of audio sources may be provided. For example, dynamic range compression (hereinafter "DRC") is a technique that reduces the dynamic range of a signal to prevent distortion that may occur at high sound pressure levels or / or to enable signals at low sound pressure levels to be heard clearly. Such DRC is used in various fields, such as audio mixing, mastering, broadcasting, and / or streaming platforms.

[0003] DRC may utilize a DRC curve representing the relationship between the input signal level and the output signal level. Based on the DRC curve, the output signal level corresponding to the input signal level can be identified, and accordingly, the final output signal level can be controlled. The electronic device can identify and / or adjust the output signal level by referring to a pre-stored DRC curve. Accordingly, the electronic device can control the dynamic range of the signal. The DRC curve can be stored in the electronic device in an optimized form, and the electronic device can identify and / or adjust the output signal level based on the pre-stored DRC curve.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] The electronic device may include a speaker, at least one processor, and a memory for storing instructions.

[0006] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the sound source to be separated into a plurality of sound objects.

[0007] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to confirm a user input specifying each of the plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0008] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to apply the plurality of gain values ​​to each of the plurality of sound objects and to mix the applied results to generate a mixed signal corresponding to the sound source.

[0009] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve.

[0010] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the speaker to control the speaker to play a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal based on the plurality of gain values ​​satisfying the condition.

[0011] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the speaker to control the speaker to reproduce a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal, based on the fact that the plurality of gain values ​​do not satisfy the condition.

[0012] The method of operation of an electronic device may include the operation of separating a sound source into multiple sound objects.

[0013] The method of operation of the above electronic device may include an operation of confirming a user input that specifies each of a plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0014] The method of operation of the electronic device may include applying the plurality of gain values ​​to each of the plurality of sound objects and mixing the applied results to generate a mixed signal corresponding to the sound source.

[0015] The method of operation of the above electronic device may include an operation to check whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve.

[0016] The method of operation of the electronic device may include controlling the speaker to play a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal based on the plurality of gain values ​​satisfying the condition, or to play a second analog signal generated by applying the dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal based on the plurality of gain values ​​not satisfying the condition.

[0017] A storage medium for storing computer-readable instructions may be provided.

[0018] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may cause the sound source to be separated into a plurality of sound objects.

[0019] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to confirm a user input specifying each of the plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0020] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to apply the plurality of gain values ​​to each of the plurality of sound objects and to mix the applied results to generate a mixed signal corresponding to the sound source.

[0021] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to check whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve.

[0022] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the speaker to control the speaker to play a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal based on the plurality of gain values ​​satisfying the condition.

[0023] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the speaker to control the speaker to reproduce a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal, based on the fact that the plurality of gain values ​​do not satisfy the condition.

[0024] The electronic device may include a speaker, at least one processor, and a memory for storing instructions.

[0025] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to confirm that a first gain value is set for a first sound object of the sound source and a second value is set for a second sound object of the sound source.

[0026] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to play the sound source using a first dynamic range control curve corresponding to the first gain value and the second gain value.

[0027] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to confirm that a third gain value different from the first gain value is set for the first sound object and that a second gain value is set for the second sound object.

[0028] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to play the sound source using a second dynamic range control curve that is at least partially different from the first dynamic range control curve corresponding to the third gain value and the second gain value.

[0029] The method of operation of an electronic device may include an operation of confirming that a first gain value is set for a first sound object of a sound source and a second value is set for a second sound object of the sound source.

[0030] The method of operation of the electronic device may include an operation of playing the sound source using a first dynamic range control curve corresponding to the first gain value and the second gain value.

[0031] The method of operating an electronic device may include an operation of confirming that a third gain value different from the first gain value is set for the first sound object and that the second gain value is set for the second sound object.

[0032] The method of operation of the electronic device may include the operation of playing the sound source using a second dynamic range control curve that is at least partially different from the first dynamic range control curve corresponding to the third gain value and the second gain value.

[0033] A storage medium for storing computer-readable instructions may be provided.

[0034] When the above instructions are executed individually or collectively by at least one processor of the electronic device, the electronic device may be caused to confirm that a first gain value is set for a first sound object of the sound source and a second value is set for a second sound object of the sound source.

[0035] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to play the sound source using a first dynamic range control curve corresponding to the first gain value and the second gain value.

[0036] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to confirm that a third gain value different from the first gain value is set for the first sound object and that a second gain value is set for the second sound object.

[0037] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to play the sound source using a second dynamic range control curve that is at least partially different from the first dynamic range control curve corresponding to the third gain value and the second gain value.

[0038] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0039] FIG. 2 is a diagram illustrating sound source processing according to a comparative example for comparison with one embodiment.

[0040] Figure 3 is a diagram illustrating the application of the DRC curve.

[0041] FIG. 4a is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0042] FIGS. 4b, 4c, and 4d are drawings for illustrating a user interface for setting a gain value according to one embodiment.

[0043] FIG. 5 is a diagram illustrating sound source processing according to one embodiment.

[0044] FIG. 6a is a diagram illustrating the selective use of a DRC curve according to one embodiment.

[0045] Figure 6b is a diagram illustrating the difference between DRC curves.

[0046] FIG. 7 is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0047] FIG. 8 is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0048] FIG. 9 is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0049] FIG. 10 is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0050] FIG. 11 is a drawing for explaining a change in the DRC curve according to one embodiment.

[0051] FIG. 12 is a diagram illustrating sound source processing according to one embodiment.

[0052] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0053] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0054] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0055] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0056] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0057] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0058] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0059] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0060] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0061] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0062] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0063] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0064] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0065] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0066] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0067] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0068] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0069] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0070] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0071] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0072] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0073] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0074] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0075] FIG. 2 is a drawing for illustrating sound source processing according to a comparative example for comparison with one embodiment. Those skilled in the art will understand that at least some of the operations according to the comparative example may be performed by the embodiments of the present disclosure and / or the configurations described in the comparative example may be included in the embodiments of the present disclosure. FIG. 2 is to be described with reference to FIG. 3. FIG. 3 is a drawing for illustrating the application of a DRC curve.

[0076] The electronic device (101) can check and / or load a sound source (203) for playback. For example, the electronic device (101) can check a sound source (203) that is pre-stored or temporarily stored based on streaming, and there are no restrictions on the method of storing and / or checking the sound source (203). The sound source (203) may be implemented as sound only, or may be implemented in a manner where it is stored together with (or synchronized with) a video.

[0077] The electronic device (101) can separate a sound source (203) into a plurality of sound objects (211, 213, 215, 217), for example, based on a separation module (205). The plurality of sound objects (211, 213, 215, 217) may include, for example as in FIG. 2, a sound object (211) corresponding to voice, a sound object (213) corresponding to music, a sound object (215) corresponding to wind, and a sound object (217) corresponding to others, but this is exemplary. The sound objects (211, 213, 215, 217) may be obtained and / or identified by the separation of the sound source (203). The separation and / or identification of the sound source (203) may be performed, for example, based on time-frequency analysis, utilization of spatial characteristics, and / or machine learning-based signal processing, but this is exemplary and there are no limitations on the method of separation and / or identification. Since sound objects (211, 213, 215, 217) may be the result of the separation of the sound source (203), the sound objects may be named as sub-sound sources, sub-sounds, separated signals, or parts of the sound source (203), and there are no limitations.

[0078] The electronic device (101) can determine gain values ​​(201) corresponding to each of the sound objects (211, 213, 215, 217). For example, the gain values ​​(201) corresponding to each of the sound objects (211, 213, 215, 217) may be g1, g2, g3, g4. For example, the electronic device (101) can determine the gain values ​​(201) of each of the sound objects (211, 213, 215, 217) based on input through a user interface (e.g., a screen or a voice recognition user interface, but not limited to) for adjusting the gain values ​​of at least some of the sound objects (211, 213, 215, 217). For example, each of the gain values ​​(201) may have a default value, and at least some of the gain values ​​may be adjusted based on input through a user interface, but without limitation. An example of a user interface is to be described with reference to FIGS. 4b through 4d, and a description thereof is omitted. Meanwhile, it is exemplary that at least some of the gain values ​​(201) are set based on input by a user, and the electronic device (101) according to an embodiment of the present disclosure may set at least some of the gain values ​​of the sound objects (211, 213, 215, 217) without user input. The gain values ​​may be replaced, for example, with volume, loudness, or magnitude, but without limitation.

[0079] The electronic device (101) can provide a mixed signal (221) by amplifying and mixing each of the sound objects (211, 213, 215, 217) based on gain values ​​(201), for example, using an amplification module (207). For example, a sound object (211) may be multiplied by a gain value of g1 corresponding to it, a sound object (212) may be multiplied by a gain value of g2 corresponding to it, a sound object (213) may be multiplied by a gain value of g3 corresponding to it, and a sound object (214) may be multiplied by a gain value of g4 corresponding to it. The results of multiplying the gain values ​​(201) may be summed (mixed), and accordingly, a mixed signal (221) may be provided.

[0080] The electronic device (101) can provide an analog signal (225) by applying a DRC curve (209) that is pre-stored in the electronic device (101) to a mixed signal (221), for example, using a DRC core module (223). For example, referring to FIG. 3, a first waveform (310) of a sound object (211) corresponding to a voice is disclosed. Ideally, the first waveform (310) of the sound object (211) corresponding to a voice should contain only voice sound. However, perfect separation may not be achieved, in which case the first waveform of the sound object (211) corresponding to a voice may contain other sounds in addition to voice sound. For example, the first part (311) of the first waveform (310) may contain, for example, music sound. The second part (312) of the first waveform (310) may contain, for example, voice sound. As described above, voice sound separation by the separation module (205) may not be perfectly performed, and accordingly, music sound may be included in the first part (311). The volume of the music sound included in the first part (311) may be relatively smaller than the volume of the voice sound included in the second part (312). Meanwhile, based on the amplification module (207), amplification may be performed by multiplying the first waveform (310) of the sound object (211) corresponding to the voice by g1, which is a gain value corresponding to the sound object (211). Although not illustrated, g2, g3, and g4 may also be multiplied for other sound objects (213, 215, 217), and a mixed signal (221) may be provided by summing (mixing) the multiplication results. For example, g1 may be a relatively large value. In this case, not only the waveform included in the second part (312), but also the waveform included in the first part (311) can be amplified relatively greatly.Since the first part (311) contains music sounds due to imperfect separation, amplification based on g1 of that part may not be desirable. Since g1 is set relatively large for the purpose of adjusting the voice sound to be relatively large compared to other sounds, amplification of g1 for music sounds due to imperfect separation is not desirable. The electronic device (101) may apply a pre-stored DRC curve (209) to the mixed signal resulting from the mixing of the amplification results. The pre-stored DRC curve (209) may include, for example, a linear graph with a slope of 1 in a first range of input values ​​(-100 dBm to 0 dBm). For example, the input value of the mixed signal for the time interval containing music sounds may be included in the first range, and as a result of applying the DRC curve (209) (the result of applying the linear graph interval with a slope of 1), an output value identical to the input value may be confirmed. In FIG. 3, a second waveform (330) corresponding to an analog signal to which a pre-stored DRC curve (209) is applied is disclosed. The first part (331) of the second waveform (330) may include, for example, a music sound amplified based on g1, and the second part (332) may include, for example, a voice sound amplified based on g1. As described above, the music sound included in the first part (331) is undesirable because it is caused by the amplification of g1 corresponding to the voice sound for a component caused by imperfect separation. Accordingly, it may be desirable to suppress the first part (331) of the second waveform (330) by applying a DRC curve other than the pre-stored DRC curve (209), and this will be explained below.

[0081] FIG. 4a is a drawing for explaining the operation method of an electronic device according to one embodiment. FIG. 4a will be explained with reference to FIG. 4b to 4d and FIG. 5. FIG. 4b to 4d are drawings for explaining a user interface for setting a gain value according to one embodiment. FIG. 5 is a drawing for explaining sound source processing according to one embodiment.

[0082] According to one embodiment, the electronic device (101) can separate the sound source (203) into a plurality of sound objects (211, 213, 215, 217) in operation 401. The separation of the plurality of sound objects (211, 213, 215, 217) has been described above, so the description here is not repeated. In operation 403, the electronic device (101) can check user input specifying each of the plurality of gain values ​​(201) corresponding to each of the plurality of sound objects (211, 213, 215, 217). For example, the electronic device (101) can check user input through a user interface. For example, as shown in FIG. 4b, the electronic device (101) can provide a first screen (420) as a user interface. The first screen (420) may be, for example, a video playback application execution screen, but there is no restriction on the type of application. In the example of FIG. 4b, the sound source (203) is implemented as being stored together with the video (or synchronized in time), but those skilled in the art will understand that this is exemplary and that processing of the sound source (203) alone may also be possible.

[0083] Referring to FIG. 4b, the first screen (420) may include an image (421) constituting the video, playback information (422), a playback bar (423), an auto-setting icon (430), icons (431, 432, 433) corresponding to each of a plurality of sound objects, an object (440) representing gain values, an indicator (441), an icon for cancellation (442), an icon for confirmation (443), an original listening icon (451), and / or a mute icon (452), but is not limited thereto. For example, the icons (431, 432, 433) corresponding to each of a plurality of sound objects may be identified and represented based on the separation result of the sound source (203), but is not limited thereto. The object (440) representing gain values ​​is depicted in FIG. 4b as including a plurality of bars extended in the vertical direction, but is not limited thereto. Each of the multiple (or N, where N is a natural number greater than 1) vertically extended bars may correspond to each of the settable candidate gain values. For example, N candidate values ​​may be set within the settable gain value range for a sound object, and each of the N vertically extended bars may correspond to each of the candidate values. The electronic device (101) may identify the candidate value corresponding to the vertically extended bar designated by the indicator (441) (or where the indicator (441) is located) as the gain value corresponding to the currently designated icon (in FIG. 4b, the icon (431) corresponding to the sound object corresponding to the voice). Based on user input, the bar designated by the indicator (441) may be changed. For example, as in FIG. 4c, depending on user input, the indicator (441) may designate (or position) the bar placed at the left end of the deformed object (444).In this example, the position of the indicator (441) is fixed, and the object (440) of FIG. 4b is changed to the object (444) according to user input, for example, as if multiple bars extended vertically are moving, but this is graphically optional and not limited. Those skilled in the art will understand that in other examples, the object (440) of FIG. 4b may be maintained while the position of the indicator (441) is changed according to user input. In FIG. 4c, an object (445) that specifies (or positions) a bar placed at the left end of the modified object (444) and represents a candidate value (expressed as “-100” in FIG. 4c) corresponding to the specified bar may be represented in place of the icon (431) of FIG. 4b. Meanwhile, it is graphically optional to represent the object (445) by replacing the icon (431), and those skilled in the art will understand that the display of the icon (431) may be maintained while a candidate value (e.g., -100) is displayed in a different location. The “-100” in FIG. 4c is a value for intuitive recognition, and a corresponding gain value (e.g., may be in dB units, but is not limited) may be set. For example, as in FIG. 4d, depending on user input, the indicator (441) may specify (or position) a bar placed at the right end of the transformed object (446). In this example, the position of the indicator (441) is fixed, and depending on user input, the object (440) in FIG. 4b is changed to the object (446), for example, as multiple bars extended in the vertical direction move, but this is graphically optional and is not limited. In another example, those skilled in the art will understand that the object (440) of FIG. 4b may be maintained while the position of the indicator (441) is changed according to user input.In FIG. 4d, a bar placed at the right end of the deformed object (446) is designated (or positioned), and an object (447) representing a candidate value (expressed as “100” in FIG. 4d) corresponding to the designated bar may be represented in place of the icon (431) in FIG. 4b. Meanwhile, the representation of the object (447) in place of the icon (431) is graphically optional, and those skilled in the art will understand that the candidate value (e.g., 100) may be represented in a different location while the display of the icon (431) is maintained. “100” in FIG. 4c is a value for intuitive recognition, and a corresponding gain value (e.g., in dB units, but without limitation) may be set. As the position of the indicator (441) changes, the gain value may change, and accordingly, the volume corresponding to the sound object may be adjusted in real time during video playback. The user can select a desired volume by further adjusting the position of the indicator (441) while listening to the volume adjustment corresponding to a specific sound object in real time. The electronic device (101) can play the original sound source (203) with the gain value not adjusted based on the confirmation of the selection for the original listening icon (451). The electronic device (101) can set the volume for the corresponding sound object to substantially 0 based on the confirmation of the selection for the silent icon (452).

[0084] As described above, a gain value corresponding to a sound object can be set according to user input through a graphic-based user interface. For example, other icons (432, 433) of FIG. 4b may be selected to set the gain value of another sound object. In this case as well, a candidate value corresponding to the vertically extended bar designated (or located) by the indicator (441) may be set as the gain value of the sound object. Alternatively, gain values ​​corresponding to each of the optimized sound objects may be set according to the icon (430) for automatic setting. For example, gain values ​​may be set based on the size of each of the optimized sound objects, but this is exemplary and not limited to.

[0085] Meanwhile, the graphic-based user interface is exemplary, and there are no restrictions on the method of setting gain values ​​corresponding to at least some of the sound objects. For example, the user may utter a voice such as “Set the volume of the voice to twice the current level,” and the electronic device (101) may identify a gain value corresponding to the sound object (e.g., 3 dB corresponding to “twice”) based on voice analysis. Alternatively, the user may utter a voice with no specified gain value, such as “Make the human voice louder,” or “Down the music volume a little.” The electronic device (101) may identify a gain value of a specified value based on voice analysis, and there are no restrictions on the method of identification.

[0086] The electronic device (101) can generate a mixed signal (221) corresponding to a sound source (203) by applying a plurality of gain values ​​(201) to each of a plurality of sound objects (211, 213, 215, 217) in operation 405, as shown in FIG. 5, and mixing the applied results. Since the application (e.g., multiplication) and / or mixing of the plurality of gain values ​​(201) to each of the plurality of sound objects (211, 213, 215, 217) has been described above, the description here is not repeated.

[0087] The electronic device (101) can check whether, in operation 407, a plurality of gain values ​​satisfy a condition for applying a pre-stored dynamic range control curve (209). For example, the condition for applying a pre-stored dynamic range control curve (209) may be associated with a maximum value among the plurality of gain values. For example, the condition for application may be a condition that the maximum value is not excessively large in absolute and / or relative terms. In one example, the electronic device (101) can check whether the maximum value among the plurality of gain values ​​is below a threshold value as the satisfaction of the condition for applying a pre-stored dynamic range control curve (209). In one example, the electronic device (101) can check whether the difference between the maximum value and the remaining values ​​other than the maximum value among the plurality of gain values ​​satisfies a specified second condition as the satisfaction of the condition for applying a pre-stored dynamic range control curve (209). The second condition may be, for example, a condition where the maximum value is smaller than the sum of the remaining values. The second condition may be, for example, a condition where the difference between the maximum value and the next-highest maximum value is smaller than a specified threshold difference (or, a condition where the ratio is smaller than a threshold ratio). The second condition may be, for example, a condition where the difference between the maximum value and the minimum value is smaller than a specified threshold difference (or, a condition where the ratio is smaller than a threshold ratio), and there are no restrictions on how the second conditions are set.

[0088] If it is confirmed that the conditions for applying a pre-stored dynamic range control curve (209) are satisfied (407 operation—yes), the electronic device (101) can control the speaker (227) to play a first analog signal generated by applying the pre-stored dynamic range control curve (209) to the mixed signal in the 409 operation. If it is not confirmed that the conditions for applying a pre-stored dynamic range control curve (209) are satisfied (407 operation—no), the electronic device (101) can control the speaker (227) to play a second analog signal generated by applying a dynamic range control curve generated based on at least some of a plurality of gain values ​​to the mixed signal in the 411 operation. As shown in FIG. 5, the electronic device (101) may generate a DRC curve based on at least some of the gain values ​​(201), for example, using a DRC curve generation module (229). The electronic device (101) may apply the generated DRC curve, rather than a pre-stored DRC curve (209), to the mixed signal (221), for example, using a DRC core module (223). Those skilled in the art will understand that the application of the DRC curve here may mean setting the magnitude or input level of the analog signal to be played by checking the output value corresponding to the input value (or magnitude or input level) of the mixed signal by referring to the DRC curve. Hereinafter, with reference to FIG. 6a and 6b, the selective use of the DRC curve and the differences between the DRC curves will be explained. The generation of a DRC curve based on at least some of the gain values ​​(201) will be explained with reference to FIG. 7.

[0089] FIG. 6a is a diagram illustrating the selective use of a DRC curve according to one embodiment. The embodiment of FIG. 6a will be described with reference to FIG. 6b. FIG. 6b is a diagram illustrating the difference between DRC curves.

[0090] According to one embodiment, as described with reference to FIG. 4a, depending on whether the conditions for applying a pre-stored dynamic range control curve (209) are satisfied, the pre-stored DRC curve (209) or the generated DRC curve (611) may be applied using the DRC core module (223). For example, in the example of FIG. 6a, it is assumed that the generated DRC curve (611) is applied because the conditions for applying a pre-stored dynamic range control curve (209) are not satisfied. A third waveform (340) corresponding to the analog signal generated by applying the generated DRC curve (611) is shown in FIG. 6a. The first part (341) of the third waveform (340) may include, for example, a music sound amplified based on g1, and the second part (342) may include, for example, a voice sound amplified based on g1. For music sound amplified based on g1, a generated DRC curve (611) may be applied, and accordingly, the size of the first part (341) may be relatively smaller than the size of the first part (311) of FIG. 3. For example, referring to FIG. 6b, a pre-stored DRC curve (209) may include at least one first output value (643) corresponding to at least one first input value (641) and at least one second output value (644) corresponding to at least one second input value (642). The boundary values ​​of at least one first input value (641) and at least one second input value (642) may be named as reference input values ​​(640). As described above, the slope of at least one second input value (642) and at least one second output value (644) may be, for example, 1, but there is no limitation.The generated DRC curve (611) may include at least one third output value (653) corresponding to at least one third input value (651) and at least one fourth output value (644) corresponding to at least one fourth input value (652). The boundary values ​​of at least one third input value (651) and at least one fourth input value (652) may be named as reference input values ​​(650). The reference input value (650) may be identical to the reference input value (640) of the previously stored DRC curve (209). For example, at least one first input value (641) may be identical to at least one third input value (651), and at least one second input value (642) may be identical to at least one fourth input value (652). For example, at least one first output value (643) may be the same as at least one third output value (653). For example, at least one second output value (644) may be different from at least one fourth output value (654). For example, the slope of at least one fourth input value (652) and at least one fourth output value (654) may be greater than 1. Accordingly, when the generated DRC curve (611) is applied, the output value corresponding to any one of the input values ​​of at least one fourth input value (e.g., -20 dBm or less) may be smaller than the output value corresponding to any one of the input values ​​of at least one second input value (e.g., -20 dBm or less). Accordingly, as shown in FIG. 6b, the size of the first part (341) to which the generated DRC curve (611) is applied may be smaller than the size of the first part (331) to which the previously stored DRC curve (209) is applied. Accordingly, the amplification of the music, which is the noise target, can be suppressed based on the voice.This may be caused by the fact that the output value corresponding to any input value in the range of -20 dBm or less of the generated DRC curve (611) is smaller than the output value corresponding to any input value in the range of -20 dBm or less of the pre-stored DRC curve (209). As described above, the electronic device (101) can suppress noise components based on imperfect separation based on the application of the generated DRC curve (611). Below, with reference to FIG. 7, a method for generating the DRC curve (611) will be described.

[0091] FIG. 7 is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0092] According to one embodiment, the electronic device (101) can determine in operation 701 that a plurality of gain values ​​(201) do not satisfy the conditions for applying a pre-stored dynamic range control curve (209). In operation 703, the electronic device (101) can determine, for example, the reference input value (650) of FIG. 6b based on the maximum value among the plurality of gain values ​​(201). In one example, the electronic device (101) can determine the reference input value (650) based on Equation 1.

[0093]

[0094] In mathematical formula 1, “dB_limit” is a reference input value (650), fixed_val is a specified value corresponding to the noise floor, and max_gain may be the maximum value among multiple gain values ​​(201).

[0095] The electronic device (101) can generate a first output value corresponding to input values ​​less than the reference input value (650) in operation 705. For example, as described in FIG. 6b, the slope between the input value less than the reference input value (650) and the corresponding first output value may be set greater than the slope between the input value less than the reference input value (640) and the corresponding output value of the pre-stored DRC curve (209). The electronic device (101) can identify a second output value corresponding to input values ​​greater than or equal to the reference input value (650) in operation 707. The second output value corresponding to input values ​​greater than or equal to the reference input value (650) may be, for example, identical to the output value corresponding to input values ​​greater than or equal to the reference input value (640) of the pre-stored DRC curve (209). The electronic device (101) can generate a DRC curve based on the first output value and the second output value in operation 709. As described above, for example, the generated DRC curve may be a DRC curve in which the output value corresponding to an input value greater than or equal to a reference input value, as described in FIG. 6b, is identical to a pre-stored DRC curve (209), and the output value corresponding to an input value less than a reference input value is different from the pre-stored DRC curve (209) (e.g., having a larger slope), but this is exemplary and not limited.

[0096] FIG. 8 is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0097] According to one embodiment, the electronic device (101) can separate the sound source (203) into a plurality of sound objects (211, 213, 215, 217) in operation 801. The electronic device (101) can check a user input in operation 803 that specifies each of a plurality of gain values ​​(201) corresponding to each of the plurality of sound objects (211, 213, 215, 217). In operation 805, the electronic device (101) can apply the plurality of gain values ​​(201) to each of the plurality of sound objects (211, 213, 215, 217) and mix the applied results to generate a mixed signal (221) corresponding to the sound source. The electronic device (101) can determine, in operation 807, whether the maximum value among the gain values ​​(201) is below a threshold value (Max_gain <= 1.0f) and / or whether the maximum value is below the sum of the remaining values ​​(Max_gain < others_sum_gain). If the maximum value among the gain values ​​(201) is below the threshold value, and / or the maximum value is below the sum of the remaining values ​​(operation 807—e.g.), the electronic device (101) can, in operation 809, control the speaker (227) to play a first analog signal generated by applying a pre-stored dynamic range control curve to the mixed signal. If the maximum value among the gain values ​​(201) is not below the threshold value and the maximum value is not below the sum of the remaining values ​​(operation 807 - No), the electronic device (101) can, in operation 811, determine the reference input value (dB_limit) for generating the DRC curve as the sum of the value corresponding to the noise floor and the maximum value (fixed_val + max_gain). In operation 813, the electronic device (101) can determine the coordinates of the first point (P1) constituting the DRC curve as (dB_limit * 2, dB_limit * 2 * suppressionMultiple).The suppression multiple may be a value for setting the slope for input values ​​below the reference input value (dB_limit), as described with reference to FIG. 6b, but there is no limit. The larger the suppression multiple, the larger the slope may be, but there is no limit. In operation 813, the electronic device (101) can determine the coordinates of the second point (P2) constituting the DRC curve as (dB_limit, dB_limit). For example, the second point (P2) may be a point corresponding to the reference input value (dB_limit) in FIG. 6b, and the first point (P1) may be a point corresponding to the minimum value of at least one third input value (652). In operation 815, the electronic device (101) can generate a dynamic range control curve based on the first point (P1) and the second point (P2). For example, the graph between the first point (P1) and the second point (P2) may be represented as having linearity, but there are no limitations. In FIG. 6b, the DRC curve is illustrated as ending at the second point (P2), but this is exemplary, and those skilled in the art will understand that the DRC curve may be implemented to extend through the second point (P2). The electronic device (101) can control the speaker (227) to play a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​(201) to the mixed signal in operation 817.

[0098] FIG. 9 is a drawing for explaining the operation method of an electronic device according to one embodiment.

[0099] According to one embodiment, the electronic device (101) can separate the sound source (203) into multiple sound objects (211, 213, 215, 217) in operation 901. In operation 903, the electronic device (101) can confirm a user input specifying each of the multiple gain values ​​(201) corresponding to each of the multiple sound objects (211, 213, 215, 217). In operation 905, the electronic device (101) can generate a mixed signal (221) corresponding to the sound source by applying the multiple gain values ​​(201) to each of the multiple sound objects (211, 213, 215, 217) and mixing the applied results. In operation 907, the electronic device (101) can select a dynamic range control curve based on the multiple gain values ​​(201). The electronic device (101) can control the speaker (227) to play an analog signal generated by applying a selected dynamic range control curve to a mixed signal in a 911 operation. In one example, the electronic device (101) can select one DRC curve based on multiple gain values ​​(201) among a plurality of pre-stored DRC curves. A rule-based selection based on at least some of the plurality of gain values ​​(201) or a selection based on inference by an artificial intelligence model may be performed, but those skilled in the art will understand that there are no limitations on the method of selection. In one example, the electronic device (101) may generate a DRC curve based on at least some of the plurality of gain values ​​(201). For example, a DRC curve may be generated according to a DRC curve generation rule based on multiple gain values ​​(201), or a DRC curve may be generated according to the application of an artificial intelligence model to multiple gain values ​​(201), and there are no restrictions on the generation method.

[0100] FIG. 10 is a drawing for explaining the operation method of an electronic device according to one embodiment. The embodiment of FIG. 10 will be explained with reference to FIG. 11. FIG. 11 is a drawing for explaining the change of a DRC curve according to one embodiment.

[0101] According to one embodiment, the electronic device (101) can confirm that, in operation 1001, a first gain value is set for a first sound object (211) of the sound source (203) and a second value is set for a second sound object (213) of the sound source (203). In operation 1003, the electronic device (101) can play the sound source (203) using a first dynamic range control curve corresponding to the first gain value and the second gain value. In operation 1005, the electronic device (101) can confirm that a third gain value is set for the first sound object (211) and a second gain value is set for the second sound object (213). For example, depending on user input through a user interface such as that in FIG. 4b, the gain value corresponding to the first sound object (211) may be changed from the first gain value to the third gain value. In this example, it is assumed that the gain value corresponding to the second sound object (213) is maintained. The electronic device (101) may play the sound source (203) in operation 1007 using a second dynamic range control curve that is at least partially different from the first dynamic range control curve corresponding to the third gain value and the second gain value. For example, referring to FIG. 11, the electronic device (101) may play a portion of the sound source (201) using a DRC curve (1121) corresponding to gain values ​​(1111) of [1.0, 1.0, 1.0, 1.0] during a first period (T1). Meanwhile, the electronic device (101) can confirm a change to gain values ​​(1112) of [5.6, 0.0, 0.0, 0.0] and can play a portion of the sound source (201) during a second period (T2) using a corresponding DRC curve (1122). Meanwhile, the electronic device (101) [1.0, 1.0, 1.0, 1.A change to gain values ​​(1111) of [0] can be confirmed, and a portion of the sound source (201) can be played during a third period (T3) using a corresponding DRC curve (1121). Meanwhile, the electronic device (101) can confirm a change to gain values ​​(1112) of [2.8, 0.0, 0.0, 0.0], and a portion of the sound source (201) can be played during a fourth period (T4) using a corresponding DRC curve (1123). As described above, the electronic device (101) can confirm the adjustment of gain values ​​while the sound source (201) is being played, and accordingly, the DRC curve applied in real time can be changed. In one example, the electronic device (101) may apply, for example, a DRC curve (1121) and then use a DRC curve (1122) in place of it, but this is exemplary. In another example, the electronic device (101) may be implemented to sequentially use at least one intermediate curve and then use the DRC curve (1122) as the use of the DRC curve (1121) is requested. The at least one intermediate curve may be, for example, a curve representing a gradual change from the DRC curve (1121) to the DRC curve (1122), but is not limited thereto.

[0102] FIG. 12 is a drawing for explaining sound source processing according to one embodiment.

[0103] According to one embodiment, the electronic device (101) may separate a sound source (203) into a plurality of sound objects (211, 213, 215, 217) using, for example, a separation module (205). The electronic device (101) may apply DRC curves to each of the plurality of sound objects (211, 213, 215, 217) using, for example, each of the sub-DRC core modules (1201, 1202, 1203, 1204). For example, the sub-DRC core modules (1201, 1202, 1203, 1204) may be configured to apply DRC curves optimized for each of the plurality of sound objects (211, 213, 215, 217). The amplification module (207) may provide a mixed signal (221) by performing mixing by applying gain values ​​(201) to the results of applying DRC curves optimized for each of the multiple sound objects (211, 213, 215, 217). Since the subsequent process has been explained with reference to FIG. 5, the explanation here is not repeated.

[0104] The electronic device (101) may include a speaker (227), at least one processor (110), and a memory (130) for storing instructions.

[0105] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the sound source to be separated into a plurality of sound objects.

[0106] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to confirm a user input specifying each of the plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0107] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to apply the plurality of gain values ​​to each of the plurality of sound objects and to mix the applied results to generate a mixed signal corresponding to the sound source.

[0108] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve.

[0109] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the speaker (227) to control the first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal based on the plurality of gain values ​​satisfying the condition.

[0110] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the speaker (227) to control the speaker to play a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal, based on the fact that the plurality of gain values ​​do not satisfy the condition.

[0111] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the maximum value among the plurality of gain values ​​is below a threshold value as the satisfaction of the condition, as at least part of the operation of checking whether the plurality of gain values ​​satisfy the condition for applying a pre-stored dynamic range control curve.

[0112] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies a specified second condition as at least part of an operation to check whether the plurality of gain values ​​satisfy a condition for applying a pre-stored dynamic range control curve.

[0113] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the maximum value among the plurality of gain values ​​is less than the sum of the remaining values ​​other than the maximum value as the satisfaction of the second condition, as at least part of an operation to check whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies the specified second condition.

[0114] The output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned pre-stored dynamic range control curve may be identical to the output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned generated dynamic range control curve.

[0115] The output value corresponding to the first value among the input values ​​less than the reference input value of the above-preserved dynamic range control curve may be greater than the output value corresponding to the first value among the input values ​​less than the reference input value of the above-generated dynamic range control curve.

[0116] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the reference input value to be checked based on the maximum value among the plurality of gain values.

[0117] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to generate output values ​​corresponding to input values ​​less than the reference input value.

[0118] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check the reference input value by summing the noise floor value specified for the maximum value among the plurality of gain values ​​as at least part of the operation of checking the reference input value.

[0119] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to identify a first point identified based on the reference input value as at least part of an operation of generating output values ​​corresponding to input values ​​less than the reference input value.

[0120] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause to identify a second point identified based on the reference input value and a predetermined suppression multiple as at least part of an operation to generate output values ​​corresponding to input values ​​less than the reference input value.

[0121] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to generate output values ​​corresponding to input values ​​less than the reference input value based on the first point and the second point as at least part of an operation of generating output values ​​corresponding to input values ​​less than the reference input value.

[0122] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to generate a mixed signal corresponding to the sound source by mixing the results of applying each of the DRC curves corresponding to each of the sound objects to each of the applied results, as at least part of the operation of generating a mixed signal corresponding to the sound source by applying each of the multiple gain values ​​to each of the multiple sound objects and mixing the applied results.

[0123] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the selection of a first graphic object among a plurality of graphic objects for selecting each of the plurality of sound objects as at least part of an operation of confirming a user input specifying each of the plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0124] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to identify a candidate gain value identified based on at least a portion of the user input among the plurality of candidate gain values ​​corresponding to the first graphic object as the gain value corresponding to the first graphic object, as at least part of the operation of identifying a plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0125] The operation method of the electronic device (101) may include the operation of separating a sound source into a plurality of sound objects.

[0126] The method of operation of the above electronic device (101) may include an operation of confirming a user input that specifies each of a plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0127] The method of operation of the electronic device (101) may include applying the plurality of gain values ​​to each of the plurality of sound objects and mixing the applied results to generate a mixed signal corresponding to the sound source.

[0128] The method of operation of the above electronic device (101) may include an operation to check whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve.

[0129] The method of operation of the electronic device (101) may include controlling the speaker (227) to play a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal based on the fact that the plurality of gain values ​​satisfy the condition, or to play a second analog signal generated by applying the dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal based on the fact that the plurality of gain values ​​do not satisfy the condition.

[0130] The operation of checking whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve may include checking whether the maximum value among the plurality of gain values ​​is below a threshold value as the satisfaction of the condition.

[0131] The operation of checking whether the above plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve may include checking whether the difference between the maximum value among the above plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies a specified second condition as the satisfaction of the condition.

[0132] The operation of checking whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies a specified second condition may include checking whether the maximum value among the plurality of gain values ​​is smaller than the sum of the remaining values ​​as the satisfaction of the second condition.

[0133] The output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned pre-stored dynamic range control curve may be identical to the output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned generated dynamic range control curve.

[0134] The output value corresponding to the first value among the input values ​​less than the reference input value of the above-preserved dynamic range control curve may be greater than the output value corresponding to the first value among the input values ​​less than the reference input value of the above-generated dynamic range control curve.

[0135] The method of operation of the electronic device (101) may include an operation of checking the reference input value based on the maximum value among the plurality of gain values.

[0136] The method of operation of the above electronic device (101) may include an operation of generating output values ​​corresponding to input values ​​less than the reference input value.

[0137] The operation of verifying the reference input value may include the operation of verifying the reference input value by summing the noise floor value designated to the maximum value among the plurality of gain values.

[0138] The operation of generating output values ​​corresponding to input values ​​less than the reference input value may include the operation of verifying a first point verified based on the reference input value.

[0139] The operation of generating output values ​​corresponding to input values ​​less than the reference input value may include the operation of verifying a second point verified based on the reference input value and a predetermined suppression constant (suppressionMultiple).

[0140] The operation of generating output values ​​corresponding to input values ​​less than the reference input value may include the operation of generating output values ​​corresponding to input values ​​less than the reference input value based on the first point and the second point.

[0141] A storage medium for storing computer-readable instructions may be provided.

[0142] When the above instructions are executed individually or collectively by at least one processor (110) of the electronic device (101), the electronic device (101) may cause the sound source to be separated into a plurality of sound objects.

[0143] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to confirm a user input specifying each of the plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0144] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to apply the plurality of gain values ​​to each of the plurality of sound objects and to mix the applied results to generate a mixed signal corresponding to the sound source.

[0145] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve.

[0146] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the speaker (227) to control the first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal based on the plurality of gain values ​​satisfying the condition.

[0147] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the speaker (227) to control the speaker to play a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal, based on the fact that the plurality of gain values ​​do not satisfy the condition.

[0148] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the maximum value among the plurality of gain values ​​is below a threshold value as the satisfaction of the condition, as at least part of the operation of checking whether the plurality of gain values ​​satisfy the condition for applying a pre-stored dynamic range control curve.

[0149] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies a specified second condition as at least part of an operation to check whether the plurality of gain values ​​satisfy a condition for applying a pre-stored dynamic range control curve.

[0150] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check whether the maximum value among the plurality of gain values ​​is less than the sum of the remaining values ​​other than the maximum value as the satisfaction of the second condition, as at least part of an operation to check whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies the specified second condition.

[0151] The output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned pre-stored dynamic range control curve may be identical to the output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned generated dynamic range control curve.

[0152] The output value corresponding to the first value among the input values ​​less than the reference input value of the above-preserved dynamic range control curve may be greater than the output value corresponding to the first value among the input values ​​less than the reference input value of the above-generated dynamic range control curve.

[0153] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the reference input value to be checked based on the maximum value among the plurality of gain values.

[0154] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to generate output values ​​corresponding to input values ​​less than the reference input value.

[0155] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to check the reference input value by summing the noise floor value specified for the maximum value among the plurality of gain values ​​as at least part of the operation of checking the reference input value.

[0156] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to identify a first point identified based on the reference input value as at least part of an operation of generating output values ​​corresponding to input values ​​less than the reference input value.

[0157] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause to identify a second point identified based on the reference input value and a predetermined suppression multiple as at least part of an operation to generate output values ​​corresponding to input values ​​less than the reference input value.

[0158] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to generate output values ​​corresponding to input values ​​less than the reference input value based on the first point and the second point as at least part of an operation of generating output values ​​corresponding to input values ​​less than the reference input value.

[0159] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to generate a mixed signal corresponding to the sound source by mixing the results of applying each of the DRC curves corresponding to each of the sound objects to each of the applied results, as at least part of the operation of generating a mixed signal corresponding to the sound source by applying each of the multiple gain values ​​to each of the multiple sound objects and mixing the applied results.

[0160] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the selection of a first graphic object among a plurality of graphic objects for selecting each of the plurality of sound objects as at least part of an operation of confirming a user input specifying each of the plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0161] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to identify a candidate gain value identified based on at least a portion of the user input among the plurality of candidate gain values ​​corresponding to the first graphic object as the gain value corresponding to the first graphic object, as at least part of the operation of identifying a plurality of gain values ​​corresponding to each of the plurality of sound objects.

[0162] The electronic device (101) may include a speaker (227), at least one processor (110), and a memory (130) for storing instructions.

[0163] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may cause the first gain value to be set for the first sound object of the sound source and the second value to be set for the second sound object of the sound source.

[0164] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to play the sound source using a first dynamic range control curve corresponding to the first gain value and the second gain value.

[0165] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to confirm that a third gain value different from the first gain value is set for the first sound object and that a second gain value is set for the second sound object.

[0166] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to play the sound source using a second dynamic range control curve that is at least partially different from the first dynamic range control curve corresponding to the third gain value and the second gain value.

[0167] The method of operation of the electronic device (101) may include an operation of confirming that a first gain value is set for a first sound object of the sound source and a second value is set for a second sound object of the sound source.

[0168] The method of operation of the electronic device (101) may include the operation of playing the sound source using a first dynamic range control curve corresponding to the first gain value and the second gain value.

[0169] The method of operation of the electronic device (101) may include an operation of confirming that a third gain value different from the first gain value is set for the first sound object and that the second gain value is set for the second sound object.

[0170] The method of operation of the electronic device (101) may include the operation of playing the sound source using a second dynamic range control curve that is at least partially different from the first dynamic range control curve corresponding to the third gain value and the second gain value.

[0171] A storage medium for storing computer-readable instructions may be provided.

[0172] When the above instructions are executed individually or collectively by at least one processor (110) of the electronic device (101), the electronic device (101) may cause the electronic device (101) to confirm that a first gain value is set for a first sound object of the sound source and a second value is set for a second sound object of the sound source.

[0173] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to play the sound source using a first dynamic range control curve corresponding to the first gain value and the second gain value.

[0174] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to confirm that a third gain value different from the first gain value is set for the first sound object and that a second gain value is set for the second sound object.

[0175] When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) may be caused to play the sound source using a second dynamic range control curve that is at least partially different from the first dynamic range control curve corresponding to the third gain value and the second gain value.

[0176] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0177] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0178] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0179] One embodiment of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0180] According to one embodiment, the method according to the embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0181] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the components of the multiple components in the same or similar manner as those performed by the corresponding components among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), Speaker (227); At least one processor (110); and The electronic device (101) includes a memory (130) for storing instructions, wherein the instructions are executed individually or collectively by the at least one processor (110): Separate the sound source into multiple sound objects, and Check user input specifying each of the multiple gain values ​​corresponding to each of the multiple sound objects mentioned above, and The plurality of gain values ​​are applied to each of the plurality of sound objects, and the applied results are mixed to generate a mixed signal corresponding to the sound source, Check whether the above multiple gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve, and Based on the fact that the plurality of gain values ​​satisfy the above conditions, the speaker (227) is controlled to play a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal, and An electronic device (101) that causes the speaker (227) to be controlled to play a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal, based on the fact that the plurality of gain values ​​do not satisfy the condition.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) is made to perform at least as part of an operation to determine whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve: An electronic device (101) that causes the maximum value among the plurality of gain values ​​to be below a threshold value as the satisfaction of the condition.

3. In any one of paragraphs 1 to 2, When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) is made to perform at least as part of an operation to determine whether the plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve: An electronic device (101) that causes the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value to satisfy a specified second condition as the satisfaction of the condition.

4. In any one of paragraphs 1 to 3, When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) is enabled to determine, at least as part of an operation, whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies a specified second condition: An electronic device (101) that causes checking whether the maximum value among the plurality of gain values ​​is smaller than the sum of the remaining values ​​as the satisfaction of the second condition.

5. In any one of paragraphs 1 to 4, The output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned pre-stored dynamic range control curve are identical to the output values ​​corresponding to input values ​​greater than or equal to the reference input value of the aforementioned generated dynamic range control curve, and An electronic device (101) in which the output value corresponding to the first value among the input values ​​less than the reference input value of the above-preserved dynamic range control curve is greater than the output value corresponding to the first value among the input values ​​less than the reference input value of the above-produced dynamic range control curve.

6. In any one of paragraphs 1 through 5, When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) is enabled, Based on the maximum value among the plurality of gain values ​​above, the reference input value is checked, and An electronic device (101) that causes output values ​​corresponding to input values ​​less than the above reference input value.

7. In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) is enabled to perform, at least as part of the operation of verifying the reference input value: An electronic device (101) that causes the reference input value to be verified by summing the noise floor value designated at the maximum value among the plurality of gain values.

8. In any one of paragraphs 1 through 7, When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) is at least as part of an operation to generate output values ​​corresponding to input values ​​less than the reference input value: Verify the first point confirmed based on the above reference input value, and Identify the second point confirmed based on the above reference input value and the predetermined suppression constant (suppressionMultiple), and An electronic device (101) that causes to generate an output value corresponding to input values ​​less than the reference input value based on the first point and the second point.

9. In any one of paragraphs 1 through 8, The above instructions, when executed individually or collectively by the at least one processor (110), are at least part of an operation in which the electronic device (101) applies the plurality of gain values ​​to each of the plurality of sound objects and mixes the applied results to generate a mixed signal corresponding to the sound source. An electronic device (101) that causes to generate a mixed signal corresponding to the sound source by mixing the results of applying each of the DRC curves corresponding to each of the sound objects to each of the applied results.

10. In any one of paragraphs 1 through 9, When the above instructions are executed individually or collectively by the at least one processor (110), the electronic device (101) is at least part of an operation of confirming a user input that specifies each of the plurality of gain values ​​corresponding to each of the plurality of sound objects. Confirm the selection of the first graphic object among the plurality of graphic objects for selecting each of the above plurality of sound objects, and An electronic device (101) that causes a candidate gain value identified based on at least a portion of user input among a plurality of candidate gain values ​​corresponding to the first graphic object to be identified as a gain value corresponding to the first graphic object.

11. In the method of operating the electronic device (101), The operation of separating a sound source into multiple sound objects; An operation to verify user input specifying each of a plurality of gain values ​​corresponding to each of the plurality of sound objects above; An operation of applying the plurality of gain values ​​to each of the plurality of sound objects and mixing the applied results to generate a mixed signal corresponding to the sound source; An operation to check whether the above plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve; Operation of controlling the speaker (227) to play a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal based on the fact that the plurality of gain values ​​satisfy the condition, or to play a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal based on the fact that the plurality of gain values ​​do not satisfy the condition. A method of operation of an electronic device (101) including 12. In Paragraph 11, The operation of checking whether the above plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve is: An operation to check whether the maximum value among the plurality of gain values ​​is below a threshold value as whether the condition is satisfied. A method of operation of an electronic device (101) including 13. In any one of paragraphs 11 to 12, The operation of checking whether the above plurality of gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve is: An operation to check whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies a specified second condition as the satisfaction of said condition. A method of operation of an electronic device (101) including 14. In any one of paragraphs 11 through 13, The operation of checking whether the difference between the maximum value among the plurality of gain values ​​and the remaining values ​​other than the maximum value satisfies a specified second condition is: An operation to check whether the maximum value among the plurality of gain values ​​is smaller than the sum of the remaining values ​​as whether the second condition is satisfied. A method of operation of an electronic device (101) including 15. In a storage medium storing computer-readable instructions, When the above instructions are executed individually or collectively by at least one processor (110) of the electronic device (101), the electronic device (101) is caused to: Separate the sound source into multiple sound objects, and Check user input specifying each of the multiple gain values ​​corresponding to each of the multiple sound objects mentioned above, and The plurality of gain values ​​are applied to each of the plurality of sound objects, and the applied results are mixed to generate a mixed signal corresponding to the sound source, Check whether the above multiple gain values ​​satisfy the conditions for applying a pre-stored dynamic range control curve, and Based on the fact that the plurality of gain values ​​satisfy the above conditions, the speaker (227) is controlled to play a first analog signal generated by applying the pre-stored dynamic range control curve to the mixed signal, and A storage medium that causes the speaker (227) to be controlled to play a second analog signal generated by applying a dynamic range control curve generated based on at least some of the plurality of gain values ​​to the mixed signal, based on the fact that the plurality of gain values ​​do not satisfy the condition.

Images