Electronic device and method for managing buffer used for audio editing, and non-transitory storage medium

By employing buffer management strategies for audio editing, the system addresses delays in audio editing processes, ensuring seamless playback and synchronization with video.

WO2026235479A1PCT designated stage Publication Date: 2026-11-12SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2026/096634
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-06-26
Filing Date
2026-05-06
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Existing audio editing technologies experience delays of 1-2 seconds before initiating audio editing processes, leading to disrupted sound output during playback, affecting user experience.

Method used

The system manages audio editing by using multiple buffers to handle audio output and editing processes concurrently, allowing simultaneous output of unedited and edited audio components, minimizing delay through buffer management.

Benefits of technology

This approach ensures uninterrupted audio playback by reducing initialization delays and maintaining synchronized audio and video output during real-time content playback.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2026096634_12112026_PF_FP_ABST
    Figure KR2026096634_12112026_PF_FP_ABST
Patent Text Reader

Abstract

The present document relates to an electronic device and a method for managing a buffer used for audio editing, and a non-transitory storage medium. According to one embodiment, the electronic device comprises: at least one processor including processing circuitry; and a memory for storing instructions, wherein, when executed individually or collectively by the at least one processor, the instructions can instruct the electronic device to: output, on the basis of playing back the first content, first audio of a first content through a first buffer used to output the first audio; on the basis of identifying a request for editing the at least one component while playing back the first content, identify, from the first audio, the time required to perform a process for editing at least one component included in the first audio; set a second buffer for maintaining output of the first audio on the basis of the identified time; output the first audio through the second buffer while performing the process for editing the at least one component from the first audio; and, on the basis of identifying completion of the process, simultaneously output each of the first audio and second audio, in which the at least one component is edited from the first audio, through the second buffer for a designated time according to a designated ratio. Other various embodiments are also possible.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device, method, and non-transient storage medium for managing a buffer used for audio editing

[0001] The present disclosure relates to an electronic device, a method, and a non-transient computer-readable storage medium for managing a buffer used for audio editing.

[0002] With the advancement of digital technology, electronic devices are being provided in various forms, such as smartphones, tablet PCs, or PDAs. Electronic devices are also being developed in wearable forms to enhance portability and user accessibility.

[0003] As the performance of Neural Processing Units (NPUs) and Graphics Processing Units (GPUs) in electronic devices advances, audio editing technologies are also evolving. One such technology is audio eraser technology. It can provide the ability to remove unnecessary noise (e.g., static) from recorded videos, voice recordings, and various media content, allowing for the output of only voice, only music, or the selective output of desired audio sources. This feature is particularly useful for removing ambient noise during playback following video or voice recording.

[0004] There may be a time delay of 1-2 seconds until the process for audio editing begins (e.g., initialization or preparation) before applying the technique for audio editing.

[0005] If the initialization time or process time of the electronic device is delayed, the output time of sound with effects applied by audio editing is delayed, so the user may experience the sound output being cut off.

[0006] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0007] According to one embodiment of the present disclosure, an electronic device may include at least one processor comprising a processing circuit and a memory for storing instructions.

[0008] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to output the first audio through a first buffer used to output the first audio of the first content based on playing the first content.

[0009] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to determine the time required to perform a process for editing the at least one component from the first audio based on confirming a request to edit the at least one component included in the first audio while playing the first content.

[0010] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the second buffer to be set to maintain the output of the first audio based on the identified time.

[0011] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to output the first audio through the second buffer while performing the process for editing the at least one component from the first audio.

[0012] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first audio and the second audio, each of which the at least one component from the first audio has been edited, to be output simultaneously at a specified rate through the second buffer for a specified time based on confirming the completion of the process.

[0013] According to one embodiment, a method of operation in an electronic device may include an operation of outputting a first audio through a first buffer used to output a first audio of the first content based on playing a first content.

[0014] According to one embodiment, the method may include an operation of determining the time required to perform a process for editing the at least one component from the first audio based on confirming a request to edit at least one component included in the first audio while playing the first content.

[0015] According to one embodiment, the method may include the operation of setting a second buffer to maintain the output of the first audio based on the confirmed time.

[0016] According to one embodiment, the method may include the operation of outputting the first audio through the second buffer while performing the process for editing the at least one component from the first audio.

[0017] According to one embodiment, the method may include an operation of simultaneously outputting the first audio and the second audio, each of which the at least one component from the first audio has been edited, at a specified rate through the second buffer for a specified time, based on confirming the completion of the process.

[0018] According to one embodiment, in a non-transient computer-readable storage medium storing one or more programs, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute the operation of outputting the first audio through a first buffer used to output the first audio of the first content based on playing the first content.

[0019] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of determining the time required to perform a process for editing the at least one component from the first audio based on confirming a request to edit the at least one component included in the first audio while playing the first content.

[0020] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of setting a second buffer to maintain the output of the first audio based on the identified time.

[0021] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform the operation of outputting the first audio through the second buffer while performing the process for editing the at least one component from the first audio.

[0022] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of simultaneously outputting each of the first audio and the second audio, in which the at least one component of the first audio is edited, at a specified rate through the second buffer for a specified time, based on confirming the completion of the process.

[0023] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0024] FIG. 2 is a diagram showing the configuration of an electronic device according to one embodiment.

[0025] FIG. 3 is a diagram showing an example of the configuration of an audio circuit according to one embodiment.

[0026] FIG. 4 is a diagram showing an example of a buffer of an audio circuit according to one embodiment.

[0027] FIG. 5 is a diagram illustrating an example of managing a buffer used for audio editing of an electronic device according to one embodiment.

[0028] FIG. 6 is a diagram illustrating an example of managing a buffer used for audio editing of an electronic device according to one embodiment.

[0029] FIG. 7 is a diagram illustrating an example of managing a buffer used for audio editing of an electronic device according to one embodiment.

[0030] FIG. 8 is a diagram illustrating an example of managing a buffer used for audio editing of an electronic device according to one embodiment.

[0031] FIG. 9 is a diagram illustrating an example of managing a buffer used for audio editing of an electronic device according to one embodiment.

[0032] FIG. 10 is a drawing showing an example of a method of operation in an electronic device according to one embodiment.

[0033] FIG. 11 is a drawing showing an example of a method of operation in an electronic device according to one embodiment.

[0034] FIG. 12 is a drawing showing an example of a method of operation in an electronic device according to one embodiment.

[0035] FIGS. 13a, FIGS. 13b, FIGS. 13c and FIGS. 13d are drawings illustrating examples of buffers used for audio editing in an electronic device according to one embodiment.

[0036] FIGS. 14a and FIGS. 14b are drawings illustrating examples of a method of operation in an electronic device according to one embodiment.

[0037] FIGS. 15a and FIGS. 15b are drawings illustrating examples of a method of operation in an electronic device according to one embodiment.

[0038] FIGS. 16a and FIGS. 16b are drawings illustrating examples of a method of operation in an electronic device according to one embodiment.

[0039] FIG. 17 is a diagram illustrating an example of a method of operation in an electronic device according to one embodiment.

[0040] FIGS. 18a, FIGS. 18b, FIGS. 18c, FIGS. 18d, FIGS. 18e and FIGS. 18f are drawings illustrating examples of screens for audio editing in an electronic device according to one embodiment.

[0041] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0042] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity. The term "user" as used in the embodiments of the present disclosure may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0043] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0044] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0045] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0046] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0047] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0048] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0049] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0050] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0051] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0052] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0053] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0054] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0055] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0056] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0057] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0058] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0059] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0060] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0061] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0062] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0063] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0064] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0065] The present disclosure can manage a buffer used for audio editing to reduce the delay time (e.g., approximately 2 seconds) for starting (e.g., initializing) and performing a process for audio editing (e.g., audio eraser). If audio output delay occurs while playing content (e.g., video), video may not be output during the delay time in order to synchronize audio and video (AV), which may have an adverse effect on user usability.

[0066] The present disclosure may provide an electronic device, a method, and a non-transient storage medium that distinguish between a state in which a process for audio editing (e.g., an audio eraser) is performed or not performed, and set and manage a buffer used for audio output according to the distinguished state, thereby minimizing delay for performing the process during real-time playback of content and maintaining uninterrupted playback of content (video).

[0067] The present disclosure may provide an electronic device, a method, and a non-transient storage medium for managing a buffer used for audio editing to reduce the time delayed (e.g., about 2 seconds) for starting (e.g., initialization) and performing the process for audio editing (e.g., audio eraser).

[0068] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0069] Hereinafter, an electronic device, a method, and a non-transient computer-readable storage medium for managing a buffer used for audio editing will be described in detail.

[0070] FIG. 2 is a diagram showing the configuration of an electronic device according to one embodiment.

[0071] Referring to FIG. 2, an electronic device (101) according to one embodiment (e.g., the electronic device (101) of FIG. 1) may include a processor (210), memory (220), display (230), audio circuit (230), and communication circuit (250). The electronic device (201) may be configured to include an electrode circuit or various other components, or to exclude some of the components, but is not limited thereto.

[0072] According to one embodiment, when a processor (210) receives a request while playing content (e.g., video), it can control an audio circuit (230) to edit audio while playing content. The processor (210) can control an audio circuit (230) to output the first audio through a first buffer used to output the audio of the content being played (hereinafter referred to as the first audio). Here, the first buffer may temporarily store data of the first audio output through a decoder of the audio circuit (230) prior to generating or editing the audio to be output.

[0073] According to one embodiment, the processor (210) may detect a request to edit (e.g., separate and output sound source or remove noise) at least one component included in the first audio (e.g., at least one of sound source types separable from audio data (e.g., voice, music, wind, noise, laugh and / or crowd) and / or other types (e.g., noise)) while playing content. Based on detecting the request to edit at least one component, the processor (210) may determine the time required to perform the process of editing at least one component from the first audio, and based on the determined time, set a second buffer to maintain the output of the audio. The processor (210) may set the size (e.g., capacity) of the second buffer in correspondence with the time required to perform the process of editing at least one component so that no delay occurs in content playback (e.g., audio output). Here, the time may include a first time (e.g., delay time) required to start (or initialize) a process for editing at least one component from the first audio and a second time required to edit (e.g., noise removal) at least one component from the audio after starting (or initializing) the process.

[0074] According to one embodiment, the processor (210) can control the audio circuit (230) to output the first audio through the second buffer while performing a process for editing at least one component from the first audio.

[0075] According to one embodiment, the processor (210) may control the audio circuit (230) to perform an operation (e.g., a crossfad operation) of simultaneously outputting the first audio and the second audio, each having at least one component edited from the first audio, at a specified ratio for a specified time through the second buffer, based on confirming the completion of a process for editing at least one component from the first audio. According to one embodiment, the processor (210) may control the audio circuit (230) to perform a crossfad operation, based on confirming the completion of a process for editing at least one component (e.g., removing noise from a specified sound source), of sequentially decreasing the volume of the first audio (e.g., the size or signal strength of the first audio) by a specified ratio and sequentially increasing the volume of the second audio (e.g., the size or signal strength of the first audio) by a specified ratio for a specified time through the second buffer.

[0076] According to one embodiment, the processor (120) can control the audio circuit (230) to output the second audio through a third buffer used to output the second audio after simultaneously outputting the first audio and the second audio for a specified time.

[0077] According to one embodiment, the processor (210) may be a hardware module or a software module (e.g., an application program) and may be a hardware component (function) or a software element (program) comprising at least one of various sensors provided in the electronic device (201), a data measurement module, an input / output interface, a module for managing the state or environment of the electronic device (201), or a communication module.

[0078] According to one embodiment, the processor (210) may include, for example, one or more combinations of hardware, software, or firmware. The processor (210) may be configured to omit at least some of the components or to include additional components for performing image processing operations in addition to the components.

[0079] According to one embodiment, the memory (220) (e.g., the memory (130) of FIG. 1) may store information and / or data associated with the operation of the electronic device (201). According to one embodiment, the memory (220) may store instructions that cause the processor (210) to perform the aforementioned operation when the electronic device (101) is executed.

[0080] According to one embodiment, the memory (220) may include an audio buffer that temporarily stores audio of content output through an audio decoder of an audio circuit (230) while playing content.

[0081] According to one embodiment, the memory (220) can store various data generated during program execution, including a program used for functional operation (e.g., the program (140) of FIG. 1). The memory (240) may largely include a program area (e.g., the program (140) of FIG. 1) and a data area (not shown). The program area (140) may store related program information for operating the electronic device (201), such as an operating system (OS) (e.g., the operating system (142) of FIG. 1) that boots the electronic device (201). The data area (not shown) may store transmitted and / or received data and generated data according to one embodiment. Additionally, the memory (220) may be configured to include at least one storage medium among flash memory, hard disk, multimedia card micro type memory (e.g., secure digital (SD) or extreme digital (XD) memory), RAM, and ROM. According to one embodiment, the memory (220) can store biological information and operation information set for each operation mode.

[0082] According to one embodiment, an audio circuit (230) (e.g., the audio module (170) of FIG. 1) can output sound for the audio of the content. The audio circuit (230) may include, for example, at least one of an audio codec (e.g., an audio decoder and / or an audio encoder), a microphone (MIC), a receiver, an earphone output (EAR_L), or a speaker. The audio circuit (230) may include an audio editing module and an earphone output (EAR_L) or an audio output management module.

[0083] According to one embodiment, the display (240) can display an output screen of the content being played. According to one embodiment, the display (240) may display guidance information related to the execution of the measurement action of biometric information by acute angle action mode during content playback (audio editing). According to one embodiment, the display (240) may display information related to abnormal signs of the user's health condition based on biometric information (e.g., warning information or guidance information) or additional information based on the user's physical condition or health condition (e.g., at least one of health training information, hospital information, first aid information, or information for stress relief). According to one embodiment, the display (240) may be implemented in the form of a touch screen. When the display (240) is implemented in the form of a touch screen together with an input module, it may display various information generated according to the user's touch action. According to one embodiment, the display (240) may be an LCD (liquid crystal display), TFT-LCD (thin film transistor LCD), OLED (organic light emitting diodes), LED, AMOLED (active matrix organic LED), micro LED, mini LED, flexible display, and It may be composed of at least one of three-dimensional displays. Additionally, some of these displays may be configured to be transparent or light-transmitting so that the outside can be seen through them. This may be configured in the form of a transparent display including a TOLED (transparent OLED). According to one embodiment, in addition to the display (240), it may further include other display modules mounted thereon (e.g., an expansion display or a flexible display).

[0084] According to one embodiment, the communication circuit (250) can communicate with an external electronic device (e.g., the electronic device (102 or 104) of FIG. 1, the server (108) of FIG. 1, or another user's electronic device). For example, the communication circuit (250) can transmit measured biometric information to an external electronic device. According to one embodiment, the communication circuit (240) can perform at least one of, for example, cellular communication, UWB (ultra wide band) communication, Bluetooth communication, or / and WiFi (wireless fidelity) communication, and can additionally perform communication of other communication methods capable of communicating with an external electronic device. According to one embodiment, the communication circuit (250) can transmit to an external electronic device at least one of information related to a user's physical condition obtained based on biometric information by at least one processor (210), information related to abnormal signs of the user's health condition (e.g., warning information or guidance information), or additional information based on the user's physical condition or health condition (e.g., at least one of health training information, hospital information, first aid information or information for stress relief).

[0085] FIG. 3 is a diagram showing an example of the configuration of an audio circuit according to one embodiment, and FIG. 4 is a diagram showing an example of a buffer of an audio circuit according to one embodiment.

[0086] Referring to FIGS. 3 and 4, an audio circuit (230) according to one embodiment may include an audio decoder (310), an audio buffer (320), an audio editing module (330), and an audio output management module (340). In addition, the audio circuit (230) may further include other components related to audio editing processing and output.

[0087] According to one embodiment, the audio decoder (310) decodes the encoded audio of the content (e.g., an audio frame), sets a timestamp corresponding to an audio buffer (320) (e.g., a first buffer) that stores the decoded audio (hereinafter referred to as the first audio), and sets a buffer size and an audio data (e.g., PCM) prompt. According to one embodiment, the audio decoder (310) can set a PCM format.

[0088] According to one embodiment, the audio buffer may be used to output a first audio of the content being played to an audio output management module (340) or an audio editing module (330). Here, the audio buffer may include a first buffer (410) (e.g., source buffer) used for outputting the first audio when in a state (e.g., disable state) that performs a process for editing at least one component of the first audio (e.g., removing noise from a specified sound source), a second buffer (420) (e.g., transition buffer) used for outputting the first audio and / or the second audio, and a third buffer (430) (e.g., edit buffer) used for outputting the second audio. The audio buffer may include a first buffer (410) used for outputting the first audio when in a state (e.g., enable state) that does not perform a process for editing at least one component of the first audio (e.g., removing noise from a specified sound source). The audio buffer may include a fourth buffer (e.g., audio output buffer) that stores output audio (e.g., first audio and / or second audio) transmitted from the audio output management module (340) of the audio circuit (230) to an audio output device (e.g., earphone output or speaker).

[0089] According to one embodiment, the audio editing module (330) may perform a process for editing at least one component from the first audio output through the first buffer (410) from the audio decoder (310) based on confirming an audio editing request during content playback. According to one embodiment, the audio editing module (330) may include a buffer management module (331), a post-processing switching module (332), a post-processing generation module (333), and a post-processing generation time estimation module (334).

[0090] According to one embodiment, the buffer management module (331) can store the first audio (e.g., original audio) decoded from the audio decoder (310) in the first buffer (410) and can manage the timestamp and buffer size. The buffer management module (331) can transfer the first audio stored in the first buffer (410) to the audio output management module (340) in the original output situation, transfer the first audio to the post-processing generation module (333) in the post-processing output situation, and transfer the first audio to the post-processing switching module (332) in the post-processing switching situation.

[0091] According to one embodiment, the post-processing switching module (332) can predict the switching time by checking the expected time for post-processing generation, perform a cross fade between the first buffer (410) and the third buffer (430), and determine the usage size of the first buffer (410) and the third buffer (430).

[0092] According to one embodiment, the post-processing generation module (333) can process a post-processing request and initialize a post-processing solution, and can update a timestamp in the post-processing generation buffer by checking the first buffer (410) after post-processing generation and post-processing generation.

[0093] According to one embodiment, the post-processing generation time estimation module (334) can check the estimated time of initialization of the post-processing solution (e.g., acquisition or calculation), check the estimated time of generation of the post-processing solution, and predict the availability of the post-processing solution (e.g., frequency of use of media content) (e.g., check).

[0094] According to one embodiment, the audio editing module (330) can update a timestamp set in the first buffer (410) through the post-processing generation module (333), determine the time required to perform a process for editing at least one component from the first audio (e.g., the estimated time for generating the post-processing solution) through the post-processing generation time estimation module (334), and set a second buffer (420) for maintaining the audio output based on the time determined through the post-processing switching module (332). The time may include a first time (e.g., a delay time) required to start (or initialize) the process for editing at least one component from the first audio and a second time required to edit (e.g., noise removal) at least one component from the audio after starting (or initializing) the process. According to one embodiment, the audio editing module (330) can set the size of the first buffer (410) and / or the second buffer (420) through the post-processing switching module (332).

[0095] According to one embodiment, the audio editing module (330) can determine the availability of a process for editing at least one component from the first audio (e.g., frequency of media content usage) through the post-processing generation time estimation module (334).

[0096] According to one embodiment, the audio editing module (330) can transmit the first audio to the audio output management module (340) through the second buffer (420) while performing a process to edit at least one component from the first audio through the original buffer management (331).

[0097] According to one embodiment, the audio editing module (330) can perform an operation (e.g., a crossfad operation) of simultaneously outputting the first audio and the second audio, each of which at least one component from the first audio has been edited, through the second buffer (420) for a specified time according to a specified ratio, based on confirming the completion of a process for editing at least one component through the post-processing switching module (332). The audio editing module (330) can perform a crossfad operation by the post-processing switching module (332) of sequentially decreasing the volume of the first audio by a specified ratio and sequentially increasing the volume of the second audio by a specified ratio for a specified time through the second buffer (420).

[0098] According to one embodiment, the audio output management module (340) can manage (e.g., deliver to the output device) the first audio output from the audio decoder (310) through the first buffer (410) and / or the second audio edited from the first audio to be output through an output device (e.g., earphone output or speaker). According to one embodiment, the audio output management module (340) can provide the size of the fourth buffer used for audio output and the remaining buffer time (e.g., if it is 300ms, the time to store 300ms of outputtable audio data (PCM)) to the audio editing module (330).

[0099] Referring again to FIG. 4, according to one embodiment, when an audio circuit (230) receives a request for audio editing, it may use a first buffer (e.g., source buffer) (410), a second buffer (420) (e.g., transition buffer) and a third buffer (430) (e.g., post-processing buffer) to store the first audio for a process for editing at least one component of the first audio (e.g., removing noise from a specified sound source) as a process for audio editing. The first buffer (410) may store the first audio, which is decoded audio data (e.g., source data). The second buffer (420) is used during the transition to the disabled state (401) or the enabled state (402), and its size (e.g., time or buffer capacity) is set in correspondence with the time required to perform a process for editing at least one component from the first audio for uninterrupted content playback (e.g., a first time required to start (or initialize) (e.g., delay time) and a second time required to edit at least one component from the audio (e.g., noise removal) after starting (or initializing) the process), and its size may be adjusted according to the crossfade duration. The third buffer (430) can store the second audio edited by the post-processing transition module (332) of the audio editing module (330).

[0100] According to one embodiment, the audio circuit (230) can transmit the first audio stored in the first buffer (410) to the output management module (340) in a disabled state (401) in which the first audio output from the audio decoder (310) is output without editing (e.g., in real time) through the post-processing switching module (332).

[0101] According to one embodiment, when the audio circuit (230) receives a request for audio editing in a disabled state (401) through a post-processing transition module (332), it can switch from the disabled state (401) to an enabled state (402) (e.g., a state for editing at least one component from the first audio). According to one embodiment, while switching to the enabled state (402) through the post-processing transition module (332) (e.g., during initialization), the audio circuit (230) can determine the time required to perform a process for editing at least one component from the first audio, and based on the determined time, set (e.g., configure) a second buffer (420) (e.g., an edit buffer (transition buffer)) through the post-processing transition module (332). According to one embodiment, the audio circuit (230) outputs the first audio transmitted from the first buffer (410) (e.g., source buffer) based on the time through the post-processing transition module (332) to the third buffer (430) (e.g., post-processing buffer), and upon confirming the completion of the process, the first audio transmitted from the first buffer (410) (e.g., source buffer) and the second audio output from the third buffer (430) can be simultaneously output through the second buffer (420) (e.g., transition buffer) according to a specified ratio. According to one embodiment, the audio circuit (230) can perform a crossfad operation through the second buffer (420) via the post-processing transition module (332) to sequentially decrease the volume of the first audio by a specified ratio (e.g., fade out) and sequentially increase the volume of the second audio by a specified ratio (e.g., fade in) for a specified time.

[0102] According to one embodiment, when the audio circuit (230) switches from a disabled state (401) to an enabled state (402) through a post-processing switching module (332) (e.g., when the audio stored in the second buffer (420) (e.g., PCM data in which the first audio and the second audio are crosspadded) is exhausted), the edited second audio can be output through the second buffer (420). That is, when the second buffer (420) is exhausted through the post-processing switching module (332), the audio circuit (230) determines that the state switching is complete, changes from a disabled state (401) to an enabled state (402) while playing content in real time, and outputs only the edited second audio through the second buffer (420).

[0103] According to one embodiment, the audio circuit (230) receives a request to switch from an enabled state (402) to a disabled state (401) through a post-processing switching module (332), and during the switch to the disabled state (401) (e.g., during the completion of the process), sets a second buffer (420) (e.g., a transition buffer) through the post-processing switching module (332), and can simultaneously output the first audio output from the first buffer (410) and the second audio output from the third buffer (430) through the second buffer (420) according to a specified ratio. According to one embodiment, the audio circuit (230) can output the decoded first audio through the first buffer (410) when the audio stored in the second buffer (420) is exhausted (e.g., PCM data in which the first audio and the second audio are crosspadded) is switched from the enabled state (402) to the disabled state (401) through the post-processing switching module (332).

[0104] According to one embodiment, the audio circuit (230) can perform a crossfad operation through the post-processing switching module (332) to sequentially increase the volume of the first audio output from the first buffer (410) by a specified ratio for a specified time through the second buffer (420) (e.g., volume fade in from 1 to 0), and sequentially decrease the volume of the second audio output from the third buffer (430) (e.g., volume of the second audio) by a specified ratio (e.g., volume fade out from 1 to 0). When the second buffer (420) is exhausted through the post-processing switching module (332), the audio circuit (230) changes to a disabled state (402) as the state transition is complete, and outputs only the decoded first audio through the first buffer (410).

[0105] An audio circuit (230) according to one embodiment may set the time for performing crosspads through a post-processing switching module (332) to a specified value (e.g., 200ms). An audio circuit (230) according to one embodiment may adjust the time for performing crosspads to switch to an enable state for performing a process for editing through a post-processing switching module (332) according to the difference between the decoded audio data and the post-processed audio data. For example, the audio circuit (230) may set the time for performing crosspads to be longer through the post-processing switching module (332) to make the transition more natural as the difference increases.

[0106] FIG. 5 is a diagram illustrating an example of managing a buffer used for audio editing in an electronic device according to one embodiment.

[0107] Referring to FIG. 5, when an audio circuit (230) according to one embodiment receives a request for audio editing (e.g., a request to edit at least one component from a first audio), it can determine the size (e.g., actual playback time of the output audio) and the remaining buffer time (e.g., amount of data of the stored audio) of a fourth buffer (e.g., audio output buffer) (510) used to output output audio (e.g., first audio and / or second audio) to an audio output device (e.g., earphones or speakers).

[0108] An audio circuit (230) according to one embodiment can set the size of buffers (e.g., a first buffer (410), a second buffer (420), and a third buffer (430)) required to perform a process for audio editing (e.g., a process for editing at least one component from a first audio). The audio circuit (230) can determine an initialization time (e.g., a first time) and / or a time required to perform the process (e.g., a second time) for editing at least one component from the first audio. An audio circuit (230) according to one embodiment can set the size of the second buffer (420) based on the first time, the second time, and the remaining buffer time of the fourth buffer so that audio playback is not interrupted by editing while playing content. For example, the first buffer (410) may be set to a specified size or its size may be set based on the characteristics of the content being played, and the third buffer (430) may be set to a specified size or its size may be set based on the type of the editing process (e.g., the type of at least one component from the first audio).

[0109] According to one embodiment, the audio circuit (230) may, for example, transfer a first audio corresponding to an additional 300ms to the fourth buffer (510) to maintain playback of content (e.g., audio of content) during the first time (e.g., 400ms for initialization), when the first time (e.g., initialization time) is 400ms, the second time (e.g., process time) is 200ms, and the remaining time of the fourth buffer (510) (e.g., remaining buffer for audio output) is 100ms. After the first time, the audio circuit (230) may store a first audio corresponding to 200ms in the second buffer (420) to transfer a first audio corresponding to a second time of 200ms to the fourth buffer (510) to maintain playback of content (e.g., audio of content), based on identifying that the remaining time of the fourth buffer (510) is 0ms. According to one embodiment, the audio circuit (230) can store the first audio and the edited second audio in the second buffer (420) at a specified ratio so that the first audio and the edited second audio are each output simultaneously according to a specified ratio through a crosspad after storing the first audio in the second buffer (420). Here, the first audio may be output from the first buffer (410), and the edited second audio may be output from the third buffer (430). According to one embodiment, the audio circuit (230) can play noise-removed content (e.g., smooth audio) without delay during real-time playback of content, without delay caused by performing a processor to edit at least one component from the first audio data through the second buffer (420).

[0110] According to one embodiment, the audio circuit (230) can determine the required time (e.g., required amount) of the first audio to be stored in the second buffer (420) by subtracting the time of the audio output buffer (e.g., fourth buffer (510)) from the process time (e.g., second time) using the following <Equation 1> to set the second buffer (420). Here, if the result obtained using <Equation 1> is negative, the result may be ignored.

[0111]

[0112] According to one embodiment, the audio circuit (230) can determine the required time (e.g., required amount) of the first audio to be stored in the second buffer (420) based on the audio playback speed (spped) using the following <Equation 2> to set the second buffer (420) used for performing a process for editing. Here, if the result obtained using <Equation 2> is negative, the result can be ignored.

[0113]

[0114] FIG. 6 is a diagram illustrating an example of managing a buffer used for audio editing in an electronic device according to one embodiment.

[0115] Referring to FIG. 6, an audio circuit (230) according to one embodiment can store the first audio in the second buffer (420) in an amount corresponding to the remaining time of the fourth buffer (510), which is 100ms, when the audio playback speed is, for example, 0.5 times, the first time (e.g., initialization time) is 400ms, the second time (e.g., process time) is 200ms, and the remaining time of the fourth buffer (510) (e.g., remaining buffer for audio output) is 100ms, as the audio is played for 200ms, which is the actual double time (e.g., actual 200ms playback, total 400ms guaranteed). According to one embodiment, the audio circuit (230) can set the size of the second buffer (420) based on the remaining time of the fourth buffer (510), the first time, and the second time, based on confirming a request for audio editing. According to one embodiment, the audio circuit (230) may store a first audio corresponding to 100ms, which is 0.5 times the speed of 200ms, in the second buffer (420) so as to transmit the first audio corresponding to 200ms, which is a second time, to the fourth buffer (510) for maintaining the playback of content (e.g., audio of content). According to one embodiment, the audio circuit (230) may store the first audio and the edited second audio in the second buffer (420) at a specified ratio so as to output the first audio and the edited second audio to the fourth buffer (510) simultaneously, respectively, according to a specified ratio through a crosspad, after storing the first audio in the second buffer (420). Here, the first audio may be output from the first buffer (410), and the edited second audio may be output from the third buffer (430).

[0116] FIG. 7 is a diagram illustrating an example of managing a buffer used for audio editing in an electronic device according to one embodiment.

[0117] Referring to FIG. 7, an audio circuit (230) according to one embodiment can transfer the first audio from the first buffer (410) to the fourth buffer (510) in an amount corresponding to 700ms for audio playback for 350ms, as audio is played for 50ms corresponding to the remaining time of the fourth buffer (510) (e.g., remaining buffer for audio output), when the audio playback speed is, for example, 2x speed, the first time (e.g., initialization time) is 400ms, the second time (e.g., process time) is 200ms, and the remaining time of the fourth buffer (510) (e.g., remaining buffer for audio output) is 100ms, so that audio output is guaranteed for 400ms.

[0118] According to one embodiment, the audio circuit (230) can set the size of the second buffer (420) when the remaining time of the fourth buffer is 0ms. According to one embodiment, the audio circuit (230) can store a first audio (e.g., original data) corresponding to 400ms, which is twice the speed of 200ms, in the second buffer (420) to transfer the first audio corresponding to 200ms, which is a second time, to the fourth buffer (510) to maintain playback of content (e.g., audio of content). According to one embodiment, after storing the first audio in the second buffer (420), the audio circuit (230) can store the first audio and the edited second audio in the second buffer at a specified ratio so that the first audio and the edited second audio are each output simultaneously according to a specified ratio through a crosspad. Here, the first audio may be output from the first buffer (410), and the edited second audio may be output from the third buffer (430).

[0119] FIG. 8 is a diagram illustrating an example of managing a buffer used for audio editing in an electronic device according to one embodiment.

[0120] Referring to FIG. 8, an audio circuit (230) according to one embodiment checks a first time (e.g., initialization time: 200ms) and a second time (e.g., process time: 100ms), and if it is confirmed that the sum of the checked first time and second time (e.g., 300ms) is shorter than the size (e.g., 500ms) of a fourth buffer (510) (e.g., residual buffer for audio output), it can maintain the output of the first audio so that there is no delay in the fourth buffer (510), and set the second buffer (420) based on the first time, the second time, and the residual time of the fourth buffer (510) so that there is no delay or is minimized in the process for audio editing. An audio circuit (330) according to one embodiment can transfer the first audio corresponding to 500ms stored in the first buffer (410) to the fourth buffer (510) without having to transfer all of the first audio to the fourth buffer (510) to fill the fourth buffer (510), by setting the time for filling the fourth buffer (510) to a time shorter than 500ms (e.g., 200ms). Here, the audio circuit (330) can adjust the time for filling the fourth buffer (510) according to the situation (e.g., type of component to be edited, type of content, playback speed, or remaining time of the fourth buffer (510).

[0121] According to one embodiment, the audio circuit (230) may, for example, transfer a first audio corresponding to the sum (e.g., 300ms) of a first time (e.g., initialization time) and a second time (e.g., process time) from the first buffer (410) to the fourth buffer (510) when the size of the fourth buffer (510) is 500ms, the size of the first buffer (410) is 500ms, and the remaining time (e.g., 200ms) of the first buffer (410) may be used as the second buffer (420). The audio circuit (230) may set the size (e.g., 200ms) of the second buffer (420) based on the remaining time (e.g., 200ms) of the first buffer (410). The audio circuit (230) can store the first audio and the edited second audio in the second buffer at a specified ratio so as to output the first audio and the edited second audio simultaneously, respectively, through a crosspad according to a specified ratio, based on the size of the second buffer (420) (e.g., 200ms). Here, the first audio may be output from the first buffer (410), and the edited second audio may be output from the third buffer (430). The audio circuit (230) can store only the first audio and the edited second audio processed through the crosspad in the second buffer (420) as it determines that the sum of the identified first time and second time (e.g., 300ms) is shorter than the size of the fourth buffer (510) (e.g., 500ms).

[0122] FIG. 9 is a diagram illustrating an example of managing a buffer used for audio editing in an electronic device according to one embodiment.

[0123] Referring to FIG. 9, if an audio circuit (230) according to one embodiment determines that a sufficient amount of first audio remains in the fourth buffer (510), the fourth buffer (510) can be utilized as a second buffer (e.g., transition buffer) (420). For example, if the remaining time of the fourth buffer (510) is 400ms, the first time (e.g., initialization time) is 200ms, and the second time (e.g., process time) is 100ms, the remaining time of 400ms can be utilized as the second buffer (420) for the time of 100ms, which is the sum of the first time and the second time, which is 300ms. In this case, the audio circuit (230) can achieve the effect of performing a process for audio editing 100ms faster than the time of exhausting all remaining time of the fourth buffer (510) (e.g., remaining buffer for audio output), which is 400ms. The size of the second buffer (420) can be set variably and can be adjusted according to the time of the crosspad.

[0124] Referring again to FIGS. 2 to 4, according to one embodiment, a processor (210) of an electronic device (201) can check first information for synchronizing audio and video of content, including the sizes of the plurality of first buffers and timestamps set in the plurality of first buffers, when the first buffer (410) is configured in plurality. Here, the first information may include a list (e.g., a list of first buffers) including the sizes of the plurality of first buffers and timestamps set in the plurality of first buffers.

[0125] According to one embodiment, the processor (210) may divide the third buffer (430) based on the first information and set second information for synchronizing audio and video of content, including the size and timestamp for each of the divided multiple elements of the third buffer (430). Here, the second information may include a list (e.g., a list of the second buffer) containing the sizes of the multiple elements of the third buffer (430) and the timestamps set for the multiple elements of the third buffer (430). If the minimum unit buffer for storing the first audio in the first buffer (410) is not set until the first time has elapsed, a delay may occur in the playback start time of the second audio. To reduce the delay in the playback start time of the second audio, the processor (210) may add silence (e.g., a silent buffer) for the remaining time excluding the portion where the first audio is stored from the time of the minimum unit buffer.

[0126] According to one embodiment, after the processor (210) completes the execution of a process for audio editing (e.g., a process for editing at least one component from a first audio (e.g., noise removal (e.g., audio eraser)), if the identified first time is smaller than the specified minimum first time, the processor may update the specified minimum first time to the identified first time.

[0127] According to one embodiment, the processor (120) may be a hardware module or a software module (e.g., an application program) and may be a hardware component (function) or a software element (program) comprising at least one component provided in the electronic device (201). According to one embodiment, the processor (210) may include, for example, one or more combinations of hardware, software, or firmware. The processor (210) may be configured to omit at least some of the components or to include additional components for performing image processing operations in addition to the components.

[0128] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1, electronic device (201) of FIG. 2)) can implement a software module related to audio editing (e.g., program (140) of FIG. 1). The memory of the electronic device (e.g., memory (130) of FIG. 1, memory (220) of FIG. 2) can store instructions (e.g., instructions) to implement the software module. At least one processor (e.g., processor (120) of FIG. 1) can execute the instructions stored in memory to implement the software module and can control hardware associated with the function of the software module (e.g., sensor module (176) of FIG. 1, camera module (180), communication module (190) of FIG. 1, or communication circuit (250) of FIG. 2) and display module (160) of FIG. 1 or display (240) of FIG. 2).

[0129] A software module of an electronic device (101, 201) according to one embodiment may be configured to include a kernel (or HAL), a framework (e.g., middleware (144) of FIG. 1), and an application (e.g., application (146) of FIG. 1). At least some of the software modules may be preloaded onto the electronic device (101, 201) or downloadable from a server (e.g., server (108)).

[0130] According to one embodiment, the kernel may include, for example, a system resource manager or a device driver, but may be configured to include other modules, not limited thereto. The system resource manager may perform control, allocation, or reclamation of system resources. The device driver may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WIFI driver, an audio driver, or an IPC (inter-process communication) driver.

[0131] According to one embodiment, the framework may provide functions commonly required by the application, or provide various functions to the application through an application programming interface (API) (not shown) so that the application can efficiently use limited system resources within the electronic device (101, 201). The framework may include modules that form combinations of various functions of the components. The framework may provide modules specialized for each type of operating system to provide differentiated functions. The framework may dynamically delete some existing components or add new components.

[0132] According to one embodiment, the application may be configured to include an application (e.g., a module, a manager, or a program) for displaying an image of the external environment in real space. The application may include an application received from an external electronic device (e.g., a server (108) or an electronic device (102, 104)). According to one embodiment, the application may include a preloaded application or a third-party application downloadable from a server. The components of the software module and the names of the components according to the illustrated embodiments may vary depending on the type of operating system. According to one embodiment, at least a portion of the software module may be implemented as software, firmware, hardware, or a combination of at least two of these. At least a portion of the software module may be implemented (e.g., executed) by a processor (e.g., AP). At least a portion of the software module may include, for example, a module, a program, a routine, a set of instructions, or a process for performing at least one function.

[0133] As such, in one embodiment, the main components of an electronic device have been described through the electronic device (101, 201) of FIGS. 1 and 2. However, in various embodiments, the components illustrated in FIGS. 1 and 2 are not all essential components, and the electronic device (101, 201) may be implemented with more components than those illustrated, or with fewer components. Additionally, the positions of the main components of the electronic device (101, 201) described above through FIGS. 1 and 2 may be changed according to various embodiments.

[0134] As such, in one embodiment, the main components of an electronic device have been described through the electronic device (101, 201) of FIGS. 1 and 2. However, in various embodiments, the components illustrated in FIGS. 1 and 2 are not all essential components, and the electronic device may be implemented with more components than those illustrated, or with fewer components. Additionally, the positions of the main components of the electronic device (101, 201) described above through FIGS. 1 and 2 may be changed according to various embodiments.

[0135] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 and the electronic device (201) of FIG. 2) may include at least one processor (e.g., the processor (120) of FIG. 1 and the processor (210) of FIG. 2)) including a processing circuit and a memory (e.g., the memory (130) of FIG. 1 and the memory (220) of FIG. 2) for storing instructions.

[0136] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to output the first audio through a first buffer (e.g., the first buffer (410) of FIGS. 4 to 9) used to output the first audio of the first content based on playing the first content.

[0137] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to determine the time required to perform a process for editing the at least one component from the first audio based on confirming a request to edit the at least one component included in the first audio while playing the first content.

[0138] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to set a second buffer (e.g., the second buffer (420) of FIGS. 4 to 9) for maintaining the output of the first audio based on the identified time.

[0139] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to output the first audio through the second buffer while performing the process for editing the at least one component from the first audio.

[0140] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first audio and the second audio, each of which the at least one component from the first audio has been edited, to be output simultaneously at a specified rate through the second buffer for a specified time based on confirming the completion of the process.

[0141] According to one embodiment, the identified time may include a first time required to start the process and a second time required to edit at least one component from the first audio after starting the process.

[0142] According to one embodiment, the size of the second buffer may be set to the time for outputting the first audio through the second buffer based on the first time and the second time, and the specified time for outputting the first audio and the second audio simultaneously, respectively.

[0143] According to one embodiment, the processor for editing the at least one component may be a process for removing noise from the at least one component.

[0144] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to output the second audio through a third buffer (e.g., the third buffer (430) of FIGS. 4 to 9) used to output the second audio after simultaneously outputting the first audio and the second audio for the specified time.

[0145] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the volume of the first audio to decrease sequentially by the specified ratio and the volume of the second audio to increase sequentially by the specified ratio during the specified time through the second buffer, based on confirming the completion of the process.

[0146] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be configured to check the size of a fourth buffer (e.g., the fourth buffer (510) of FIGS. 5 to 9) used to output audio through an audio output device and the remaining time of the fourth buffer, and based on identifying that the checked time is greater than or equal to the time corresponding to the size of the fourth buffer, to transfer the first audio through the first buffer to the fourth buffer for the remaining time of the fourth buffer, and to transfer the first audio through the first buffer to the fourth buffer for the remaining time of the first buffer excluding the remaining time of the fourth buffer, and based on the second time and the remaining time of the fourth buffer, to check the first required time of the first audio to be stored in the second buffer, and while performing the process, to transfer the first audio from the first buffer to the second buffer for the first required time of the first audio.

[0147] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to determine the second required time of the first audio to be stored in the second buffer based on the second time, the remaining time of the fourth buffer, and the playback speed of the content, and, while performing the process, to transfer the first audio from the first buffer to the second buffer for the second required time of the first audio.

[0148] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to transfer the first audio through the first buffer to the fourth buffer for a minimum time to maintain the output of the first audio based on identifying that the identified time is less than the time corresponding to the size of the fourth buffer, transfer the first audio from the first buffer to the fourth buffer for the remaining time of the fourth buffer while performing the process, and transfer the first audio to the second buffer for the remaining time of the first buffer based on confirming the completion of the process.

[0149] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to determine the first information for synchronizing audio and video of the content, including the sizes of the plurality of first buffers and timestamps set in the plurality of first buffers, based on determining that the first buffer is composed of a plurality of first buffers, and based on the first information, to divide the third buffer and set the second information for synchronization, including the size and timestamp for each of the divided plurality of elements of the third buffer.

[0150] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to add silence for the remaining time excluding the portion in which the first audio is stored in the time of the minimum unit buffer, in order to reduce the delay for the start time of playback of the second audio, based on confirming that the minimum unit buffer for storing the first audio in the first buffer has not been set until the first time has elapsed, and after the process is completed, to update the minimum first time to the first time based on confirming that the first time is smaller than the specified minimum first time.

[0151] FIG. 10 is a diagram illustrating an example of an operation method in an electronic device according to one embodiment. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0152] Referring to FIG. 10, an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and the electronic device (201) of FIG. 2) can play content (e.g., video) in operation 1001.

[0153] In operation 1003, the electronic device may output the first audio through a first buffer (e.g., the first buffer (410) of FIGS. 4 to 9) used to output the first audio of the content during playback of the content (e.g., real-time playback). The electronic device may output the first audio using the first buffer to maintain real-time playback of the content in a disabled state (e.g., from the first buffer, to a fourth buffer which is an audio output buffer (e.g., the fourth buffer (510) of FIGS. 5 to 9), and then output through the fourth buffer).

[0154] In operation 1005, the electronic device may check whether there is a request to edit at least one component included in the first audio as a request for audio editing while playing the content. If there is no request for audio editing, the electronic device may perform operation 1003 to output the first audio using the first buffer in a disabled state. If a request for audio editing is detected, the electronic device may perform operation 1007.

[0155] In operation 1007, the electronic device may determine the time required to perform a process for editing at least one component from the first audio (e.g., the sum of a first time and a second time) based on acknowledging a request for audio editing (e.g., a request to edit at least one component included in the first audio). Here, the first time may be the time required to start (or initialize) the process for editing at least one component from the first audio. The second time may be the second time required to edit (e.g., noise removal) at least one component from the audio after starting (or initializing) the process.

[0156] In operation 1009, the electronic device may set a second buffer (e.g., the second buffer (420) of FIGS. 4 to 9) to maintain the audio output based on the time identified above. The electronic device may set the size (e.g., buffer capacity) of the second buffer based on the time identified above. According to one embodiment, to set the second buffer, the electronic device may use the above <Equation 1> to subtract the time of the audio output buffer (e.g., the fourth buffer (510)) from the process time (second time) to determine the required time (e.g., required amount) of the first audio to be stored in the second buffer. According to one embodiment, to set the second buffer used for performing a process for editing, the electronic device may use the above <Equation 2> to determine the required time (e.g., required amount) of the first audio to be stored in the second buffer based on the audio playback speed (spped). Afterward, the electronic device may terminate the operation to set the second buffer.

[0157] In operation 1011, the electronic device can output the first audio through a second buffer while performing a process for editing at least one component from the first audio.

[0158] In operation 1013, the electronic device may simultaneously output the first audio and the second audio, each having at least one component edited from the first audio, at a specified ratio for a specified time through the second buffer, based on confirming the completion of the process. According to one embodiment, the electronic device may perform a crossfad operation in which, based on confirming the completion of a process for editing at least one component (e.g., removing noise from a specified sound source), the first audio (e.g., volume of the first audio) is sequentially decreased by a specified ratio and the second audio (e.g., volume of the second audio) is sequentially increased by a specified ratio for a specified time through the second buffer.

[0159] In operation 1015, the electronic device may output the first audio and the second audio simultaneously for a specified time, and then output the second audio through a third buffer used to output the second audio. The electronic device may check that it has transitioned from a disabled state to an enabled state (e.g., when the audio stored in the second buffer is exhausted), and in the enabled state, output the second audio through the third buffer (e.g., the third buffer (430) of FIGS. 4 to 9).

[0160] FIG. 11 is a diagram illustrating an example of a method of operation in an electronic device according to one embodiment. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. FIG. 11 is a flowchart for explaining specific operations for operations 1007 and 1109 of FIG. 10.

[0161] Referring to FIG. 11, an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and FIG. 2) can determine, in operation 1101, the time required to perform a process for editing at least one component from the first audio output from the first buffer (e.g., the first buffer (410) of FIG. 4 to 9) and the remaining time of the fourth buffer (e.g., the fourth buffer (510) of FIG. 5 to 9) based on confirming a request to edit at least one component included in the first audio while playing content (e.g., a video) during operation 1101. Here, the first time may be the time required to start (or initialize) the process for editing at least one component from the first audio. The second time may be the second time required to edit (e.g., noise removal) at least one component from the audio after starting (or initializing) the process.

[0162] In operation 1103, the electronic device can check whether the remaining time of the fourth buffer is greater than the identified required time. If the result of the check is that the identified time is greater than the remaining time of the fourth buffer, the electronic device performs operation 1105, and if the identified required time is not greater than the remaining time of the fourth buffer, the electronic device can perform operation 1107.

[0163] In operation 1105, the electronic device can determine the time obtained by subtracting the determined time from the remaining time of the fourth buffer based on determining that the remaining time of the fourth buffer is greater than the determined time required, recover the fourth buffer by the amount of the subtracted time, and set the size of the second buffer (e.g., the second buffer (420) of FIGS. 4 to 9) based on the size of the recovered fourth buffer (e.g., the time recovered corresponding to the size) and the size of the first buffer (e.g., the time corresponding to the size). Afterward, the electronic device can terminate the operation of setting the second buffer.

[0164] In operation 1107, the electronic device can determine whether the size of the fourth buffer is greater than the determined time based on determining that the remaining time of the fourth buffer is not greater than the determined time. If, as a result of the determination, it is determined that the size of the fourth buffer is greater than the determined time, the electronic device performs operation 1109, and if it is determined that the size of the fourth buffer is not greater than the determined time, the electronic device can perform operation 1111.

[0165] In operation 1109, the electronic device may collect only the first buffer (e.g., source buffer) for a first time (e.g., initialization time) and / or a second time (e.g., process time), based on determining that the size of the fourth buffer is greater than the time determined above, and may transfer the first audio output from the first buffer to the fourth buffer for a second time (e.g., process time). Afterward, the electronic device may perform operation 1113.

[0166] In operation 1111, the electronic device recovers the fourth buffer for a time equal to the remaining time of the fourth buffer subtracted from the first time and / or second time, based on confirming that the size of the fourth buffer is not greater than the confirmed time, and transfers the first audio output from the first buffer to the fourth buffer for a time equal to the size of the recovered fourth buffer (e.g., the recovered time corresponding to the size), and then the electronic device may perform operation 1113.

[0167] In operation 1113, a second buffer can be created using the remaining time of the first buffer, the size of the second buffer can be set, and an operation (e.g., a crosspad operation) can be performed to simultaneously output the first audio and the second audio, each having at least one component edited from the first audio, through the second buffer according to a specified ratio. Afterward, the electronic device can terminate the operation of setting the second buffer.

[0168] FIG. 12 is a diagram illustrating an example of a method of operation in an electronic device according to one embodiment, and FIG. 13a, FIG. 13b, FIG. 13c, and FIG. 13d are diagrams illustrating examples of buffers used for audio editing in an electronic device according to one embodiment. In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0169] Referring to FIG. 12, an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1 and FIG. 2) may identify a plurality of first buffers that store a decoded first audio output from an audio decoder based on confirming a request for audio editing (e.g., a request to edit at least one component included in the first audio (e.g., noise removal)) during the operation of playing content (e.g., a video) in FIG. 1201.

[0170] In operation 1203, the electronic device may set the size and timestamp for each of the plurality of first buffers and store in memory the first information (e.g., a list of first buffers) for synchronizing the audio and video of the content, which includes the size and timestamp for each of the plurality of first buffers. According to one embodiment, as illustrated in FIGS. 13a and 13b, the electronic device may identify the plurality of first buffers (e.g., first buffer indices #1 to #5) and sequentially perform a process of editing (e.g., removing noise) at least one component from the first audio stored in each of the plurality of first buffers based on the sizes of the plurality of first buffers (#1 to #5). Since the electronic device cannot respond to cases where the timestamp values ​​of multiple first buffers (e.g., first buffer indices #1 to #5) change significantly and this may lead to audio and video synchronization (AV Sync) problems, a third buffer (430) (e.g., post-processing buffer) can be created by dividing it using the method shown in FIG. 13b. Each of the multiple first buffers has the same size (e.g., 19200 bytes) and can sequentially set (e.g., assign) timestamps that increase in a specified time unit. Since the minimum size of audio data for performing the above process is 9600 bytes, the sizes and timestamps of the divided elements of the third buffer can be set based on this, second information for audio and video synchronization of content including the set sizes and timestamps of the divided elements of the third buffer can be set, and the set second information can be stored in memory.

[0171] In operation 1205, the electronic device can check whether the sum of the sizes of a plurality of first buffers included in a list is greater than or equal to the size of a third buffer required to perform a process for editing. If, as a result of the check, the sum of the sizes of the plurality of first buffers is greater than or equal to the size of the third buffer, the electronic device performs operation 1205; otherwise, the electronic device can perform operation 1201 again. According to one embodiment, the electronic device repeatedly performs the operation of storing a first audio in a plurality of first buffers (e.g., storing it in a decoding buffer list) and checks whether the sum of the sizes of the plurality of first buffers exceeds the minimum size required to perform the process for editing at least one component from the first audio. For example, the decoding buffer list includes multiple first buffers, #1 (e.g., size 19200 byte), #2 (e.g., size 19200 byte), and #3 (e.g., size 19200 byte), and checks the sum of the buffer sizes is 57600 bytes. If the minimum buffer size for performing the above process is 96000 bytes, the minimum buffer size for audio editing is not satisfied, so a request for audio editing cannot be made. As another example, if the decoding buffer list includes multiple first buffers such as #1 (e.g., size 19200 byte), #2 (e.g., size 19200 byte), #3 (e.g., size 19200 byte), #4 (e.g., size 19200 byte), and #5 (e.g., size 19200 byte), and the sum of the buffer sizes is 96000 bytes, and the minimum buffer size for performing the process is 96000 bytes, then the minimum buffer size for audio editing is satisfied, so a request for audio editing can be made.

[0172] In operation 1207, the electronic device determines the minimum size (e.g., 9600 bytes) of a third buffer to be used to perform a process (e.g., an audio eraser) for editing at least one component from the first audio, and can perform a process for editing at least one component from the first audio through an audio editing module.

[0173] In operation 1209, the electronic device may separate the third buffer (430) (e.g., the third buffer (430) of FIGS. 4 to 9) into multiple elements based on the size and timestamp of the first element in the list of the first buffer, based on the confirmation that the process is completed. The electronic device may set or update a timestamp in the third buffer (430) for audio editing for audio / video (AV) sync. The electronic device may ensure that the audio / video (AV) sync is not disrupted by the set or updated timestamp even when using the third buffer (430) separated into multiple elements during the process. According to one embodiment, as illustrated in FIG. 13b, the electronic device may sequentially edit at least one component (e.g., noise) from the first audio based on timestamps set in each of the plurality of first buffers to generate an edited second audio, and sequentially store the edited second audio in the divided elements of the third buffer (430) corresponding to each of the first buffers. For example, the timestamp of the first index (Index #1) of the first buffer may be set to 0, but since it is impossible to handle cases where the timestamp value of the first buffer changes significantly and may lead to AV Sync problems, the electronic device may divide the third buffer (430) (e.g., the decoding buffer list (1320) of the third buffer) to store the edited 96,000-byte audio based on the size and timestamp of the first buffer, as illustrated in FIG. 13b. The electronic device can prevent the problem of AV Sync being out of sync even after performing the process by setting the timestamps of the first buffer and the third buffer (430) to be the same.

[0174] In operation 1211, the electronic device may update the first information (e.g., the decoding buffer list of the first buffer) based on the completion of the process. The electronic device may remove the first element from the decoding buffer list (1310) of the first buffer and output the edited second audio (e.g., output audio rendering). Afterward, when the audio editing process (1301) is completed, the electronic device may create a third buffer (430) (e.g., post-processing buffer) using the PCM of the first buffer (e.g., original buffer) through a post-processing generation module. Multiple first buffers may be used because the minimum PCM size for post-processing generation differs. Afterward, the audio and video synchronization (AV Sync) can be prevented even when using the third buffer (e.g., post-processing buffer) created by applying an embodiment of the present disclosure to assign a time stamp to the third buffer (e.g., post-processing buffer) (430). Assuming that a plurality of first buffers are stored in the decoding buffer list (1310) as illustrated in FIG. 13a, the size of Index #1 of the first buffer (e.g., 19200 bytes) is separated from the start of the third buffer (430) based on the size of Index #1 of the first buffer (e.g., 96000 bytes) (430), the third buffer (430) is separated by setting a time stamp of 0, and the decoding buffer list (1310) is updated by removing the first element (Index #1) of the first buffer from the decoding buffer list (1310). Then, the audio circuit (230) can request rendering for the separated buffer elements of the post-processing switching third buffer (430).

[0175] In operation 1213, the electronic device can check whether all of the second audio stored in the third buffer (430) is exhausted. If, as a result of the check, it is exhausted, the electronic device terminates the operation, and if it is not exhausted, it can perform operation 1209 to output the second audio for the next element in sequence. As illustrated in FIG. 13c, the third buffer (430) can be separated by a size of 19200 bytes (e.g., separated from an edited 76800-byte PCM) by referencing the first second element (Index #2) of the plurality of first buffers remaining in the updated list (1311), and an audio rendering request can be made by setting a timestamp of 100ms on the separated element, and the list (1311) can be updated as in FIG. 13d by removing the second element (Index #2) of the first buffer from the updated list (1311) to obtain the updated list (1312). Rendering can be requested by creating a separated third buffer (430) of size 19200 bytes by referring to Index #2 of the updated list (1312) (e.g., decoding buffer list) from the remaining third buffer (430) (e.g., edited 76800-byte PCM) and setting a timestamp of 100ms. By repeating the above operation to separate the third buffer (430) and create an edited second audio to be output, the audio and video synchronization (AV Sync) problem can be resolved.

[0176] FIGS. 14a and FIGS. 14b are drawings illustrating examples of a method of operation in an electronic device according to one embodiment.

[0177] Referring to FIGS. 14a and 14b, according to one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (201) of FIG. 2) can determine the original buffer collection time and the time required to perform the process to perform a process to edit (e.g., noise removal) at least one component from a first audio output through a first buffer (410) (e.g., original buffer) by means of an audio circuit (e.g., audio module (170) of FIG. 1, audio circuit (230) of FIG. 2). The original buffer collection time may increase in network bandwidth or system conditions during streaming or search operations. To address the issue where the original buffer collection time increases in proportion to the minimum buffer unit buffer size required to perform the process, the electronic device may utilize a silent buffer (1410). For example, if the minimum buffer unit buffer size is 2 seconds, a situation may occur where it takes longer than the time (SI) to collect the first audio corresponding to 2 seconds, depending on network conditions or content characteristics while playing content. In this case, although preparation for editing is complete, the editing process may be delayed until the first audio is fully prepared. Subsequently, when the minimum unit buffer is prepared, the editing process is started, and thereafter, a delay may occur due to the time (BW) required until the minimum unit buffer is fully prepared. The delay time for the start of playback until the actually edited second audio is output is the sum of the initialization time for audio editing (SI) (e.g., the first time), the time (BW) required until the first buffer (410) is set to the minimum time (e.g., the minimum unit buffer is fully prepared), and the actual process time (P) (e.g., the second time). The longer the BW, the greater the delay in the start of playback.

[0178] According to one embodiment, the electronic device may perform a process for editing during a second time immediately after a first time has elapsed, without waiting for a minimum unit buffer to be prepared to minimize delay time. If the electronic device is not prepared with a minimum unit buffer for setting a first buffer (410) that stores the first audio decoded during the first time (SI), which is the initialization time, the remaining portion may be filled with silence (e.g., a silence buffer (1410)) following the first buffer (410-1). The prepared minimum unit buffer (first buffer + silence buffer) may be transferred to an audio editing module (e.g., an audio editing module (330) of FIG. 1) of an audio circuit (e.g., an audio module (170) of FIG. 1 and an audio circuit (230) of FIG. 2) to perform a process for editing (e.g., noise removal). Afterward, when the audio editing module returns the third buffer, the portion of the silent buffer (1410) is discarded and the first audio of the first buffer (410) is edited (e.g., removing noise from at least one component of the first audio) so that the edited second audio can be output through the third buffer (430: 430-1, 430-2, 430-3) so that playback can start immediately. At this time, the audio editing module (330) can start buffering again immediately after outputting the second audio through the minimum unit buffer. The audio editing module (330) can output the edited second audio through the third buffer (430: 430-1, 430-2, 430-3) by configuring the minimum unit buffer considering the second time (P), which is the time required to perform the editing process, and the amount of remaining data in the third buffer (430: 430-1, 430-2, 430-3). According to one embodiment, the electronic device plays the first third buffer (430-1) and the second third buffer (430-2) continuously, excluding the silent buffer (1410), and at this time, tick noise may occur.In this case, the second buffer (transition buffer) is set up in the same way as when switching to the enable state of the first buffer (410) and the third buffer (430), and the first audio and the second audio edited from the first audio (e.g., noise removed from the first audio) are simultaneously output using a crossfade according to a specified ratio, thereby allowing the content to be naturally switched to the edited audio so as to maintain content playback without interruption during real-time playback.

[0179] FIGS. 15a and FIGS. 15b are drawings illustrating examples of a method of operation in an electronic device according to one embodiment.

[0180] Referring to FIG. 15a and FIG. 15b, according to one embodiment, an electronic device may manage the time required to perform a process (e.g., audio eraser) for editing (e.g., noise removal) at least one component from a first audio (e.g., a first time (e.g., initialization 1300ms) and a second time (e.g., process 300ms)) as a minimum PCM size (e.g., 2000ms) for generating an edited second audio. To apply a minimum delay time to the process, when performing the process, the minimum operation time may be checked and the checked minimum operation time may be continuously updated.

[0181] According to one embodiment, the electronic device performs a process (e.g., audio eraser) for editing (e.g., noise removal) at least one component from a first audio for a specified first time and can measure an initialization time (e.g., first time). By checking the measured initialization time and the previously identified minimum (MIN) initialization time, if the measured initialization time is smaller, the minimum (MIN) initialization time can be updated. For example, as shown in FIG. 15b, when the process (e.g., audio eraser) is initialized for the second time (#2), if the measured initialization time is 1600ms and the minimum (MIN) initialization time measured so far is 1500ms, the minimum initialization time may not be updated. In another example, when the process (e.g., audio eraser) is initialized for the third time (#3), if the measured initialization time is 1300ms and the minimum initialization time measured so far is 1500ms, the initialization time can be updated to 1300ms. The electronic device can update the process time (e.g., second time) in the same way as updating the minimum initialization time (e.g., first time). By performing a process (e.g., audio eraser) to edit (e.g., noise removal) at least one component from the first audio based on the updated minimum initialization time (e.g., first time) and the updated minimum process time (e.g., second time), the electronic device can minimize delay and ensure there is no interruption during content playback.

[0182] FIG. 16a is a drawing showing an example of a method of operation in an electronic device according to one embodiment. FIG. 16b is a drawing showing an example of a method of operation in an electronic device according to one embodiment.

[0183] Referring to FIGS. 16a and 16b, according to one embodiment, in operation 1601, the electronic device checks the updated minimum first time and minimum second time, and in operation 1603, based on the checked minimum first time (e.g., initialization time) and minimum second time (e.g., process time), the size (e.g., buffer amount) of the audio output buffer (e.g., fourth buffer) can be set before performing the process for editing. For example, if the minimum first time is 1300ms and the minimum second time is 300ms, the size of the audio output buffer can be set to 1600ms before performing the process for editing. The electronic device can perform the process for editing with a minimum delay time to output the edited second audio (e.g., including crossfade) after 1600ms. In order to resolve the issue where the audio output buffer time of 1600ms is exhausted and there is no longer any second audio to output, and thus an undderun may occur, depending on the conditions of the system, the electronic device can check in operation 1605 whether the first time and the second time are within the expected time. If, as a result of the check, the initialization of the process for editing is not completed within the expected time, in operation 1607, the device can output (e.g., add) audio of a certain size (e.g., a set time) to the audio output buffer (e.g., the fourth buffer) and update the expected time by the added buffer time, and then repeat operation 1605 while outputting audio of a certain size again. For example, if the first time, which is the time for the ongoing initialization, exceeds 1300ms, a time of a specified buffer size (e.g., 50ms) is added to the first buffer (410) to prevent the audio output from cutting off before the process for editing is performed, and the expected initialization time can be increased to 1350ms.For example, if the electronic device is not completed by the time 1350ms has passed, it can add a fixed fixed-size buffer of 50ms and increase the estimated initialization time to 1400ms.

[0184] If, as a result of checking in operation 1605, the electronic device is initialized within the expected time, then in operation 1609, it can check whether creation is completed within the expected time. If, as a result of checking, creation is not completed, in operation 1611, audio of a certain size (e.g., a set time) is added to the audio output buffer (e.g., the fourth buffer) and waited, and the expected time can be updated by the added buffer time. Afterwards, operation 1609 can be performed again. For example, if the electronic device is initialized before 1400ms has passed, a total of 100ms of first audio (e.g., original data) can be added beyond the expected time (1300ms -> 1400ms). Similarly, since the second time, which is the process time, may be delayed depending on the system's condition, audio interruption can be prevented by adding a time of a specified buffer size to the first buffer (410) in the same way as updating the expected time while initialization is in progress. For example, if the estimated second time is 300ms and the edited second audio is not generated even after 300ms, the first audio of a fixed buffer size (e.g., 50ms) can be added to the first buffer (410) (1700ms -> 1750ms). By supplementing the first buffer (410) by taking into account the actual estimated time, the electronic device can set the first buffer (410) with a minimum delay time when switching to an enabled state to perform the editing process, thereby preventing the audio output from being cut off even if the actual estimated time is delayed.

[0185] In operation 1609, if the electronic device is completed within the expected time, in operation 1613, it can perform post-processing (editing process) by configuring a second buffer (420) (e.g., transition buffer), store the second audio in which at least one component of the first audio has been edited in the third buffer (430), perform an operation (e.g., crosspad operation) of simultaneously outputting the first audio and the second audio in which at least one component of the first audio has been edited through the second buffer (420) according to a specified ratio, and output the first audio and the edited second audio output through the second buffer (420) to a buffer for audio output (e.g., fourth buffer).

[0186] According to one embodiment, an electronic device can reduce the time required to perform a process for audio editing based on content characteristics and user patterns. Assuming that the usage frequency of the audio editing process (e.g., Audio Eraser) is high, the electronic device can record and manage the usage frequency of the audio editing process for each piece of content, and then pre-initialize the audio editing process when the corresponding content is played again. The execution frequency of the process for each piece of content can be managed in a database. If the user performs the process very frequently at a specific location, the editing process can be pre-initialized so that the user can respond immediately while performing the audio editing process. By recording user patterns, the electronic device can save both the initialization time (e.g., first time) and the processing time (e.g., second time) for the editing process.

[0187] According to one embodiment, an electronic device can identify the characteristics of content in advance in the background and prepare a process for appropriate audio editing for each piece of content. For example, the electronic device can identify the characteristics of content in advance in the background when there is no influence on current consumption, such as in a charging situation. For example, if a specific video contains a large amount of noise, the electronic device can store information related to the noise (e.g., information on sections containing a large amount of noise) in advance in a database (DB), and when the user plays the video, it can read the stored information to initialize a process for audio editing (e.g., Audio Eraser) in advance, thereby saving initialization time.

[0188] FIG. 17 is a drawing showing an example of a method of operation in an electronic device according to one embodiment.

[0189] Referring to FIG. 17, according to one embodiment, when an electronic device switches to a state for performing a process for audio editing (e.g., switching to an enable state), it may switch to a second process (B) operation during a first process (A) operation as illustrated in FIG. 17 to minimize delay time. Based on the initialization time (e.g., first time) and process time (e.g., second time) of the second process (B), the remaining time of the audio output buffer (e.g., fourth buffer) can be checked. The remaining time of the audio output buffer (e.g., fourth buffer) can be checked in the same way as the operation of switching from a disabled state to an enable state. The first process (A) may continue to perform the operation of generating a processing result until a result processed through the second process (B) is generated, and may stop the output of the edited second audio when the processing result of the second process (B) is generated.

[0190] According to one embodiment, since the minimum buffer size of the first audio for editing may differ for each process in a state where the electronic device performs a process for audio editing (e.g., an enabled state), the electronic device may manage a buffer (e.g., a first buffer) to maintain the output of the first audio for the minimum buffer size required to perform the process for audio editing in a disabled state. Accordingly, when the minimum buffer size is larger than a specified size, the electronic device may prevent additional delay in collecting data of the first audio when receiving a request for audio editing. For example, in the case of an audio eraser (e.g., an audio eraser), since the first audio (e.g., PCM data) for a specified time (e.g., 2 seconds) is required for a single editing process, the electronic device may control the output of a decoder so that the first audio (e.g., PCM data) for the specified time (e.g., 2 seconds) can be maintained in the first buffer even in a disabled state. In the disabled state, whenever some first audio (e.g., some PCM data) is transferred from the first buffer to the audio output buffer (e.g., the fourth buffer), if the size of the first buffer is smaller than the minimum buffer size for setting the second buffer, the output of the decoder can be controlled to store the first audio in the first buffer up to the minimum buffer size.

[0191] FIGS. 18a, FIGS. 18b, FIGS. 18c, FIGS. 18d, FIGS. 18e and FIGS. 18f are drawings illustrating examples of screens for audio editing in an electronic device according to one embodiment.

[0192] Referring to FIG. 18a, an electronic device according to one embodiment may display a first screen (1810) on a display (240) that displays content being played in real time. The electronic device may display a first icon (1811) on the first screen (1810) for requesting audio editing while the content is being played in real time. An electronic device according to one embodiment may display an object (e.g., a playback bar) (1813) on the first screen (1810) that indicates the audio playback time.

[0193] Referring to FIG. 18b, according to one embodiment, when a first icon (1811) included in a first screen (1810) is selected while playing content, the electronic device may set buffers used for audio editing (e.g., a first buffer, a second buffer, and a third buffer) before transitioning to a state for performing a process for audio editing (e.g., an enable state) (e.g., during the time required to perform a process for audio editing). According to one embodiment, the electronic device may display an object (1815) (e.g., an object indicating loading) on ​​the first screen (1810) indicating that buffers used for audio editing (e.g., a first buffer, a second buffer, and a third buffer) are being set. According to one embodiment, since the first audio is continuously output even while the electronic device is configuring the buffers used for audio editing (e.g., during the time required to perform a process for audio editing), the electronic device can achieve the effect of uninterrupted content playback.

[0194] Referring to FIG. 18c, an electronic device according to one embodiment may display a graphic element (e.g., background color change) (1817) that applies a visual effect indicating that the process for audio editing has been completed on a first icon (1811), based on confirming that the process for audio editing has been completed.

[0195] Referring to FIG. 18d, an electronic device according to one embodiment may display an object (1819) representing a section where a crossfade is applied to a section corresponding to the time required to perform a process for audio editing on an object (e.g., a playback bar) (1817) representing audio playback time.

[0196] Referring to FIG. 18e, an electronic device according to one embodiment may display an object (1821) on a first screen (1810) that represents result information (e.g., noise removal rate) of performing a process for audio editing on a first icon (1811). Here, the object (1821) may be displayed in place of or adjacent to the first icon (1811). The object (1821) may have an effect such as a crosspad to remove interruptions in the content being played during the time required to perform a process for audio editing (e.g., noise removal) from the time a request for audio editing is received (e.g., acknowledged) (e.g., when the transition to the enable state is completed).

[0197] Referring to FIG. 18f, an electronic device according to one embodiment may display an object (1823) on a first screen (1810) representing the noise removal rate of at least one component (e.g., voice, music, wind, and others) when performing a process for removing noise from at least one component (e.g., voice, music, wind, and others) from a first audio as a process for audio editing. Here, the object (1823) may be displayed in place of an icon (1811) or adjacent to the first icon (1811). The noise removal rate may vary depending on the components (e.g., voice, music, wind, and others) included in the first audio. Content containing a lot of noise may allow the user to fully perceive the noise removal effect, while content containing little noise may have a negligible noise removal effect, so the user may not perceive the noise removal effect.

[0198] According to one embodiment, a method of operation in an electronic device (e.g., the electronic device (101) of FIG. 1 and the electronic device (201) of FIG. 2) may include an operation of outputting the first audio through a first buffer (e.g., the first buffer (410) of FIG. 4 to 9) used to output the first audio of the first content based on playing the first content.

[0199] According to one embodiment, the method may include an operation of determining the time required to perform a process for editing the at least one component from the first audio based on confirming a request to edit at least one component included in the first audio while playing the first content.

[0200] According to one embodiment, the method may include the operation of setting a second buffer (e.g., the second buffer (420) of FIGS. 4 to 9) for maintaining the output of the first audio based on the confirmed time.

[0201] According to one embodiment, the method may include the operation of outputting the first audio through the second buffer while performing the process for editing the at least one component from the first audio.

[0202] According to one embodiment, the method may include an operation of simultaneously outputting the first audio and the second audio, each of which the at least one component from the first audio has been edited, at a specified rate through the second buffer for a specified time, based on confirming the completion of the process.

[0203] According to one embodiment, the identified time may include a first time required to start the process and a second time required to edit at least one component from the first audio after starting the process.

[0204] According to one embodiment, the size of the second buffer may be set to the time for outputting the first audio through the second buffer based on the first time and the second time, and the specified time for outputting the first audio and the second audio simultaneously, respectively.

[0205] According to one embodiment, the processor for editing the at least one component may be a processor for removing noise from the at least one component.

[0206] According to one embodiment, the method may further include the operation of outputting the second audio through a third buffer (e.g., the third buffer (430) of FIGS. 4 to 9) used to output the second audio after simultaneously outputting the first audio and the second audio for the specified time.

[0207] According to one embodiment, the operation of simultaneously outputting the first audio and the second audio, each of which the at least one component from the first audio has been edited, according to a specified ratio may include, based on confirming the completion of the process, sequentially decreasing the volume of the first audio by the specified ratio and sequentially increasing the volume of the second audio by the specified ratio during the specified time through the second buffer.

[0208] According to one embodiment, the method may further include: checking the size of a fourth buffer (e.g., the fourth buffer (510) of FIGS. 5 to 9) used to output audio through an audio output device and the remaining time of the fourth buffer; based on identifying that the checked time is greater than or equal to the time corresponding to the size of the fourth buffer, the operation of transferring the first audio through the first buffer to the fourth buffer for the remaining time of the fourth buffer; the operation of transferring the first audio through the first buffer to the fourth buffer for the remaining time of the first buffer excluding the remaining time of the fourth buffer; checking the first required time of the first audio to be stored in the second buffer based on the second time and the remaining time of the fourth buffer; and, while performing the process, transferring the first audio from the first buffer to the second buffer for the first required time of the first audio.

[0209] According to one embodiment, the method may include an operation of determining the second required time of the first audio to be stored in the second buffer based on the second time, the remaining time of the fourth buffer, and the playback speed of the content, and an operation of transferring the first audio from the first buffer to the second buffer for the second required time of the first audio while performing the process.

[0210] According to one embodiment, the method may further include the operation of transferring the first audio through the first buffer to the fourth buffer for a minimum time to maintain the output of the first audio based on identifying that the confirmed time is less than the time corresponding to the size of the fourth buffer, the operation of transferring the first audio from the first buffer to the fourth buffer for the remaining time of the fourth buffer while performing the process, and the operation of transferring the first audio to the second buffer for the remaining time of the first buffer based on confirming the completion of the process.

[0211] According to one embodiment, the method may further include the operation of confirming the first information for synchronizing audio and video of the content, which includes the sizes of the plurality of first buffers and timestamps set in the plurality of first buffers, based on confirming that the first buffer is composed of a plurality of first buffers, and the operation of dividing the third buffer based on the first information and setting the second information for synchronizing, which includes the size and timestamp for each of the divided plurality of elements of the third buffer.

[0212] According to one embodiment, the method may include an operation of adding silence for the remaining time excluding the portion in which the first audio is stored from the time of the minimum unit buffer to reduce the delay for the start time of playback of the second audio, based on confirming that a minimum unit buffer to store the first audio in the first buffer has not been set until the first time has elapsed, and an operation of updating the minimum first time to the first time based on confirming that the first time is smaller than a specified minimum first time after the process is completed.

[0213] According to one embodiment, in a non-transient computer-readable storage medium storing one or more programs, the one or more programs may include executable instructions to cause the electronic device to perform an operation of outputting a first audio through a first buffer (e.g., a first buffer (410) of FIGS. 4 to 9) used to output a first audio of said first content based on playing a first content, when executed by at least one processor (e.g., a processor (120) of FIG. 1 and a processor (210) of FIGS. 2) of an electronic device (e.g., an electronic device (101) of FIG. 1 and an electronic device (201) of FIG. 2).

[0214] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of determining the time required to perform a process for editing the at least one component from the first audio based on confirming a request to edit the at least one component included in the first audio while playing the first content.

[0215] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of the electronic device, cause the electronic device to execute an operation of setting a second buffer (e.g., the second buffer (420) of FIGS. 4 to 9) for maintaining the output of the first audio based on the identified time.

[0216] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform the operation of outputting the first audio through the second buffer while performing the process for editing the at least one component from the first audio.

[0217] According to one embodiment, the one or more programs may include executable instructions that, when executed by at least one processor of an electronic device, cause the electronic device to execute an operation of simultaneously outputting each of the first audio and the second audio, in which the at least one component of the first audio is edited, at a specified rate through the second buffer for a specified time, based on confirming the completion of the process.

[0218] According to one embodiment, the identified time may include a first time required to start the process and a second time required to edit at least one component from the first audio after starting the process.

[0219] According to one embodiment, the size of the second buffer may be set to the time for outputting the first audio through the second buffer based on the first time and the second time, and the specified time for outputting the first audio and the second audio simultaneously, respectively.

[0220] According to one embodiment, the processor for editing the at least one component may be a process for removing noise from the at least one component.

[0221] This document allows for reducing delays associated with the start and execution of a process for audio editing (e.g., audio eraser) and maintaining uninterrupted content playback by managing the buffer used to start (e.g., initialize) and execute the process. In addition, various effects that can be identified directly or indirectly through this document may be provided. The effects obtainable from this disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description below.

[0222] Furthermore, the embodiments disclosed in this document are presented for the purpose of explaining and understanding the disclosed technical content and are not intended to limit the scope of the technology described in this document. Accordingly, the scope of this document should be interpreted to include all modifications or various other embodiments based on the technical concept of this document.

[0223] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0224] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0225] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0226] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-transient' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0227] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0228] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101, 201), At least one processor (120, 210) including a processing circuit; and It includes memory (130, 220) for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Based on playing the first content, the first audio is output through a first buffer (410) used to output the first audio of the first content, and Based on confirming a request to edit at least one component included in the first audio while playing the first content, determining the time required to perform a process for editing the at least one component from the first audio, and Based on the confirmed time above, a second buffer (420) is set to maintain the output of the first audio, and While performing the process for editing the at least one component from the first audio, the first audio is output through the second buffer, and An electronic device that causes the first audio and the second audio, each of which the at least one component from the first audio has been edited, to be output simultaneously at a specified rate through the second buffer for a specified time based on confirming the completion of the above process.

2. In Paragraph 1, The confirmed time above includes a first time required to start the process and a second time required to edit at least one component from the first audio after starting the process, and The size of the second buffer is set to the time for outputting the first audio through the second buffer based on the first time and the second time, and the specified time for outputting the first audio and the second audio simultaneously, respectively. The processor for editing the above at least one component is a process for removing noise from the above at least one component, and The above instructions, when executed individually or collectively by the at least one processor, cause the electronic device to output the second audio through a third buffer (430) used to output the second audio after simultaneously outputting the first audio and the second audio for the specified time.

3. In claim 1 or 2, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on confirming the completion of the above process, the volume of the first audio is sequentially reduced by the specified ratio during the specified time through the second buffer, and An electronic device that causes the volume of the second audio to increase sequentially by the specified ratio.

4. In any one of claims 1 to 3, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Check the size of the fourth buffer (510) used to output audio through an audio output device and the remaining time of the fourth buffer, and Based on identifying that the confirmed time is greater than or equal to the time corresponding to the size of the fourth buffer, the first audio is transferred to the fourth buffer through the first buffer for the remaining time of the fourth buffer, and The first audio is transmitted to the fourth buffer through the first buffer for the remaining time of the first buffer, excluding the remaining time of the fourth buffer, and Based on the second time and the remaining time of the fourth buffer, determine the first required time of the first audio to be stored in the second buffer, and An electronic device that, while performing the above process, transfers the first audio from the first buffer to the second buffer for the first required time of the first audio.

5. In any one of claims 1 to 4, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on the second time, the remaining time of the fourth buffer, and the playback speed of the content, the second required time of the first audio to be stored in the second buffer is determined, and An electronic device that, while performing the above process, causes the first audio to be transferred from the first buffer to the second buffer for the second required time of the first audio.

6. In any one of claims 1 to 5, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on identifying that the above-mentioned confirmed time is less than the time corresponding to the size of the fourth buffer, the first audio is transferred to the fourth buffer through the first buffer for a minimum time to maintain the output of the first audio, and While performing the above process, the first audio is transferred from the first buffer to the fourth buffer for the remaining time of the fourth buffer, and An electronic device that causes the first audio to be transferred to the second buffer for the remaining time of the first buffer, based on confirming the completion of the above process.

7. In any one of claims 1 through 6, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on confirming that the first buffer is composed of a plurality of first buffers, the first information for synchronizing audio and video of the content is confirmed, including the sizes of the plurality of first buffers and timestamps set in the plurality of first buffers. An electronic device that, based on the first information, divides the third buffer, includes a size and timestamp for each of the divided plurality of elements of the third buffer, and causes to set the second information for synchronization.

8. In any one of claims 1 through 7, when the instructions are executed individually or collectively by the at least one processor, the electronic device: Based on confirming that a minimum unit buffer for storing the first audio in the first buffer has not been set until the first time has elapsed, silence is added for the remaining time excluding the portion where the first audio is stored from the time of the minimum unit buffer in order to reduce the delay for the start time of playback of the second audio, and An electronic device that, after the above process is completed, causes the minimum first time to be updated to the first time based on confirming that the first time is smaller than the specified minimum first time.

9. A method of operation in an electronic device (101, 201), An operation of outputting the first audio through a first buffer (410) used to output the first audio of the first content based on playing the first content; An operation to determine the time required to perform a process for editing the at least one component from the first audio, based on confirming a request to edit at least one component included in the first audio while playing the first content; The operation of setting a second buffer (420) to maintain the output of the first audio based on the confirmed time; The operation of outputting the first audio through the second buffer while performing the process for editing the at least one component from the first audio; and A method comprising, based on confirming the completion of the above process, simultaneously outputting the first audio and the second audio, each having at least one component edited from the first audio, through the second buffer for a specified time according to a specified ratio.

10. In Paragraph 9, The confirmed time above includes a first time required to start the process and a second time required to edit at least one component from the first audio after starting the process, and The size of the second buffer is set to the time for outputting the first audio through the second buffer based on the first time and the second time, and the specified time for outputting the first audio and the second audio simultaneously, respectively. The processor for editing the above at least one component is a process for removing noise from the above at least one component, and The above method is, The method further includes the operation of simultaneously outputting the first audio and the second audio during the specified time, and then outputting the second audio through a third buffer (430) used to output the second audio. The operation of simultaneously outputting the first audio and the second audio, each of which the at least one component edited from the first audio, according to a specified ratio, A method comprising, based on confirming the completion of the above process, sequentially decreasing the volume of the first audio by the specified ratio and sequentially increasing the volume of the second audio by the specified ratio during the specified time through the second buffer.

11. In paragraph 9 or 10, the above method is, An operation to check the size of the fourth buffer (510) used to output audio through an audio output device and the remaining time of the fourth buffer; Based on identifying that the confirmed time is greater than or equal to the time corresponding to the size of the fourth buffer, the operation of transmitting the first audio through the first buffer to the fourth buffer for the remaining time of the fourth buffer; An operation of transmitting the first audio to the fourth buffer through the first buffer for the remaining time of the first buffer excluding the remaining time of the fourth buffer; An operation to determine the first required time of the first audio to be stored in the second buffer based on the second time and the remaining time of the fourth buffer; and A method comprising, while performing the above process, further including the operation of transferring the first audio from the first buffer to the second buffer for the first required time of the first audio.

12. In any one of paragraphs 9 to 13, the above method is, An operation to determine the second required time of the first audio to be stored in the second buffer based on the second time, the remaining time of the fourth buffer, and the playback speed of the content; While performing the above process, an operation to transfer the first audio from the first buffer to the second buffer for the second required time of the first audio; Based on identifying that the confirmed time is less than the time corresponding to the size of the fourth buffer, the operation of transferring the first audio through the first buffer to the fourth buffer for a minimum time to maintain the output of the first audio; While performing the above process, the operation of transferring the first audio from the first buffer to the fourth buffer for the remaining time of the fourth buffer; and A method further comprising, based on confirming the completion of the above process, an operation of transferring the first audio to the second buffer for the remaining time of the first buffer.

13. In any one of paragraphs 9 through 12, the above method is, Based on confirming that the first buffer is composed of a plurality of first buffers, an operation of confirming first information for synchronizing audio and video of the content, including the sizes of the plurality of first buffers and timestamps set in the plurality of first buffers; and A method further comprising the operation of dividing the third buffer based on the first information and setting second information for synchronization including a size and timestamp for each of the divided plurality of elements of the third buffer.

14. In any one of paragraphs 9 to 13, the above method is, Based on confirming that a minimum unit buffer for storing the first audio in the first buffer has not been set until the first time has elapsed, an operation to add silence for the remaining time excluding the portion in which the first audio is stored from the time of the minimum unit buffer in order to reduce the delay for the start time of playback of the second audio; and A method further comprising, after the above process is completed, updating the minimum first time to the first time based on confirming that the first time is smaller than the specified minimum first time.

15. In a non-transient computer-readable storage medium storing one or more programs, the one or more programs, when executed by at least one processor (120, 210) of an electronic device (101, 201), cause the electronic device: An operation of outputting the first audio through a first buffer (410) used to output the first audio of the first content based on playing the first content; An operation to determine the time required to perform a process for editing the at least one component from the first audio, based on confirming a request to edit at least one component included in the first audio while playing the first content; The operation of setting a second buffer (420) to maintain the output of the first audio based on the confirmed time; The operation of outputting the first audio through the second buffer while performing the process for editing the at least one component from the first audio; and A non-transient computer-readable storage medium comprising, based on confirming the completion of the above process, executable commands to simultaneously output the first audio and the second audio, each of which the at least one component from the first audio has been edited, at a specified rate through the second buffer for a specified time.