Electronic device outputting audio and control method thereof

Abstract

An electronic device is disclosed. The electronic device includes a communication interface and at least one processor to cause: to output a first audio if the first audio and a signal corresponding to a first play start of the first audio are received from a first device through the communication interface; stopping the output of the first audio and outputting the second audio if the second audio and a signal of second playback start of the second audio are received from the second device through the communication interface while outputting the first audio; when the output of the second audio is finished, sending a signal for requesting to play the first audio to the first equipment through the communication interface; and outputting the first audio if a signal corresponding to the start of the first playback is received through the communication interface after the transmission of the signal requesting the playback of the first audio.

Description

Technical Field

[0001] The present disclosure relates to an electronic device that outputs audio and a control method thereof. More particularly, the present disclosure relates to an electronic device that outputs audio based on data received from a plurality of devices and a control method thereof. Background Art

[0002] As electronic technology develops, various types of electronic devices are being developed and supplied. Specifically, audio sink devices such as Bluetooth speakers or Bluetooth headphones that output audio by performing communication with user terminal devices and the like are being developed, and their supply is expanding. Summary of the invention

[0003] According to one aspect of the present disclosure, an electronic device includes: a communication interface; and at least one processor, configured to: output the first audio data based on receiving first audio data and a first playback start signal corresponding to the first audio data from a first device through the communication interface; stop the output of the first audio data and output the second audio data based on receiving second audio data and a second playback start signal corresponding to the second audio data from a second device through the communication interface while outputting the first audio data; send a signal requesting to play the first audio data to the first device through the communication interface based on the end of the output of the second audio data; and output the first audio data based on receiving the first playback start signal through the communication interface after sending the signal requesting to play the first audio data.

[0004] The at least one processor may be further configured to stop outputting the second audio data based on receiving a play stop signal corresponding to the second audio data from the second device through the communication interface within a first time from when outputting of the second audio data starts.

[0005] The electronic device may also include: at least one memory storing historical information corresponding to the device or at least one of audio duration information corresponding to multiple application types, wherein at least one processor may also be configured to: based on receiving a play stop signal through the communication interface during the first time period, and based on at least one of the historical information or the audio duration information, stop the output of the second audio data, and send a signal requesting the first audio data to be played to the first device through the communication interface.

[0006] At least one processor may also be configured to: based on receiving a second playback start signal from a second device through a communication interface when outputting the first audio data, identify type information of an application among multiple application types corresponding to the second audio data, and identify the duration of the first time based on the identified application type information and the audio duration information.

[0007] The electronic device may further include: a user interface, wherein the at least one processor is further configured to: identify the duration of the first time based on a user input received through the user interface.

[0008] At least one processor may also be configured to: based on receiving a second playback start signal and second audio data from a second device through a communication interface, identify whether the second audio data is of an alarm type based on the second audio data or at least one of the historical information corresponding to the second device; based on the second audio data being identified as an alarm type, identify whether a playback stop signal is received from the second device through the communication interface during a first time period; and based on identifying that a playback stop signal is received during the first time period, send a signal to the first device through the communication interface requesting the first audio data to be played.

[0009] The electronic device may further include: at least one memory storing a trained neural network model, wherein the at least one processor is further configured to: identify whether the second audio data is of an alarm type by inputting the second audio data into the trained neural network model.

[0010] At least one processor may also be configured to stop the output of the second audio data based on the fact that the number of times a signal corresponding to the same type as the second playback start signal is received through the communication interface during a second time interval from when the second playback start signal is received from the second device is greater than or equal to a preset number of times.

[0011] The electronic device may further include: an outputter, wherein the second audio data is of an alarm type, and wherein the at least one processor is further configured to: output the first audio data through the outputter based on receiving a first play start signal from the first device through the communication interface, output the second audio data through the outputter based on receiving a second play start signal from the second device through the communication interface when outputting the first audio data, and output the first audio data through the outputter based on receiving the first play start signal through the communication interface in response to a signal requesting to play the first audio.

[0012] At least one processor can also be configured to: based on receiving a first playback start signal through the communication interface in response to a signal requesting to play the first audio data, the first audio data is output from a second playback time point in the first audio data, and the second playback time point is prior to the first playback time point by a preset time interval, and the first playback time point corresponds to the playback time point in the first audio data when the output of the first audio data stops.

[0013] According to one aspect of the present disclosure, a method for controlling an electronic device includes: outputting the first audio data based on receiving the first audio data and a first play start signal corresponding to the first audio data from a first device; stopping the output of the first audio data and outputting the second audio data based on receiving the second audio data and a second play start signal corresponding to the second audio data from a second device while outputting the first audio data; sending a signal requesting to play the first audio data to the first device based on the end of the output of the second audio data; and outputting the first audio data based on receiving the first play start signal after sending the signal requesting to play the first audio data.

[0014] Transmitting the signal requesting to play the first audio may include ending output of the second audio data based on receiving a play stop signal corresponding to the second audio data from the second device within a first time from when output of the second audio starts.

[0015] Sending a signal requesting to play the first audio may also include: based on receiving a play stop signal from the second device during the first time period, and based on at least one of the historical information corresponding to the device stored in the memory of the electronic device or the audio duration information corresponding to multiple application types stored in the memory, stopping the output of the second audio data, and sending a signal requesting to play the first audio data to the first device.

[0016] The method may also include: based on receiving a second playback start signal from the second device when outputting the first audio, identifying type information of an application among multiple application types corresponding to the second audio data; and identifying the duration of the first time based on the identified application type information and audio duration information.

[0017] The method may further include: based on receiving a second playback start signal and second audio data from the second device, identifying whether the second audio data is an alarm type based on the second audio data or at least one of the historical information corresponding to the second device, based on the second audio data being identified as an alarm type, identifying whether a playback stop signal is received from the second device during a first time period, and based on identifying that a playback stop signal is received during the first time period, sending a signal to the first device requesting to play the first audio data.

[0018] The method may also include: based on receiving a first playback start signal in response to a signal requesting to play the first audio, the first audio data is output from a second playback time point in the first audio data, the second playback time point being prior to the first playback time point by a preset time interval, and the first playback time point corresponding to the playback time point in the first audio data when the output of the first audio data is stopped.

[0019] According to one aspect of the present disclosure, a non-transitory computer-readable recording medium stores instructions which, when executed by at least one processor, cause the at least one processor to execute a method for controlling an electronic device, wherein the method includes: outputting the first audio data based on receiving the first audio data and a first play start signal corresponding to the first audio data from a first device; stopping the output of the first audio data and outputting the second audio data based on receiving the second audio data and a second play start signal corresponding to the second audio data from a second device while outputting the first audio data; sending a signal requesting the first audio data to be played to the first device based on the end of the output of the second audio data; and outputting the first audio data based on receiving the first play start signal after sending the signal requesting the first audio data to be played.

[0020] Transmitting the signal requesting to play the first audio may include ending output of the second audio data based on receiving a play stop signal corresponding to the second audio data from the second device within a first time from when output of the second audio starts.

[0021] Sending a signal requesting to play the first audio may also include: based on receiving a play stop signal from the second device during the first time period, and based on at least one of the historical information corresponding to the device stored in the memory of the electronic device or the audio duration information corresponding to multiple application types stored in the memory, stopping the output of the second audio data and sending a signal requesting to play the first audio data to the first device.

[0022] The method may also include: based on receiving a second playback start signal from the second device when outputting the first audio, identifying type information of an application among multiple application types corresponding to the second audio data; and identifying the duration of the first time based on the identified application type information and audio duration information. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent through the following description in conjunction with the accompanying drawings, in which:

[0024] Figure 1 is a diagram schematically illustrating a control method of an electronic device of the related art according to one or more embodiments;

[0025] Figure 2 is a block diagram showing a configuration of an electronic device according to one or more embodiments;

[0026] Figure 3 is a flowchart illustrating a method of outputting audio by an electronic device according to one or more embodiments;

[0027] Figure 4 is a flowchart illustrating an audio output method of an electronic device according to one or more embodiments;

[0028] Figure 5 is a flow chart illustrating a method of identifying a size of a first time interval according to one or more embodiments;

[0029] Figure 6 is a flow chart illustrating a method of identifying a size of a first time interval according to one or more embodiments;

[0030] Figure 7 is a flow chart illustrating a method of identifying a type of audio according to one or more embodiments;

[0031] Figure 8 is a flowchart illustrating a control method when an alarm play start signal of the same type is received according to one or more embodiments;

[0032] Fig. 9 is a sequence diagram illustrating a control method of an electronic device according to one or more embodiments;

[0033] Fig.10 is a diagram schematically showing an implementation of an electronic device according to one or more embodiments; and

[0034] Fig.11 is a block diagram illustrating a detailed configuration of an electronic device according to one or more embodiments. DETAILED DESCRIPTION

[0035] The present disclosure will be described in detail below with reference to the accompanying drawings.

[0036] Terms used in the present disclosure will be briefly described, and the present disclosure will be described in detail.

[0037] The terms used to describe the embodiments of the present disclosure are currently widely used general terms, which have been selected in consideration of their functions in this article. However, the terms may change depending on the intentions of those skilled in the relevant art, legal or technical interpretations, the emergence of new technologies, etc. Further, in some cases, there may be arbitrarily selected terms, and in such cases, the meaning of the terms may be described in the corresponding descriptions. Therefore, the terms used herein may be understood not only by their names, but based on the meaning of the terms and the overall content of the present disclosure.

[0038] In the present disclosure, expressions such as “having”, “may have”, “including”, “may include”, etc. are used to specify the existence of corresponding characteristics (for example, elements such as values, functions, operations, or components), and do not exclude the existence or possibility of additional characteristics.

[0039] The expression at least one of A and / or B should be understood to mean any one of “A” or “B” or “A and B”.

[0040] Expressions such as "first", "second", "1st", "2nd" etc. used herein may be used to refer to various elements, regardless of order and / or importance. In addition, it should be noted that these expressions are only used to distinguish an element from another element, rather than limiting the relevant elements.

[0041] When an element (e.g., a first element) is indicated as being “(operably or communicatively) coupled” or “connected to” another element (e.g., a second element), it should be understood that the element is directly coupled to / coupled to the other element or coupled through other elements (e.g., a third element).

[0042] Unless otherwise specified, singular expressions include plural expressions. It should be understood that terms such as "formed" or "comprising" are used herein to specify the presence of characteristics, quantities, steps, operations, elements, components, or combinations thereof, and do not exclude the presence or possibility of adding one or more of other characteristics, quantities, steps, operations, elements, components, or combinations thereof.

[0043] The term "module" or "part" used in the embodiments of this document performs at least one function or operation and can be implemented in hardware or software, or in a combination of hardware and software. In addition, in addition to the "module" or "part" that needs to be implemented in specific hardware, multiple "modules" or multiple "parts" can be integrated into at least one module and implemented in at least one processor.

[0044] In addition, the “deep neural network (DNN)” here may be a representative example of an artificial intelligence neural network model that simulates brain nerves, and is not limited to an artificial neural network model that uses a specific algorithm.

[0045] In addition, the "parameter" may be a value used in the calculation process of each layer forming the neural network herein, and may include, for example, a weight value used when applying an input value to a predetermined calculation formula. In addition, the parameter may be represented in a matrix form. The parameter may be a value set based on the training result, and may be updated by separate training data if necessary.

[0046] Figure 1 is a diagram schematically illustrating a control method of an electronic device of the related art according to one or more embodiments.

[0047] refer to Figure 1 According to one or more embodiments, the electronic apparatus 100 may receive audio data from a plurality of devices 20 or 30 and output audio corresponding to the received audio data.

[0048] According to one or more embodiments, the electronic device 100 may be a device that outputs sound, and may be, for example, a speaker or a headset having a Bluetooth function. However, the above is not limited thereto, and the electronic device 100 according to the embodiment may perform communication with an external device by using not only a wireless communication method but also a wired communication method. That is, the electronic device 100 may be a speaker or a headset that outputs sound using a wireless communication method.

[0049] According to one or more embodiments, the plurality of devices 20 or 30 may be user terminal devices. For example, the plurality of devices 20 or 30 may include at least one of a smart phone, a tablet personal computer (PC), a laptop PC, a netbook computer, and a wearable device, but is not limited thereto, and may be implemented as various types of devices as long as it is a terminal device capable of performing communication with the electronic device 100.

[0050] According to one or more embodiments, the electronic apparatus 100 may output first audio based on first audio data received from the first device 20 among the plurality of devices through the communication interface.

[0051] When outputting the first audio based on the data received from the first device 20, if audio data is received from the second device 30 due to a preset event occurring in the second device 30, the related art electronic apparatus 100 outputs the first audio even when receiving the audio data from the second device 30, ignoring the audio data from the second device. Therefore, the related art electronic apparatus 100 outputs the second audio received from the second device 30 after the output of the first audio ends, and there has been a problem that the user recognizes the second audio late.

[0052] Alternatively, according to one or more embodiments, while outputting the first audio based on the data received from the first device 20, if audio data associated with the second audio is received from the second device 30 due to a preset event occurring in the second device, the electronic apparatus 100 of the related art outputs the second audio received from the second device 30 by stopping the output of the first audio. Therefore, there is a problem of reduced user satisfaction due to reduced usability, because the first audio that was previously being played is not played after the output of the second audio is ended, and thus the electronic apparatus 100 is in a continuous silent state where audio is no longer output.

[0053] Therefore, various embodiments that can enhance the usability of an electronic device will be described below by outputting audio based on data received from a first device and, based on audio data associated with second audio received from a second device, re-outputting the previously played audio when the output of the second audio ends.

[0054] Figure 2 is a block diagram illustrating a configuration of an electronic device according to one or more embodiments.

[0055] refer to Figure 2 , the electronic device 100 may include a communication interface 110 and at least one processor 120 (hereinafter, referred to as a processor).

[0056] According to one or more embodiments, the electronic device 100 may be a device that outputs sound, and may be an electronic device that can perform communication with another electronic device. For example, the electronic device may be a speaker or a headset with a Bluetooth function, but is not limited thereto, and may be implemented as various devices that can output sound, such as, for example but not limited to, a TV including a smart TV (TV), a tablet computer, a smart phone, a desktop computer, a laptop computer, etc.

[0057] However, the above is not limited thereto, and the electronic apparatus 100 according to the example may perform communication with an external device using not only a wireless communication method but also a wired communication method. That is, the electronic apparatus 100 may be a device that outputs sound using a wireless communication method.

[0058] However, the electronic device 100 according to one or more embodiments is not limited to the above-mentioned apparatuses, and may be implemented as a server capable of performing communication with another electronic device.

[0059] The communication interface 110 can receive input of various types of content. For example, the communication interface 110 can receive input of signals from an external device (e.g., source device), an external storage medium (e.g., USB memory), an external server (e.g., WEBHARD), etc. in a streaming or downloading method through a communication method such as, for example but not limited to, AP-based Wi-Fi, Bluetooth, ZigBee, wired / wireless local area network (LAN), wide area network (WAN), Ethernet, IEEE 1394, High Definition Multimedia Interface (HDMI), Universal Serial Bus (USB), Mobile High Definition Link (MHL), Audio Engineering Society / European Broadcasting Union (AES / EBU), Optical, Coaxial, etc.

[0060] The communication interface 110 according to an example may communicate with external devices such as a remote control device and an external server using the same communication module (eg, Wi-Fi).

[0061] According to another example, the communication interface 110 can use different communication modules to communicate with external devices such as remote control devices and external servers. For example, the communication interface 110 can use at least one of an Ethernet module or Wi-Fi to communicate with an external server, and use a Bluetooth module to communicate with external devices such as remote control devices. However, this is only one embodiment, and when communicating with multiple external devices or external servers, the communication interface 110 can use at least one communication module among various communication modules.

[0062] According to one or more embodiments, the electronic device 100 may transmit and receive data with a plurality of external devices through the communication interface 110. According to an example, the electronic device 100 may transmit and receive data with an external device through a Bluetooth function. Here, the electronic device 100 according to an example may use 2.45 GHz, which is an Institute for Supply Management (ISM) wavelength.

[0063] According to one or more embodiments, Bluetooth audio / video distribution transport protocol and audio / video remote control profile standard applications may be included.

[0064] However, the present disclosure is not limited thereto, and the electronic apparatus 100 may perform communication with the external device using a wireless or wired communication method including a different method of Wi-Fi as described above.

[0065] At least one processor 120 (hereinafter referred to as a processor) can control the overall operation of the electronic device 100 by being electrically coupled to the communication interface 110. The processor 120 can be formed by one or more processors. Specifically, the processor 120 can perform the operation of the electronic device 100 according to various embodiments of the present disclosure by executing at least one instruction stored in the memory.

[0066] According to one or more embodiments, the processor 120 may be implemented as a digital signal processor (DSP), a microprocessor, a graphics processing unit (GPU), an artificial intelligence (AI) processor, a neural processing unit (NPU), or a time controller (TCON) for processing digital image signals. However, the above is not limited thereto, and may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), or an ARM processor, or may be defined by corresponding terms. In addition, the processor 120 may be implemented in a system on chip (SoC) or a large-scale integrated circuit (LSI) in which a processing algorithm is embedded, and may be implemented in the form of an application-specific integrated circuit (ASIC) and a field-programmable gate array (FPGA).

[0067] The processor 120 according to one or more embodiments may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON). However, the present disclosure is not limited thereto, and may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), or an ARM processor, or may be defined by corresponding terms.

[0068] According to one or more embodiments, the processor 120 may output the audio received from the first device.

[0069] According to an example, the processor 120 may output the first audio received from the first device based on the play start signal of the first audio received from the first device among the plurality of devices through the communication interface 110. Here, the play start signal of the first audio may be a signal that the electronic device 100 controls to start playing the first audio, and may be, for example, an audio / video distribution transport protocol (AVDTP) start signal or an audio / video remote control profile (AVRCP) play signal.

[0070] According to an example, when a signal including first audio data is received from the first device through the communication interface 110, the processor 120 may output the first audio. Here, the first audio may be, for example, audio associated with an image displayed in the first device or voice data played in the first device, but is not limited thereto.

[0071] According to one or more embodiments, the processor 120 may stop the output of the first audio and output the second audio received from the second device.

[0072] Here, the second audio (also referred to as "second audio data") received according to the example may be an audio of an alarm type. The audio received according to the example may be an alarm corresponding to a specific application including a messenger alarm or a morning call alarm, but is not limited thereto, and may be an alarm having different audio data according to the type of application. In such a case, the play time (or output time) of the alarm based on the type of application according to the example may be different.

[0073] Alternatively, the second audio according to the example may be an audio of a sound effect type. For example, the second audio may be a sound effect corresponding to a specific application, but is not limited thereto, and may be a sound effect having different audio data according to the application type.

[0074] According to one or more embodiments, in addition to the audio of the alarm or sound effect type, the second audio may be various types of audio whose audio playing time is less than a preset size.

[0075] According to an example, the processor 120 can stop the output of the first audio and output the second audio received from the second device based on receiving a signal corresponding to the start of playback of the second audio (or, a playback start signal of the second audio) from a second device among multiple devices through the communication interface 110 when the first audio is output.

[0076] Here, the play start signal of the second audio may be a signal that the electronic device 100 controls to output the second audio. According to an example, the second audio play start signal may be an audio / video distribution transport protocol (AVDTP) start signal or an audio / video remote control profile (AVRCP) play signal.

[0077] For example, the processor 120 can output the first audio (e.g., audio associated with an image displayed in the first device) based on receiving a second audio playback start signal (e.g., an alarm playback start signal) from the second device through the communication interface 110, while outputting the first audio (e.g., audio associated with an image displayed in the first device) based on a control signal received from the first device, stop outputting the first audio, and output the second audio.

[0078] According to one or more embodiments, the processor 120 may send a signal requesting to play the first audio (or a play request signal of the first audio) to the first device through the communication interface 110 based on completion of output of the second audio.

[0079] Here, the play request signal of the first audio may be a signal requesting the first device to send a play start signal of the first audio. The play request signal according to an embodiment may be an audio / video remote control profile (AVRCP) play signal. Even without a separate user input, the first device that receives the play request signal may send a play start signal of the first audio to the electronic device 100. That is, the first device that receives the play request signal of the first audio from the electronic device 100 may be able to automatically perform the play of the first audio.

[0080] According to an example, the processor 120 can end the output of the second audio based on receiving a signal corresponding to stopping the playback of the second audio (or a second audio stop signal) from the second device through the communication interface 110, and send a playback request signal for the first audio to the first device through the communication interface 110.

[0081] Here, the second audio stop signal may be a control signal for ending the output of the second audio by the electronic device 100. The second audio stop signal may be, for example, an Audio / Video Distribution Transport Protocol (AVDTP) pause signal or an Audio / Video Remote Control Profile (AVRCP) stop signal, but is not limited thereto.

[0082] For example, the processor 120 may end the output of the second audio based on receiving a second audio stop signal from the second device through the communication interface 110 during the first time from when the second audio is output, and send a play request signal for the first audio to the first device through the communication interface 110.

[0083] Here, the first time (or first time interval) may be a time interval based on the time point at which the alarm is output to the time point at which the preset time has passed. According to an example, the size of the first time interval may be a value stored at the time of initial setting, but is not limited thereto, and may have different values ​​according to user input, the type of device that performs communication with the electronic device, the communication form (e.g., Bluetooth, Wi-Fi, etc.), historical information, and user identification information (user ID information), etc. As above, by Figures 4 to 7 Provide detailed explanation.

[0084] According to one or more embodiments, the processor 120 may output the first audio received from the first device based on a signal corresponding to the start of playback of the first audio corresponding to a playback request signal of the first audio received from the first device through the communication interface 110.

[0085] According to one or more embodiments, the processor 120 may output the above-mentioned first audio or second audio through a speaker provided in the electronic device 100, but is not limited thereto, and when the electronic device 100 is implemented as a server according to the example, the processor 120 may send a signal associated with the first audio or the second audio to another device to output the first audio or the second audio from the other device (e.g., a Bluetooth speaker or a user terminal). Fig.10 Provide detailed explanation.

[0086] Figure 3 is a flowchart illustrating a method of outputting audio by an electronic device according to one or more embodiments.

[0087] refer to Figure 3 According to one or more embodiments, the control method may include identifying whether a play start signal of the first audio is received from the first device (S310). According to an example, the control method may include identifying whether a play start signal of the first audio played in the first device is received through the communication interface 110.

[0088] Then, according to one or more embodiments, the control method may include: based on receiving a playback start signal of the first audio (Yes), outputting the first audio received from the first device (S320). According to an example, the control method may include: based on receiving a control signal corresponding to the playback start of the first audio from the first device through the communication interface 110, receiving audio data corresponding to the first audio from the first device, and outputting the first audio based on this.

[0089] In such a case, according to an example, a control signal corresponding to the start of playback of the first audio (or, a first audio playback start signal) and audio data corresponding to the first audio can be sent and received by grouping as one communication packet. According to an example, the control method may include receiving information associated with the first audio from the first device, the information including the playback start signal of the first audio and the audio data corresponding to the first audio.

[0090] Then, the control method according to one or more embodiments may include identifying whether a second audio playback start signal is received from the second device when the first audio is output (S330). According to an example, the control method may include: when the first audio is output based on the audio corresponding to the first audio received from the first device, identifying whether a second audio playback start signal is received from the second device through the communication interface 110.

[0091] Then, according to one or more embodiments, the control method may include: based on receiving a second audio playback start signal from the second device (yes), stopping the output of the first audio and outputting the second audio received from the second device (S340). According to an example, the control method may include: based on receiving a second audio playback start signal from the second device when outputting the first audio, stopping the output of the first audio, and receiving data corresponding to the second audio from the second device, and outputting the second audio based on this.

[0092] Then, the control method according to one or more embodiments may include identifying whether to end the output of the second audio (S350). According to an example, the control method may include: based on the output of the first audio being stopped and the second audio being output, identifying whether the output of the second audio is ended based on a second audio playback stop signal received from the second device.

[0093] For example, if the playback time of the second audio is 10 seconds, a second audio stop signal may be received from the first device from the time point when the second audio is played to the time point after 10 seconds have passed, and the control method may include ending the output of the second audio when the second audio stop signal is received. However, the present disclosure is not limited to the above description, and the control method may include: when the second audio stop signal is received from the second device during the first time interval from the output of the second audio, ending the output of the second audio. Figures 4 to 7 Provide detailed explanation.

[0094] Then, the control method according to one or more embodiments may include: based on the output of the second audio ending (yes), sending a play request signal of the first audio to the first device (S360). According to an example, the control method may include: based on receiving a second audio stop signal from the first device after 10 seconds from the time point of playing the second audio, ending the output of the second audio. The control method may include sending a play request signal of the first audio to the first device as the output of the second audio ends.

[0095] Then, the control method according to one or more embodiments may include identifying whether a play start signal of the first audio corresponding to the play request signal of the first audio is received from the first device (S370). Then, the control method according to one or more embodiments may include: based on the play start signal of the first audio corresponding to the play request signal of the first audio being received (yes), outputting the first audio received from the first device (S380).

[0096] The control method according to an example may include outputting the first audio based on audio data corresponding to the first audio received from the first device based on a play start signal of the first audio corresponding to a play request signal of the first audio received from the first device.

[0097] Therefore, the electronic device 100 may output the audio again before outputting the second audio based on receiving the control signal to end the second audio output before the preset time has passed. Therefore, the electronic device 100 may not generate a silent state and may enhance user satisfaction.

[0098] Here, the silent state may refer to a state in which the audio is not output through the electronic device 100 because the previous first audio is no longer played after the playback of the second audio ends. That is, even when the second audio such as an alarm is played during the playback of the first audio, the electronic device 100 can output the previous first audio again after the playback of the second audio ends, and thus, the state in which the audio is not output after the playback of the second audio ends can be prevented.

[0099] Figure 4is a flowchart illustrating an audio output method of an electronic device according to one or more embodiments.

[0100] refer to Figure 4 According to one or more embodiments, the control method may first include identifying whether a second audio stop signal is received from the second device during a first time interval from when the second audio is output (S410). According to an example, the control method may include: based on outputting the second audio based on the received second audio playback start signal, identifying whether a second audio stop signal is received from the second device through the communication interface 110 within 10 seconds from when the second audio starts to be output.

[0101] Then, the control method according to one or more embodiments may include: based on receiving a second audio stop signal from the second device during the first time interval from when the second audio is output (Yes), ending the output of the second audio (S420). According to an embodiment, the control method may include: based on receiving a second audio stop signal from the second device before 10 seconds have passed, ending the output of the second audio, 10 seconds being the size of the first time interval from when the second audio is output.

[0102] Then, the control method according to one or more embodiments may include transmitting a play request signal to the first device based on the output end of the second audio (S430).

[0103] Then, the control method according to one or more embodiments may include identifying whether a play start signal of the first audio corresponding to the play request signal of the first audio is received from the first device (S440). Here, the play request signal of the first audio according to the example may be an audio / video remote control profile (AVRCP) play signal.

[0104] Then, when a play start signal of the first audio corresponding to the play request signal of the first audio is received from the first device according to one or more embodiments, the control method may include outputting the first audio received from the first device ( S450 ).

[0105] Because the play time of the second audio is relatively short compared to different types of audio (e.g., music, image audio, etc.), the control method may send a play request signal to the first device based on receiving a stop signal of the second audio before a preset time has passed since the second audio was output. Therefore, even if a stop signal of the second audio is received and the output of the second audio is ended, the electronic device 100 may output the first audio, and thus, the mute state of the electronic device 100 may not occur.

[0106] Figure 5 is a flow chart illustrating a method of identifying a size of a first time interval in accordance with one or more embodiments.

[0107] According to one or more embodiments, the electronic apparatus 100 may include a memory in which at least one of history information or audio duration information corresponding to types of a plurality of applications respectively corresponding to a plurality of devices is stored.

[0108] Here, the history information respectively corresponding to the plurality of devices may be information associated with the use history of the respective devices corresponding to the electronic apparatus 100 for performing communication, and may include, for example, information associated with the duration of the audio previously used by the user corresponding to the respective devices. Alternatively, for example, information associated with the number of times each of the different types of audio previously used (or the number of times output) may be included.

[0109] However, the present disclosure is not limited thereto, and according to an embodiment, may also include information associated with the number of times each of the different types of audio output from the corresponding device is used regardless of how the user outputs it, or information associated with the duration of different types of audio corresponding to each device.

[0110] Alternatively, for example, information about the number of times the alarm is used per preset time interval (e.g., 8:00 a.m. to 10:00 a.m.), or information associated with the duration of the alarm may be included. That is, the history information may include different information according to a plurality of users respectively corresponding to a plurality of devices, and according to an embodiment, different history information according to a time interval for each user may be stored.

[0111] The audio duration information corresponding to the plurality of application types may be information associated with the duration of the audio (or, the audio play time) for outputting the audio corresponding to the respective applications, and will be transmitted through Figure 6 A method of identifying a duration of a first time interval according to an application type is described in detail.

[0112] According to an embodiment, the memory may store information associated with the audio duration corresponding to each of the application types, and the control method may identify the duration of the first time interval based on the information stored in the memory.

[0113] refer to Figure 5 , the control method according to one or more embodiments may include identifying a duration of a first time interval based on at least one of history information or audio duration information corresponding to a plurality of application types ( S510 ).

[0114] According to an embodiment, the control method may include identifying a duration of the first time interval as 8 seconds based on that a duration of the second audio corresponding to the second device is identified as 8 seconds based on information stored in the memory.

[0115] Alternatively, the control method according to one or more embodiments may include: based on the duration of the audio used by the user being different based on the historical information stored in the memory, identifying an average value associated with audio durations of different lengths as the duration of the first time interval. In such a case, the control method according to the example may include identifying the duration of the first time interval based on the audio duration being less than a threshold.

[0116] For example, if the alarm durations are 3 seconds, 8 seconds, 10 seconds, and 60 seconds, respectively, the control method may include identifying the duration of the first time interval as 7 seconds (= (3+8+10) / 3) based on the duration of the alarm being less than 30 seconds as a threshold. However, the present disclosure is not limited thereto, and the control method according to the example may include identifying the maximum value of the audio durations that is less than the threshold as the duration of the first time interval. In the above example, the duration of the first time interval may be 10 seconds.

[0117] Alternatively, the control method according to the example may include: identifying the duration of the first time interval based on information about the number of times the audio is used (or output) for each preset time interval (e.g., 8:00 a.m. to 10:00 a.m.) or information associated with the duration of the audio. For example, the control method may include: based on the first alarm having an audio duration of 8 seconds, the maximum output is between 8:00 a.m. and 10:00 a.m. based on information stored in the memory, identifying the duration of the first time interval as 8 seconds. In such a case, the control method according to the example may include identifying the duration of the first time interval based only on information associated with audio having a duration less than a threshold.

[0118] Then, the control method according to one or more embodiments may include identifying whether a second audio stop signal is received from the second device during the identified first time interval from when the second audio is output (S520). According to an embodiment, the control method may include: based on the duration of the first time interval being identified as 8 seconds based on the historical information, identifying whether the second audio stop signal is received from the second device before 8 seconds have passed from when the second audio is output.

[0119] Then, the control method according to one or more embodiments may include ending the output of the second audio and sending a play request signal of the first audio to the first device (S530). According to an embodiment, the control method may include: based on receiving a second audio stop signal from the second device before 8 seconds (which is the duration of the first time interval) elapses from when the second audio is output based on the history information, ending the output of the second audio, and sending a play request signal of the first audio to the first device.

[0120] According to one or more embodiments, audio duration information corresponding to a plurality of user terminal device types may be included in the memory.According to one or more embodiments, the processor 120 may identify the duration of the first time interval based on the audio duration information corresponding to a plurality of external device types stored in the memory.

[0121] According to an embodiment, the processor 120 may identify the duration of the first time interval based on the type of an external device (e.g., a user terminal) that performs communication with the electronic apparatus 100. Here, according to an embodiment, the type of the external device may be a brand type of the external device or a model type of the external device. According to an embodiment, the memory may store audio duration information corresponding to each brand of a plurality of external devices, or store audio duration information corresponding to each model type of the external device.

[0122] For example, the processor 120 may identify the type of the second device based on identification information (e.g., model name or ID information) of the second device that performs communication with the electronic apparatus 100, and identify audio duration information corresponding to the second device based on information stored in the memory. Then, the processor 120 may identify the duration of the first time interval based on the identified duration information.

[0123] According to the above example, the first time interval may be identified based on information corresponding to the characteristics of each user (eg, the user's usage history), and thus, whether the audio data received from the second device is an alarm may be identified in consideration of each user's situation.

[0124] Figure 6 is a flow chart illustrating a method of identifying a duration of a first time interval in accordance with one or more embodiments.

[0125] According to one or more embodiments, the electronic device 100 may include a memory storing audio duration information corresponding to a plurality of application types. Here, the audio duration information corresponding to a plurality of application types may be information associated with the duration (or audio play time) of the audio used to perform the alarm function corresponding to each application.

[0126] According to an example, when a text message is received in the electronic device 100 and the duration (or amount) of maintaining an alarm corresponding to the reception of the text message is 3 seconds, the alarm duration corresponding to the text application may be 3 seconds, and the alarm duration corresponding to the morning call application may be 8 seconds. However, the present disclosure is not limited thereto, and may further include audio duration information corresponding to an application that provides an alarm to a user (such as different types of applications, for example but not limited to, a messenger application, a social network service (SNS) application, etc.).

[0127] According to an example, the memory may store information associated with audio durations corresponding to respective application types, and the control method may include identifying a duration of the first time interval based on the information stored in the memory.

[0128] refer to Figure 6 According to one or more embodiments, the control method may include identifying whether an audio playback start signal is received from a second device when the first audio is output (S610). According to an embodiment, the control method may include: when the first audio is output based on audio data received from the first device, identifying whether an audio playback start signal is received from the second device.

[0129] Then, the control method according to one or more embodiments may include identifying type information of an application corresponding to the audio (S620). According to an example, when a text message (or, text message application) alert is received from the second device, the control method may include identifying the type of audio received from the second device as a text message alert based on information stored in the memory.

[0130] According to an embodiment, in the audio playback start signal received from the second device and the audio-associated information (or, audio information) including audio data corresponding to the audio, identification information associated with the application corresponding to the audio (e.g., metadata corresponding to each application) may be included.

[0131] Alternatively, the control method according to an example may include identifying an application type corresponding to the alarm by inputting audio data corresponding to the alarm in a trained neural network model.

[0132] Then, the control method according to one or more embodiments may include identifying audio duration information corresponding to the identified type of application ( S630 ).

[0133] According to an example, when the type of alarm received from the second device is identified as a text message alarm, the control method may include identifying the alarm duration information corresponding to the text message application identified based on the information stored in the memory as 2 seconds. However, the present disclosure is not limited thereto, and the alarm duration information corresponding to multiple application types may vary according to user input, etc.

[0134] Then, the control method according to one or more embodiments may include identifying a duration of the first time interval based on the identified audio duration information ( S640 ).

[0135] According to an example, the control method may include: based on the alarm duration information corresponding to the identified text message application being identified as 2 seconds, identifying the identified alarm duration of 1 second as the duration of the first time interval. Therefore, the control method may include: based on receiving a stop signal for the alarm within 1 second from the time point when the second device outputs (or plays) the alarm, ending the output of the alarm and sending a play request signal for the first audio to the first device.

[0136] Return to reference Figure 2 , the processor 120 according to one or more embodiments may identify a duration of the first time interval based on a user input.

[0137] According to an example, the electronic device 100 may further include a user interface, and the processor 120 may identify the duration of the first time interval based on the received user input based on the user input corresponding to the duration of the first time interval received through the user interface. In this case, the processor 120 according to the example may display a user interface (UI) for receiving the user input corresponding to the duration of the first time interval through the display.

[0138] For example, the processor 120 may identify the duration of the first time interval as 8 seconds based on the received user input for setting the duration of the first time interval to 8 seconds, based on the received user input.

[0139] However, the present disclosure is not limited thereto, and the processor 120 according to an embodiment may receive user input information for identifying the duration of the first time interval from the first device or the second device, and identify the duration of the first time interval based thereon.

[0140] Figure 7 is a flow chart illustrating a method of identifying a type of audio according to one or more embodiments.

[0141] refer to Figure 7First, the control method according to one or more embodiments may include receiving a second audio playback start signal and second audio information including second audio data (or, information associated with the second audio) from a second device (S710). Here, the second audio data may be data associated with a digital signal corresponding to the audio played in the second device.

[0142] Then, the control method according to one or more embodiments may include identifying whether the second audio is an alarm type based on the second audio data or the history information corresponding to the second device (S720). According to an embodiment, the control method may include identifying whether the second audio is an alarm type by comparing the second audio data with sample data associated with the alarm.

[0143] For example, the memory may store audio data associated with an alarm (or, sample data associated with an alarm) corresponding to each application that performs an alarm function, and the processor 120 may identify whether the second audio is an alarm type by comparing the audio data associated with the alarm stored in the memory.

[0144] Alternatively, the control method according to the embodiment may also include: identifying whether the second sound is an alarm category based on historical information corresponding to the second device. According to the embodiment, the memory may store historical information associated with applications used by the user, and the control method may include identifying whether the second audio is an alarm type by comparing audio data associated with an alarm corresponding to each application used by the user and the second audio data based on the information stored in the memory.

[0145] Then, according to one or more embodiments, based on the second audio being identified as an alarm type based on the second audio data or historical information corresponding to the second device (yes), the control method may include identifying whether a second audio stop signal is received from the second device during a first time interval from when the second audio is output (S730).

[0146] According to an embodiment, based on the second audio being identified as not being an alarm type based on the second audio data or history information corresponding to the second device (No), the control method may include continuously outputting the second audio currently being output.

[0147] Then, according to one or more embodiments, when a second audio stop signal is received from the second device during the first time interval (Yes), the control method may include transmitting a play request signal of the first audio to the first device (S740).

[0148] Return to reference Figure 2 According to one or more embodiments, the processor 120 may also use a trained neural network model to identify whether the second audio is an alarm type.

[0149] The processor 120 may process the input data according to predefined operating rules or an artificial intelligence model stored in the memory. The predefined operating rules or artificial intelligence model (or neural network model) may be created through learning.

[0150] The "created by learning" mentioned here refers to creating a predefined operating rule or artificial intelligence model with desired characteristics by applying a learning algorithm to multiple learning data. The above learning can be performed in the device itself in which the artificial intelligence according to the present disclosure is executed, or by a separate server and / or system.

[0151] According to an embodiment, the electronic device 100 may further include a memory in which a trained neural network model is stored. The artificial intelligence model may be formed by a plurality of neural network layers. At least one layer may include at least one weight value, and the processing of the layer is performed by the processing result of the previous layer and at least one defined process. Examples of neural networks may include convolutional neural networks (CNNs), deep neural networks (DNNs), recurrent neural networks (RNNs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), deep Q networks, and transformers, and unless otherwise specified, the neural networks of the present disclosure are not limited to the above examples.

[0152] A learning algorithm may be a method for training a predetermined target machine (e.g., a robot) to make decisions or predictions on its own using a plurality of learning data. Examples of learning algorithms may include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, and unless otherwise specified, the learning algorithms of the present disclosure are not limited to the above examples.

[0153] According to an example, the processor 120 can identify whether the second audio is an alarm type by inputting the second audio data into the trained neural network model. In this case, the trained neural network model can be trained using multiple application types that perform alarm functions and audio data associated with alarms (or, sample data associated with alarms) corresponding to the multiple applications as learning data.

[0154] Therefore, the electronic device 100 may be able to identify the type of the second audio based on the audio data and the history information, and if the second audio is identified as an alarm type, the electronic device 100 may output the first audio again when the output of the second audio ends.

[0155] Figure 8 is a flowchart illustrating a control method of receiving a second audio play start signal of the same type according to one or more embodiments.

[0156] refer to Figure 8First, the control method according to one or more embodiments may include identifying whether an audio play start signal of the same type as the second audio play start signal is received greater than or equal to a preset number of times during a second time interval (S810). Here, the second time interval may refer to a time interval from a time point when the second audio play start signal is first received in the electronic device 100 to a time point when a preset time has passed.

[0157] According to an example, the same type of audio play start signal may be audio corresponding to the same type of application, but is not limited thereto, and according to an example may be audio received from the same device.

[0158] According to an example, a play start signal associated with a text message alert received from the second device may be assumed. If the duration of the second time interval is 10 seconds, the control method may include: identifying the number of times the play start signal corresponding to the text message alert is received before 10 seconds have passed from the time point when the play start signal corresponding to the text message alert is first received. According to an example, the control method may include identifying whether the number of identified receptions is greater than or equal to a preset number of times (e.g., 3 times).

[0159] Then, based on receiving an audio playback start signal of the same type as the second audio playback start signal from the second device during the second time interval greater than or equal to a preset number of times (yes), the control method according to one or more embodiments may include ending the output of the second audio and sending a playback request signal for the first audio to the first device (S820).

[0160] According to an example, the control method may end the output of the alarm and send a play request signal for the first audio to the first device based on the same type of alarm as the text message alarm being received 4 times and thus exceeding 3 times (which is a preset number of times during 10 seconds as the second time interval).

[0161] Therefore, the electronic device 100 may end the output of the alarm based on the same alarm being repeated and played, and may be able to output the first audio that was previously played, and thus, user satisfaction may be improved.

[0162] Return to reference Figure 2 According to one or more embodiments, the first audio output after receiving the playback start signal of the first audio corresponding to the playback request signal of the first audio can be output again based on the first playback time point from the playback time point (or, output time point) before the preset time to the first playback time point at which the output of the first audio is stopped.

[0163] For example, when the output of the first audio is stopped at a time point 30 seconds after the start of the first audio being output, the first play time point may be a time point at a time point 30 seconds after the start of the output of the first audio. When a play start signal of the first audio corresponding to the play request signal of the first audio is received, the first audio may be output again based on the play time point before the threshold time (e.g., 5 seconds). In the above example, the first audio may be output again based on the play time point at a time point 25 seconds after the start of the first audio being output.

[0164] However, the present disclosure is not limited thereto, and when a play start signal of the first audio corresponding to a play request signal of the first audio is received according to an example, the first audio may be output again based on the first play time point at which the output of the first audio is stopped.

[0165] For example, when the output of the first audio is stopped at a time point of 30 seconds after the start of the first audio being output, the first playback time point may be a playback time point of 30 seconds after the start of the first audio being output. In this case, the first audio may be output again based on the time point of 30 seconds after the start of the first audio being output.

[0166] Fig. 9 is a sequence diagram illustrating a control method of an electronic device according to one or more embodiments.

[0167] refer to Fig. 9 First, according to one or more embodiments, the first device 200 may send a play start signal of the first audio to the electronic apparatus 100 (S910). According to an example, the first device 200 may send information associated with the first audio to the electronic apparatus 100 through a communication interface based on a preset event that occurs (for example, receiving a user input for playing the first audio), and the information includes the play start signal of the first audio and the first audio data.

[0168] Then, the electronic device 100 according to one or more embodiments may output the first audio (S920). According to an example, the electronic device 100 may output the first audio through an outputter based on the first audio data based on the play start signal of the first audio and the information associated with the first audio data received from the first device 200. The outputter may include a speaker, a display, a vibration generator, etc., but is not limited thereto, and may be formed in various embodiments that transmit information in a form that can be sensed by the five senses of the user.

[0169] Then, the second device 300 according to one or more embodiments may send a second audio play start signal (S930) to the electronic apparatus 100. According to an example, the second device 300 may send a play start signal for playing an alarm associated with a text message and information associated with the alarm including audio data associated with the alarm to the electronic apparatus 100 through a communication interface based on a preset event that occurs (e.g., an alarm event that occurs based on receiving a text message in the second device).

[0170] Then, the electronic apparatus 100 according to one or more embodiments may output the second audio (S940). According to an example, the electronic apparatus 100 may output the alarm through the outputter based on the audio data associated with the alarm based on the information associated with the alarm including the alarm play start signal associated with the text message received from the second device.

[0171] Then, the second device 300 according to one or more embodiments may send a second audio stop signal to the electronic apparatus 100 (S950). According to an example, when the alarm play time (eg, 2 seconds) associated with the text message elapses, the second device 300 may send a stop signal of the alarm to the electronic apparatus 100.

[0172] However, the present disclosure is not limited thereto, and the stop signal of the alarm may be transmitted to the electronic device 100 as one communication packet through a play start signal of the alarm and an audio data packet associated with the alarm.

[0173] Then, the electronic apparatus 100 according to one or more embodiments may end output of the second audio (S960). According to an example, when a stop signal of the text message alarm is received from the second device 300 due to a preset time elapse (S950), the electronic apparatus 100 may end output of the text message alarm.

[0174] Then, the electronic device 100 according to one or more embodiments may send a play request signal (S970) to the first device 200. According to an example, the electronic device 100 may end the output of the text message alarm based on receiving an alarm stop signal of the text message from the second device 300 during a time point of 3 seconds (which is the duration of the first time interval) from the time point of outputting the text message alarm, and send a play request signal of the first audio to the first device 200 through the communication interface 110.

[0175] Then, the first device 200 according to one or more embodiments may send a play start signal to the electronic apparatus 100 (S980). According to an example, the first device 200 may send a play start signal of the first audio and information associated with the first audio including the first audio data to the electronic apparatus 100 based on the play request signal of the first audio received from the electronic apparatus 100.

[0176] In such a case, even when there is no separate user input, the first device 200 according to the example can send information associated with the first audio including a play start signal of the first audio to the electronic device 100 based on the play request signal of the first audio received from the electronic apparatus 100. That is, even if the user of the first device 200 does not separately provide an input for playing the first audio, the first audio can be played.

[0177] Then, the electronic device 100 according to one or more embodiments may output the first audio (S990). According to an example, the electronic device 100 may output the first audio through the outputter based on the play start signal of the first audio received from the first device 200 and the information associated with the first audio including the first audio data. In this case, the electronic device 100 according to the example may output the first audio based on the time point at which the output of the first audio stops (which is the play time point of the first audio).

[0178] Therefore, the electronic device 100 can play the first audio again after the output of the alarm ends based on the alarm received from the second device 300 ending within the preset time, and thus, the problem of no longer outputting the audio after the alarm ends can be solved. Therefore, user satisfaction and convenience can be increased.

[0179] Fig.10 is a diagram schematically illustrating an implementation of an electronic device according to one or more embodiments.

[0180] The electronic device 100 according to one or more embodiments may be implemented as a speaker, but is not limited thereto, and may also be implemented as Fig.10 According to an example, when the electronic device 100 is implemented as the server 1000, the processor 120 may receive information associated with the first audio from the first device 1020 through the communication interface 110, and receive information associated with the alarm from the second device 1030. Alternatively, the processor 120 according to the example may also send a play request signal associated with the first audio to the first device 1020 through the communication interface 110.

[0181] refer to Fig.10According to one or more embodiments, when information associated with the first audio including a playback start signal of the first audio is received from the first device 1020, the processor 120 may send first audio data for outputting the first audio to the speaker 1010 through the communication interface 110.

[0182] According to one or more embodiments, when an alarm stop signal is received during a first time interval from a time point when the first audio is output, the processor 120 may send a control signal for ending the output of the alarm to the speaker 1010 through the communication interface 110. The speaker 1010 according to the example may be a speaker with a Bluetooth function, but is not limited thereto.

[0183] According to one or more embodiments, based on the electronic device 100 being implemented as the server 1000, the server 1000 may identify whether an alarm stop signal is received during a first time interval from a time point when the first audio is output. According to an example, based on the electronic device 100 being implemented as the server 1000, the processor 120 may receive history information corresponding to the second device 1030, and based on this, identify the duration of the first time interval.

[0184] According to one or more embodiments, the electronic device 100 and the plurality of devices 1010 to 1030 may be implemented as an Internet of Things (IoT) system. Based on the electronic device 100 and the plurality of devices 1010 to 1030 being implemented as an IoT system, the electronic device 100 and the plurality of devices 1010 to 1030 may perform communication between each of the terminal devices.

[0185] The electronic device 100 according to one or more embodiments may be implemented not only as a speaker and a server but also as a user terminal capable of outputting sound, such as a smart phone.

[0186] Fig.11 is a block diagram illustrating a detailed configuration of an electronic device according to one or more embodiments.

[0187] refer to Fig.11 , the electronic device 100' according to one or more embodiments may include a communication interface 110, a processor 120, a memory 130, a speaker 140, a user interface 150, a microphone 160, a display 170, a sensor 180, and an input and output interface 190. Fig.11 The configuration shown is Figure 2 The configuration shown overlays a detailed description of the configuration.

[0188] The memory 130 may store data required for various embodiments. The memory 130 may be implemented in the form of a memory embedded in the electronic device 100' according to data storage usage, or in the form of a memory that can be attached to the electronic device 100' and can be removed from the electronic device 100'. For example, data for driving the electronic device 100' may be stored in a memory embedded in the electronic device 100', and data for the extended functions of the electronic device 100' may be stored in a memory that can be attached to the electronic device 100' and can be removed from the electronic device 100'. The memory embedded in the electronic device 100' may be implemented as at least one of a volatile memory (e.g., a dynamic random access memory (DRAM), a static RAM (SRAM), or a synchronous dynamic RAM (SDRAM), etc.) or a non-volatile memory (e.g., a one-time programmable read-only memory (OTPROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., a NAND flash memory or a NOR flash memory, etc.), a hard disk drive, or a solid state drive (SSD)). In the case where the memory is attachable to and detachable from the electronic device 100', the memory can be implemented in a form such as, for example, but not limited to, a memory card (e.g., Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (micro-SD), Mini Secure Digital (mini-SD), Extreme Digital (xD), Multi Media Card (MMC)), etc.), an external memory connectable to a USB port (e.g., Universal Serial Bus (USB) memory), etc.

[0189] The speaker 140 may be formed by a tweeter for playing high-frequency sounds, a mid-frequency speaker for playing mid-frequency sounds, a woofer for playing low-frequency sounds, a subwoofer for playing ultra-low-frequency sounds, a housing for controlling resonance, a crossover network for dividing the frequency of an electrical signal input to the speaker by frequency band, and the like.

[0190] The speaker 140 may output a sound signal to the outside of the electronic device 100'. The speaker 140 may output multimedia playback, recording playback, various notification sounds, voice messages, etc. The electronic device 100' may include an audio output device such as the speaker 140, but may include an output device such as an audio output terminal. Specifically, the speaker 140 may provide acquired information, information manufactured and produced based on the acquired information, response results or operation results associated with the user's voice, etc. in the form of voice.

[0191] The user interface 150 may be implemented with devices such as buttons, a touch pad, a mouse, and a keyboard, or may be implemented as a touch screen, a remote controller transceiver, etc., and may perform the above-mentioned display function or operation input function together therewith. The remote controller transceiver may receive a remote controller signal from an external remote control device or send a remote controller signal through at least one communication method among infrared communication, Bluetooth communication, or Wi-Fi communication.

[0192] The microphone 160 may refer to a module that obtains sound and converts it into an electrical signal, and may be a condenser microphone, a ribbon microphone, a dynamic microphone, a piezoelectric device microphone, a carbon microphone, or a micro-electromechanical system (MEMS) microphone. In addition, the above may be implemented in omnidirectional, bidirectional, unidirectional, sub-cardioid, super-cardioid, or hyper-cardioid methods.

[0193] Various embodiments in which the electronic device 100 ′ performs an operation corresponding to a user voice signal received through the microphone 160 may be provided.

[0194] In an example, the electronic device 100' may control the display 170 based on a user voice signal received through the microphone 160. For example, if a user voice signal for displaying content A is received, the electronic device 100' may control the display 170 to display content A.

[0195] In another example, the electronic device 100' may control an external display device connected to the electronic device 100' based on a user voice signal received through the microphone 160. Specifically, the electronic device 100' may generate a control signal for controlling the external display device for an operation corresponding to the user voice signal to be performed in the external display device, and send the generated control signal to the external display device. Here, the electronic device 100' may store a remote control application for controlling the external display device. Then, the electronic device 100' may send the generated control signal to the external display device using at least one communication method among Bluetooth, Wi-Fi, or infrared methods. For example, if a user voice signal for displaying content A is received, the electronic device 100' may send a control signal for controlling the display of content A in the external display device to the external display device. Here, the electronic device 100' may refer to various terminal devices, such as smart phones, artificial intelligence (AI) speakers, etc., on which a remote control application may be installed.

[0196] In another example, the electronic device 100' may use a remote control device to control an external display device connected to the electronic device 100' based on a user voice signal received through the microphone 160. Specifically, the electronic device 100' may send a control signal for controlling the external display device to the remote control device for an operation corresponding to the user voice signal to be performed in the external display device. The remote control device may then send the control signal received from the electronic device 100' to the external display device. For example, if a user voice signal for displaying content A is received, the electronic device 100' may send a control signal for controlling content A to be displayed in the external display device to the remote control device, and the remote control device may send the received control signal to the external display device.

[0197] According to one or more embodiments, the electronic device 100 ′ may include a display 170 . Specifically, the electronic device 100 ′ may directly display the obtained image or content in the display 170 .

[0198] According to other embodiments, the electronic device 100' may not include the display 170. The electronic device 100' may be connected to an external display device, and an image or content stored in the electronic device 100' may be sent to the external display device. Specifically, the electronic device 100' may send an image or content to the external display device together with a control signal for controlling the image or content to be displayed in the external display device. Here, the external display device may be connected to the electronic device 100' through the communication interface 110 or the input and output interface 190. For example, the electronic device 100' may not include a display such as a set-top box (STB). In addition, the electronic device 100' may include only a small-scale display that can display only simple information such as text information. Here, the electronic device 100' may send an image or content to an external display device by wire or wirelessly through the communication interface 110, or send an image or content to an external display device through the input and output interface 190.

[0199] The display 170 may be implemented as a display including an emissive device or a display including a non-emissive device and a backlight. For example, the display 170 may be implemented as various types of displays, such as, but not limited to, a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a light emitting diode (LED), a micro LED, a mini LED, a plasma display panel (PDP), a quantum dot (QD) display, a quantum dot light emitting diode (QLED), etc. In the display 170, a driving circuit, a backlight unit, etc. that may be implemented in the form of an a-si TFT, a low temperature polysilicon (LTPS) TFT, an organic TFT (OTFT), etc. may be included.

[0200] The display 170 may be implemented as a touch screen coupled to a touch sensor, a flexible display, a rollable display, a three-dimensional display (3D display), a display physically coupled to a plurality of display modules, etc. The processor 120 may control the display 170 to output an output image obtained according to the various embodiments described above. Here, the output image may be a high-resolution image of 4K or greater than or equal to 8K.

[0201] The sensor 180 may include a plurality of sensors of various types. The sensor 180 may measure a physical quantity or sense an operating state of the electronic device 100', and convert the measured or sensed information into an electrical signal. The sensor 180 may include a camera, and the camera may include a lens focused on visible light and other optical signals, which are received by being reflected by an object through an image sensor, and the image sensor may sense the visible light and other optical signals. Here, the image sensor may include a two-dimensional (2D) pixel array divided into a plurality of pixels. The camera according to the example may be implemented as a depth camera.

[0202] The input and output interface 190 may be any one of a High Definition Multimedia Interface (HDMI), a Mobile High Definition Link (MHL), a Universal Serial Bus (USB), a Display Port (DP), a Thunderbolt Interface (Thunderbolt), a Video Graphics Array (VGA) Port, an RGB Port, a D-Sub (D-SUB), and a Digital Visual Interface (DVI). The input and output interface 190 may input and output at least one of an audio signal and a video signal. According to one or more embodiments, the input and output interface 190 may include a port for inputting and outputting only an audio signal and a port for inputting and outputting only a video signal as separate ports, or may be implemented as one port for inputting and outputting both an audio signal and a video signal. The electronic device 100' may send at least one of an audio signal and a video signal to an external device (e.g., an external display device or an external speaker) through the input and output interface 190. Specifically, an output port included in the input and output interface 190 may be connected to an external device, and the electronic device 100' may send at least one of an audio signal and a video signal to an external device through the output port.

[0203] According to the various embodiments described above, when audio data associated with an alarm is received from a second device while outputting audio based on data received from a first device, the audio previously being played can be output again when the output of the alarm ends, thereby increasing the usability of the electronic device. Therefore, user satisfaction can be enhanced.

[0204] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed in an electronic device of the related art. Alternatively, the methods according to the various embodiments of the present disclosure described above can be performed using a neural network (or a deep trained neural network) (i.e., a learning network model) trained based on deep learning. In addition, the methods according to the various embodiments of the present disclosure described above can be implemented using only software upgrades associated with the electronic device of the related art or only hardware upgrades. In addition, the various embodiments of the present disclosure described above can be performed by an embedded server provided in the electronic device or by an external server of the electronic device.

[0205] According to one or more embodiments of the present disclosure, the various embodiments described above may be implemented with software including instructions stored in a machine-readable storage medium (e.g., a computer). The machine may call instructions stored in the storage medium, and as a device operable according to the called instructions, may include a display device according to the above-described embodiments (e.g., display device (A)). Based on the instructions executed by the processor, the processor may perform functions corresponding to the instructions directly or using other elements under the control of the processor. The instructions may include code generated by a compiler or executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. In this article, "non-transitory" only means that the storage medium is tangible and does not include signals, and the term does not distinguish between data stored semi-permanently or temporarily stored in the storage medium. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0206] In addition, according to one or more embodiments, a method according to the various embodiments described above may be provided that is included in a computer program product. The computer program product may be exchanged between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or distributed online through an application store (e.g., PLAYSTORE™). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored in a storage medium such as a memory of a manufacturer's server, an application store's server, or a relay server, or may be temporarily generated.

[0207] In addition, each of the elements (e.g., modules or programs) according to the various embodiments described above may be formed as a single entity or multiple entities, and some of the sub-elements described above may be omitted, or other sub-elements may be further included in various embodiments. Alternatively or additionally, some elements (e.g., modules or programs) may be integrated into one entity and perform the same or similar functions performed by the corresponding corresponding elements before integration. According to various embodiments, the operations performed by a module, a program or another element may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or at least some operations may be performed in a different order, omitted or another operation may be added.

[0208] Although the present disclosure has been shown and described with reference to various exemplary embodiments of the present disclosure, it should be understood that the various exemplary embodiments are intended to be illustrative rather than restrictive. Those skilled in the art will appreciate that various changes in form and details may be made therein without departing from the true spirit and full scope of the present disclosure (including the appended claims and their equivalents).

Claims

1. An electronic device, comprising: Communication interface; as well as At least one processor configured to: Based on receiving the first audio data and the first play start signal corresponding to the first audio data from the first device through the communication interface, the first audio data is outputted, Based on receiving second audio data and a second play start signal corresponding to the second audio data from the second device through the communication interface while the first audio data is being output, the output of the first audio data is stopped and the second audio data is output, Based on the completion of the output of the second audio data, a signal requesting to play the first audio data is sent to the first device through the communication interface, and Based on receiving a first play start signal through the communication interface after sending a signal requesting to play the first audio data, the first audio data is output.

2. The electronic device according to claim 1, in, The at least one processor is further configured to: Based on receiving a play stop signal corresponding to the second audio data from the second device through the communication interface within a first time from when the output of the second audio data starts, the output of the second audio data is stopped.

3. The electronic device according to claim 2, further comprising: at least one memory storing at least one of history information corresponding to a device or audio duration information corresponding to a plurality of application types, Wherein, the at least one processor is further configured to: Based on receiving a play stop signal through the communication interface during the first time period, and based on at least one of the historical information or the audio duration information, the output of the second audio data is stopped, and a signal requesting the first audio data to be played is sent to the first device through the communication interface.

4. The electronic device according to claim 3, in, The at least one processor is further configured to: Based on receiving a second play start signal from the second device through the communication interface when the first audio data is output, identifying type information of an application among the plurality of application types corresponding to the second audio data, and A duration of the first time is identified based on the type information of the identified application and the audio duration information.

5. The electronic device according to claim 2, further comprising: User interface, Wherein, the at least one processor is further configured to: A duration of the first time is identified based on user input received through the user interface.

6. The electronic device according to claim 2, in, The at least one processor is further configured to: Based on receiving a second play start signal and second audio data from a second device through the communication interface, identifying whether the second audio data is of an alarm type based on at least one of the second audio data or history information corresponding to the second device, Based on the second audio data being identified as an alarm type, identifying whether a play stop signal is received from the second device via the communication interface during the first time, and Based on identifying that a play stop signal is received during the first time, a signal requesting to play the first audio data is sent to the first device through the communication interface.

7. The electronic device according to claim 6, further comprising: at least one memory for storing the trained neural network model, Wherein, the at least one processor is further configured to: Whether the second audio data is of an alarm type is identified by inputting the second audio data into the trained neural network model.

8. The electronic device according to claim 1, in, The at least one processor is further configured to: Based on the fact that during a second time interval from when the second play start signal is received from the second device, the number of times a signal corresponding to the same type as the second play start signal is received through the communication interface is greater than or equal to a preset number, the output of the second audio data is stopped.

9. The electronic device according to claim 1, further comprising: Output, The second audio data is of an alarm type, and Wherein, the at least one processor is further configured to: Based on receiving a first play start signal from the first device through the communication interface, outputting the first audio data through the outputter, Based on receiving a second play start signal from the second device through the communication interface when the first audio data is output, outputting the second audio data through the outputter, and Based on receiving a first play start signal through the communication interface in response to a signal requesting play of the first audio, the first audio data is output through the outputter.

10. The electronic device according to claim 1, in, The at least one processor is further configured to: Based on receiving a first playback start signal through the communication interface in response to a signal requesting to play the first audio data, the first audio data is output from a second playback time point in the first audio data, the second playback time point being prior to the first playback time point by a preset time interval, and the first playback time point corresponding to the playback time point in the first audio data when the output of the first audio data stops.

11. A method for controlling an electronic device, the method comprising: outputting the first audio data based on receiving the first audio data and a first play start signal corresponding to the first audio data from the first device; based on receiving second audio data and a second play start signal corresponding to the second audio data from the second device while the first audio data is being output, stopping the output of the first audio data and outputting the second audio data; Based on the completion of output of the second audio data, sending a signal requesting to play the first audio data to the first device; as well as Based on receiving a first play start signal after transmitting a signal requesting play of the first audio data, the first audio data is output.

12. The method according to claim 11, wherein: Sending a signal requesting to play the first audio includes: Based on receiving a play stop signal corresponding to the second audio data from the second device within a first time from when the output of the second audio data starts, the output of the second audio data ends.

13. The method according to claim 12, wherein: The sending of the signal requesting to play the first audio further includes: Based on receiving a play stop signal from the second device during the first time period, and based on at least one of the historical information corresponding to the device stored in the memory of the electronic device or the audio duration information corresponding to multiple application types stored in the memory, the output of the second audio data is stopped, and a signal requesting the first audio data to be played is sent to the first device.

14. The method according to claim 13, further comprising: identifying type information of an application among the plurality of application types corresponding to the second audio data based on receiving a second play start signal from the second device while the first audio is output; as well as A duration of the first time is identified based on the type information of the identified application and the audio duration information.

15. A non-transitory computer-readable recording medium having stored therein instructions, which when executed by at least one processor cause the at least one processor to execute a method of controlling an electronic device, the method comprising: outputting the first audio data based on receiving the first audio data and a first play start signal corresponding to the first audio data from the first device; based on receiving second audio data and a second play start signal corresponding to the second audio data from a second device while outputting the first audio data, stopping the output of the first audio data and outputting the second audio data; Based on the completion of output of the second audio data, sending a signal requesting to play the first audio data to the first device; as well as Based on receiving a first play start signal after transmitting a signal requesting play of the first audio data, the first audio data is output.

Images