Electronic device and operating method thereof

Abstract

To improve sound by selecting a main speaker and a sub-speaker according to information about each speaker if audio is output through a speaker built in an electronic device and an external speaker.SOLUTION: An electronic device comprises: a built-in speaker; a wireless communication interface configured to communicate with an external speaker; and a controller. The controller is configured to: acquire first output information of the built-in speaker and second output information of the external speaker S301, S303; and, based on the first output information and the second output information S305, output a first audio signal to the built-in speaker S307, S309, and transmit a second audio signal to the external speaker through the wireless communication interface S311.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to electronic devices. [Background technology]

[0002] Digital TV services using wired or wireless communication networks are becoming popular, and digital TV services can provide a variety of services that could not be provided by the existing analog broadcasting services.

[0003] For example, IPTV (Internet Protocol Television) and smart TV services, which are types of digital TV services, provide bidirectionality that allows users to actively select the type of program they want to watch, the viewing time, etc. Based on this bidirectionality, IPTV and smart TV services can also provide various additional services, such as internet search, home shopping, online games, etc.

[0004] Recently, to enhance the sound field, users listen to audio through the TV's built-in speakers and external speakers.

[0005] However, in the past, the speakers built into the TV always output the main audio, and an external device connected to the TV output the sub-audio, which meant that it was not possible to provide optimal sound.

[0006] That is, in the conventional technology, the role of each speaker is limited regardless of the output information or characteristic information of the speakers built into the TV and the external device. Summary of the Invention [Problem to be solved by the invention]

[0007] The object of the present disclosure is to improve sound quality by selecting a main speaker and a sub speaker according to information on each speaker when audio is output through a speaker built into an electronic device and an external speaker.

[0008] The object of the present disclosure is to provide optimal sound quality by controlling audio transmitted to each speaker or selecting a role for each speaker based on the audio output of each speaker built into an electronic device and an external speaker. [Means for solving the problem]

[0009] An electronic device according to an embodiment of the present disclosure may include a speaker, a wireless communication interface for communication with an external speaker, and a controller that acquires first output information of the speaker and second output information of the external speaker, outputs a first audio signal to the speaker based on the first output information and the second output information, and transmits a second audio signal to the external speaker via the wireless communication interface.

[0010] An operating method of an electronic device according to an embodiment of the present disclosure may include the steps of acquiring first output information of a speaker built into the electronic device and second output information of an external speaker, outputting a first audio signal to the speaker based on the first output information and the second output information, and transmitting a second audio signal to the external speaker via the wireless communication interface. Effect of the Invention

[0011] According to an embodiment of the present disclosure, when audio is output through a speaker built into an electronic device and an external device, optimal sound quality is provided, improving a user's listening satisfaction.

[0012] According to an embodiment of the present disclosure, the roles of the electronic device speaker and the external speaker are automatically set without a separate user operation to provide optimal sound. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram showing the configuration of an electronic device according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram illustrating a configuration of an audio output system according to an embodiment of the present disclosure. [Diagram 3] FIG. 3 is a ladder diagram illustrating a method of operation of an audio output system according to one embodiment of the present disclosure. [Figure 4] FIG. 4 is a flowchart illustrating a process of setting a main speaker and a sub-speaker based on output information according to an embodiment of the present disclosure. [Diagram 5] FIG. 5 is a diagram illustrating an example of changing an audio component of a speaker of an electronic device according to audio channel information of an external device set as a main speaker according to an embodiment of the present disclosure. [Figure 6] FIG. 6 is a flowchart illustrating a process of determining a main speaker and a sub-speaker by comparing a first audio output from an internal speaker and a second audio output from a speaker of an external device according to an embodiment of the present disclosure. [Figure 7a] FIG. 7a is a diagram showing an example of determining the main speaker and the sub-speaker according to the average output volume of the audio. [Figure 7b] FIG. 7b is a diagram showing an example of determining the main speaker and the sub-speaker according to the average output volume of the audio. [Figure 8] FIG. 8 is a flowchart illustrating a process of determining a main speaker and a sub-speaker according to yet another embodiment of the present disclosure. [Figure 9] FIG. 9 is a flowchart illustrating a process of setting speakers based on an output deviation between a first audio output from an internal speaker and a second audio output from an external speaker. [Figure 10]FIG. 10 is a diagram illustrating a notification that is output when the characteristics of an external speaker are not suitable for configuring an audio system according to an embodiment of the present disclosure. [Figure 11a] FIG. 11a is a flow chart illustrating the operation when a new external device is connected to the electronic device. [Figure 11b] FIG. 11b is a diagram illustrating user guide information according to an embodiment of the present disclosure. [Figure 12] FIG. 12 is a diagram illustrating an example of changing a main speaker according to an embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram illustrating an example of enhancing the output of a speaker of an electronic device based on the power supply of an external speaker. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, the embodiments of the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "section" for components used in the following description are given or mixed together to facilitate the writing of the specification and do not have any mutually distinguishing meanings or roles by themselves.

[0015] The electronic device according to the embodiment of the present invention is an intelligent electronic device that adds a computer-assisted function to a broadcast receiving function, and has an interface that is more convenient to use than a handwritten input device, a touch screen, a spatial remote control, etc., by adding an Internet function to the broadcast receiving function. Also, by connecting to the Internet and a computer with the support of a wired or wireless Internet function, it is possible to perform functions such as e-mail, web browsing, banking, and games. A standardized general-purpose OS can be used for such various functions.

[0016] Therefore, the electronic device described in the present invention can perform various user-friendly functions since various applications can be freely added or deleted on a general-purpose OS kernel. More specifically, the electronic device can be a network TV, HBBTV, smart TV, LED TV, OLED TV, etc., and can also be applied to a smartphone in some cases.

[0017] FIG. 1 is a block diagram showing the configuration of an electronic device according to an embodiment of the present invention.

[0018] Referring to FIG. 1, the electronic device 100 may include a broadcast receiving unit 130, an external device interface 135, a memory 140, a user input interface 150, a controller 170, a wireless communication interface 173, a display 180, a speaker 185, and a power supply circuit 190.

[0019] The broadcast receiving unit 130 may include a tuner 131 , a demodulator 132 , and a network interface 133 .

[0020] The tuner 131 can select a specific broadcast channel in response to a channel selection command, and can receive a broadcast signal for the selected specific broadcast channel.

[0021] The demodulator 132 can separate the received broadcast signal into a video signal, an audio signal, and a data signal related to the broadcast program, and can restore the separated video signal, audio signal, and data signal into a form that can be output.

[0022] The external device interface 135 can receive an application or a list of applications in an adjacent external device and transmit it to the controller 170 or the memory 140 .

[0023] The external device interface 135 may provide a connection path between the electronic device 100 and an external device. The external device interface 135 may receive one or more of video and audio output from an external device connected to the electronic device 100 wirelessly or via a wire, and transmit the video and audio to the controller 170. The external device interface 135 may include a plurality of external input terminals. The plurality of external input terminals may include an RGB terminal, one or more HDMI (High Definition Multimedia Interface) terminals, and a component terminal.

[0024] A video signal from an external device input via the external device interface 135 is output via a display 180. An audio signal from an external device input via the external device interface 135 is output via a speaker 185.

[0025] The external device that can be connected to the external device interface 135 may be any one of a set-top box, a Blu-ray player, a DVD player, a game console, a sound bar, a smartphone, a PC, a USB memory, and a home theater, but these are merely examples.

[0026] The network interface 133 may provide an interface for connecting the electronic device 100 to a wired / wireless network including the Internet. The network interface 133 may transmit or receive data to or from other users or other electronic devices via the connected network or another network linked to the connected network.

[0027] In addition, some of the content data stored in the electronic device 100 can be transmitted to other users preregistered in the electronic device 100 or to a user or an electronic device selected from other electronic devices.

[0028] The network interface 133 can connect to a specific web page via the connected network or another network linked to the connected network, i.e., can connect to a specific web page via the network and transmit or receive data to or from the server.

[0029] The network interface 133 can receive content or data provided by a content provider or a network operator, i.e., can receive content and related information such as movies, advertisements, games, VOD, and broadcast signals provided by a content provider or a network operator via a network.

[0030] In addition, the network interface 133 can receive firmware update information and update files provided by a network operator, and can transmit data to the Internet, a content provider, or a network operator.

[0031] The network interface 133 can select and receive a desired application from among applications that are open to the public via a network.

[0032] The memory 140 can store programs for each signal processing and control in the controller 170, and can store processed video, audio, or data signals.

[0033] The memory 140 can also function as a temporary storage for video, audio, or data signals input from the external device interface 135 or the network interface 133, and can store information about a specific image through a channel storage function.

[0034] The memory 140 can store an application or an application list input from the external device interface 135 or the network interface 133 .

[0035] The electronic device 100 can play content files (moving image files, still image files, music files, document files, application files, etc.) stored in the memory 140 and provide them to the user.

[0036] The user input interface 150 can transmit a signal input by the user to the controller 170 or transmit a signal from the controller 170 to the user. For example, the user input interface 150 can receive and process control signals such as power on / off, channel selection, screen setting, etc. from the remote control device 200 according to various communication methods such as Bluetooth, WB (Ultra Wideband), ZigBee, RF (Radio Frequency) communication method, or infrared (IR) communication method, or can process to transmit a control signal from the controller 170 to the remote control device 200.

[0037] In addition, the user input interface 150 can transmit control signals input from local keys (not shown) such as a power key, a channel key, a volume key, a setting value, etc. to the controller 170.

[0038] The video signal processed by the controller 170 is input to the display 180 and displayed as a video corresponding to the video signal. The video signal processed by the controller 170 is also input to an external output device via the external device interface 135.

[0039] The audio signal processed by the controller 170 is output as audio to a speaker 185. In addition, the audio signal processed by the controller 170 is input to an external output device via the external device interface 135.

[0040] The controller 170 may also control the overall operation of the electronic device 100 .

[0041] In addition, the controller 170 can control the electronic device 100 according to user commands or internal programs input via the user input interface 150, and can connect to a network to enable a user to download a desired application or application list into the electronic device 100.

[0042] The controller 170 controls the display 180 or the speaker 185 to output the channel information selected by the user together with the processed video or audio signal.

[0043] In addition, the controller 170 causes a video signal or audio signal from an external device, such as a camera or camera recorder, input via the external device interface 135 to be output via the display 180 or speaker 185 in response to an external device video playback command received via the user input interface 150.

[0044] Meanwhile, the controller 170 can control the display 180 to display an image, for example, a broadcast image inputted through the tuner 131, an external input image inputted through the external device interface 135, an image inputted through the network interface unit, or an image stored in the memory 140 can be controlled to be displayed on the display 180. In this case, the image displayed on the display 180 can be a still image or a moving image, and can be a 2D image or a 3D image.

[0045] In addition, the controller 170 may control the playback of content stored in the electronic device 100, received broadcast content, or external input content input from the outside, and the content may be in various forms such as broadcast video, external input video, audio files, still images, connected web screens, and document files.

[0046] The wireless communication interface 173 may communicate with an external device via wired or wireless communication. The wireless communication interface 173 may perform short range communication with an external device. To this end, the wireless communication interface 173 may support short range communication using at least one of Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (Wireless USB) technologies. The wireless communication interface 173 may support wireless communication between the electronic device 100 and a wireless communication system, between the electronic device 100 and another electronic device 100, or between the electronic device 100 and a network in which the electronic device 100 (or an external server) is located, via a wireless area network. The short range wireless communication network may be a wireless personal area network.

[0047] Here, the other electronic device 100 may be a wearable device (e.g., a smart watch, smart glass, HMD (head mounted display)) or a mobile terminal such as a smartphone that can exchange data with (or link with) the electronic device 100 according to the present invention. The wireless communication interface 173 can detect (or recognize) a wearable device capable of communicating with the electronic device 100 in the vicinity of the electronic device 100.

[0048] Furthermore, if the detected wearable device is a device authenticated to communicate with the electronic device 100 according to the present invention, the controller 170 can transmit at least a portion of the data processed by the electronic device 100 to the wearable device via the wireless communication interface 173. Thus, the user of the wearable device can utilize the data processed by the electronic device 100 through the wearable device.

[0049] The display 180 can convert the video signal, data signal, OSD signal processed by the controller 170 or the video signal, data signal, etc. received by the external device interface 135 into R, G, B signals, respectively, to generate driving signals.

[0050] Meanwhile, since the electronic device 100 illustrated in FIG. 1 is merely one embodiment of the present invention, some of the illustrated components may be integrated, added, or omitted depending on the specifications of the electronic device 100 actually implemented.

[0051] That is, two or more components may be integrated into one component, or one component may be divided into two or more components, as necessary. Furthermore, the functions performed by each block are merely for the purpose of explaining the embodiments of the present invention, and the specific operations and devices do not limit the scope of the present invention.

[0052] According to yet another embodiment of the present invention, unlike that shown in FIG. 1, the electronic device 100 does not have a tuner 131 and a demodulator 132, and can receive and play video via a network interface 133 or an external device interface 135.

[0053] For example, the electronic device 100 may be embodied separately as an image processing device, such as a set-top box for receiving broadcast signals or content via various network services, and a content playback device for playing back content input from the image processing device.

[0054] In this case, the operation method of the electronic device according to the embodiment of the present invention described below may be performed not only by the electronic device 100 as described with reference to FIG. 1, but also by any one of a video processing device such as a separate set-top box or a content playback device having a display 180 and a speaker 185.

[0055] FIG. 2 is a diagram illustrating a configuration of an audio output system according to an embodiment of the present disclosure.

[0056] Referring to FIG. 2, the audio output system 20 may include an electronic device 100 , a remote control device 200 and an external device 300 .

[0057] The electronic device 100 may transmit a sound source to a built-in speaker 185 and output a first audio corresponding to the sound source through the speaker 185 .

[0058] The external device 300 can transmit the same sound source as the sound source transmitted to the speaker 185 or a different sound source to the external device 300 .

[0059] The remote control device 200 may be a remote control for controlling the electronic device 100 remotely.

[0060] The remote control device 200 can collect the first audio outputted through the speaker 185 and the second audio outputted through the external device 300 through a microphone.

[0061] The remote control device 200 can transmit the collected first and second audio to the electronic device 100 .

[0062] FIG. 3 is a ladder diagram illustrating a method of operation of an audio output system according to one embodiment of the present disclosure.

[0063] In FIG. 3, it is assumed that the electronic device 100 and the external device 300 are connected to each other according to a wired communication standard or a wireless communication standard.

[0064] The wireless communication standard may be the Bluetooth standard or the Wi-Fi standard, by way of example only.

[0065] When the wireless communication standard is the Bluetooth standard, each of the wireless communication interface 173 of the electronic device 100 and the external device 300 may include a Bluetooth circuit for Bluetooth communication.

[0066] Hereinafter, the speaker 185 of the electronic device 100 may be named an internal speaker, and the speaker of the external device 300 may be named an external speaker.

[0067] Referring to FIG. 3, the controller 170 of the electronic device 100 obtains first output information of the speaker 185 (S301).

[0068] The speaker 185 may be an integral component of the electronic device 100 . In one embodiment, the first output information of the speaker 185 may include one or more of the output power included in the specification information of the speaker 185, audio channel information of the speaker 185, the actual output power of the audio output by the speaker 185, directivity information of the speaker 185, or operating frequency range information of the speaker 185.

[0069] The controller 170 may store the first output information of the speaker 185 in the memory 140 .

[0070] The controller 170 may transmit the model name of the speaker 185 to the external server via the network interface 133 and receive first output information of the speaker 185 from the external server.

[0071] The electronic device 100 may include a plurality of speakers 185 .

[0072] The controller 170 of the electronic device 100 obtains second output information of the external device 300 (S303).

[0073] In one embodiment, the controller 170 may receive information about the external device 300 from the wirelessly connected external device 300 .

[0074] The information of the external device 300 may include specification information of the external device 300. Specifically, the specification information of the external device 300 may include second output information for a speaker provided in the external device 300 and identification information of the speaker (e.g., model name).

[0075] The second output information may include at least one of output power or audio channel information of a speaker included in the external device 300, actual output power directivity information or operating frequency range information of the audio output by the speaker included in the external device.

[0076] When the controller 170 is wirelessly connected to the external device 300, the controller 170 can receive second output information from the external device 300.

[0077] In yet another embodiment, the controller 170 may transmit the model name of the speaker provided in the external device 300 to an external server via the network interface 133 and receive second output information of the speaker provided in the external device 300 from the external server.

[0078] In yet another embodiment, the controller 170 may receive the second output information of the external device 300 from the remote control device 200. The remote control device 200 may receive the second output information of the external device 300 from the external device 300 and may transmit the second output information of the external device 300 to the electronic device 100 upon a request of the electronic device 100.

[0079] Meanwhile, the controller 170 may receive the second output information from each of a plurality of external devices having a speaker. That is, the external speaker may be configured in a plurality of units.

[0080] The controller 170 of the electronic device 100 may determine, based on the first output information and the second output information, the first audio information to be transmitted to the speaker 185 of the electronic device 100 and the second audio information to be transmitted to the external device 300 (S305).

[0081] In one embodiment, the controller 170 may set one of the speaker 185 of the electronic device 100 and the speaker of the external device 300 as a main speaker and the other as a sub-speaker based on the first output information and the second output information.

[0082] This will be described with reference to FIG.

[0083] FIG. 4 is a flowchart illustrating a process of setting a main speaker and a sub-speaker based on output information according to an embodiment of the present disclosure.

[0084] The controller 170 of the electronic device 100 may compare first output information of the speaker 185 and second output information of the external device 300 (output information of a speaker provided in the external device) (S401).

[0085] Based on the comparison result, the controller 170 of the electronic device 100 may determine one of the speaker 185 and the speaker provided in the external device 300 as a main speaker and the other as a sub-speaker (S403).

[0086] In one embodiment, the controller 170 can compare a first output power of the speaker 185 with a second output power of a speaker provided in the external device 300, and determine the speaker with the larger output power as the main speaker and the speaker with the smaller output power as the sub-speaker.

[0087] The controller 170 can output main audio to the main speaker and surround audio to the sub-speakers.

[0088] If it is determined that the main speaker is the speaker 185 of the electronic device 100 and the sub-speaker is the speaker of the external device 300, the controller 170 can transmit the main audio to the speaker 185 and output the surround audio to the external device 300.

[0089] Conversely, if the main speaker is the speaker of the external device 300 and the sub-speaker is the speaker 185 of the electronic device 100, the controller 170 can transmit the main audio to the external device 300 and output the surround audio to the speaker 185.

[0090] In one embodiment, the main audio may be the audio spoken by a person in the content video, and the sub-audio (or surround audio) may be background audio, but this is merely an example.

[0091] Meanwhile, when the speaker of the external device 300 is set as the main speaker, the controller 170 can change the components of the audio output from the speaker 185 according to the audio channel information of the speaker of the external device 300 .

[0092] FIG. 5 is a diagram illustrating an example of changing an audio component of a speaker of an electronic device according to audio channel information of an external device set as a main speaker according to an embodiment of the present disclosure.

[0093] Referring to FIG. 5, 5.1 channel audio systems 300-1 to 300-5 and an electronic device 100 are illustrated.

[0094] The audio systems 300-1 to 300-5 or the speakers provided in the audio systems 300-1 to 300-5 may be external devices 300.

[0095] The audio system may include a center speaker 300-1, a left speaker 300-2, a right speaker 300-3, a rear left speaker 300-4, and a rear right speaker 300-5.

[0096] It is assumed that the center speaker 300-1 is set as the main speaker of the external device 300, and the electronic device 100 receives audio channel information (center of 5.1 channel) of the center speaker 300-1.

[0097] The electronic device 100 may control the internal speakers 185-1 and 185-2 such that the internal speakers 185-1 and 185-2 output audio by configuring two channels for a surround back according to audio channel information of the center speaker 300-1.

[0098] This creates the effect of creating a 7.1 channel audio system.

[0099] In yet another embodiment, the controller 170 of the electronic device 100 may determine the main speaker and the sub-speaker based on the first audio output from the internal speaker 185 and the second audio output from the speaker of the external device 300.

[0100] FIG. 6 is a flowchart illustrating a process of determining a main speaker and a sub-speaker by comparing a first audio output from an internal speaker and a second audio output from a speaker of an external device according to an embodiment of the present disclosure.

[0101] Referring to FIG. 6, the controller 170 of the electronic device 100 obtains an output order of the primary audio and the secondary audio (S601).

[0102] In one embodiment, the electronic device 100 may include a microphone (not shown) and may receive the first audio and the second audio via the microphone.

[0103] The microphone may be provided separately from the electronic device 100. In this case, the microphone may be provided in the remote control device 200.

[0104] The controller 170 may determine that the first audio collected by the microphone first is the audio output from the internal speaker 185, and may determine that the second audio collected later is the audio output from the speaker of the external device 300. This is because the audio delivered to the internal speaker 185 is output before the audio delivered to the speaker of the external device 300.

[0105] The controller 170 of the electronic device 100 compares the first average output magnitude of the first audio and the second average output magnitude of the second audio for a certain period of time (S603).

[0106] The fixed time may be the period during which each audio is output.

[0107] The controller 170 may measure the average power of the first audio output for a certain period of time and obtain the average power as a first average output magnitude.

[0108] The controller 170 may measure the average power of the second audio output for a certain period of time and obtain the average power as the second average output magnitude.

[0109] The reason for using the average power is to minimize the error.

[0110] Based on the comparison result, the controller 170 of the electronic device 100 determines one of the internal speaker 185 and the speaker of the external device 300 as a main speaker, and determines the remaining one as a sub-speaker (S605).

[0111] The controller 170 may determine a speaker that outputs audio with a large average output volume as a main speaker, and a speaker that outputs audio with a small average output volume as a sub-speaker.

[0112] 7a and 7b are diagrams showing an example of determining the main speaker and the sub-speaker according to the average output volume of the audio.

[0113] 7a, the electronic device 100 outputs audio to an internal speaker 185 and transmits the same audio to an external device 300. The internal speaker 185 may be provided on one side of the electronic device 100.

[0114] The remote control device 200 can collect the first audio 710 output from the internal speaker 185 and the second audio 730 output from the external device 300 .

[0115] The remote control device 200 transmits the first audio 710 and the second audio 730 to the electronic device 100 .

[0116] The remote control device 200 may recognize the first collected audio of the two audios as the first audio output from the internal speaker 185, and may recognize the later collected audio as the second audio output from the external device 300. The remote control device 200 may transmit the first audio and the second audio together with the recognition result to the electronic device 100.

[0117] The electronic device 100 may measure a first average output magnitude of the first audio and a second average output magnitude of the second audio over a period of time.

[0118] The electronic device 100 may compare the measured first and second average output magnitudes and determine the speaker that outputs the louder audio as the main speaker based on the comparison.

[0119] The electronic device 100 may transmit main audio to a speaker determined as a main speaker, and transmit sub-audio to a speaker determined as a sub-speaker.

[0120] Meanwhile, the controller 170 may scale either the first audio or the second audio before comparing the average output magnitudes of the first audio and the second audio.

[0121] This is because the distance between the speaker 185 and the remote control device 200 and the distance between the external device 300 and the remote control device 200 or the performance of each speaker may differ, resulting in a sound pressure deviation.

[0122] Referring to FIG. 7b, the electronic device 100 may obtain a sound pressure deviation value between the internal speaker 185 and the external device 300, and correct the audio output to the internal speaker 185 based on the sound pressure deviation value.

[0123] This is to prevent the sound pressure deviation value from being too large.

[0124] To this end, the electronic device 100 may obtain a sound pressure deviation value based on a difference between the amplitude of the first audio and the amplitude of the second audio, and scale the first audio if the sound pressure deviation value is equal to or greater than a preset value. Of course, the electronic device 100 may scale the second audio instead of scaling the first audio.

[0125] The electronic device 100 may scale the first audio or the second audio so that the sound pressure deviation value is less than a preset value.

[0126] Scaling may be the process of increasing or decreasing the overall loudness of an audio signal.

[0127] Before comparing the average output magnitude, audio compensation may be performed to balance the sound between the two speakers to compensate for deviations from the external speakers.

[0128] This also applies if multiple external speakers are present.

[0129] Referring again to FIG.

[0130] The controller 170 of the electronic device 100 outputs the determined first audio information to the speaker 185 (S307), and outputs a first audio signal based on the first audio information through the speaker 185 (S309).

[0131] The first audio information includes a first audio signal output by the speaker 185 of the electronic device 100 .

[0132] The first audio information may further include one or more of the type of the first audio signal transmitted to the speaker 185 of the electronic device 100 or information on whether the speaker 185 is a main speaker or a sub-speaker.

[0133] The type of the first audio signal may indicate whether the audio delivered to the speaker 185 is main audio or surround audio.

[0134] The speaker 185 of the electronic device 100 outputs the first audio signal included in the first audio information.

[0135] The controller 170 of the electronic device 100 transmits the determined second audio information to the external device 300 via the wireless communication interface 173 (S311).

[0136] The second audio information includes a second audio signal output by the speaker of the external device 300 .

[0137] The second audio information may further include at least one of the type of the second audio signal transmitted to the speaker of the external device 300 or information on whether the speaker of the external device 300 is a main speaker or a sub-speaker.

[0138] The type of the second audio signal may indicate whether the audio transmitted to the speaker of the external device 300 is main audio or surround audio.

[0139] The controller 170 can transmit the second audio information to the external device 300 according to the Wi-Fi communication standard or the Bluetooth communication standard.

[0140] The external device 300 outputs a second audio signal based on the second audio information received from the electronic device 100 (S313).

[0141] The external device 300 outputs the second audio signal included in the second audio information.

[0142] FIG. 8 is a flowchart illustrating a process of determining a main speaker and a sub-speaker according to yet another embodiment of the present disclosure.

[0143] FIG. 8 shows one embodiment of step S305 in FIG.

[0144] The controller 170 of the electronic device 100 obtains the distance between the user and the external speaker (S801).

[0145] The controller 170 can obtain the distance between the remote control device 200 and the external device 300 and the distance between the user and the external speaker, because the remote control device 200 is usually located at the user's location.

[0146] In one embodiment, the controller 170 may receive the distance between the remote control device 200 and the external device 300 from the remote control device 200. The remote control device 200 may transmit a signal to the external device 300 and measure the distance using a Received Signal Strength Indicator (RSSI) value of the received signal received from the external device 300.

[0147] In yet another embodiment, the controller 170 may receive the distance between the remote control device 200 and the external device 300 from the external device 300. The external device 300 may transmit a signal to the remote control device 200 and measure the distance using a Received Signal Strength Indicator (RSSI) value of the received signal received from the remote control device 200.

[0148] In yet another embodiment, the controller 170 may measure the distance between the user and the external device 300 using depth information of an image captured by a camera (not shown) included in the electronic device 100 .

[0149] The controller 170 determines the main speaker and the sub-speaker from among the internal speaker 185 and the external speaker based on the first output information, the second output information, and the obtained distance (S803).

[0150] In one embodiment, the controller 170 may determine that the external speaker is the main speaker if the acquired distance is within a certain distance, because the user is more sensitive to the sound output through the external speaker when the distance between the user and the external speaker is close.

[0151] Here, the certain distance may be 1 m, but this is merely an example value.

[0152] When the first output power of the internal speaker 185 is greater than the second output power of the external speaker and the distance between the user and the external device 300 is within a certain distance, the controller 170 can determine the external speaker as the main speaker and the internal speaker 185 as the sub-speaker.

[0153] That is, when the distance between the user and the external device 300 is within a certain distance, the controller 170 can determine the external speaker as the main speaker and the internal speaker 185 as the sub-speaker even if the first output power of the internal speaker 185 is greater than the second output power of the external speaker.

[0154] Thus, according to an embodiment of the present disclosure, the main speaker is determined taking into consideration the output power of each of the internal and external speakers and the position between the user and the external speaker, thereby providing sound that is more suited to the user's situation.

[0155] FIG. 9 is a flowchart illustrating a process of setting speakers based on an output deviation between a first audio output from an internal speaker and a second audio output from an external speaker.

[0156] FIG. 9 shows an embodiment that embodies step S305 in FIG.

[0157] Referring to FIG. 9, the controller 170 of the electronic device 100 determines whether the output deviation is within a certain range based on the first output information of the internal speaker 185 and the second output information of the external speaker (S901).

[0158] In one embodiment, the controller 170 may determine that the output deviation is within a certain range if the difference between the first average output magnitude of the first audio output from the internal speaker 185 and the second average output magnitude of the second audio output from the external speaker is less than a preset magnitude difference, as in the embodiment of FIG. 7a.

[0159] If the output deviation is within a certain range, the controller 170 may determine that the internal speaker 185 and the external speaker each output the same audio, or may set an audio channel according to the position of each speaker (S903).

[0160] In one embodiment, if the controller 170 determines that the output deviation is within a certain range, it may determine that the internal speaker 185 and the external speaker each output the same type of audio.

[0161] That is, if the controller 170 determines that the output deviation is within a certain range, it can operate the internal speaker 185 and the external speaker in mono mode.

[0162] The same type may be either a main audio type or a surround audio type.

[0163] In yet another embodiment, the controller 170 may set the audio channels according to the respective positions of the internal speaker 185 and the external speaker if it determines that the output deviation is within a certain range.

[0164] For example, if the internal speaker 185 is located to the right of the external speaker, the controller 170 can set the internal speaker 185 as the right channel speaker and the external speaker as the left channel speaker.

[0165] That is, the controller 170 can operate the two speakers in stereo mode if the output deviation is within a certain range and the internal speaker 185 is located to the right of the external speaker.

[0166] This allows the internal speaker 185 to output audio originating on the right side of the picture, and the external speaker to output audio originating on the left side of the picture. If the output deviation is not within a certain range, the controller 170 may set the role of each speaker according to the characteristic information of each speaker (S905).

[0167] The characteristic information of each speaker may include one or more of the following: directivity information or operating frequency range information of the speaker.

[0168] The directional information may include information regarding the direction in which the speaker transmits audio.

[0169] The operating frequency range information may include the frequency range of audio that the speaker outputs.

[0170] The first output information may further include one or more of directivity information or operating frequency range information of the internal speaker 185, and the second output information may further include directivity information or operating frequency range information of the external speaker.

[0171] In one embodiment, if the output deviation is not within a certain range and only the external speaker has directivity information, the controller 170 can set the external speaker as a directional speaker and the internal speaker 185 as a non-directional speaker.

[0172] A non-directional speaker is a speaker that transmits audio evenly into the surrounding space.

[0173] In yet another embodiment, the controller 170 can set the roles of the internal speaker 185 and the external speaker according to the operating frequency range when the output deviation is not within a certain range and the operating frequency ranges of the internal speaker 185 and the external speaker are different.

[0174] For example, the controller 170 can set the internal speaker 185 as a bass speaker if the operating frequency range of the internal speaker 185 is 20 Hz to 500 Hz, and can set the external speaker as a tweeter speaker if the operating frequency range of the external speaker is between 2 kHz and 20 kHz.

[0175] The controller 170 can deliver audio that matches the operating frequency range of each speaker.

[0176] In this way, according to an embodiment of the present disclosure, when the output deviation of each speaker is not within a certain range, an audio system can be provided that can output optimal sound by assigning each speaker a role according to its characteristics.

[0177] Meanwhile, in yet another embodiment, the controller 170 can output a notification if the output deviation is not within a certain range and the characteristics of the external speaker are not suitable for configuring the audio system.

[0178] FIG. 10 is a diagram illustrating a notification that is output when the characteristics of an external speaker are not suitable for configuring an audio system according to an embodiment of the present disclosure.

[0179] The controller 170 can display a notification 1000 on the display 180 to guide individual use when the output deviation of the audio output from the internal speaker 185 and the external speaker is not within a certain range and the characteristics of the external speaker are not suitable for forming an audio system.

[0180] For example, a case where the characteristics of an external speaker are not suitable for configuring an audio system may be when the operating frequency range of the external speaker falls outside the respective ranges of the bass, tweeter, or up-firing.

[0181] FIG. 11a is a flow chart illustrating the operation when a new external device is connected to the electronic device.

[0182] FIG. 11a is an embodiment that follows on from the embodiment of FIG.

[0183] Referring to FIG. 11a, the controller 170 of the electronic device 100 determines whether an external device is connected (S1101).

[0184] The external device may be a device that is already connected to the electronic device 100 or a new device that is not already connected to the electronic device 100.

[0185] When an external device is connected, the controller 170 determines whether a preset combination exists with the connected external device (S1103).

[0186] The memory 140 may store audio combinations between the electronic device 100 and external devices that are already connected.

[0187] The audio combination may include identification information of the external device, role information of the internal speaker 185 of the electronic device 100, and role information of the external speaker included in the external device.

[0188] The role information may include one or more of whether the speaker is a main speaker or a sub-speaker, the speaker's sound channel information, the speaker's directivity information, or a role according to the speaker's operating frequency range.

[0189] If it is determined that a previously set combination exists with the connected external device, the controller 170 sets the internal speaker 185 and the external device to a mode corresponding to the set combination (S1105).

[0190] When a preset combination between an external device connected to the memory 140 and the electronic device 100 is stored, the controller 170 can set the roles of the internal speaker 185 and the external device according to the stored combination.

[0191] For example, in a combination where the internal speaker 185 serves as a main speaker and the external device serves as a sub-speaker, the controller 170 can transmit main audio to the internal speaker 185 and surround audio to the external device.

[0192] As such, according to an embodiment of the present disclosure, if an external device is already connected to the electronic device 100, the audio system can be quickly and automatically configured using the stored audio combination.

[0193] If it is determined that there is no existing combination with the connected external device, the controller 170 obtains third output information of the new external device (S1107).

[0194] The third output information may include one or more of output power or audio channel information, directivity information, or operating frequency range information of a speaker included in the new external device.

[0195] The controller 170 can also receive location information of the new external device relative to the location of the electronic device 100 from the new external device.

[0196] The controller 170 determines whether a new audio combination is possible based on the first output information of the internal speaker 185 and the third output information of the new external device (S1109).

[0197] The controller 170 may determine that a new combination is possible when the acoustic performance of the entire audio system is complemented by the addition of a new external device.

[0198] In one embodiment, the controller 170 can determine that new audio combinations are possible when the operating frequency range of the internal speaker 185 and the operating frequency range of the external device differ.

[0199] If the controller 170 determines that a new audio combination is possible, it can set the roles of the speakers according to the characteristic information of each speaker (S1111).

[0200] The speaker characteristic information may include one or more of speaker directivity information or operating frequency range information.

[0201] The directional information may include information regarding the direction in which the speaker transmits audio.

[0202] The operating frequency range information may include the frequency range of audio that the speaker outputs.

[0203] In one embodiment, if only the new external device's speaker has directional information, the controller 170 can configure the external device's speaker as a directional speaker and the internal speaker 185 as a non-directional speaker.

[0204] In yet another embodiment, the controller 170 may set the roles of the internal speaker 185 and the speaker of the external device according to the operating frequency ranges when the operating frequency ranges of the internal speaker 185 and the speaker of the external device are different.

[0205] For example, if the operating frequency range of the internal speaker 185 is 20 Hz to 500 Hz, the controller 170 can set the internal speaker 185 as a bass speaker, and if the operating frequency range of the speaker of the external device is between 2 kHz and 20 kHz, the controller 170 can set the speaker of the external device as a tweeter speaker.

[0206] On the other hand, if the controller 170 determines that a new audio combination is possible, it may display a notification on the display 180 suggesting that a new external device may be added and connected to the audio system.

[0207] If the controller 170 determines that a new audio combination is not possible, it may output user guide information (S1113).

[0208] In one embodiment, the user guide information may include a guide for setting a new role for the speaker of the external device in relation to the electronic device 100 .

[0209] FIG. 11b is a diagram illustrating user guide information according to an embodiment of the present disclosure.

[0210] If it is determined that audio combination with the newly connected external device is not possible, the electronic device 100 may display first user guide information 1110 on the display 180 .

[0211] For example, the first user guide information 1110 may include text that guides the user to record audio output from a new external device.

[0212] If the electronic device 100 records audio output from a new external device via the microphone, it can display second user guide information 1130 on the display 180 that recommends a role for the external device based on the recorded audio.

[0213] In this manner, according to an embodiment of the present disclosure, the electronic device 100 can continuously monitor additional external devices that can be connected and assign specific roles to the external devices or provide a user with guidance for assigning roles to the external devices.

[0214] FIG. 12 is a diagram illustrating an example of changing a main speaker according to an embodiment of the present disclosure.

[0215] The electronic device 100 is a stand-type display device and includes all the components shown in FIG.

[0216] The external speaker 1200 is an example of the external device 300 of FIG.

[0217] The electronic device 100 can include a display 1210 , a shaft 1230 , and a stand base 1250 .

[0218] The shaft 1230 can connect the display 1210 and the stand base 1250. The shaft 1230 can extend vertically.

[0219] The lower end of the shaft 1230 may be connected to an end of the stand base 1250 .

[0220] The lower end of the shaft 1230 may be rotatably coupled to the periphery of the stand base 1250 .

[0221] The display 1210 and shaft 1230 can rotate about a vertical axis relative to the stand base 1250.

[0222] The upper portion of the shaft 1230 may be coupled to the rear surface of the display 1210 .

[0223] The stand base 1250 can serve to support the display 1210 .

[0224] The display 1210 may be configured to include a shaft 1230 and a stand base 1250 .

[0225] The display device 1210 can rotate about the point where the top of the shaft 1230 and the rear surface of the display 1210 meet.

[0226] The display device 1210 may also be equipped with an internal speaker (not shown).

[0227] If the output power included in the specification information of the internal speaker is greater than the output power included in the specification information of the external speaker 1200, the electronic device 100 may determine the internal speaker as the main speaker and the external speaker as the sub-speaker.

[0228] Thereafter, if the actually measured audio output power of the internal speaker is smaller than the audio output power of the external speaker 1200, the electronic device 100 can switch the main speaker to the external speaker 1200 and the sub-speaker to the internal speaker.

[0229] In this manner, according to an embodiment of the present disclosure, if the output power according to the specification information of each speaker differs from the actually measured output power, the main speaker can be changed to suit the situation to provide optimal sound.

[0230] In yet another embodiment, even if the internal speaker is determined to be the main speaker and the external speaker 1200 is determined to be the sub-speaker, the electronic device 100 can transmit surround audio and part of the main audio to the external speaker if the output power included in the specification information of the external speaker 1200 is greater than the output power included in the specification information of the internal speaker.

[0231] This is to make the most of the output performance of the external speaker 1200.

[0232] FIG. 13 is a diagram illustrating an example of enhancing the output of a speaker of an electronic device based on the power supply of an external speaker.

[0233] In FIG. 13, the electronic device 100 and the external speaker 1200 are borrowed from the example of FIG.

[0234] It is also assumed that the internal speaker of the electronic device 100 and the external speaker 1200 are outputting the same audio.

[0235] The external speaker 1200 may gradually reduce the audio output power if there is less than a certain amount of power remaining.

[0236] The electronic device 100 may receive information on the power supply of the external speaker 1200 from the external speaker 1200, and gradually increase the audio output power of the internal speaker if the power supply of the external speaker 1200 is less than a certain power supply.

[0237] This ensures that the acoustic performance of the audio system is maintained to the maximum extent possible.

[0238] The electronic device 100 can determine the main speaker based on the type of content that the electronic device 100 consumes.

[0239] For example, when a movie image is being displayed on the display 1210 of the electronic device 100, the internal speaker of the electronic device 100 may be determined to be the main speaker.

[0240] This allows the internal speaker of the electronic device 100 to output main audio (audio of a person speaking), and the external speaker 1200 to output surround audio (BGM).

[0241] According to an embodiment of the present disclosure, the above-described method may be embodied as processor-readable code on a program-recorded medium, such as a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0242] The electronic device described above is not limited to the configurations and methods of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications are possible.

Claims

1. In an electronic device, Speakers and a wireless communication interface for communicating with an external speaker; a controller that acquires first output information of the speaker and second output information of the external speaker, outputs a first audio signal to the speaker based on the first output information and the second output information, and transmits a second audio signal to the external speaker via the wireless communication interface.

2. The controller, The electronic device of claim 1 , further comprising: a step of comparing the first output information with the second output information; and determining, according to a comparison result, from among the speaker and the external speaker, a main speaker that outputs main audio and a sub-speaker that outputs surround audio.

3. The controller, 3. The electronic device of claim 2, wherein if the output power of the speaker included in the first output information is greater than the output power of the external speaker included in the second output information, the speaker is determined to be the main speaker and the external speaker is determined to be the sub-speaker.

4. The controller, transmitting identification information of the external speaker to an external server and receiving the second output information from the external server; The electronic device of claim 1 , further comprising: a first output unit configured to receive the second output information from the external speaker.

5. The controller, 3. The electronic device of claim 2, further comprising: when the external speaker is determined as the main speaker and the speaker is determined as the sub-speaker, the electronic device controls the first audio signal output from the speaker according to audio channel information of the external speaker included in the second output information.

6. The controller, comparing a first average output magnitude of a first audio output from the speaker for a certain period of time with a second average output magnitude of a second audio output from the external speaker for the certain period of time; The electronic device according to claim 2 , further comprising: determining, according to a result of the comparison, a main speaker for outputting main audio and a sub-speaker for outputting surround audio from among the speaker and the external speaker.

7. The controller, Obtaining a distance between a user and the external speaker; The electronic device of claim 1 , further comprising: determining, from among the speaker and the external speaker, a main speaker that outputs main audio and a sub-speaker that outputs surround audio, based on the first output information, the second output information, and the distance.

8. The controller, 2. The electronic device of claim 1, wherein when a difference between a first average output magnitude of a first audio output from the speaker for a certain time period and a second average output magnitude of a second audio output from the external speaker for the certain time period is less than a preset difference, the electronic device transmits the same audio signal to the speaker and the external speaker, or sets respective audio channels for the speaker and the external speaker.

9. The controller, 2. The electronic device of claim 1, further comprising: a first speaker and an external speaker configured to play a role according to characteristic information of the speaker and the external speaker when a difference between a first average output magnitude of a first audio output from the speaker for a certain period of time and a second average output magnitude of a second audio output from the external speaker for the certain period of time is equal to or greater than a preset difference.

10. The characteristic information includes directivity information, The controller, The electronic device of claim 9 , further comprising: if only the external speaker has directional information, setting the external speaker as a directional speaker and setting the speaker as a non-directional speaker.

11. The characteristic information includes an operating frequency range; The controller, The electronic device of claim 9 , wherein each of the speaker and the external speaker is set as one of a bass speaker, a tweeter speaker, or an up-firing speaker depending on the operating frequency range.

12. The controller, When a new external device is connected, it is determined whether there is a pre-stored audio combination between the new external device and the electronic device; The electronic device of claim 1 , wherein if a pre-stored audio combination exists, the roles of the speaker and the external device are set according to the pre-stored audio combination.

13. The controller obtains third output information of the external device when there is no pre-stored audio combination; The electronic device of claim 12 , further comprising: outputting a notification that the external device can be additionally connected when it is determined that a new audio combination is possible based on the third output information.

14. The controller, The electronic device of claim 13 , further comprising: setting roles based on characteristic information of the speaker and the external device, when it is determined that a new audio combination is possible based on the third output information.

15. The electronic device of claim 13 , further comprising: recommending a role for the external device if it is determined that a new audio combination is not possible based on the third output information.

16. When the output power included in the specification information of the speaker is greater than the output power included in the specification information of the external speaker, the controller determines the speaker as the main speaker and determines the external speaker as the sub-speaker; 3. The electronic device of claim 2, wherein when an output power of the audio output from the speaker is smaller than an output power of the audio output from the external speaker, the speaker is converted into the sub-speaker and the external speaker is converted into the main speaker.

17. The controller, The speaker is determined as the main speaker, the external speaker is determined as the sub-speaker, and if the output power included in the specification information of the external speaker is greater than the output power included in the specification information of the internal speaker, The electronic device of claim 2 , further comprising: a first input / output section for inputting a first audio signal to the first input / output section;

18. The electronic device of claim 1 , wherein the controller receives the first audio output by the speaker and the second audio output by the external speaker from a remote control device that controls an operation of the electronic device.

19. The electronic device according to claim 1 , wherein the speaker and the external speaker each comprise a plurality of speakers.

20. 1. A method of operating an electronic device, comprising: obtaining first output information of a speaker built into the electronic device and second output information of an external speaker; outputting a first audio signal to the speaker based on the first output information and the second output information; and transmitting a second audio signal to the external speaker via the wireless communication interface.

Images