Electronic device and control method thereof

Abstract

This electronic device comprises: a memory storing instructions; a display; and at least one processor including processing circuitry, wherein the instructions, when executed individually or collectively by the at least one processor, instruct the electronic device to: obtain content information including image frames and subtitle information; obtain a content language on the basis of the subtitle information; obtain a user language corresponding to a user of the electronic device; display a first subtitle UI corresponding to the content language via the display if the content language matches the user language; and display a second subtitle UI corresponding to the user language via the display if the content language does not match the user language.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device and a method for controlling the same that provide subtitle information corresponding to a user language.

[0002] Image content and subtitle information can be displayed together on the screen. Multiple frames included in the image content may have a set playback time. Subtitle information can be provided in correspondence with the playback time. Subtitle information can be generated based on a specific language.

[0003] Through subtitle information displayed along with image content, users can easily understand the dialogue or explanations output from the image content.

[0004] However, if subtitle information is generated in a language that is difficult for users to understand, users may be unable to use the subtitles. Additionally, users may experience the inconvenience of having to manually change the language of the subtitle information.

[0005] The present disclosure is designed to improve upon the aforementioned problems, and the purpose of the present disclosure is to provide an electronic device and a method for controlling the same that provide subtitle information corresponding to the user language by comparing the content language and the user language.

[0006] According to one embodiment, the electronic device includes at least one processor comprising a memory for storing instructions, a display, and processing circuitry, and when the instructions are executed individually or collectively by the at least one processor, the electronic device acquires content information including image frames and subtitle information, acquires a content language based on the subtitle information, acquires a user language corresponding to a user of the electronic device, and if the content language and the user language match, displays a first subtitle UI corresponding to the content language through the display, and if the content language and the user language do not match, displays a second subtitle UI corresponding to the user language through the display.

[0007] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may acquire the setting language of the OSD (On-Screen Display) of the electronic device in the user language.

[0008] The electronic device includes a microphone, and when the instructions are executed individually or collectively by the at least one processor, the electronic device may acquire a user voice through the microphone and acquire the user language corresponding to the user voice based on a language analysis model.

[0009] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may display a first guide UI through the display to provide the second subtitle UI corresponding to the user language if the content language and the user language do not match.

[0010] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may display the second subtitle UI through the display when user input for requesting the second subtitle UI is received through the first guide UI.

[0011] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may display the first subtitle UI through the display based on the first subtitle data corresponding to the content language among the subtitle information, if the content language and the user language match.

[0012] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may identify whether there is second subtitle data corresponding to the user language in the subtitle information when the user input for requesting the second subtitle UI through the first guide UI is received, and if there is second subtitle data in the subtitle information, display the second subtitle UI through the display based on the second subtitle data.

[0013] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may obtain third subtitle data by translating the first subtitle data into the user language if the second subtitle data does not exist in the subtitle information, and display the second subtitle UI through the display based on the third subtitle data.

[0014] When the above instructions are executed individually or collectively by the at least one processor, the electronic device may identify the user location and the target area corresponding to the user location within the entire area of ​​the screen displayed through the display, and display the second subtitle UI through the display in the target area, if the content language and the user language do not match.

[0015] The electronic device includes a communication interface, and if the content language and the user language do not match, it can identify an external device that can be connected to the electronic device, generate a control signal to output the second subtitle UI through the external device, and transmit the control signal to the external device through the communication interface.

[0016] According to one embodiment, a control method for an electronic device comprises the steps of: acquiring content information including an image frame and subtitle information; acquiring a content language based on the subtitle information; acquiring a user language corresponding to a user of the electronic device; displaying a first subtitle UI corresponding to the content language if the content language and the user language match; and displaying a second subtitle UI corresponding to the user language if the content language and the user language do not match.

[0017] The step of acquiring the above user language may allow the setting language of the OSD (On-Screen Display) of the electronic device to be acquired as the above user language.

[0018] The step of acquiring the user language may involve acquiring a user voice through a microphone of the electronic device and acquiring the user language corresponding to the user voice based on a language analysis model.

[0019] The above control method may include a step of displaying a first guide UI to provide a second subtitle UI corresponding to the user language if the content language and the user language do not match.

[0020] The step of displaying the second subtitle UI may be performed by displaying the second subtitle UI when user input requesting the second subtitle UI is received through the first guide UI.

[0021] The step of displaying the first subtitle UI may be performed such that, if the content language and the user language match, the first subtitle UI is displayed based on the first subtitle data corresponding to the content language among the subtitle information.

[0022] The step of displaying the second subtitle UI can be performed by, when the user input for requesting the second subtitle UI through the first guide UI is received, identifying whether second subtitle data corresponding to the user language exists in the subtitle information, and if the second subtitle data exists in the subtitle information, displaying the second subtitle UI based on the second subtitle data.

[0023] The step of displaying the second subtitle UI may, if the second subtitle data does not exist in the subtitle information, obtain third subtitle data by translating the first subtitle data into the user language and display the second subtitle UI based on the third subtitle data.

[0024] The step of displaying the second subtitle UI may, if the content language and the user language do not match, identify the user location, identify a target area corresponding to the user location among the entire area of ​​the displayed screen, and display the second subtitle UI in the target area.

[0025] If the content language and the user language do not match, the above control method may include the steps of identifying an external device connectable to the electronic device, generating a control signal for outputting the second subtitle UI through the external device, and transmitting the control signal to the external device.

[0026] FIG. 1 is a drawing for explaining a subtitle UI according to one embodiment.

[0027] FIG. 2 is a block diagram illustrating an electronic device according to one embodiment.

[0028] FIG. 3 is a block diagram illustrating the specific configuration of the electronic device of FIG. 2 according to one embodiment.

[0029] FIG. 4 is a diagram illustrating the operation of providing a first subtitle UI and a second subtitle UI according to one embodiment.

[0030] FIG. 5 is a diagram illustrating the operation of providing a first subtitle UI, a third subtitle UI, and a third subtitle UI according to one embodiment.

[0031] FIG. 6 is a diagram illustrating the operation of providing a first guide UI according to one embodiment.

[0032] FIG. 7 is a drawing for explaining a first guide UI according to one embodiment.

[0033] FIG. 8 is a drawing for explaining a first guide UI according to one embodiment.

[0034] FIG. 9 is a diagram illustrating the operation of acquiring subtitle information according to one embodiment.

[0035] FIG. 10 is a diagram illustrating an operation of providing a second subtitle UI considering the user's location according to one embodiment.

[0036] FIG. 11 is a drawing for explaining the operation of identifying a target area according to one embodiment.

[0037] FIG. 12 is a diagram illustrating an operation to identify multiple users and provide a subtitle UI according to one embodiment.

[0038] FIG. 13 is a diagram illustrating an operation to identify a user location and provide a second subtitle UI when user input is received through a first guide UI according to one embodiment.

[0039] FIG. 14 is a diagram illustrating the operation of acquiring a user language according to one embodiment.

[0040] FIG. 15 is a diagram illustrating the operation of providing a second guide UI for inputting a user language according to one embodiment.

[0041] FIG. 16 is a drawing for explaining a second guide UI according to one embodiment.

[0042] FIG. 17 is a diagram illustrating the priority of a method for acquiring a user language according to one embodiment.

[0043] FIG. 18 is a drawing for explaining a method of connecting an electronic device and a terminal device according to one embodiment.

[0044] FIG. 19 is a diagram illustrating the operation of receiving setting language or location information through a terminal device according to one embodiment.

[0045] FIG. 20 is a drawing for explaining a subtitle UI according to one embodiment.

[0046] FIG. 21 is a drawing illustrating the display position of a second subtitle UI that varies according to the user's position, according to one embodiment.

[0047] FIG. 22 is a drawing for explaining a subtitle UI provided to multiple users according to one embodiment.

[0048] FIG. 23 is a diagram illustrating an operation that provides both a content language and a user language according to one embodiment.

[0049] FIG. 24 is a diagram illustrating the display position of a second subtitle UI that varies according to the user's position, according to one embodiment.

[0050] FIG. 25 is a diagram illustrating the operation of providing a second subtitle UI in consideration of the user language according to one embodiment.

[0051] FIG. 26 is a drawing for explaining a subtitle UI provided in a situation where multiple users exist, according to one embodiment.

[0052] FIG. 27 is a diagram illustrating the operation of providing a subtitle UI through a peripheral device according to one embodiment.

[0053] FIG. 28 is a diagram illustrating the operation of outputting subtitle information as an audio signal according to one embodiment.

[0054] FIG. 29 is a diagram illustrating the operation of outputting subtitle information as an image signal according to one embodiment.

[0055] FIG. 30 is a diagram illustrating the operation of displaying subtitle information on a screen according to one embodiment.

[0056] FIG. 31 is a diagram illustrating a language comparison operation in consideration of the power state of an electronic device according to one embodiment.

[0057] FIG. 32 is a diagram illustrating an operation to provide a second subtitle UI based on subtitle style information according to one embodiment.

[0058] FIG. 33 is a drawing for illustrating a subtitle style according to one embodiment.

[0059] FIG. 34 is a drawing for explaining the subtitle position according to one embodiment.

[0060] FIG. 35 is a drawing for explaining a method of controlling an electronic device according to one embodiment.

[0061] The present disclosure will be described in detail below with reference to the attached drawings.

[0062] The terms used in the embodiments of this disclosure have been selected to be as widely used as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant explanatory section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0063] In this specification, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, operations, or components such as parts) and do not exclude the presence of additional features.

[0064] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0065] Expressions such as "first," "second," "first," or "second" used in this specification may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0066] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0067] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "consisting of" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0068] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor, except for a "module" or "part" that needs to be implemented in specific hardware.

[0069] In this specification, the term "user" may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0070] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.

[0071] FIG. 1 is a drawing for explaining a subtitle UI according to one embodiment.

[0072] Referring to FIG. 1, an electronic device (100) can provide content. An electronic device (100) can display content. The content provided by the electronic device (100) may include a plurality of image frames over time. The content may include subtitle data corresponding to the plurality of image frames. An electronic device (100) may provide content including image frames over time and subtitle data.

[0073] Content may be provided based on at least one language. Content may be provided in a pre-set language. The pre-set language may be written as a default language. The electronic device (100) may provide content based on a pre-set language. The electronic device (100) may provide a first subtitle UI in a pre-set language.

[0074] According to one embodiment, the electronic device (100) can change the language of the content based on a preset event. The electronic device (100) can display a second subtitle UI with the language changed.

[0075] For example, assume that the content language (pre-set language) is English. When a pre-set event is identified, the electronic device (100) can change from English, which is the language of the content, to another language. The pre-set event may include at least one of an event that obtains a user command or an event that identifies the user language.

[0076] According to one embodiment, the electronic device (100) can provide a subtitle UI using translated subtitle data while maintaining the existing content language without changing the language of the content.

[0077] For example, assume that the content language (pre-set language) is English. When a pre-set event is identified, the electronic device (100) can display a first subtitle UI generated in English, which is the language of the content, and a second subtitle UI translated into the changed language together.

[0078] FIG. 2 is a block diagram illustrating an electronic device (100) according to one embodiment.

[0079] Referring to FIG. 2, the electronic device (100) may include at least one of a memory (110) for storing instructions, a display (140), and a processing circuitry, and at least one processor (120).

[0080] At least one processor (120) can acquire content information including image frames and subtitle information. At least one processor (120) can display the content through a display (140).

[0081] The content may include an image frame. The image frame may be described as image data or an image signal, etc.

[0082] For example, at least one processor (120) can store content in memory (110). At least one processor (120) can provide content stored in memory (110).

[0083] For example, at least one processor (120) can receive content from an external server. The external server may be a content provider. The external server may be a server that provides OTT (Over The Top) services.

[0084] For example, at least one processor (120) can receive content from a user terminal device. At least one processor (120) can provide content received from the user terminal device through a mirroring function.

[0085] The content may include subtitle information corresponding to an image frame. The image frame and subtitle information may be information provided based on time information. The subtitle information may be information provided together at the time of display of the image frame.

[0086] At least one processor (120) can obtain the content language based on subtitle information.

[0087] For example, subtitle information may include at least one subtitle data. The subtitle data may include text data for displaying subtitles based on a specific language.

[0088] At least one processor (120) can obtain a content language based on subtitle data corresponding to a default language among at least one subtitle data.

[0089] For example, subtitle information may include subtitle data corresponding to one language. At least one processor (120) may acquire the language corresponding to the subtitle data as the content language.

[0090] For example, subtitle information may include multiple subtitle data corresponding to each of multiple languages. At least one processor (120) may acquire a language corresponding to a default subtitle data among the multiple subtitle data as the content language.

[0091] At least one processor (120) can acquire a user language corresponding to a user of the electronic device (100).

[0092] For example, at least one processor (120) can obtain the setting language of the OSD (On-Screen Display) of the electronic device (100) as a user language.

[0093] The electronic device (100) may include a microphone (160).

[0094] At least one processor (120) can acquire a user voice through a microphone (160). At least one processor (120) can acquire a user language corresponding to the user voice based on a language analysis model.

[0095] Various methods for acquiring user language are described in FIGS. 14 to 17.

[0096] At least one processor (120) can determine whether the content language and the user language match. At least one processor (120) can determine the method of providing the subtitle UI by comparing the content language and the user language.

[0097] The subtitle UI may be a UI that includes dialogue or explanations provided by the content. The subtitle UI may be described as a text overlay UI, subtitle layer UI, text UI, message UI, dialogue UI, explanation UI, etc.

[0098] If the content language and the user language match, at least one processor (120) can display a first subtitle UI corresponding to the content language through a display (140).

[0099] If the content language and the user language do not match, at least one processor (120) can display a second subtitle UI corresponding to the user language through the display (140).

[0100] If the content language and the user language do not match, at least one processor (120) can display a first guide UI through a display (140) to provide a second subtitle UI corresponding to the user language.

[0101] The first guide UI may be a UI for providing subtitles different from the default subtitles of the content. The first guide UI may be a UI for receiving user input to provide subtitles corresponding to the user's language.

[0102] A description of the first guide UI is shown in FIGS. 6 to 8.

[0103] When user input to request a second subtitle UI is received through the first guide UI, at least one processor (120) can display the second subtitle UI through the display (140).

[0104] The first guide UI may be described as a nudge UI. The nudge UI may be a UI that guides the use of a specific function (e.g., a subtitle UI provision function). The nudge UI may be a UI that encourages the use of a specific function a threshold number of times.

[0105] If the content language and the user language match, at least one processor (120) can display a first subtitle UI through a display (140) based on first subtitle data corresponding to the content language among the subtitle information.

[0106] The first subtitle data may include subtitles (or text) written in a language identified as the content language.

[0107] When user input to request a second subtitle UI is received through a first guide UI, at least one processor (120) can identify whether there is second subtitle data corresponding to the user language in the subtitle information.

[0108] If second subtitle data exists in the subtitle information, at least one processor (120) can display a second subtitle UI through a display (140) based on the second subtitle data. The second subtitle data may include subtitles (or text) written in the user's language.

[0109] If the second subtitle data does not exist in the subtitle information, at least one processor (120) can obtain the third subtitle data by translating the first subtitle data into the user language. At least one processor (120) can display the second subtitle UI through the display (140) based on the third subtitle data. An explanation regarding the subtitle data is described in FIG. 9.

[0110] If the content language and the user language do not match, at least one processor (120) can identify the user location. At least one processor (120) can identify a target area corresponding to the user location among the entire area of ​​the screen displayed through the display (140). At least one processor (120) can display a second subtitle UI in the target area through the display (140). Descriptions related to the user location are described in FIGS. 10 to 13. The target area may be an area for displaying subtitles close to the user's location.

[0111] The electronic device (100) may include a communication interface (130). If the content language and the user language do not match, at least one processor (120) may identify an external device that can be connected to the electronic device (100). The external device may be a device for providing a second subtitle UI. The external device may be a device including output hardware (e.g., a display, a projector, a speaker, etc.) for outputting the second subtitle UI.

[0112] At least one processor (120) can generate a control signal for outputting a second subtitle UI through an external device. At least one processor (120) can transmit the control signal to an external device through a communication interface (130).

[0113] The operation of outputting the second subtitle UI through an external device is described in FIGS. 27 to 30.

[0114] The connection operation with the terminal device (200) is described in FIGS. 18 to 19.

[0115] Various methods for providing a second subtitle UI are described in FIGS. 20 to 26.

[0116] Explanations related to subtitle style information are described in FIGS. 32 and 33.

[0117] The electronic device (100) can provide subtitle services by identifying the language primarily used by the user. It can provide subtitle services by directly recognizing the user's language without the user having to input it directly.

[0118] If the content (channel, program, etc.) changes, the operation of comparing the content language and the user language may be restarted.

[0119] FIG. 3 is a block diagram illustrating the specific configuration of the electronic device (100) of FIG. 2 according to one embodiment.

[0120] Referring to FIG. 3, the electronic device (100) may include at least one of a memory (110), at least one processor (120), a communication interface (130), a display (140), a speaker (145), a sensor unit (150), a camera (155), a microphone (160), an operation interface (165), an input / output interface (170), and a power supply unit (175).

[0121] The memory (110) may be implemented as internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) or RAM included in at least one processor (120), or as memory separate from at least one processor (120). Depending on the purpose of data storage, the memory (110) may be implemented as a memory embedded in the electronic device (100) or as a memory that can be attached to and detached from the electronic device (100). For example, data for operating the electronic device (100) may be stored in memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in memory that can be attached to and detached from the electronic device (100).

[0122] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that is detachable from the electronic device (100), it may be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory that can be connected to a USB port (e.g., USB memory).

[0123] Memory (110) can store at least one instruction. Based on the instruction stored in memory (110), at least one processor (120) can perform various operations.

[0124] At least one processor (120) can perform overall control operations of the electronic device (100). At least one processor (120) can perform the function of controlling the overall operation of the electronic device (100).

[0125] At least one processor (120) may be implemented as a digital signal processor (DSP) that processes digital signals, a microprocessor, or a time controller (TCON). However, it is not limited thereto and may include or be defined by one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an ARM (advanced reduced instruction set computer (RISC) machine) processor. At least one processor (120) may be implemented as a System on Chip (SoC) or large scale integration (LSI) with a built-in processing algorithm, or may be implemented in the form of a Field Programmable Gate Array (FPGA). At least one processor (120) can perform various functions by executing computer executable instructions stored in memory.

[0126] The communication interface (130) is a configuration that communicates with various types of external devices according to various types of communication methods. The communication interface (130) may include a wireless communication module or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.

[0127] A wireless communication module may be a module that communicates wirelessly with an external device. For example, a wireless communication module may include at least one module among a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0128] Wi-Fi modules and Bluetooth modules can perform communication using Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi module or a Bluetooth module, various connection information, such as the SSID (service set identifier) ​​and session key, is transmitted and received first; after establishing a communication connection using this information, various types of information can be transmitted and received.

[0129] The infrared communication module performs communication according to infrared communication (IrDA, Infrared Data Association) technology, which uses infrared rays located between visible light and millimeter waves to wirelessly transmit data over short distances.

[0130] Other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation), in addition to the communication method described above.

[0131] A wired communication module may be a module that communicates with an external device via a wire. For example, a wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0132] According to one embodiment, the communication interface (130) may use the same communication module (e.g., Wi-Fi module) to communicate with an external device, such as a remote control device, and an external server.

[0133] According to one embodiment, the communication interface (130) may use different communication modules to communicate with external devices, such as a remote control device and an external server. For example, the communication interface (130) may use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may use a Bluetooth module to communicate with an external device, such as a remote control device. However, this is merely one embodiment, and the communication interface (130) may use at least one of various communication modules when communicating with multiple external devices or external servers.

[0134] The display (140) can be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, and a PDP (Plasma Display Panel). The display (140) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT (amorphous silicon thin film transistor), an LTPS (low temperature poly silicon) TFT, and an OTFT (organic TFT). The display (140) can be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, a three-dimensional display, etc. According to one embodiment of the present disclosure, the display (140) may include not only a display panel that outputs an image, but also a bezel that houses the display panel. In particular, according to one embodiment of the present disclosure, the bezel may include a touch sensor for detecting user interaction.

[0135] The display (140) can display a screen. The screen may include images, videos, text, etc. The screen may include a content screen, an application execution screen, a web browser screen, a GUI (Graphic User Interface) screen, etc.

[0136] The speaker (145) may be a component that outputs various audio data as well as various notification sounds or voice messages.

[0137] The sensor unit (150) can collect data indicating a state related to the surrounding environment or the electronic device (100). The sensor unit (150) may include at least one sensor. The sensor unit (150) may include a sensor that senses the external environment of the electronic device (100). The sensor unit (150) may include a sensor that senses the internal state of the electronic device (100). The sensing data collected through the sensor may be transmitted to one of the memory (110) of the electronic device (100), at least one processor (120), or a communication interface (130).

[0138] The camera (155) is configured to capture an object and generate an image, and the image includes both video and still images. The camera (155) can acquire an image of at least one external device and can be implemented as a camera, lens, infrared sensor, etc.

[0139] The camera (155) may include a lens and an image sensor. The types of lenses include general-purpose lenses, wide-angle lenses, zoom lenses, etc., and may be determined according to the type, characteristics, and usage environment of the electronic device (100). As an image sensor, a Complementary Metal Oxide Semiconductor (CMOS) and a Charge Coupled Device (CCD) may be used.

[0140] The microphone (160) is a component for receiving user voice or other sounds and converting them into audio data. The microphone (160) can receive the user's voice when active. For example, the microphone (160) may be formed integrally on the upper side, front side, or side side of the electronic device (100). The microphone (160) may include various components such as a microphone for collecting analog user voice, an amplifier circuit for amplifying the collected user voice, an A / D conversion circuit for sampling the amplified user voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0141] The operation interface (165) may be implemented as a device such as a button, touchpad, mouse, and keyboard, or as a touch screen capable of performing the aforementioned display function and operation input function. The button may be a various type of button, such as a mechanical button, touchpad, or wheel, formed in any area of ​​the exterior of the main body of the electronic device (100), such as the front, side, or back portions.

[0142] The input / output interface (170) may be any one of the following interfaces: HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). The input / output interface (170) may input and output at least one of audio and video signals. Depending on the implementation example, the input / output interface (170) may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals. The electronic device (100) may transmit at least one of the audio and video signals to an external device (e.g., an external display device or an external speaker) through the input / output interface (170). An output port included in the input / output interface (170) can be connected to an external device, and the electronic device (100) can transmit at least one of audio and video signals to the external device through the output port.

[0143] The input / output interface (170) can be connected to a communication interface. The input / output interface (170) can transmit information received from an external device to the communication interface or transmit information received through the communication interface to an external device.

[0144] The power supply unit (175) can generate, convert, or supply power required for the electronic device (100). The power supply unit (175) can generate a supply voltage or a supply current using the power. The power generated by the power supply unit (175) can be supplied to various components included in the electronic device (100).

[0145] FIG. 4 is a diagram illustrating the operation of providing a first subtitle UI and a second subtitle UI according to one embodiment.

[0146] Referring to FIG. 4, the electronic device (100) can acquire content information (S410). The content information may include various information related to the content. The content information may include at least one of a content name, an image frame, a content language, subtitle data, a content playback time, and a content provider. The content information may be described as metadata.

[0147] The electronic device (100) can obtain a content language based on content information (S420). The electronic device (100) can identify the content language included in the content information.

[0148] The electronic device (100) can acquire user information (S430). User information may include various information related to the user. User information may include at least one of the user's name, age, gender, country, identification information, and language. For example, user information may be information stored in the electronic device (100). For example, user information may be information received from an external device.

[0149] The electronic device (100) can acquire a user language based on user information (S440). The user language may be a language set by the user. The user language may represent a language set by the user among a plurality of languages ​​available to the user.

[0150] For example, an electronic device (100) can acquire a user language based on the OSD (On-Screen Display) setting language of the electronic device (100).

[0151] For example, the electronic device (100) can identify the language used in the identified country based on the location of the electronic device (100), and acquire the user language based on the identified language.

[0152] For example, an electronic device (100) can acquire a user's language based on a user's voice. The electronic device (100) can acquire a user's voice through a microphone. The electronic device (100) can identify the language of the user's voice analyzed through the microphone.

[0153] For example, an electronic device (100) can obtain a user language based on the OSD (On-Screen Display) setting language of a terminal device (200).

[0154] The electronic device (100) can identify whether the content language and the user language match (S450). The electronic device (100) can identify whether the content language, which is the default language set in the content, matches the user language. If the content language is a language that the user cannot recognize, the user may have difficulty understanding the provided content.

[0155] If the content language and the user language match (S450-Y), the electronic device (100) can provide a first subtitle UI based on the content language (S460). The first subtitle UI may include subtitle data generated based on the content language, which is the basic language of the content.

[0156] If the content language and the user language do not match (S450-N), the electronic device (100) may provide a second subtitle UI based on the user language (S470). The second subtitle UI may include subtitle data generated based on the user language.

[0157] For example, the second subtitle UI may be a subtitle UI generated based on pre-stored subtitle data.

[0158] For example, the second subtitle UI may be a subtitle UI generated by analyzing previously stored subtitle data in real time.

[0159] FIG. 5 is a diagram illustrating the operation of providing a first subtitle UI, a third subtitle UI, and a third subtitle UI according to one embodiment.

[0160] Referring to FIG. 5, the electronic device (100) can determine whether multiple users are identified (S531).

[0161] For example, it can be determined whether multiple users are identified based on the number of terminal devices connected to the electronic device (100).

[0162] For example, an electronic device (100) can identify multiple users based on a captured image. The electronic device (100) can acquire a captured image through a camera. The electronic device (100) can identify whether multiple users are included in the captured image.

[0163] For example, an electronic device (100) can identify multiple users based on user voices. The electronic device (100) can acquire an audio signal through a microphone. The electronic device (100) can identify whether the audio signal contains multiple user voices.

[0164] For example, an electronic device (100) can identify multiple users based on an ultrasonic signal. The electronic device (100) can acquire an ultrasonic signal. The electronic device (100) can identify whether multiple users are present in the vicinity through the ultrasonic signal.

[0165] When multiple users are identified (S531-Y), the electronic device (100) can identify a first user language corresponding to the first user (S541). The electronic device (100) can identify a second user language corresponding to the second user (S542).

[0166] The electronic device (100) can identify whether the content language, the first user language, and the second user language all match (S551).

[0167] When the content language, the first user language, and the second user language all match (S551-Y), the electronic device (100) can provide a first subtitle UI based on the content language (S560). An explanation related to this is described in the embodiment (2510) of FIG. 25.

[0168] If the content language, the first user language, and the second user language do not all match (S551-N), the electronic device (100) can identify whether the content language and the first user language match and whether the content language and the second user language do not match (S552).

[0169] If the content language matches the first user language and the content language does not match the second user language (S552-Y), the electronic device (100) can provide a first subtitle UI based on the content language and provide a second subtitle UI based on the first user language (S571). An explanation related to this is described in the embodiment (2520) of FIG. 25.

[0170] If the condition that the content language and the first user language match and the content language and the second user language do not match is not satisfied (S552-N), the electronic device (100) can identify whether the content language and the first user language do not match and the content language and the second user language match (S554).

[0171] If the content language and the first user language do not match and the content language and the second user language match (S554-Y), the electronic device (100) can provide a first subtitle UI based on the content language and a third subtitle UI based on the second user language (S572). An explanation related to this is described in the embodiment (2610) of FIG. 26.

[0172] If the content language and the first user language do not match and the condition that the content language and the second user language match is not satisfied (S554-N), the electronic device (100) may provide a first subtitle UI based on the content language, provide a second subtitle UI based on the first user language, and provide a third subtitle UI based on the second user language (S573). An explanation related to this is described in the embodiment (2620) of FIG. 26.

[0173] FIG. 6 is a diagram illustrating the operation of providing a first guide UI according to one embodiment.

[0174] The operations S610, S620, S630, S640, S650, S660, and S670 of FIG. 6 may correspond to the operations S410, S420, S430, S440, S450, S460, and S470 of FIG. 4. Redundant explanation is omitted.

[0175] If the content language and the user language do not match (S650-N), the electronic device (100) may provide a first guide UI to provide a subtitle UI corresponding to the user language (S665). The electronic device (100) may identify whether user input selecting the first guide UI is received (S666).

[0176] If no user input is received to select the first guide UI (S666-N), the electronic device (100) can provide the first subtitle UI based on the content language (S660).

[0177] When user input selecting the first guide UI is received (S666-Y), the electronic device (100) can provide a second subtitle UI based on the user's language (S670).

[0178] FIG. 7 is a drawing for explaining a first guide UI according to one embodiment.

[0179] Referring to the embodiment (700) of FIG. 7, the electronic device (100) may display a first guide UI (710) for providing a subtitle UI corresponding to a user language. When user input is received through the first guide UI (710), the electronic device (100) may provide a second subtitle UI. The second subtitle UI may include subtitle data generated by a user language different from the content language. The subtitle data may be included in the content.

[0180] FIG. 8 is a drawing for explaining a first guide UI according to one embodiment.

[0181] Referring to the embodiment (800) of FIG. 8, the electronic device (100) may display a first guide UI (810) for providing a subtitle UI corresponding to the user language. When user input is received through the first guide UI (810), the electronic device (100) may provide a second subtitle UI. The second subtitle UI may include result information obtained by translating subtitle data generated based on the content language in real time. Subtitle data obtained based on the translation result may be recorded as translation information.

[0182] To distinguish it from the first guide UI (710) of Fig. 7, the first guide UI (810) may be described as the third guide UI (810).

[0183] FIG. 9 is a diagram illustrating the operation of acquiring subtitle data according to one embodiment.

[0184] The S966 operation of FIG. 9 may correspond to the S666 operation of FIG. 6. Redundant explanation is omitted.

[0185] After providing the first guide UI, the electronic device (100) can identify whether user input selecting the first guide UI is received (S966).

[0186] If no user input selecting the first guide UI is received (S966-N), the electronic device (100) can obtain first subtitle data corresponding to the content language (S961). The electronic device (100) can provide a first subtitle UI based on the first subtitle data (S962).

[0187] When user input selecting the first guide UI is received (S966-Y), the electronic device (100) can identify second subtitle data corresponding to the user language (S971).

[0188] When second subtitle data corresponding to the user language is identified (S971-Y), the electronic device (100) can acquire second subtitle data corresponding to the user language (S972). The electronic device (100) can provide a second subtitle UI based on the second subtitle data (S973).

[0189] If second subtitle data corresponding to the user language is not identified (S971-N), the electronic device (100) can obtain first subtitle data corresponding to the content language (S974). The electronic device (100) can obtain third subtitle data by translating the first subtitle data into the user language (S975). The electronic device (100) can provide a second subtitle UI based on the third subtitle data (S976).

[0190] FIG. 10 is a diagram illustrating an operation of providing a second subtitle UI considering the user's location according to one embodiment.

[0191] The operations S1010, S1020, S1030, S1040, S1050, S1060, and S1070 of FIG. 10 may correspond to the operations S410, S420, S430, S440, S450, S460, and S470 of FIG. 4. Redundant descriptions are omitted.

[0192] If the content language and the user language match (S1050-Y), the electronic device (100) can provide a first subtitle UI to a default area based on the content language (S1060). The default area may be a pre-set area. For example, the default area may be a center bottom area. The default area may be indicated as a default location.

[0193] If the content language and the user language do not match (S1050-N), the electronic device (100) can identify the user location (S1067).

[0194] For example, an electronic device (100) can identify the location of a user through a terminal device (200). The electronic device (100) can be connected to the terminal device (200) via a pre-configured communication method (e.g., BLE). The electronic device (100) can identify the location of the terminal device (200). The electronic device (100) can identify the location of the terminal device (200) as the user's location.

[0195] For example, an electronic device (100) can identify a user's location through a captured image. The electronic device (100) can acquire a captured image of the front of the electronic device (100). The electronic device (100) can identify a person object among a plurality of objects included in the captured image. The electronic device (100) can identify a user's location based on the location where the person object is identified.

[0196] For example, an electronic device (100) can identify a user's location based on user voice data obtained through a microphone. The electronic device (100) may include a plurality of microphones. The electronic device (100) can identify a user's location by analyzing user voice data obtained from each of the plurality of microphones.

[0197] For example, an electronic device (100) can identify a user's location based on an ultrasonic signal. The electronic device (100) may include a transmitter that outputs ultrasonic waves and a receiver that receives reflected waves. The electronic device (100) can identify a user's location based on the output ultrasonic waves and reflected waves.

[0198] The electronic device (100) can identify a target area corresponding to the user's location within the entire area of ​​the screen (S1068). The electronic device (100) can provide a second subtitle UI to the target area based on the user's language (S1070). The target area can be described as the target location.

[0199] FIG. 11 is a drawing for explaining the operation of identifying a target area according to one embodiment.

[0200] Referring to FIG. 11, the electronic device (100) can determine whether multiple users are identified (S1131). The operation S1131 may correspond to the operation S531 of FIG. 5. Redundant description is omitted.

[0201] The electronic device (100) can identify a first user language corresponding to a first user (S1141). The electronic device (100) can identify a first target area corresponding to a first user location within the entire area of ​​the screen (S1142).

[0202] The electronic device (100) can identify a second user language corresponding to a second user (S1143). The electronic device (100) can identify a second target area corresponding to a second user location within the entire area of ​​the screen (S1144). Subsequent operations are described in FIG. 12 (F12).

[0203] FIG. 12 is a diagram illustrating an operation to identify multiple users and provide a subtitle UI according to one embodiment.

[0204] Referring to FIG. 12, after the operations of FIG. 11 are performed, the electronic device (100) can identify whether the content language, the first user language, and the second user language all match (S1251). The condition in which the content language, the first user language, and the second user language all match can be described as the first condition.

[0205] If the content language, the first user language, and the second user language all match (S1251-Y), the electronic device (100) can provide a first subtitle UI in a basic area based on the content language (S1260). If the first condition is satisfied, the electronic device (100) can provide a first subtitle UI corresponding to the content language in a basic area. The basic area may be an area pre-configured to provide a subtitle UI.

[0206] If the content language, the first user language, and the second user language do not all match (S1251-N), the electronic device (100) can identify whether the content language and the first user language match and the content language and the second user language do not match, satisfying a second condition (S1252).

[0207] If the second condition is satisfied (S1252-Y), the electronic device (100) can provide a first subtitle UI in a basic area based on the content language and provide a second subtitle UI in a first target area based on the first user language (S1271).

[0208] If the second condition is not satisfied (S1252-N), the electronic device (100) can identify whether the third condition is satisfied, in which the content language is inconsistent with the first user language and the content language is inconsistent with the second user language (S1254).

[0209] When the third condition is satisfied (S1254-Y), the electronic device (100) can provide a first subtitle UI in a basic area based on the content language and provide a third subtitle UI in a second target area based on the second user language (S1272).

[0210] If the third condition is not satisfied (S1254-N), the electronic device (100) may provide a first subtitle UI in a basic area based on the content language, provide a second subtitle UI in a first target area based on the first user language, and provide a third subtitle UI in a second target area based on the second user language (S1273).

[0211] FIG. 13 is a diagram illustrating an operation to identify a user location and provide a second subtitle UI when user input is received through a first guide UI according to one embodiment.

[0212] The operations S1310, S1320, S1330, S1340, S1350, S1360, S1367, S1368, and S1370 of FIG. 13 may correspond to the operations S1010, S1020, S1030, S1040, S1050, S1060, S1067, S1068, and S1070 of FIG. 10. Redundant description is omitted.

[0213] If the content language and the user language do not match (S1350-N), the electronic device (100) may provide a first guide UI to provide a subtitle UI corresponding to the user language (S1365). The electronic device (100) may identify whether user input selecting the first guide UI is received (S1366).

[0214] If no user input is received to select the first guide UI (S1366-N), the electronic device (100) can provide the first subtitle UI based on the content language (S1360).

[0215] When user input selecting the first guide UI is received (S1366-Y), the electronic device (100) can identify the user location (S1367). The electronic device (100) can perform operations S1368 and S1370. The user location can be recorded as user location information.

[0216] For example, the user location may represent the user's relative location with respect to the electronic device (100). An explanation related to this is described in operation S1067 of FIG. 10.

[0217] For example, the user location may represent the absolute location of the user. The electronic device (100) may identify the user location based on GPS information of the terminal device (200) corresponding to the user. The electronic device (100) may receive GPS information of the terminal device (200) from the terminal device (200) or from an external server connected to the terminal device (200). The electronic device (100) may identify a target area corresponding to the user location based on the GPS information of the electronic device (100) and the GPS information of the terminal device (200).

[0218] FIG. 14 is a diagram illustrating the operation of acquiring a user language according to one embodiment.

[0219] Referring to FIG. 14, the electronic device (100) can use various methods to acquire the user language.

[0220] For example, the electronic device (100) can obtain setting information of the electronic device (100) (S1410). The electronic device (100) can determine whether a setting language is identified based on the setting information of the electronic device (100) (S1411). If a setting language of the electronic device (100) is identified (S1411-Y), the electronic device (100) can obtain the setting language of the electronic device (100) as a user language (S1412).

[0221] If the setting language of the electronic device (100) is not identified (S1411-N), the electronic device (100) can obtain location information of the electronic device (100) (S1420). The electronic device (100) can obtain the current location of the electronic device (100) based on GPS information or installation information.

[0222] For example, the electronic device (100) can identify the location of the electronic device (100) based on GPS information. The electronic device (100) can obtain GPS information indicating the absolute location of the electronic device (100). For example, the electronic device (100) can store installation information. The installation information may include information indicating where the electronic device (100) is installed. The installation information may include address information or country information. The electronic device (100) can identify the location of the electronic device (100) based on at least one of the address information or country information included in the installation information.

[0223] The electronic device (100) can determine whether the location of the electronic device (100) is identified (S1421). If the location of the electronic device (100) is identified (S1421-Y), the electronic device (100) can identify the language corresponding to the location of the electronic device (100) based on a location-specific language table (S1422). The location-specific language table may include information indicating the language corresponding to each of a plurality of locations. For example, the language corresponding to the Korean location may be Korean, and the language corresponding to the US location may be English.

[0224] The electronic device (100) can obtain a language corresponding to the location of the identified electronic device (100) as a user language (S1423).

[0225] If the location of the electronic device (100) is not identified (S1421-N), the electronic device (100) can determine whether a user voice is acquired (S1430). If a user voice is acquired (S1430-Y), the electronic device (100) can identify the language corresponding to the user voice based on a language analysis model (S1431). The language analysis model may be a model that determines which language the user voice corresponds to. The language analysis model may be an artificial intelligence model.

[0226] For example, a language analysis model can be stored in an electronic device (100).

[0227] For example, the language analysis model can be stored on an external server. The electronic device (100) can obtain the language corresponding to the user's voice through the external server.

[0228] The electronic device (100) can acquire a language corresponding to the user's voice as the user's language (S1432).

[0229] If user voice is not obtained (S1430-N), the electronic device (100) can determine whether the user terminal device (200) is connected (S1440). For example, the terminal device (200) may be the user's smartphone or wearable device.

[0230] When the terminal device (200) is connected (S1440-Y), the electronic device (100) may request the setting language of the terminal device (200) (S1441). The electronic device (100) may request the setting language of the terminal device (200) from the terminal device (200). The terminal device (200) may transmit information regarding the setting language to the electronic device (100) in response to the request of the electronic device (100). The electronic device (100) may receive information regarding the setting language from the terminal device (200).

[0231] The electronic device (100) can obtain the setting language of the terminal device (200) as the user language (S1442).

[0232] If the terminal device (200) is identified as not being connected (S1440-N), the electronic device (100) may provide a first subtitle UI based on the content language (S1460). If the electronic device (100) cannot separately identify a user language other than the content language, it may provide only the first subtitle UI corresponding to the previously set content language.

[0233] The embodiment of FIG. 14 may show operations considering the priority according to the first case of FIG. 17.

[0234] FIG. 15 is a diagram illustrating the operation of providing a second guide UI for inputting a user language according to one embodiment.

[0235] The operations S1510, S1511, S1512, S1520, S1521, S1522, S1523, S1530, S1531, S1532, S1540, S1541, and S1542 of FIG. 15 may correspond to the operations S1410, S1411, S1412, S1420, S1421, S1422, S1423, S1430, S1431, S1432, S1440, S1441, and S1442 of FIG. 14. Redundant description is omitted.

[0236] If the terminal device (200) is identified as not being connected (S1540-N), the electronic device (100) may provide a second guide UI for inputting a user language (S1550).

[0237] The electronic device (100) can identify whether a user language is received through the second guide UI (S1551).

[0238] If the user language is not received through the second guide UI (S1551-N), the electronic device (100) can provide the first subtitle UI based on the content language (S1560).

[0239] When a user language is received through the second guide UI (S1551-Y), the electronic device (100) can acquire the input language as the user language (S1552).

[0240] FIG. 16 is a drawing for explaining a second guide UI according to one embodiment.

[0241] Referring to FIG. 16, the electronic device (100) may display a second guide UI (1600). The second guide UI (1600) may display a screen for directly selecting a user language. The second guide UI (1600) may include at least one of a UI (1610) indicating that the user language cannot be identified, a UI (1620) guiding the user to select a user language, a UI (1630) for selecting at least one language, and a UI (1640) for directly inputting the user language.

[0242] When user input is received selecting a UI (1640) for directly inputting a user language, the electronic device (100) can display a screen for inputting the user language.

[0243] FIG. 17 is a diagram illustrating the priority of a method for acquiring a user language according to one embodiment.

[0244] Referring to FIG. 17, the electronic device (100) may store a priority table (1700) for identifying user languages. The priority table (1700) may indicate priorities for a plurality of methods for identifying user languages.

[0245] There may be various methods to identify the user's language.

[0246] According to the first method, the electronic device (100) can obtain a user language based on the OSD (On-Screen Display) setting language of the electronic device (100).

[0247] According to the second method, the electronic device (100) can identify the language used in the identified country based on the location of the electronic device (100) and acquire the user language based on the identified language.

[0248] According to the third method, the electronic device (100) can acquire a user language based on the user's voice. The electronic device (100) can acquire the user's voice through a microphone. The electronic device (100) can identify the language of the user's voice analyzed through the microphone.

[0249] According to the fourth method, the electronic device (100) can obtain a user language based on the OSD (On-Screen Display) setting language of the terminal device (200).

[0250] The electronic device (100) can determine how to identify the user language.

[0251] The electronic device (100) can identify the user language based on at least one of four methods.

[0252] For example, an electronic device (100) can identify a user language based on one of four preset methods.

[0253] For example, an electronic device (100) can identify a user language using all four methods. When all four methods are used, the user language can be identified based on priority.

[0254] The electronic device (100) can identify a user language according to one of a plurality of cases corresponding to a priority table (1700).

[0255] According to the first case, the electronic device (100) can identify the user language in the order of the first method, the second method, the third method, and the fourth method. If the user language is identified by the first method, the electronic device (100) does not need to perform operations according to the second method, the third method, and the fourth method. Conversely, if the user language is not identified by the first method, the electronic device (100) can identify the user language by the second method of the next priority.

[0256] According to the second case, the electronic device (100) can identify the user language in the order of the fourth method, the third method, the second method, and the first method.

[0257] According to the third case, the electronic device (100) can identify the user language in the order of the third method, the fourth method, the second method, and the first method.

[0258] In addition to the three cases mentioned above, user language can be identified according to various other cases.

[0259] FIG. 18 is a drawing for explaining a method of connection between an electronic device (100) and a terminal device according to one embodiment.

[0260] Referring to the embodiment (1810) of FIG. 18, an electronic device (100) and a terminal device (200) can be connected. The electronic device (100) can be directly connected to the terminal device (200) for communication. The electronic device (100) and the terminal device (200) can exchange information (or data) with each other.

[0261] For example, an electronic device (100) can be connected to a terminal device (200) using Bluetooth communication (or low-power Bluetooth communication).

[0262] For example, an electronic device (100) can be connected to a terminal device (200) using Wi-Fi communication.

[0263] Referring to the embodiment (1820) of FIG. 18, an electronic device (100) and a terminal device (200) may be connected via a server (300). The electronic device (100) and the terminal device (200) may be included in a single IoT (Internet of Things) network. The IoT network may be controlled (or managed) by the server (300). The electronic device (100) may be connected to the server (300), and the terminal device (200) may be connected to the server (300). The electronic device (100) and the terminal device (200) may exchange information (or data) via the server (300).

[0264] FIG. 19 is a diagram illustrating the operation of receiving setting language or location information through a terminal device according to one embodiment.

[0265] Referring to FIG. 19, the electronic device (100) can be connected to a terminal device (200) for communication. The electronic device (100) and the terminal device (200) can exchange information (or data) with each other.

[0266] The electronic device (100) can identify whether the terminal device (200) is connectable (S1905). If the terminal device (200) is connectable (S1905-Y), the electronic device (100) can request a setting language from the terminal device (200) (S1910).

[0267] For example, a terminal device (200) may receive a setting language request from an electronic device (100). The terminal device (200) may identify the setting language based on the request (S1915). The terminal device (200) may transmit the setting language to the electronic device (100) (S1920).

[0268] The electronic device (100) can receive a setting language from the terminal device (200). The electronic device (100) can obtain the setting language as a user language (S1925).

[0269] For example, an electronic device (100) may request location information from a terminal device (200) (S1930). The terminal device (200) may receive a request for location information from the electronic device (100). The terminal device (200) may obtain location information in response to the request (S1935). The terminal device (200) may transmit location information to the electronic device (100) (S1940).

[0270] The electronic device (100) can receive location information from the terminal device (200). The electronic device (100) can identify the user's location based on the location information (S1945).

[0271] The electronic device (100) can provide a second subtitle UI based on the user language and user location.

[0272] FIG. 20 is a drawing for explaining a subtitle UI according to one embodiment.

[0273] For example, it is assumed that the default language setting is English (EN). The same assumption may apply in FIGS. 20 to 26, FIGS. 28 to 30, and FIGS. 33 to 34.

[0274] Referring to the embodiment (2010) of FIG. 20, the electronic device (100) can display a first subtitle UI (10). The first subtitle UI (10) may be a UI corresponding to the default language of the content.

[0275] Referring to the embodiment (2020) of FIG. 20, the electronic device (100) can acquire a user language and display a second subtitle UI (20) corresponding to the user language.

[0276] For example, the electronic device (100) can display a second subtitle UI (20) based on the user language Korean (KR) instead of the first subtitle UI (10).

[0277] When the content language (EN) and the user language (KR) are different, the electronic device (100) can display a second subtitle UI (20) corresponding to the user language (KR) instead of a first subtitle UI (10) corresponding to the content language (EN).

[0278] This is because when the user language (KR) is identified, the electronic device (100) no longer needs to provide subtitles for the content language (EN).

[0279] FIG. 21 is a drawing illustrating the display position of a second subtitle UI that varies according to the user's position, according to one embodiment.

[0280] The electronic device (100) can display a second subtitle UI (20) corresponding to the user language (KR) based on the user location. The electronic device (100) can acquire the user location. The electronic device (100) can identify a target area (or target location) corresponding to the user location. The electronic device (100) can display the second subtitle UI (20) in the target area. The target area may vary depending on the user's location.

[0281] Referring to the embodiment (2110) of FIG. 21, if the user is located on the left side of the electronic device (100) based on the direction of looking at the electronic device (100) from the front of the electronic device (100), the electronic device (100) can display the second subtitle UI (20) in the left area of ​​the full screen.

[0282] Referring to the embodiment (2120) of FIG. 21, if the user is located to the right of the electronic device (100) based on the direction of looking at the electronic device (100) from the front of the electronic device (100), the electronic device (100) can display the second subtitle UI (20) in the right area of ​​the full screen.

[0283] The electronic device (100) can determine the area (or location) closest to the user among the entire area of ​​the screen to be displayed as the target area.

[0284] The electronic device (100) can identify the user's location movement. It is assumed that the user moves from the first location of the embodiment (2010) to the second location of the embodiment (2020). The electronic device (100) can identify the user's real-time location. The electronic device (100) can identify an event indicating that the user has moved locations.

[0285] For example, when an event indicating that the user has moved their location is identified, the electronic device (100) can move the location of the second subtitle UI (20). The electronic device (100) can display the second subtitle UI (20) based on the user's current location. When the user's location changes, the electronic device (100) can display the second subtitle UI (20) based on the changed location. The electronic device (100) can change the display location of the second subtitle UI (20) from a first target area corresponding to the first user location to a second target area corresponding to the second user location.

[0286] For example, when an event indicating that a user has moved their location is identified, the electronic device (100) may move the external device (400) to change the location where the second subtitle UI (20) is displayed. The electronic device (100) may generate a control signal to move the external device (400) and transmit the generated control signal to the external device (400). The external device (400) may display the second subtitle UI (20) based on the changed user location. Based on the control signal, the external device (400) may change the display location of the second subtitle UI (20) from a first target area corresponding to the first user location to a second target area corresponding to the second user location. An explanation regarding the output operation of the external device (400) is described in FIG. 29.

[0287] For example, when an event indicating that the user has moved their location is identified, the user's terminal device (200) may move together with the user's location. Accordingly, the terminal device (200) can maintain the display method of the second subtitle UI (20).

[0288] For example, if an event indicating that the user has moved their location is identified, the electronic device (100) may change the location where the second subtitle UI (20) is displayed. The electronic device (100) may determine whether the external device (400) for displaying the second subtitle UI (20) is movable. If the external device (400) is not movable, the electronic device (100) may identify a new external device other than the current external device (400) for displaying the second subtitle UI (20). The electronic device (100) may identify a new external device that exists within a threshold distance from the current user location (changed user location). The electronic device (100) may identify a new external device that is movable. When a new external device is identified, the electronic device (100) may display the second subtitle UI (20) in a second target area corresponding to the current user location (changed user location) through the new external device.

[0289] FIG. 22 is a drawing for explaining a subtitle UI provided to multiple users according to one embodiment.

[0290] Referring to the embodiment (2200) of FIG. 22, the electronic device (100) can identify a first user (1) and a second user (2). The electronic device (100) can identify the first user language (KR) of the first user (1). The electronic device (100) can identify the second user language (FR) of the second user (2).

[0291] The electronic device (100) can obtain a first user location of a first user (1). The electronic device (100) can obtain a first target area corresponding to the first user location among the entire screen to be displayed. The electronic device (100) can generate a second subtitle UI (20) corresponding to the first user language (KR). The electronic device (100) can display the second subtitle UI (20) in the first target area.

[0292] The electronic device (100) can obtain the second user location of the second user (2). The electronic device (100) can obtain a second target area corresponding to the second user location among the entire screen to be displayed. The electronic device (100) can generate a third subtitle UI (30) corresponding to the second user language (FR). The electronic device (100) can display the third subtitle UI (30) in the second target area.

[0293] FIG. 23 is a diagram illustrating an operation that provides both a content language and a user language according to one embodiment.

[0294] Referring to the embodiment (2310) of FIG. 23, the electronic device (100) can display a first subtitle UI (10) corresponding to the content language (EN). When the content language (EN) and the user language (EN) match, the electronic device (100) can continue to display the first subtitle UI (10) corresponding to the content language (EN).

[0295] Referring to the embodiment (2320) of FIG. 23, the electronic device (100) can display both a first subtitle UI (10) corresponding to the content language (EN) and a second subtitle UI (20) corresponding to the user language (KR). If the content language (EN) and the user language (KR) do not match, the electronic device (100) can display the first subtitle UI (10) and the second subtitle UI (20) simultaneously. The electronic device (100) can display the second subtitle UI (20) within a threshold distance (or threshold pixel) relative to the first subtitle UI (10).

[0296] For example, the electronic device (100) can display a second subtitle UI (20) below the first subtitle UI (10).

[0297] FIG. 24 is a diagram illustrating the display position of a second subtitle UI that varies according to the user's position, according to one embodiment.

[0298] The electronic device (100) can display a second subtitle UI (20) based on the user's location while displaying a first subtitle UI (10). The electronic device (100) can identify that the content language (EN) and the user language (KR) do not match. The electronic device (100) can identify the user's location. The electronic device (100) can identify a target area corresponding to the user's location. The electronic device (100) can display a second subtitle UI (20) corresponding to the user language (KR) in the target area while displaying a first subtitle UI (10) corresponding to the content language (EN).

[0299] Referring to the embodiment (2410) of FIG. 24, when a user is positioned on the left side of the electronic device (100) based on the direction of looking at the electronic device (100) from the front of the electronic device (100), the electronic device (100) can display a first subtitle UI (10) in the central area (basic area) and a second subtitle UI (20) in the left area (target area) of the entire screen.

[0300] Referring to the embodiment (2420) of FIG. 24, when a user is positioned to the right of the electronic device (100) based on the direction of looking at the electronic device (100) from the front of the electronic device (100), the electronic device (100) can display a first subtitle UI (10) in the central area (basic area) and a second subtitle UI (20) in the right area (target area) of the entire screen.

[0301] The electronic device (100) can determine the area (or location) closest to the user among the entire area of ​​the screen to be displayed as the target area.

[0302] FIG. 25 is a diagram illustrating the operation of providing a second subtitle UI in consideration of the user language according to one embodiment.

[0303] The electronic device (100) can identify a first user (1) and a second user (2). The electronic device (100) can obtain the first user language of the first user (1). The electronic device (100) can obtain the second user language of the second user (2). The electronic device (100) can determine whether there is a match by comparing the content language, the first user language, and the second user language. If the user language and the content language are different, the electronic device (100) can provide a subtitle UI corresponding to the user language.

[0304] Referring to the embodiment (2510) of FIG. 25, when the content language, the first user language, and the second user language are all the same, the electronic device (100) can continue to display the first subtitle UI (10) corresponding to the currently set content language.

[0305] Referring to the embodiment (2520) of FIG. 25, the content language (EN) and the first user language (KR) may be different, and the content language (EN) and the second user language (EN) may match. The electronic device (100) may display a second subtitle UI (20) corresponding to the first user language (KR) that does not match the content language (EN) based on the location of the first user (1).

[0306] The electronic device (100) can acquire a first target area based on the first user location of the first user (1). While displaying a first subtitle UI (10) corresponding to the content language (EN), the electronic device (100) can display a second subtitle UI (20) corresponding to the second user language (KR) in the first target area. Since the second user language (EN) of the second user (2) is the same as the content language (EN), the electronic device (100) does not need to provide a separate subtitle service to the second user (2).

[0307] FIG. 26 is a drawing for explaining a subtitle UI provided in a situation where multiple users exist, according to one embodiment.

[0308] Referring to the embodiment (2610) of FIG. 26, the electronic device (100) can identify a first user (1) and a second user (2). The electronic device (100) can obtain the first user language (EN) of the first user (1) and the second user language (FR) of the second user (2).

[0309] If the content language (EN) and the first user language (EN) match, the electronic device (100) may not provide a separate subtitle UI. If the content language (EN) and the second user language (FR) do not match, the electronic device (100) may display a third subtitle UI (30) corresponding to the second user language (FR).

[0310] The electronic device (100) can identify the second user location of the second user (2). The electronic device (100) can identify a second target area corresponding to the second user location. The electronic device (100) can display a first subtitle UI (10) corresponding to the content language (EN) in the basic area (central area) and display a third subtitle UI (30) corresponding to the second user language (FR) in the second target area (right area).

[0311] Referring to the embodiment (2620) of FIG. 26, the electronic device (100) can acquire the first user language (KR) of the first user (1). The electronic device (100) can acquire the second user language (FR) of the second user (2).

[0312] The electronic device (100) can identify that the content language (EN) and the first user language (KR) are inconsistent. The electronic device (100) can identify that the content language (EN) and the second user language (FR) are inconsistent.

[0313] The electronic device (100) can identify a first target area based on the first user location of the first user (1). The electronic device (100) can identify a second target area based on the second user location of the second user (2).

[0314] The electronic device (100) can display a first subtitle UI (10) corresponding to the content language (EN) in a basic area (central area), display a second subtitle UI (20) corresponding to the first user language (KR) in a first target area (left area), and display a third subtitle UI (30) corresponding to the second user language (FR) in a second target area (right area).

[0315] FIG. 27 is a diagram illustrating the operation of providing a subtitle UI through a peripheral device according to one embodiment.

[0316] Referring to FIG. 27, the electronic device (100) can identify whether user input selecting a first guide UI is received (S2766). If user input selecting a first guide UI is not received (S2766-N), the electronic device (100) can provide a first subtitle UI based on the content language (S2760).

[0317] When user input selecting the first guide UI is received (S2766-Y), the electronic device (100) can identify whether an external device can be connected within a threshold distance (S2771). The external device may be described as a peripheral device. For example, the external device may include a terminal device (200). For example, the external device may be a mobile projector, a stationary projector, a mobile service robot, a wearable device, etc.

[0318] If an external device cannot be connected (S2771-N), the electronic device (100) can provide a second subtitle UI based on the user language through the electronic device (100) (S2722).

[0319] If an external device can be connected (S2771-Y), the electronic device (100) can determine whether the external device has an image output function (S2773). The electronic device (100) can obtain function information of the external device. Based on the function information of the external device, the electronic device (100) can determine whether the external device can perform an image output function.

[0320] For example, the image output function may include at least one of a function that displays an image signal through a display or a function that projects an image signal through a projector (or projection lens).

[0321] If it is determined that the external device cannot perform an image output function (S2773-N), the electronic device (100) can determine whether the external device has an audio output function (S2774). If the external device does not have an audio output function (S2774-N), the electronic device (100) can provide a second subtitle UI based on the user language through the electronic device (100) (S2772).

[0322] If an audio output function exists in the external device (S2774-Y), the electronic device (100) can provide an audio signal based on the user language through the external device (S2775). The electronic device (100) can generate a control signal for the external device to output an audio signal representing a second subtitle UI. The electronic device (100) can transmit the generated control signal to the external device. The external device can output the second subtitle UI through the speaker of the external device.

[0323] If an image output function exists in the external device (S2773-Y), the electronic device (100) can determine whether the external device is movable (S2776). The electronic device (100) can identify whether the external device is a movable device based on the function information of the external device.

[0324] If the external device is not movable (S2776-N), the electronic device (100) may provide a control signal including a command to provide a second subtitle UI based on the user language through the external device (S2777). The electronic device (100) may transmit the generated control signal to the external device. The external device may output an image signal representing the second subtitle UI based on the received control signal.

[0325] If the external device is movable (S2776-Y), the electronic device (100) may provide a control signal including a first command for moving the external device and a second command for providing a second subtitle UI based on the user language through the external device (S2778).

[0326] The first signal may be a signal that controls an external device to move based on at least one of the location of the electronic device (100) or the user location. The first signal may be a signal that controls an external device to move within a critical distance from the location of the electronic device (100) or within a critical distance from the user location.

[0327] FIG. 28 is a diagram illustrating the operation of outputting subtitle data as an audio signal according to one embodiment.

[0328] Referring to the embodiment (2800) of FIG. 28, the electronic device (100) can display a first subtitle UI (10) corresponding to the content language (EN). The electronic device (100) can provide a second subtitle UI (20) corresponding to the user language (KR). The electronic device (100) can control the external device (400) so that the second subtitle UI (20) is output through the external device (400).

[0329] The electronic device (100) can identify an external device (400) that outputs a second subtitle UI (20). The electronic device (100) can obtain functional information of the external device (400). The electronic device (100) can determine whether the second subtitle UI (20) can be output based on the functional information of the external device (400). The electronic device (100) can determine whether the external device (400) can output the second subtitle UI (20) based on at least one of image data or audio data.

[0330] If the external device (400) cannot perform an image output function and can only perform an audio output function, the electronic device (100) can output a second subtitle UI (20) containing audio data through the external device (400). The electronic device (100) can generate a control command to output the second subtitle UI (20) as audio data to the external device (400). The electronic device (100) can transmit the control command to the external device (400).

[0331] The external device (400) can receive a control command from the electronic device (100). The control command may include audio data representing the second subtitle UI (20). The external device (400) can output the second subtitle UI (20) through the speaker of the external device (400).

[0332] FIG. 29 is a diagram illustrating the operation of outputting subtitle data as an image signal according to one embodiment.

[0333] Referring to the embodiment (2900) of FIG. 29, the electronic device (100) can display a first subtitle UI (10) corresponding to the content language (EN). The electronic device (100) can provide a second subtitle UI (20) corresponding to the user language (KR). The electronic device (100) can control the external device (400) so that the second subtitle UI (20) is output through the external device (400).

[0334] The electronic device (100) can determine that the external device (400) can perform an image projection function based on the functional information of the external device (400). The electronic device (100) can generate a control command for the external device (400) to project a second subtitle UI (20). The electronic device (100) can transmit the control command to the external device (400).

[0335] An external device (400) may receive a control command from an electronic device (100) for projecting a second subtitle UI (20). The control command may include a projection image representing the second subtitle UI (20). The projection image may include the second subtitle UI (20) corresponding to the user language (KR). The external device (400) may output a projection image including the second subtitle UI (20).

[0336] When a control command is received, the external device (400) can identify a projection surface for outputting the second subtitle UI (20). The external device (400) can identify a projection surface (or a location of the projection surface) for outputting the second subtitle UI (20) based on at least one of the user location or the location of the electronic device (100).

[0337] The electronic device (100) can output a second subtitle UI (20) to a projection surface. The electronic device (100) can output a projection image including the second subtitle UI (20) to a projection surface.

[0338] FIG. 30 is a diagram illustrating the operation of displaying subtitle data on a screen according to one embodiment.

[0339] Referring to FIG. 30, the electronic device (100) can display a first subtitle UI (10) corresponding to the content language (EN). The electronic device (100) can provide a second subtitle UI (20) corresponding to the user language (KR). The electronic device (100) can control the external device (400) so that the second subtitle UI (20) is output through the external device (400). The external device (400) may be a user's terminal device (200). In the drawings and the description below, it is referred to as a terminal device (200).

[0340] The terminal device (200) can perform both the function of outputting an image and the function of outputting audio.

[0341] The electronic device (100) can output the second subtitle UI (20) in the form of an image or in the form of audio through the terminal device (200). The image or audio form may be changed according to the user's settings.

[0342] The electronic device (100) can generate a control command including at least one of image data including a second subtitle UI (20) or audio data including a second subtitle UI (20). The electronic device (100) can transmit the control command to a terminal device (200).

[0343] The terminal device (200) can receive control commands from the electronic device (100).

[0344] For example, the terminal device (200) can display image data representing the second subtitle UI (20) through the display of the terminal device (200).

[0345] For example, the terminal device (200) can output audio data representing the second subtitle UI (20) through the speaker of the terminal device (200).

[0346] FIG. 31 is a diagram illustrating a language comparison operation in consideration of the power state of an electronic device (100) according to one embodiment.

[0347] Referring to FIG. 31, the electronic device (100) can acquire a broadcast language (S3120). The broadcast language may be included in the content language. The electronic device (100) can acquire a user language (S3140). Since the description related to the user language has been described in other drawings, a redundant description is omitted.

[0348] The electronic device (100) can identify whether the electronic device (100) is on (S3145). It may be difficult to provide a subtitle UI when the electronic device (100) is off or in a power-saving state.

[0349] When the electronic device (100) is turned on (S3145-Y), the electronic device (100) can identify whether the broadcast language and the user language are inconsistent (S3150).

[0350] If the broadcast language and the user language are inconsistent (S3150-Y), the electronic device (100) can determine whether a user is detected (S3155). The electronic device (100) can determine whether a user is detected within a threshold distance from the electronic device (100).

[0351] When a user is detected (S3155-Y), the electronic device (100) may provide a first guide UI to provide a subtitle UI corresponding to the user's language (S3165). The first guide UI is described in FIGS. 7 and FIGS. 8.

[0352] FIG. 32 is a diagram illustrating an operation to provide a second subtitle UI based on subtitle style information according to one embodiment.

[0353] Referring to FIG. 32, the electronic device (100) can provide a first guide UI (S3265). The first guide UI is described in FIG. 7 and FIG. 8.

[0354] The electronic device (100) can determine whether user input selecting the first guide UI is received (S3266).

[0355] If no user input is received to select the first guide UI (S3266-N), the electronic device (100) can provide the first subtitle UI based on the content language (S3260).

[0356] When user input selecting a first guide UI is received (S3266-Y), the electronic device (100) can obtain subtitle style information (S3269). The electronic device (100) can provide a second subtitle UI based on the user language and subtitle style information (S3270).

[0357] Subtitle style information may include information for determining a method of displaying subtitles when providing at least one of a first subtitle UI, a second subtitle UI, or a third subtitle UI.

[0358] For example, subtitle style information may include at least one of the size of the subtitle, the font of the subtitle, the color of the subtitle, the background transparency of the subtitle, and the background color of the subtitle.

[0359] FIG. 33 is a drawing for illustrating a subtitle style according to one embodiment.

[0360] Referring to the embodiment (3310) of FIG. 33, the electronic device (100) may display at least one of a first subtitle UI (10) or a second subtitle UI (20) based on first subtitle style information. The first subtitle style information may include information for displaying the background of the subtitle UI transparently. When the background of the subtitle UI is transparent, the electronic device (100) may display at least one of the first subtitle UI (10) or the second subtitle UI (20) by overlapping it with a content image.

[0361] Referring to the embodiment (3320) of FIG. 33, the electronic device (100) may display at least one of the first subtitle UI (10) or the second subtitle UI (20) based on second subtitle style information. The second subtitle style information may include information for displaying the transparency of the background of the subtitle UI as being below a threshold value. When the transparency is below the threshold value, the electronic device (100) may display the first subtitle UI (10) or the second subtitle UI (20) so that the content image is not visible.

[0362] For example, an electronic device (100) can identify screen complexity. The electronic device (100) can obtain screen complexity based on at least one of the number of objects or the degree of overlap of objects. If screen complexity is greater than or equal to a threshold complexity, the electronic device (100) can set the transparency of the background of the subtitle UI to be less than or equal to the threshold.

[0363] For example, the electronic device (100) can identify the number of characters in the text. If the number of characters is greater than or equal to a threshold number, the electronic device (100) can set the transparency of the background of the subtitle UI to be less than or equal to the threshold number.

[0364] For example, the electronic device (100) can provide a second subtitle UI based on text setting information of the terminal device (200). The electronic device (100) can obtain the text size of the terminal device (200). The electronic device (100) can provide a second subtitle UI based on the text size of the terminal device (200). If the text size set in the terminal device (200) is a minimum value, the electronic device (100) can display the second subtitle UI at the minimum size.

[0365] For example, an electronic device (100) can determine a text size by taking into account the age of the user. If the user's age is greater than or equal to a first threshold age or less than or equal to a second threshold age, the electronic device (100) can determine a text size as a first size. If the user's age is greater than the first threshold age and less than the second threshold age, the electronic device (100) can determine a text size as a second size that is smaller than the first size. The electronic device (100) can provide a second subtitle UI based on the determined size.

[0366] For example, the electronic device (100) can determine the style of the second subtitle UI according to the type of content. The electronic device (100) can determine a formal style or an informal style according to the type of content.

[0367] For example, the electronic device (100) can generate a second subtitle UI based on a region-specific language (e.g., a dialect) depending on the user's location or the location of the electronic device (100).

[0368] The settings for the aforementioned subtitle style can be determined (or changed) by the user's manual settings.

[0369] FIG. 34 is a drawing for explaining the subtitle position according to one embodiment.

[0370] Referring to the embodiment (3400) of FIG. 34, the electronic device (100) can identify a target area for displaying a subtitle UI by analyzing an image representing content. The electronic device (100) can identify the location of an object included in the image. The electronic device (100) can identify an empty area of ​​the entire screen where no object is identified. The electronic device (100) can display at least one of a first subtitle UI (10) or a second subtitle UI (20) in the empty area.

[0371] For example, the electronic device (100) can identify an object from each of a plurality of image frames provided in the content. The electronic device (100) can identify a location where the object does not move. The electronic device (100) can identify a location where the object does not move as a target area. The electronic device (100) can display at least one of a first subtitle UI (10) or a second subtitle UI (20) in the target area.

[0372] FIG. 35 is a drawing for explaining a method of controlling an electronic device (100) according to one embodiment.

[0373] Referring to FIG. 35, a control method for an electronic device (100) may include the steps of: obtaining content information including image frames and subtitle information (S3510); obtaining a content language based on the subtitle information (S3520); obtaining a user language corresponding to a user of the electronic device (100) (S3530); displaying a first subtitle UI corresponding to the content language if the content language and the user language match (S3540); and displaying a second subtitle UI corresponding to the user language if the content language and the user language do not match (S3550).

[0374] The step of obtaining a user language (S3530) can obtain the setting language of the OSD (On-Screen Display) of the electronic device (100) as the user language.

[0375] The step of acquiring user language (S3530) can acquire user voice through a microphone of an electronic device (100) and acquire user language corresponding to user voice based on a language analysis model.

[0376] The control method may include the step of displaying a first guide UI to provide a second subtitle UI corresponding to the user language if the content language and the user language do not match.

[0377] The step of displaying the second subtitle UI (S3550) can display the second subtitle UI when user input to request the second subtitle UI is received through the first guide UI.

[0378] The step of displaying the first subtitle UI (S3540) can display the first subtitle UI based on the first subtitle data corresponding to the content language among the subtitle information when the content language and the user language match.

[0379] The step of displaying the second subtitle UI (S3550) can identify whether there is second subtitle data corresponding to the user language in the subtitle information when user input to request the second subtitle UI is received through the first guide UI, and if there is second subtitle data in the subtitle information, the second subtitle UI can be displayed based on the second subtitle data.

[0380] The step of displaying the second subtitle UI (S3550) can obtain third subtitle data by translating the first subtitle data into the user language if the second subtitle data does not exist in the subtitle information, and display the second subtitle UI based on the third subtitle data.

[0381] The step of displaying the second subtitle UI (S3550) can identify the user's location if the content language and the user's language do not match, identify a target area corresponding to the user's location among the entire area of ​​the screen being displayed, and display the second subtitle UI in the target area.

[0382] If the content language and the user language do not match, the control method may include the steps of identifying an external device that can be connected to the electronic device (100), generating a control signal to output a second subtitle UI through the external device, and transmitting the control signal to the external device.

[0383] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0384] The methods according to the various embodiments of the present disclosure described above can be implemented by software upgrades or hardware upgrades alone for existing electronic devices.

[0385] The various embodiments of the present disclosure described above may also be performed through an embedded server equipped in an electronic device, or through an external server among at least one of the electronic device and the display device.

[0386] According to a specific example of the present disclosure, the various embodiments described above may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0387] According to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a storage medium such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0388] Each component (e.g., module or program) according to the various embodiments described above may be composed of a single or multiple entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be additionally included in the various embodiments. Generally or additionally, some components (e.g., module or program) may be integrated into a single entity to perform the functions performed by each of the respective components prior to integration in the same or similar manner. The operations performed by the module, program, or other components according to the various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations added.

[0389] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the scope of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit of the present disclosure.

Claims

1. In an electronic device, Memory for storing instructions; Display; and at least one processor including processing circuitry; and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Acquire content information including image frames and subtitle information, and Based on the above subtitle information, obtain the content language, and Acquire a user language corresponding to the user of the above electronic device, and If the above content language and the above user language match, a first subtitle UI corresponding to the above content language is displayed through the above display, and An electronic device that displays a second subtitle UI corresponding to the user language through the display if the content language and the user language do not match.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that obtains the setting language of the OSD (On-Screen Display) of the electronic device in the user language.

3. In Paragraph 1, The above electronic device is, Includes a microphone, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Acquire user voice through the above microphone, and An electronic device that obtains the user language corresponding to the user voice based on a language analysis model.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that, if the content language and the user language do not match, displays a first guide UI through the display to provide a second subtitle UI corresponding to the user language.

5. In Paragraph 4, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that, when user input to request the second subtitle UI is received through the first guide UI, displays the second subtitle UI through the display.

6. In Paragraph 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device that, when the content language and the user language match, displays the first subtitle UI through the display based on the first subtitle data corresponding to the content language among the subtitle information.

7. In Paragraph 6, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When the user input for requesting the second subtitle UI through the first guide UI is received, it is determined whether second subtitle data corresponding to the user language exists in the subtitle information, and An electronic device that, if the second subtitle data exists in the subtitle information, displays the second subtitle UI through the display based on the second subtitle data.

8. In Paragraph 7, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If the second subtitle data does not exist in the above subtitle information, the third subtitle data is obtained by translating the first subtitle data into the user language, and An electronic device that displays the second subtitle UI through the display based on the third subtitle data.

9. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If the above content language and the above user language do not match, identify the user location, and Identifying a target area corresponding to the user location among the entire area of ​​the screen displayed through the above display, and An electronic device that displays the second subtitle UI in the target area through the display.

10. In Paragraph 1, The above electronic device is, Includes a communication interface, If the above content language and the above user language do not match, identify an external device connectable to the above electronic device, and Generate a control signal to output the second subtitle UI through the above external device, and An electronic device that transmits the above control signal to the external device through the communication interface.

11. In a method for controlling an electronic device, A step of obtaining content information including image frames and subtitle information; A step of obtaining the content language based on the above subtitle information; A step of obtaining a user language corresponding to the user of the electronic device; If the content language and the user language match, a step of displaying a first subtitle UI corresponding to the content language; and A control method comprising: displaying a second subtitle UI corresponding to the user language if the content language and the user language do not match.

12. In Paragraph 11, The step of acquiring the above user language is, A control method for obtaining the setting language of the OSD (On-Screen Display) of the electronic device in the user language.

13. In Paragraph 11, The step of acquiring the above user language is, Acquire user voice through the microphone of the above electronic device, and A control method for obtaining the user language corresponding to the user voice based on a language analysis model.

14. In Paragraph 11, The above control method is, A control method comprising: displaying a first guide UI for providing a second subtitle UI corresponding to the user language when the content language and the user language do not match.

15. In Paragraph 14, The step of displaying the second subtitle UI above is, A control method for displaying the second subtitle UI when user input to request the second subtitle UI is received through the first guide UI.

Images