Electronic device and control method therefor

Abstract

This electronic device comprises: a memory for storing instructions; a display; and at least one processor including processing circuitry, wherein, when executed individually or collectively by the at least one processor, the instructions display, on the display, a first screen including a plurality of thumbnail images for respective pieces of content, acquire content information of first content when a user input for selecting a first thumbnail image of the first content from among the plurality of thumbnail images is received, generate a guide UI on the basis of the content information, and display, on the display, a second screen including the guide UI when the user input is selected for a minimum threshold time.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a control method thereof. More specifically, the present disclosure relates to an electronic device that generates a guide UI that provides information related to content, and a control method thereof.

[0002] When a screen appears for selecting multiple content items, multiple thumbnail images may be displayed. A thumbnail image may represent a single image or text representing the content. Since the thumbnail image is provided by the content creator, it may differ from the actual content contained within the content.

[0003] Thumbnail images can contain provocative or exaggerated language to attract users' attention. When users select content through thumbnail images, they may experience discomfort as they select items that are different from the actual content.

[0004] Additionally, users may have difficulty understanding the content's content based solely on the thumbnail image. If the thumbnail image doesn't display text, it can be difficult for users to understand the content's content based solely on the image.

[0005] The present disclosure is designed to improve the above-described problem, and an object of the present disclosure is to provide an electronic device and a control method thereof that generate a guide UI related to content to provide information different from a displayed thumbnail image.

[0006] According to one embodiment, an electronic device includes at least one processor including a memory storing instructions, a display, and processing circuitry, wherein the instructions, when individually or collectively executed by the at least one processor, display a first screen including a plurality of thumbnail images for each of a plurality of contents on the display, and when a user input for selecting a first thumbnail image of the first content among the plurality of thumbnail images is received, acquire content information of the first content, generate a guide UI based on the content information, and when the user input is selected for a minimum threshold time, display a second screen including the guide UI on the display.

[0007] The instructions, when individually or collectively executed by the at least one processor, may control the display to display an activation UI at a location corresponding to the first thumbnail image when the user input is received, and may display the second screen including the guide UI on the display when the location of the activation UI is maintained for the minimum threshold time.

[0008] The above instructions, when individually or collectively executed by the at least one processor, may cause the second screen including the guide UI to be displayed on the display when a touch input for selecting the first thumbnail image is maintained for a minimum threshold time or longer.

[0009] The content information may include at least one of image data, audio data, thumbnail data, or metadata of the first content, wherein the thumbnail data may include the first thumbnail image, and the metadata may include at least one of a title, an author, a supplier, a cast, a story summary, a resolution, a codec, or a viewing restriction age.

[0010] The above instructions, when individually or collectively executed by the at least one processor, may identify a thumbnail text based on the first thumbnail image, obtain a representative text of the first content based on the content information, and generate the guide UI when a preset event related to the thumbnail text is identified.

[0011] The above instructions, when individually or collectively executed by the at least one processor, may generate the guide UI based on the similarity between the thumbnail text and the representative text.

[0012] The above instructions, when individually or collectively executed by the at least one processor, cause the guide UI to be generated if the thumbnail text includes a preset text, and the preset text may include at least one of an interrogative expression, an exaggerated expression, or an advertising expression.

[0013] The above instructions, when individually or collectively executed by the at least one processor, may obtain user information including at least one of an account, name, age, gender, language, country, health, or preference category, and generate the guide UI based on the content information and the user information.

[0014] The above instructions, when individually or collectively executed by the at least one processor, may obtain environmental information including at least one of location, date, and weather, and generate the guide UI based on the content information and the environmental information.

[0015] The above instructions, when individually or collectively executed by the at least one processor, may obtain screen information including at least one of the resolution of the display or the resolution of the area where the first thumbnail image is displayed, and generate the guide UI based on the content information and the screen information.

[0016] According to one embodiment, a control method of an electronic device includes an operation of displaying a first screen including a plurality of thumbnail images for each of a plurality of contents, an operation of obtaining content information of the first content when a user input for selecting a first thumbnail image of the first content from among the plurality of thumbnail images is received, an operation of generating a guide UI based on the content information, and an operation of displaying a second screen including the guide UI when the user input is selected for a minimum threshold time.

[0017] The above control method includes an operation of displaying an activation UI at a location corresponding to the first thumbnail image when the user input is received, and the operation of displaying the second screen may display the second screen including the guide UI when the location of the activation UI is maintained for the minimum threshold time.

[0018] The action of displaying the second screen may display the second screen including the guide UI when a touch input for selecting the first thumbnail image is maintained for a minimum threshold time or longer.

[0019] The content information may include at least one of image data, audio data, thumbnail data, or metadata of the first content, wherein the thumbnail data may include the first thumbnail image, and the metadata may include at least one of a title, an author, a supplier, a cast, a story summary, a resolution, a codec, or a viewing restriction age.

[0020] The above control method includes an operation of identifying a thumbnail text based on the first thumbnail image and an operation of obtaining a representative text of the first content based on the content information, and the operation of generating the guide UI can generate the guide UI when a preset event related to the thumbnail text is identified.

[0021] FIG. 1 is a drawing for explaining an operation of displaying a guide UI according to one embodiment.

[0022] FIG. 2 is a block diagram illustrating an electronic device according to one embodiment.

[0023] FIG. 3 is a block diagram illustrating a specific configuration of the electronic device of FIG. 2, according to one embodiment.

[0024] FIG. 4 is a drawing for explaining a guide UI generation model according to one embodiment.

[0025] FIG. 5 is a flowchart illustrating an operation of generating a guide UI according to one embodiment.

[0026] FIG. 6 is a flowchart illustrating an operation of generating a guide UI when a preset user input is identified, according to one embodiment.

[0027] FIG. 7 is a flowchart illustrating an operation of obtaining at least one of content information, user information, or environment information when a preset user input is identified, according to one embodiment.

[0028] FIG. 8 is a flowchart illustrating an operation of obtaining at least one of content information, user information, or environment information before a user input for selecting first content is received, according to one embodiment.

[0029] FIG. 9 is a flowchart illustrating an operation of generating a guide UI according to a preset event, according to one embodiment.

[0030] FIG. 10 is a flowchart illustrating an operation of comparing representative text and thumbnail text according to one embodiment.

[0031] FIG. 11 is a flowchart illustrating an operation for determining whether thumbnail text includes preset text, according to one embodiment.

[0032] FIG. 12 is a drawing for explaining an operation of selecting first content according to one embodiment.

[0033] FIG. 13 is a drawing for explaining an operation of generating a guide UI according to one embodiment.

[0034] FIG. 14 is a diagram for explaining an operation of generating a guide UI when thumbnail text includes an interrogative expression, according to one embodiment.

[0035] FIG. 15 is a diagram for explaining an operation of generating a guide UI when thumbnail text includes exaggerated expressions, according to one embodiment.

[0036] FIG. 16 is a diagram illustrating an operation of generating a guide UI when thumbnail text is not related to an image, according to one embodiment.

[0037] FIG. 17 is a diagram for explaining an operation of generating a guide UI for real-time content according to one embodiment.

[0038] FIG. 18 is a drawing for explaining an operation of generating a guide UI for sports content according to one embodiment.

[0039] FIG. 19 is a drawing for explaining an operation of generating multiple guide UIs for one content according to one embodiment.

[0040] FIG. 20 is a drawing for explaining an operation of generating a guide UI according to resolution, according to one embodiment.

[0041] FIG. 21 is a drawing for explaining an operation of generating a guide UI according to age, according to one embodiment.

[0042] FIG. 22 is a drawing for explaining an operation of generating a guide UI according to a language, according to one embodiment.

[0043] FIG. 23 is a drawing for explaining an operation of generating a guide UI based on the placement position of an electronic device, according to one embodiment.

[0044] FIG. 24 is a drawing for explaining an operation of displaying a guide UI overlapping thumbnail text according to one embodiment.

[0045] FIG. 25 is a drawing for explaining an operation of generating a screen including a guide UI according to one embodiment.

[0046] FIG. 26 is a drawing for explaining an operation of applying transparency of a guide UI according to one embodiment.

[0047] FIG. 27 is a drawing for explaining an operation of displaying a guide UI according to the size of an area where content is displayed, according to one embodiment.

[0048] FIG. 28 is a drawing for explaining an operation of displaying a guide UI in an area different from an area where content is displayed, according to one embodiment.

[0049] FIG. 29 is a flowchart illustrating an operation of generating a guide UI by considering the category of content, according to one embodiment.

[0050] FIG. 30 is a flowchart for explaining a method for controlling an electronic device, according to one embodiment.

[0051] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0052] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0053] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0054] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0055] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0056] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0057] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, operation, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, operations, operations, components, parts, or combinations thereof.

[0058] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor, excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0059] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0060] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0061] FIG. 1 is a drawing for explaining an operation of displaying a guide UI according to one embodiment.

[0062] Referring to FIG. 1, the electronic device (100) can display multiple contents (A, B, C). The electronic device (100) can display thumbnails for displaying the multiple contents (A, B, C).

[0063] The electronic device (100) can display a first thumbnail corresponding to content A in a first area (11). The electronic device (100) can display a second thumbnail corresponding to content B in a second area (12). The electronic device (100) can display a third thumbnail corresponding to content C in a third area (13).

[0064] The electronic device (100) may display an activation UI (10) indicating content (or thumbnail) selected by the user. The activation UI (10) may be a UI indicating the currently selected content. The activation UI (10) may include a highlight UI for indicating the content currently selected by the user. The activation UI (10) may include a UI guiding the location of the selected content (or thumbnail). The location at which the activation UI (10) is displayed may change depending on the user's input.

[0065] The electronic device (100) can display an activation UI (10) based on an area where a content (or thumbnail) selected by the user is displayed among areas where thumbnails of multiple contents are displayed.

[0066] For example, when a user input for selecting content B is received, the electronic device (100) can display an activation UI (10) in an area (12) where a second thumbnail of content B is displayed.

[0067] When a preset user input is identified, the electronic device (100) can display a guide UI (20) related to B content.

[0068] The guide UI (20) may be a UI that provides information about selected content. The guide UI (20) may include at least one of information describing the selected content and information summarizing the content.

[0069] For example, the guide UI (20) may include the text “no.1 views today.” The electronic device (100) may analyze information about content B and display the guide UI (20) indicating that content B has the highest number of views today. The electronic device (100) may display the guide UI (20) in the second area (12) where content B is displayed.

[0070] A preset user input may represent a user input that selects a single piece of content for a threshold period of time or longer. Details related to the preset user input are described in FIG. 5.

[0071] FIG. 2 is a block diagram illustrating an electronic device (100) according to one embodiment.

[0072] An electronic device (100) may include at least one of a memory (110) for storing instructions, a display (140), and at least one processor (120) including processing circuitry.

[0073] At least one processor (120) controls the display (140) to display a first screen including a plurality of thumbnail images for each of a plurality of contents, and when a user input for selecting a first thumbnail image of the first content among the plurality of thumbnail images is received, the display (140) can be controlled to obtain content information of the first content, generate a guide UI based on the content information, and when the first thumbnail image is selected for a threshold time or longer, the display (140) can be controlled to display a second screen including the guide UI.

[0074] At least one processor (120) may display a first screen for providing a plurality of contents. At least one processor (120) may display a first screen including thumbnail images representing each of the plurality of contents.

[0075] A thumbnail image may be described as at least one of a preview image, a thumbnail image, or a summary image.

[0076] For example, the first screen may be a screen for providing first content, second content, and third content. The first screen may include a first thumbnail image for selecting the first content, a second thumbnail image for selecting the second content, and a third thumbnail image for selecting the third content.

[0077] The user can select specific content or a specific thumbnail image through the first screen. The first screen is described in FIG. 1 and FIG. 12.

[0078] At least one processor (120) may receive a user input for selecting a first thumbnail image representing the first content from among a plurality of thumbnail images.

[0079] For example, user input may be received via a remote control device that is in communication with the electronic device (100).

[0080] At least one processor (120) may control the display (140) to display an activation UI at a location corresponding to the first thumbnail image when a user input for selecting the first thumbnail image is received. At least one processor (120) may control the display (140) to display a second screen including a guide UI when the location of the activation UI does not change for a threshold time. An embodiment related to this is described in embodiment (1210) of FIG. 12.

[0081] For example, the electronic device (100) can directly receive user input. The user can input user input into the electronic device (100) through a touch sensor unit (or touch panel).

[0082] At least one processor (120) can control the display (140) to display a second screen including a guide UI when a touch input for selecting a first thumbnail image is maintained (or persists) for a threshold time (e.g., a minimum threshold time).

[0083] Content information may include at least one of image data, audio data, thumbnail data, or metadata of the first content. The thumbnail data may include the first thumbnail image. The metadata may include at least one of the title, author, provider, cast, story summary, resolution, codec, or age restriction.

[0084] At least one processor (120) may generate a guide UI based on at least one of image data, audio data, thumbnail data, or metadata included in the content information. The image data may be described as video data. The content may include image data and audio data. Content related to the content information is described in FIG. 4.

[0085] At least one processor (120) can identify thumbnail text based on the first thumbnail image. At least one processor (120) can obtain representative text of the first content based on content information. At least one processor (120) can generate a guide UI when a preset event related to the thumbnail text is identified.

[0086] At least one processor (120) can identify (or acquire) a first thumbnail image displayed on a first screen. At least one processor (120) can acquire (or extract) thumbnail text based on the first thumbnail image. The first thumbnail image may include thumbnail text. The thumbnail text may be information created by the creator of the first content. The first thumbnail image may not match the actual content of the first content.

[0087] At least one processor (120) can obtain (or identify) a representative text based on content information. At least one processor (120) can identify the representative text based on at least one of image data, audio data, or metadata included in the content information. A description thereof is provided in FIG. 9.

[0088] At least one processor (120) may receive image data and / or audio data corresponding to the first content. At least one processor (120) may obtain a representative text based on the image data and / or audio data received during a preset period of time. It may take a long time for the at least one processor (120) to analyze the entire image data and the entire audio data of the first content. Therefore, at least one processor (120) may obtain the representative text based on the image data and / or audio data received during a preset period of time. The preset period of time may be changed according to a user's settings.

[0089] At least one processor (120) can receive metadata corresponding to the first content. At least one processor (120) can obtain a representative text based on a story summary (or summary information) included in the metadata.

[0090] At least one processor (120) can obtain the similarity between the thumbnail text and the representative text, and if the similarity is below a threshold value, can generate a guide UI. A description related to this is provided in FIG. 10.

[0091] At least one processor (120) can generate a guide UI if the thumbnail text includes a preset text. The preset text may include at least one of an interrogative expression, an exaggerated expression, or an advertising expression. A description thereof is provided in FIG. 11. The interrogative expression is described in FIG. 14. The exaggerated expression is described in FIG. 15. The advertising expression is described in FIG. 16.

[0092] At least one processor (120) may obtain user information including at least one of an account, name, age, gender, language, country, health, or preference category. At least one processor (120) may generate a guide UI based on content information and user information. An example of generating a guide UI based on age is described in FIG. 21. An example of generating a guide UI based on country is described in FIG. 22.

[0093] At least one processor (120) may acquire environmental information including at least one of location, date, and weather, and generate a guide UI based on the content information and environmental information. A description related to weather is provided in FIG. 17.

[0094] For example, at least one processor (120) can generate a guide UI based on a proverb or idiom corresponding to the user's age.

[0095] At least one processor (120) can provide multiple guide UIs for a single piece of content. At least one processor (120) can provide a first guide UI and a second guide UI corresponding to a single piece of content. For example, at least one processor (120) can display a second guide UI when a threshold time elapses from the time the first guide UI is displayed. An example of a guide UI changing over time is described in FIG. 19.

[0096] At least one processor (120) can obtain screen information including at least one of the resolution of the display (140) or the resolution of the area where the first thumbnail image is displayed. At least one processor (120) can generate a guide UI based on the content information and the screen information. The details of generating the guide UI based on the screen information are described in FIG. 20.

[0097] An embodiment of determining the type of guide UI based on the placement position of an electronic device (100) is described in FIG. 23. FIG. 23 discloses an embodiment of providing different types of guide UI depending on the placement position of an electronic device (100) placed in a mobile vehicle.

[0098] At least one processor (120) can determine settings (or display settings) related to the guide UI. At least one processor (120) can display the guide UI based on the determined settings.

[0099] For example, at least one processor (120) may display a guide UI based on the location where a first thumbnail image is displayed on the first screen. At least one processor (120) may control the display (140) to display a second screen including the guide UI. Contents related to display settings indicating the location or method of displaying the guide UI are disclosed in FIGS. 24 to 28.

[0100] The thumbnail image may be an image generated by the content provider. Therefore, the thumbnail image may differ from the subject matter of the actual content. The electronic device (100) can directly generate a representative text based on the content information and create a guide UI including the representative text. Since the guide UI generated by the electronic device (100) contains substantial information, the user can trust the guide UI.

[0101] FIG. 3 is a block diagram for explaining a specific configuration of the electronic device (100) of FIG. 2, according to one embodiment.

[0102] Referring to FIG. 3, the electronic device (100) may include at least one of a memory (110), at least one processor (120), a communication interface (130), a display (140), an operation interface (150), an input / output interface (160), a speaker (170), a microphone (180), and a camera (190).

[0103] The memory (110) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in at least one processor (120), or may be implemented as a separate memory from at least one processor (120). The memory (110) may be implemented as a memory embedded in the electronic device (100) or as a memory detachable from the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding functions of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0104] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and in the case of memory that can be detachably attached to the electronic device (100), it may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc.

[0105] The memory (110) can store at least one instruction. Based on the instruction stored in the memory (110), at least one processor (120) can perform various operations.

[0106] At least one processor (120) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an advanced reduced instruction set computer (RISC) machines (ARM) processor, or may be defined by the relevant terminology. At least one processor (120) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). At least one processor (120) may perform various functions by executing computer executable instructions stored in a memory.

[0107] The communication interface (130) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication interface (130) may include a wireless communication module or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.

[0108] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0109] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, various connection information, such as the service set identifier (SSID) and session key, is first transmitted and received. This information is then used to establish a communication connection before various other information can be transmitted and received.

[0110] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which is between visible light and millimeter waves.

[0111] In addition to the above-described communication method, other communication modules may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0112] A wired communication module may be a module that communicates with an external device via a wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a paired cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0113] According to one embodiment, the communication interface (130) may utilize the same communication module (e.g., a Wi-Fi module) to communicate with an external device such as a remote control device and an external server.

[0114] According to one embodiment, the communication interface (130) may utilize different communication modules to communicate with external devices, such as remote control devices, and external servers. For example, the communication interface (130) may utilize at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may also utilize a Bluetooth module to communicate with an external device, such as a remote control device. However, this is merely one embodiment, and the communication interface (130) may utilize at least one of various communication modules when communicating with multiple external devices or external servers.

[0115] The display (140) may be implemented as a display in various forms, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a plasma display panel (PDP), etc. The display (140) may also include a driving circuit, a backlight unit, etc., which may be implemented in forms such as an a-si TFT (amorphous silicon thin film transistor), an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. The display (140) may be implemented as a touch screen combined with a touch sensor, a flexible display, a three-dimensional display (3D display, three-dimensional display), etc. According to an embodiment of the present disclosure, the display (140) may include not only a display panel that outputs an image, but also a bezel that houses the display panel. In particular, according to an embodiment of the present disclosure, the bezel may include a touch sensor for detecting user interaction.

[0116] The operating interface (150) may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or as a touch screen capable of performing the aforementioned display functions and receiving user input. The button may be a mechanical button, a touch pad, a wheel, or any other type of button formed on any area of ​​the front, side, or back of the main body of the electronic device (100).

[0117] The input / output interface (160) may be any one of HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). The input / output interface (160) may input / output at least one of audio and video signals. Depending on the implementation example, the input / output interface (160) may include a port that inputs / outputs only audio signals and a port that inputs / outputs only video signals as separate ports, or may be implemented as a single port that inputs / outputs both audio signals and video signals. The electronic device (100) may transmit at least one of the audio and video signals to an external device (e.g., an external display device or an external speaker) through the input / output interface (160). An output port included in the input / output interface (160) can be connected to an external device, and the electronic device (100) can transmit at least one of an audio and video signal to the external device through the output port.

[0118] The input / output interface (160) can be connected to a communication interface. The input / output interface (160) can transmit information received from an external device to the communication interface or transmit information received through the communication interface to the external device.

[0119] The speaker (170) may be a component that outputs various audio data as well as various notification sounds or voice messages.

[0120] The microphone (180) is a component that receives a user's voice or other sounds and converts them into audio data. The microphone (180) can receive the user's voice in an activated state. For example, the microphone (180) can be formed integrally on the upper side, the front side, the side side, etc. of the electronic device (100). The microphone (180) can include various components such as a microphone that collects the user's voice in analog form, an amplifier circuit that amplifies the collected user's voice, an A / D conversion circuit that samples the amplified user's voice and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.

[0121] The camera (190) is a device configured to capture a subject and generate a captured image, and the captured image includes both moving images and still images. The camera (190) can acquire images for at least one external device and can be implemented with a camera, lens, infrared sensor, or the like.

[0122] The camera (190) may include a lens and an image sensor. The type of lens may include a general-purpose lens, a wide-angle lens, a zoom lens, etc., and may be determined according to the type, characteristics, usage environment, etc. of the electronic device (100). The image sensor may include a complementary metal oxide semiconductor (CMOS) and a charge-coupled device (CCD).

[0123] FIG. 4 is a drawing for explaining a guide UI generation model according to one embodiment.

[0124] Referring to FIG. 4, the electronic device (100) can obtain a guide UI based on a guide UI generation model (400).

[0125] According to one embodiment, the electronic device (100) can store a guide UI generation model (400). The electronic device (100) can store the guide UI generation model (400) in a memory (110) in an on-device manner. The electronic device (100) can obtain a guide UI using the stored guide UI generation model (400).

[0126] According to one embodiment, the guide UI generation model (400) may be stored on a server. The electronic device (100) may request the guide UI from the server. The electronic device (100) may receive the guide UI generated by the guide UI generation model (400) from the server.

[0127] The guide UI generation model (400) can receive at least one of content information, user information, environment information, or screen information as input data.

[0128] Content information may indicate information related to user-selectable content. The content information may include at least one of image data, audio data, thumbnail data, and metadata.

[0129] Image data can represent an image representing content.

[0130] Audio data can represent audio representing content.

[0131] Thumbnail data may include a thumbnail image or thumbnail text that describes the content. For example, a thumbnail image may contain text.

[0132] Metadata can include information related to content. Metadata can be pre-generated data from the source device providing the content. The source device can be a content provider server. For example, metadata can include at least one of the following: title, author, provider, cast, story summary, resolution, codec, and age restriction.

[0133] User information may include information related to the user. User information may include identifying information for identifying the user or personal information related to the user. For example, user information may include at least one of the following: account, name, age, gender, language, country, health, and preference categories.

[0134] Environmental information may represent information about the environment associated with the electronic device (100) or the user. The environment may include information related to the surrounding environment of the current location of the electronic device (100). The surrounding environment may change according to the user's settings. For example, the environmental information may include at least one of location, date, and weather.

[0135] Screen information can indicate the size of the area where the guide UI is displayed. The screen information can include a resolution. The screen information can include at least one of the resolution (or size) of the entire area including the guide UI or the resolution (or size) of the thumbnail area. The thumbnail area can be an area where thumbnails of the corresponding resolution are displayed.

[0136] Guide UI can be output in a variety of ways.

[0137] For example, the guide UI may be output through a display device. The resolution may indicate the size that can be displayed on the display. The resolution may include at least one of the resolution of the entire area where the display device can display images and the resolution of the thumbnail area where thumbnail images are displayed.

[0138] For example, the guide UI can be output to a projection surface. An electronic device (100) performing a projector function can output a projection image including the guide UI to the projection surface. The guide UI generation model (400) can receive the resolution (or size) of the projection surface.

[0139] The guide UI generation model (400) can generate a guide UI based on at least one of content information, user information, environment information, and screen information.

[0140] The guide UI generation model (400) can obtain representative text of the content based on image data and audio data included in the content information. The guide UI generation model (400) can identify whether a thumbnail is suitable for the content based on thumbnail data included in the content information. The guide UI generation model (400) can identify representative text based on metadata included in the content information. A description related to this is provided in FIG. 10.

[0141] The guide UI generation model (400) can generate a guide UI based on user information.

[0142] For example, the guide UI generation model (400) can generate a guide UI that includes the user's name.

[0143] For example, the guide UI generation model (400) can generate a guide UI using words (or text size) appropriate for the user's age.

[0144] For example, the guide UI generation model (400) can generate a guide UI using a color (or word) appropriate for the user's gender.

[0145] For example, the guide UI generation model (400) can generate a guide UI based on the user's language.

[0146] For example, the guide UI generation model (400) can generate a guide UI based on a language corresponding to the user's country.

[0147] For example, the guide UI generation model (400) may generate a guide UI by considering the user's health (or health information). The guide UI generation model (400) may generate a guide UI that includes information related to the user's health.

[0148] For example, the guide UI generation model (400) can generate a guide UI based on a user's preferred category. The guide UI generation model (400) can generate a guide UI in a first color. If content in the same category as the preferred category is selected, the guide UI generation model (400) can generate a guide UI in a second color different from the first color.

[0149] For example, the guide UI generation model (400) can generate a guide UI including text indicating the current location based on the location included in the environmental information.

[0150] As an example, the guide UI generation model (400) can generate a guide UI that includes text indicating a date included in the environmental information.

[0151] As an example, the guide UI generation model (400) can generate a guide UI that includes text indicating weather included in the environmental information.

[0152] For example, the guide UI generation model (400) can generate a guide UI based on the resolution included in the screen information. The guide UI generation model (400) can determine the size of the guide UI based on the resolution. The size of the guide UI can include at least one of the size of the area where the guide UI is displayed or the size of the text included in the guide UI.

[0153] FIG. 5 is a flowchart illustrating an operation of generating a guide UI according to one embodiment.

[0154] Referring to FIG. 5, the electronic device (100) can display (or provide) multiple thumbnail images for multiple contents (S510). The electronic device (100) can receive a user input for selecting a first thumbnail image of a first content among the multiple thumbnail images (S520).

[0155] For example, the electronic device (100) may be a TV. The electronic device (100) may be connected to a remote control device capable of controlling the electronic device (100). The electronic device (100) may receive user input from the remote control device.

[0156] For example, the electronic device (100) may be a smart device. The electronic device (100) may receive a user's touch input (a touch by hand or a touch by a smart pen).

[0157] The electronic device (100) can obtain at least one of content information, user information, environment information, and screen information (S530).

[0158] The electronic device (100) can generate a guide UI based on at least one of content information, user information, environment information, and screen information (S540).

[0159] For example, the electronic device (100) can generate a guide UI using only content information.

[0160] For example, the electronic device (100) can generate a guide UI using content information and user information.

[0161] For example, the electronic device (100) can generate a guide UI using content information and environmental information.

[0162] For example, the electronic device (100) can generate a guide UI using content information and screen information.

[0163] For example, the electronic device (100) can generate a guide UI using content information, user information, and environment information.

[0164] For example, the electronic device (100) can generate a guide UI using content information, user information, and screen information.

[0165] For example, the electronic device (100) can generate a guide UI using content information, environment information, and screen information.

[0166] For example, the electronic device (100) can generate a guide UI using content information, user information, environment information, and screen information.

[0167] The electronic device (100) can identify a preset user input for the first content among a plurality of thumbnail images (S550). The preset user input may represent a user input set in advance. The preset user input may include a pattern of preset user input.

[0168] For example, the preset user input may include an input for selecting specific content for a threshold period of time or longer. The preset user input may include an input pattern for selecting specific content and not selecting other content for a threshold period of time or longer.

[0169] An input to select specific content for a threshold time or longer may indicate an input to display specific content for a threshold time or longer on the activation UI.

[0170] An input to select specific content for a threshold time or longer may represent an input that touches specific content for a threshold time or longer.

[0171] For example, the preset user input may include a user input for selecting specific content via a specific key. The preset user input may include an input for selecting specific content via a specific key among a plurality of keys included in the operating interface of the electronic device (100).

[0172] For example, the preset user input may include a user input that selects the first content in a specific mode. The specific mode may be a mode that displays a guide UI.

[0173] For example, a preset user input may include an input that stops a touch drag at a location on a particular piece of content for a threshold amount of time.

[0174] In one embodiment, the operation of identifying whether a preset user input of the S550 operation is received may be described as an operation of identifying whether a preset event has occurred.

[0175] If a preset user input is identified (S550-Y), the electronic device (100) can display (or provide) a guide UI (S560). If a preset user input is not identified (S550-N), the electronic device (100) can display multiple thumbnail images for multiple contents (S510).

[0176] Referring to the embodiment of FIG. 5, the electronic device (100) can pre-generate a guide UI and determine whether a preset user input is identified while the guide UI is being generated. If the preset user input is identified, the electronic device (100) immediately displays (or provides) the first content. If a preset user input is received, processing time may be required to generate the guide UI.

[0177] FIG. 6 is a flowchart illustrating an operation of generating a guide UI when a preset user input is identified, according to one embodiment.

[0178] The operations S610, S620, S630, S640, S650, and S660 of FIG. 6 may correspond to the operations S510, S520, S530, S540, S550, and S560 of FIG. 5. Duplicate explanations are omitted.

[0179] Unlike FIG. 5, in the embodiment of FIG. 6, the operation (S650) for identifying a preset user input may be generated before the operation (S640) for generating a guide UI. The electronic device (100) may determine whether a preset user input is identified when at least one of content information, user information, environment information, and screen information is received. The electronic device (100) may generate a guide UI when a preset user input is identified.

[0180] FIG. 7 is a flowchart illustrating an operation of obtaining at least one of content information, user information, environment information, and screen information when a preset user input is identified, according to one embodiment.

[0181] The operations S710, S720, S730, S740, S750, and S760 of FIG. 7 may correspond to the operations S510, S520, S530, S540, S550, and S560 of FIG. 5. Duplicate explanations are omitted.

[0182] Unlike FIG. 5, in the embodiment of FIG. 7, the operation (S750) of identifying a preset user input can be performed before the operation (S730) of receiving at least one of content information, user information, environment information, and screen information.

[0183] The electronic device (100) can receive at least one of content information, user information, environment information, and screen information (S730) and generate a guide UI (S740) only when a preset user input is identified.

[0184] This is because, if at least one of content information, user information, environment information, and screen information is received before identifying a preset user input, there is a high probability that unnecessary information is stored. Even if the time taken to generate a guide UI is longer than in the embodiments of FIG. 5 and FIG. 6, the electronic device (100) can receive at least one of content information, user information, environment information, and screen information after identifying a preset user input.

[0185] FIG. 8 is a flowchart illustrating an operation of obtaining at least one of content information, user information, environment information, and screen information before a user input for selecting a first thumbnail image of first content is received, according to one embodiment.

[0186] Operations S810, S820, S830, S840, S850, and S860 of FIG. 8 may correspond to operations S510, S520, S530, S540, S550, and S560 of FIG. 5. Duplicate explanations are omitted.

[0187] Unlike FIG. 5, in the embodiment of FIG. 8, the operation (S830) of receiving at least one of content information, user information, environment information, and screen information may be performed before the operation (S820) of receiving a user input for selecting a first thumbnail image of the first content.

[0188] The electronic device (100) can immediately receive at least one of content information, user information, environment information, and screen information after the operation (S810) of displaying multiple contents. This is to shorten the time required to generate a guide UI by receiving information for generating a guide UI in advance.

[0189] FIG. 9 is a flowchart illustrating an operation of generating a guide UI according to a preset event, according to one embodiment.

[0190] The operations S910, S920, S930, S940, S950, and S960 of FIG. 9 may correspond to the operations S510, S520, S530, S540, S550, and S560 of FIG. 5. Duplicate explanations are omitted.

[0191] After receiving at least one of content information, user information, environment information, and screen information, the electronic device (100) can determine whether a preset event is identified for the first content among the plurality of thumbnail images (S935).

[0192] For example, a preset event may indicate an event in which the subject matter of the content and the thumbnail do not match. The electronic device (100) may determine the subject matter of the content based on a description provided in the content. The subject matter may be described as summary information. The subject matter may include representative text. The electronic device (100) may determine whether the subject matter of the content matches the thumbnail. If the subject matter of the content does not match the thumbnail, the electronic device (100) may determine to provide a new thumbnail. A detailed description of this is provided in FIG. 11.

[0193] For example, a preset event may include an event in which a thumbnail is identified by containing a preset word (or phrase). The preset word may include at least one of an interrogative expression, an exaggerated expression, or an advertising expression. A detailed description of this is provided in Figure 12.

[0194] If a preset event for the first content among the plurality of thumbnail images is identified (S935-Y), the electronic device (100) can receive at least one of content information, user information, environment information, and screen information (S940). The electronic device (100) can perform operations S950 and S960. If a preset event for the first content among the plurality of thumbnail images is not identified (S935-N), the electronic device (100) can move to operation S910.

[0195] For example, operation S935 may be performed after operation S940.

[0196] For example, operation S935 may be performed after operation S950.

[0197] FIG. 10 is a flowchart illustrating an operation of comparing representative text and thumbnail text according to one embodiment.

[0198] Referring to FIG. 10, the electronic device (100) can obtain a thumbnail image corresponding to the first content (S1005). The electronic device (100) can extract the thumbnail image from the area where the thumbnail image corresponding to the first content is displayed. The electronic device (100) can identify the thumbnail text based on the thumbnail image (S1010).

[0199] The electronic device (100) can analyze a thumbnail image to identify thumbnail text. The electronic device (100) can identify text included in the thumbnail image.

[0200] For example, the electronic device (100) can obtain thumbnail text using OCR (Optical Character Recognition).

[0201] For example, the electronic device (100) can obtain thumbnail text using Automatic Content Recognition (ACR).

[0202] For example, the electronic device (100) can obtain thumbnail text using a text extraction model. The text extraction model may be an artificial intelligence model and may include an algorithm for extracting text from an image.

[0203] A thumbnail image may not include thumbnail text. The electronic device (100) may identify an object corresponding to the thumbnail image and identify text representing the identified object as thumbnail text.

[0204] For example, a thumbnail image may not contain text itself, but may simply contain an apple image (or object). The electronic device (100) may identify the thumbnail text as 'apple' based on the apple image (or object) contained in the thumbnail image.

[0205] The electronic device (100) can obtain a representative text corresponding to the first content (S1015). The representative text may be text representing the first content. The representative text may include summary information describing the first content. The representative text may include information indicating the subject matter of the first content.

[0206] For example, the electronic device (100) can obtain representative text based on image data included in content information.

[0207] For example, the electronic device (100) can obtain representative text based on audio data included in content information.

[0208] The electronic device (100) may receive content information related to the first content in a background environment while displaying a thumbnail of the first content. The electronic device (100) may obtain at least one of image data or audio data from the received content information. The electronic device (100) may obtain a representative text based on at least one of the image data or audio data.

[0209] For example, the electronic device (100) may obtain a representative text based on metadata included in content information. The electronic device (100) may obtain the representative text based on at least one of a title and a story summary included in the metadata.

[0210] The electronic device (100) can obtain a representative text of the first content based on content information. The electronic device (100) can obtain the representative text of the first content based on at least one of image data of the first content, audio data of the first content, or metadata of the first content.

[0211] The featured text may be automatically generated information, not created by the original content creator. Thumbnails may contain information unrelated to the actual content. However, the featured text may be consistent with the actual content. Therefore, creating a guide UI using featured text can provide more accurate information to users.

[0212] The electronic device (100) can obtain (or calculate) the similarity between the representative text and the thumbnail text (S1020). The electronic device (100) can determine whether the similarity is below a threshold (S1025). Similarity may be a concept that includes the similarity of the words themselves and the similarity of the word meanings through text comparison. The electronic device (100) can compare the representative text and the thumbnail text to determine whether the thumbnail matches the subject of the content. The threshold may be changed according to the user's settings.

[0213] If the similarity is less than the threshold value (S1025-Y), the electronic device (100) can generate a guide UI based on at least one of representative text, user information, environment information, and screen information (S1030).

[0214] If the similarity is below a threshold, the electronic device (100) can identify that the thumbnail does not match the subject matter of the content. If the thumbnail does not match the actual subject matter of the content, it may hinder the user from selecting the content. The electronic device (100) can provide accurate information to the user selecting the content by displaying a new guide UI.

[0215] FIG. 11 is a flowchart illustrating an operation for determining whether thumbnail text includes preset text, according to one embodiment.

[0216] Operations S1105, S1110, S1115, and S1130 of FIG. 11 may correspond to operations S1005, S1010, S1015, and S1030 of FIG. 10. Duplicate explanations are omitted.

[0217] After acquiring the representative text, the electronic device (100) can identify whether the thumbnail text includes a preset text (S1125). The preset text may include text that serves as a reference for identifying a preset event for generating a guide UI. The electronic device (100) can determine whether to generate a guide UI based on whether the thumbnail text includes the preset text.

[0218] For example, the preset text may include at least one of an interrogative expression, an exaggerated expression, or an advertising expression. The preset text may include at least one predefined expression (or word or sentence). The preset text may be changed (or updated) by the user.

[0219] For example, the preset text representing an interrogative expression may include at least one of where, when, why, what, who, how, how many, which, and how much. The preset text representing an interrogative expression may include a question mark symbol.

[0220] For example, a preset text representing an exaggerated expression may include at least one of the following: best, highest, maximum, excellent, first, strongest, superlative, foremost, above all, absolutely, and essential.

[0221] For example, the advertising expression may include at least one of the following preset texts: popular, free, special, limited, new, anticipated, instant, cheap, effective, and perfect.

[0222] If the thumbnail text includes preset text (S1125-Y), the electronic device (100) can generate a guide UI based on at least one of the representative text, user information, environment information, or screen information (S1130).

[0223] FIG. 12 is a drawing for explaining an operation of selecting a first thumbnail image of a first content, according to one embodiment.

[0224] Referring to an embodiment (1210) of FIG. 12, an electronic device (100) may be connected to a remote control device capable of controlling the electronic device (100). The electronic device (100) may receive a user input from the remote control device. When a user input for selecting a specific content (B content) is received from the remote control device, the electronic device (100) may display an activation UI (10) in an area where the B content (or a thumbnail of the B content) is displayed.

[0225] Referring to the embodiment (1220) of FIG. 12, the electronic device (100) can directly receive user input. The electronic device (100) can receive a user input touching the display (140) of the electronic device (100). The electronic device (100) can directly receive a user input for selecting a specific content (B content). When a user input for selecting a specific content (B content) is received, the electronic device (100) can display an activation UI (10) in an area where the B content (or a thumbnail of the B content) is displayed.

[0226] FIG. 13 is a drawing for explaining an operation of generating a guide UI according to one embodiment.

[0227] Referring to embodiment 1310 of FIG. 13, the electronic device (100) may display a thumbnail image of content selected by the user. The thumbnail image may include the thumbnail text of 'Camping Tips'.

[0228] Referring to the embodiment (1320) of FIG. 13, the electronic device (100) can display a guide UI (1321). The electronic device (100) can generate the guide UI (1321) based on at least one of content information, user information, environment information, and resolution information.

[0229] For example, the electronic device (100) can analyze content information to obtain representative text. The electronic device (100) can analyze the content information to obtain representative text including "Camping Equipment Introduction," "Black Folding Chair," and "Mesh Material." The electronic device (100) can display a guide UI (1321) including the representative text.

[0230] FIG. 14 is a diagram for explaining an operation of generating a guide UI when thumbnail text includes an interrogative expression, according to one embodiment.

[0231] Referring to embodiment (1410) of FIG. 14, the electronic device (100) can obtain thumbnail text from a thumbnail image. The electronic device (100) can identify an interrogative expression ("Why should I go camping now?") from the thumbnail text.

[0232] Referring to the embodiment (1420) of FIG. 14, when an interrogative expression is identified in the thumbnail text, the electronic device (100) can generate a guide UI (1421). A description related to the representative text included in the guide UI (1421) is described in FIG. 13. Duplicate descriptions are omitted.

[0233] FIG. 15 is a diagram for explaining an operation of generating a guide UI when thumbnail text includes exaggerated expressions, according to one embodiment.

[0234] Referring to the embodiment (1510) of FIG. 15, the electronic device (100) can obtain thumbnail text from a thumbnail image. The electronic device (100) can identify an exaggerated expression (e.g., "essential camping equipment") in the thumbnail text. If the thumbnail text includes a preset text, the electronic device (100) can identify that the thumbnail image includes an exaggerated expression. The preset text for identifying the exaggerated expression may include "essentially."

[0235] Referring to the embodiment (1520) of FIG. 15, if an exaggerated expression is identified in the thumbnail text, the electronic device (100) can generate a guide UI (1521). A description related to the representative text included in the guide UI (1521) is described in FIG. 13. Duplicate descriptions are omitted.

[0236] FIG. 16 is a diagram illustrating an operation of generating a guide UI when thumbnail text is not related to an image, according to one embodiment.

[0237] Referring to embodiment 1610 of FIG. 16, the electronic device (100) can display a thumbnail image of content. The electronic device (100) can obtain thumbnail text from the thumbnail image. The electronic device (100) can identify an advertisement expression (essential camping equipment) from the thumbnail text. If the thumbnail text includes a preset text, the electronic device (100) can identify that the thumbnail image includes an advertisement expression. The preset text for identifying the advertisement expression can include 'popular'.

[0238] Referring to the embodiment (1620) of FIG. 16, when an advertisement expression is identified in the thumbnail text, the electronic device (100) can generate a guide UI (1621). A description related to the representative text included in the guide UI (1621) is described in FIG. 13. Duplicate descriptions are omitted.

[0239] FIG. 17 is a diagram for explaining an operation of generating a guide UI for real-time content according to one embodiment.

[0240] Referring to embodiment 1710 of FIG. 17, the electronic device (100) can display a thumbnail image of real-time weather content. The electronic device (100) can receive content information corresponding to the thumbnail image. The electronic device (100) can identify the category of the content based on the content information. The electronic device (100) can determine whether the content category is real-time content.

[0241] If the content category is real-time content, the electronic device (100) can obtain environmental information. The environmental information may include at least one of location, date, and weather.

[0242] For example, the electronic device (100) can receive and store environmental information in advance. If the content category is identified as real-time content, the electronic device (100) can obtain (or call) the pre-stored environmental information.

[0243] For example, if a content category is identified as real-time content, the electronic device (100) may request environmental information from an external server. The external server may transmit environmental information to the electronic device (100) in response to the request from the electronic device (100). The electronic device (100) may receive environmental information from the external server.

[0244] Referring to the embodiment (1720) of FIG. 17, if the content category is real-time weather content, the electronic device (100) may generate a guide UI (1721) based on the weather included in the environmental information. The environmental information may include at least one of the current weather (currently clear) and the predicted weather (evening rain).

[0245] For example, the electronic device (100) may display a guide UI (1721) that includes weather and guide actions included in the environmental information. The guide actions may include information provided to the user related to the weather (e.g., preparing an umbrella).

[0246] FIG. 18 is a drawing for explaining an operation of generating a guide UI for sports content according to one embodiment.

[0247] Referring to embodiment 1810 of FIG. 18, an electronic device (100) can display a thumbnail image of real-time sports content. The electronic device (100) can receive content information corresponding to the thumbnail image. The electronic device (100) can identify the category of the content based on the content information. The electronic device (100) can determine whether the content category is real-time sports content.

[0248] If the content category is real-time sports content, the electronic device (100) can obtain sports broadcast information. The sports broadcast information may include at least one of team information, score information, game information, and broadcaster related to a sports game.

[0249] For example, the electronic device (100) may receive sports broadcast information along with a thumbnail image of the content. The sports broadcast information may be included in metadata.

[0250] Referring to an embodiment (1820) of FIG. 18, the electronic device (100) may display a guide UI (1821) including sports broadcast information. For example, the sports broadcast information may include at least one of team information (Country A, Country B), score information (3:0), and a broadcaster (Sport Channel).

[0251] FIG. 19 is a drawing for explaining an operation of generating multiple guide UIs for one content according to one embodiment.

[0252] Referring to the embodiment (1910) of FIG. 19, the electronic device (100) can display a thumbnail image of content. The electronic device (100) can display a thumbnail image including text (e.g., S-man).

[0253] Referring to an embodiment (1920) of FIG. 19, the electronic device (100) may display a first guide UI (1921) based on content information. The first guide UI (1921) may include text information including a first number of words. When a first threshold time elapses from the time when the content is selected, the electronic device (100) may display the first guide UI (1921).

[0254] Referring to the embodiment (1930) of FIG. 19, the electronic device (100) may display a second guide UI (1931) based on content information. The second guide UI (1931) may include text information including a second number of words. When a second threshold time elapses from the time the first guide UI (1921) is displayed, the electronic device (100) may display the second guide UI (1931).

[0255] For example, the first number may be greater than the second number. The electronic device (100) may display a guide UI with a smaller number of words over time. FIG. 19 illustrates an example in which the number of words included in the guide UI decreases over time.

[0256] For example, the first number may be smaller than the second number. The electronic device (100) may display a guide UI with a larger number of words over time. If a thumbnail of content is selected for a long period of time by the user, the electronic device (100) may display a guide UI that provides increasingly more information.

[0257] For example, the first critical time and the second critical time may be the same.

[0258] For example, the second critical time may be longer than the first critical time.

[0259] For example, the second critical time may be shorter than the first critical time.

[0260] FIG. 20 is a drawing for explaining an operation of generating a guide UI according to resolution, according to one embodiment.

[0261] The electronic device (100) can display a guide UI based on screen information. The screen information can include resolution information. The resolution information can include at least one of the resolution of the display on which the guide UI is displayed or the resolution of the area on which a thumbnail image of content selected by the user is displayed.

[0262] The resolution of a display can indicate the size of the total area of ​​the screen that is displayed.

[0263] The resolution of the area where the thumbnail image is displayed may indicate the size of a portion of the entire area of ​​the displayed screen where the thumbnail image is displayed.

[0264] For example, a guide UI can be displayed over the entire screen area.

[0265] For example, the guide UI may be displayed in some areas where thumbnail images are displayed.

[0266] The electronic device (100) can determine display settings related to the guide UI based on screen information. The display settings related to the guide UI can include at least one of text size and the number of text words. The electronic device (100) can determine at least one of the text size and the number of text words based on resolution information.

[0267] The electronic device (100) can display a guide UI based on the size of the entire screen area. The electronic device (100) can determine the size, position, text size, and number of text words of the guide UI by considering the size of the entire screen area.

[0268] Size can indicate the size of the area where the guide UI is displayed. Position can indicate the location where the guide UI is displayed. Text size can indicate the size of the text included in the guide UI. Text word count can indicate the number of words (or characters or lines) of text included in the guide UI.

[0269] Referring to the embodiment (2010) of FIG. 20, the electronic device (100) may have a display whose horizontal length is longer than its vertical length. The electronic device (100) may display a guide UI (2011) based on the horizontal and vertical lengths of the display.

[0270] Referring to the embodiment (2020) of FIG. 20, the electronic device (100) may have a display whose horizontal length is shorter than its vertical length. The electronic device (100) may display a guide UI (2021) based on the horizontal and vertical lengths of the display.

[0271] The horizontal length of the display of embodiment (2010) may be greater than the horizontal length of the display of embodiment (2020). The horizontal length of the guide UI (2011) of embodiment (2010) may be longer than the horizontal length of the guide UI (2021) of embodiment (2020).

[0272] FIG. 21 is a drawing for explaining an operation of generating a guide UI according to age, according to one embodiment.

[0273] Referring to FIG. 21, the electronic device (100) can display a guide UI (2111, 2121, 2131) based on the age included in the user information.

[0274] The electronic device (100) can obtain the age included in the user information.

[0275] Content information may include a viewing age restriction. Metadata included in the content information may include a viewing age restriction. For example, content may be restricted to those under 18 years of age. The electronic device (100) may compare the viewing age restriction with the age included in the user information. The electronic device (100) may generate a guide UI based on the comparison results.

[0276] If the user's age is above the viewing age limit for the content, the electronic device (100) may display a guide UI including a representative text.

[0277] If the user's age is lower than the viewing restriction age of the content, the electronic device (100) may display a guide UI including guide information indicating that viewing is not possible.

[0278] The electronic device (100) can identify a text size corresponding to an age. The electronic device (100) can store a mapping table that maps text sizes by age. The electronic device (100) can identify a text size corresponding to an age based on the mapping table. The electronic device (100) can display a guide UI based on the identified text size. The guide UI can be displayed in a larger text size as the age increases.

[0279] Age can be divided into preset groups. Those under 60 years of age can be classified into the first group. Those over 60 years of age can be classified into the second group. The mapping table can include a first text size corresponding to the first group and a second text size corresponding to the second group. The second text size can be larger than the first text size.

[0280] The electronic device (100) can determine the number of text words based on the text size. The size of the area where the guide UI is displayed may be pre-determined. Accordingly, as the text size increases, the number of displayed text words may decrease.

[0281] Referring to Example (2110), it is assumed that the viewing age limit for content is 18 years old and the user is 12 years old. The electronic device (100) may display a guide UI (2111) including guide information (prohibited for viewing by those under 18 years old) indicating that viewing of the selected content is prohibited based on the age included in the user information. The guide information may include a graphic image indicating the viewing prohibition rather than text.

[0282] Referring to Example (2120), it is assumed that the user's age belongs to the first group. The electronic device (100) can display a guide UI (2121) based on a first text size corresponding to the first group.

[0283] Referring to Example (2130), it is assumed that the user's age belongs to the second group. The electronic device (100) can display a guide UI (2131) based on a second text size corresponding to the second group.

[0284] If the first group is older than the second group, the second text size may be larger than the first text size. The second text size may be a preset size. The second text size may be changed based on the user's settings.

[0285] Since the text size determined in Example (2130) is larger than that in Example (2120), the number of text words displayed in Example (2130) may be smaller than that in Example (2120).

[0286] FIG. 22 is a drawing for explaining an operation of generating a guide UI according to a language, according to one embodiment.

[0287] Referring to FIG. 22, the electronic device (100) can identify a language or country included in user information. The electronic device (100) can display a guide UI based on the language or country.

[0288] Referring to the embodiment (2210) of FIG. 22, the electronic device (100) can display a guide UI (2211) based on the user's language (Korean) or country (Korea).

[0289] Referring to the embodiment (2220) of FIG. 22, the electronic device (100) can display a guide UI (2221) based on the user's language (English) or country (United States).

[0290] Referring to the embodiment (2230) of FIG. 22, the electronic device (100) can display a guide UI (2231) based on the user's language (Chinese) or country (China).

[0291] FIG. 23 is a drawing for explaining an operation of generating a guide UI based on the placement position of an electronic device (100), according to one embodiment.

[0292] Referring to FIG. 23, the electronic device (100) can generate a type of guide UI based on the location where the electronic device (100) is placed. The type of the guide UI can include at least one of an audio type or an image type.

[0293] Referring to the embodiment (2310) of FIG. 23, the electronic device (100) may be placed in the driver's seat of a mobile vehicle. The electronic device (100) may store placement location information. The electronic device (100) may display a guide UI based on the placement location information. If the placement location information is the driver's seat, the electronic device (100) may generate an audio-type guide UI (2311). The electronic device (100) may output the audio-type guide UI (2311) through the speaker (170) of the electronic device (100).

[0294] Referring to the embodiment (2320) of FIG. 23, the electronic device (100) can be placed on the passenger seat, the second-row seat, or the third-row seat of a mobile vehicle. The electronic device (100) can store placement location information. The electronic device (100) can display a guide UI based on the placement location information. If the placement location information is the passenger seat, the second-row seat, or the third-row seat, the electronic device (100) can generate a video-type guide UI (2321). The electronic device (100) can output the video-type guide UI (2321) through the display (140) of the electronic device (100).

[0295] FIG. 24 is a drawing for explaining an operation of displaying a guide UI overlapping thumbnail text according to one embodiment.

[0296] Referring to embodiment (2410) of FIG. 24, the electronic device (100) may display a thumbnail image of content. The thumbnail image may include thumbnail text (2411). The electronic device (100) may display the thumbnail text (2411) in a specific area among the entire area of ​​the thumbnail image.

[0297] Referring to the embodiment (2420) of FIG. 24, the electronic device (100) can display a guide UI (2421) by overlapping the thumbnail text (2411) in the thumbnail image. The electronic device (100) can identify an area where the thumbnail text (2411) is displayed. The electronic device (100) can display the guide UI (2421) based on the identified area.

[0298] FIG. 25 is a drawing for explaining an operation of generating a screen including a guide UI according to one embodiment.

[0299] Referring to embodiment (2510) of FIG. 25, the electronic device (100) can display a thumbnail image of the content.

[0300] Referring to embodiment (2510) of FIG. 25, the electronic device (100) may display a thumbnail image of content. The thumbnail image may include thumbnail text (2511). The electronic device (100) may display the thumbnail text (2511) in a specific area among the entire area of ​​the thumbnail image.

[0301] Referring to the embodiment (2520) of FIG. 25, the electronic device (100) can remove thumbnail text (2511) from a thumbnail image and generate a new thumbnail image including a guide UI (2521) at the location where the removed thumbnail text (2511) is displayed. The electronic device (100) can display the new thumbnail image.

[0302] The existing thumbnail image may be described as the first thumbnail image, and the newly created thumbnail image may be described as the second thumbnail image.

[0303] The electronic device (100) may utilize an image rendering function to generate a new thumbnail image. The image rendering function may include an operation to create a single layer by deleting an object displayed in a specific area and adding a new UI.

[0304] FIG. 26 is a drawing for explaining an operation of applying transparency of a guide UI according to one embodiment.

[0305] Referring to the embodiment (2610) of FIG. 26, the electronic device (100) can display a thumbnail image of content. The thumbnail image can include thumbnail text (2611). The electronic device (100) can display the thumbnail text (2611) in a specific area among the entire area of ​​the thumbnail image.

[0306] Referring to the embodiment (2620) of FIG. 26, the electronic device (100) can display a guide UI (2621) by overlapping the thumbnail text (2611) in the thumbnail image. The electronic device (100) can identify an area where the thumbnail text (2611) is displayed. The electronic device (100) can display the guide UI (2621) based on the identified area.

[0307] The electronic device (100) can display a guide UI (2621) based on a preset transparency. The preset transparency can be changed according to the user's settings.

[0308] If the transparency exceeds 0%, the thumbnail text (2611) may be displayed overlapping with the guide UI (2621).

[0309] If the transparency is 0%, the thumbnail text (2611) covered by the guide UI (2621) may not be visible. An example related to this is described in FIG. 24.

[0310] FIG. 27 is a drawing for explaining an operation of displaying a guide UI according to the size of an area where content is displayed, according to one embodiment.

[0311] Referring to embodiment (2710) of FIG. 27, the electronic device (100) may display a thumbnail image of content. The thumbnail image may include thumbnail text. The electronic device (100) may display the thumbnail text in a specific area of ​​the entire area of ​​the thumbnail image.

[0312] Referring to embodiment (2720) of FIG. 27, the electronic device (100) can display a guide UI over the entire area where a thumbnail image is displayed. The guide UI can be displayed based on a preset transparency.

[0313] FIG. 28 is a drawing for explaining an operation of displaying a guide UI in an area different from an area where content is displayed, according to one embodiment.

[0314] Referring to the embodiment (2810) of FIG. 28, the electronic device (100) can display a guide UI (2811) based on an area where a thumbnail image of the selected content is displayed. The electronic device (100) can identify a representative location (2812) of the area where the selected content is displayed. The electronic device (100) can display the guide UI (2811) based on the representative location (2812). The representative location (2812) may not actually be displayed.

[0315] Referring to the embodiment (2820) of FIG. 28, the electronic device (100) can identify an area where a thumbnail image of the selected content is displayed and a remaining area where the thumbnail image is not displayed. The electronic device (100) can display a guide UI (2821) in the remaining area where the thumbnail image is not displayed. The user can view the thumbnail image and the guide UI (2821) together.

[0316] FIG. 29 is a flowchart illustrating an operation of generating a guide UI by considering the category of content, according to one embodiment.

[0317] Referring to FIG. 29, the electronic device (100) can obtain a thumbnail image (S2905). The electronic device (100) can analyze the thumbnail image to obtain a category of the first content (S2910). As an example, the electronic device (100) can analyze the thumbnail image using a Graph Neural Network (GNN).

[0318] The electronic device (100) can identify whether the category is real-time content (S2915). If the category is not real-time content (S2915-N), the electronic device (100) can analyze the image data (or video data) of the first content to generate representative text (S2920). For example, the electronic device (100) can analyze the image data using at least one of a convolutional neural network (CNN), a recurrent neural network (RNN), and a long short-term memory (LSTM).

[0319] The electronic device (100) can generate a guide UI based on at least one of representative text, user information, environment information, and screen information (S2925). As an example, the electronic device (100) can generate a guide UI using an AttnGAN (Attentional Generative Adversarial Network).

[0320] If the identified category is real-time content (S2915-Y), the electronic device (100) can identify whether the thumbnail image contains thumbnail text (S2930).

[0321] If the thumbnail image does not contain thumbnail text (S2930-N), the electronic device (100) may perform operations S2920 and S2925.

[0322] If the thumbnail image includes thumbnail text (S2930-Y), the electronic device (100) can obtain the thumbnail text based on the thumbnail image (S2935).

[0323] The electronic device (100) can analyze image data of the first content and audio data of the first content to generate a representative text (S2940). For example, the electronic device (100) can analyze at least one of the image data or audio data using at least one of a convolutional neural network (CNN), a recurrent neural network (RNN), and a long short-term memory (LSTM).

[0324] The electronic device (100) can obtain the similarity between the representative text and the thumbnail text (S2945). The electronic device (100) can identify whether the similarity is less than a threshold value (S2950).

[0325] If the similarity is less than the threshold value (S2950-Y), the electronic device (100) can generate a guide UI based on at least one of representative text, user information, environment information, and screen information (S2925).

[0326] FIG. 30 is a flowchart for explaining a method of controlling an electronic device (100) according to one embodiment.

[0327] Referring to FIG. 30, a control method of an electronic device (100) may include an operation (S3010) of displaying a first screen including a plurality of thumbnail images for each of a plurality of contents, an operation (S3020) of obtaining content information of the first content when a user input for selecting a first thumbnail image of the first content among the plurality of thumbnail images is received, an operation (S3030) of generating a guide UI based on the content information, and an operation (S3040) of displaying a second screen including the guide UI when the first thumbnail image is selected for a threshold time or longer.

[0328] The control method includes an operation of displaying an activation UI at a location corresponding to the first thumbnail image when a user input for selecting a first thumbnail image is received, and an operation of displaying a second screen (S3040) may display a second screen including a guide UI when the location of the activation UI is not changed or maintained for a threshold time.

[0329] The operation of displaying the second screen (S3040) can display a second screen including a guide UI when a touch input for selecting the first thumbnail image is maintained for a threshold time or longer.

[0330] The content information includes at least one of image data, audio data, thumbnail data, or metadata of the first content, wherein the thumbnail data includes the first thumbnail image, and the metadata may include at least one of a title, an author, a provider, a cast, a story summary, a resolution, a codec, or a viewing restriction age.

[0331] The control method includes an operation of identifying a thumbnail text based on a first thumbnail image and an operation of obtaining a representative text of the first content based on content information, and the operation of generating a guide UI (S3030) can generate a guide UI when a preset event related to the thumbnail text is identified.

[0332] The control method includes an operation for obtaining a similarity between thumbnail text and representative text, and an operation for generating a guide UI (S3030) can generate a guide UI if the similarity is less than a threshold value.

[0333] The operation of generating a guide UI (S3030) generates a guide UI if the thumbnail text includes a preset text, and the preset text may include at least one of a question expression, an exaggerated expression, or an advertising expression.

[0334] The control method includes an operation of obtaining user information including at least one of an account, name, age, gender, language, country, health, or preference category, and the operation of generating a guide UI (S3030) can generate the guide UI based on content information and user information.

[0335] The control method includes an operation of obtaining environmental information including at least one of location, date, and weather, and the operation of generating a guide UI (S3030) can generate the guide UI based on content information and environmental information.

[0336] The control method includes an operation of acquiring screen information including at least one of the resolution of the display of the electronic device (100) or the resolution of the area where the first thumbnail image is displayed, and the operation of generating a guide UI (S3030) can generate the guide UI based on the content information and the screen information.

[0337] The methods according to the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0338] The methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0339] The various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic device and the display device.

[0340] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When the instructions are executed by a processor, the processor may directly or under the control of the processor use other components to perform a function corresponding to the instructions. The instructions may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain signals and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0341] According to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0342] Each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0343] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the scope of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea of ​​the present disclosure.

Claims

1. In electronic devices, Memory that stores instructions; display; At least one processor comprising processing circuitry; The above instructions, when individually or collectively executed by the at least one processor, Displaying a first screen including a plurality of thumbnail images for each of a plurality of contents on the display, When a user input is received for selecting a first thumbnail image of the first content among the plurality of thumbnail images, content information of the first content is obtained, Generate a guide UI based on the above content information, An electronic device that displays a second screen including the guide UI on the display when the user input is selected for a minimum threshold time.

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, When the above user input is received, the display is controlled to display an activation UI at a location corresponding to the first thumbnail image, An electronic device that displays the second screen including the guide UI on the display when the position of the activation UI is maintained for the minimum threshold time.

3. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, An electronic device that displays the second screen including the guide UI on the display when a touch input for selecting the first thumbnail image is maintained for a minimum threshold time or longer.

4. In paragraph 1, The above content information is, Contains at least one of image data, audio data, thumbnail data or metadata of the first content, The above thumbnail data is, Including the first thumbnail image above, The above metadata is, An electronic device that includes at least one of the following: title, author, provider, cast, story summary, resolution, codec, or viewing age restriction.

5. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, Identifying thumbnail text based on the first thumbnail image, Obtaining a representative text of the first content based on the above content information, An electronic device that generates the guide UI when a preset event related to the above thumbnail text is identified.

6. In paragraph 5, The above instructions, when individually or collectively executed by the at least one processor, An electronic device that generates the guide UI based on the similarity between the thumbnail text and the representative text.

7. In paragraph 5, The above instructions, when individually or collectively executed by the at least one processor, If the above thumbnail text contains a preset text, the above guide UI is generated, The above preset text is, An electronic device comprising at least one of an interrogative expression, an exaggerated expression, or an advertising expression.

8. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, Obtain user information including at least one of the following categories: account, name, age, gender, language, country, health or preference; An electronic device that generates the guide UI based on the content information and the user information.

9. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, Obtain environmental information including at least one of location, date, and weather, An electronic device that generates the guide UI based on the content information and the environment information.

10. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, Obtain screen information including at least one of the resolution of the display or the resolution of the area where the first thumbnail image is displayed, An electronic device that generates the guide UI based on the content information and the screen information.

11. In a method for controlling an electronic device performed by a processor of one director, An action of displaying a first screen including multiple thumbnail images for each of multiple contents; An operation of obtaining content information of the first content when a user input for selecting a first thumbnail image of the first content among the plurality of thumbnail images is received; An operation of generating a guide UI based on the above content information; and A control method comprising: an action of displaying a second screen including the guide UI when the user input is selected for a minimum threshold time; 12. In paragraph 11, The above control method is, When the above user input is received, an action of displaying an activation UI at a location corresponding to the first thumbnail image is included; The action of displaying the above second screen is: A control method for displaying the second screen including the guide UI when the position of the above-mentioned activation UI is maintained for the minimum threshold time.

13. In paragraph 11, The action of displaying the above second screen is: A control method for displaying the second screen including the guide UI when a touch input for selecting the first thumbnail image is maintained for a minimum threshold time or longer.

14. In paragraph 11, The above content information is, Contains at least one of image data, audio data, thumbnail data or metadata of the first content, The above thumbnail data is, Including the first thumbnail image above, The above metadata is, A control method that includes at least one of the following: title, author, provider, cast, story summary, resolution, codec, or viewing age restriction.

15. In paragraph 11, The above control method is, An operation of identifying thumbnail text based on the first thumbnail image; and An operation of obtaining a representative text of the first content based on the content information; The action of creating the above guide UI is: A control method for generating the guide UI when a preset event related to the above thumbnail text is identified.

Images