Display device and control method therefor

Abstract

A display device is disclosed. One or more processors identify a user behavior pattern on the basis of user behavior history information for each web content type, identify a main user behavior for each web content type on the basis of pattern information corresponding to the user behavior pattern, store, in a memory, first mapping information in which the main user behavior identified for each web content type is mapped to a specific button from among a plurality of buttons included in a controller, identify the type of web content displayed on the display when a control signal corresponding to the specific button is received from the controller, identify the main user behavior corresponding to the specific button on the basis of the identified type of web content, and control the display on the basis of the identified main user behavior.

Description

Display device and control method thereof

[0001] The present disclosure relates to a display device and a method for controlling the same.

[0002] Recently, there has been a significant increase in the number of users experiencing web browsing using smart TVs. Consequently, users have been able to control web content displayed on the smart TV by using specific buttons among the multiple buttons included on the controller.

[0003] However, it has been pointed out that the usability of web content experiences on smart TVs is low due to limitations in controller input caused by manual user operation.

[0004] A display device according to one or more embodiments of the present disclosure comprises a display, a memory for storing instructions, and one or more processors including processing circuitry.

[0005] According to one or more embodiments, when the instructions are executed individually or collectively, the one or more processors identify a user action pattern based on user action history information by web content type, identify a main user action by web content type based on pattern information corresponding to the user action pattern, store in the memory a first mapping information in which the main user action identified by the web content type is mapped to a specific button among a plurality of buttons included in the controller, and when a control signal corresponding to the specific button is received from the controller, identify the type of web content displayed on the display, identify the main user action corresponding to the specific button based on the identified web content type, and control the display based on the identified main user action.

[0006] According to one or more embodiments, when the instructions are executed individually or collectively by one or more processors, the display device identifies the type of the web content based on at least one of the URL (Uniform Resource Locator) information of the web content and the layout information of a plurality of UI elements included in the web content.

[0007] According to one or more embodiments, the user behavior pattern includes at least one of clicking, scrolling, selecting an image, playing a video, and inputting text, and pattern information corresponding to the user behavior pattern includes the number of executions and duration of the user behavior pattern per unit time.

[0008] According to one or more embodiments, the memory stores user behavior information mapped to the specific button for each specific web content, and when the instructions are executed individually or collectively by the one or more processors, the display device, when a main user behavior corresponding to the specific web content stored in the memory is identified, displays a guide UI through the display for changing the user behavior information mapped to the specific button to the main user behavior information, and when user input for changing is received through the guide UI, changes the user behavior information mapped to the specific button to the main user behavior information.

[0009] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the display device updates the first mapping information by changing the first main user action mapped to the first web content to the second main user action when the main user action for the first web content is changed to the second main user action based on re-identified user action pattern information after the mapping information including the first main user action corresponding to the first web content is stored in the memory.

[0010] According to one or more embodiments, the memory further includes second mapping information mapped to control information corresponding to a plurality of buttons included in the controller, and when the instructions are executed individually or collectively by the one or more processors, the display device, after receiving a control signal corresponding to a specific operation for the specific button from the controller, identifies control information corresponding to the specific button based on the second mapping information and controls the display based on the identified control information.

[0011] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the display device inputs type information of the web content into an artificial intelligence model to identify a main user action corresponding to the type of the web content.

[0012] A control method for a display device according to one or more embodiments of the present disclosure comprises: identifying a user action pattern based on user action history information for each web content type; identifying a main user action for each web content type based on pattern information corresponding to the user action pattern; storing in the display device first mapping information in which the main user action identified for each web content type is mapped to a specific button among a plurality of buttons included in a controller; and, when a control signal corresponding to the specific button is received from the controller, identifying a type of web content; identifying a main user action corresponding to the specific button based on the identified type of web content; and controlling the web content based on the identified main user action.

[0013] A non-transient computer-readable storage medium storing computer instructions that cause a display device to perform an operation when executed by a processor of a display device according to one or more embodiments of the present disclosure, wherein the operation comprises: an operation of identifying a user action pattern based on user action history information for each web content type; an operation of identifying a main user action for each web content type based on pattern information corresponding to the user action pattern; an operation of storing first mapping information in the display device in which the main user action identified for each web content type is mapped to a specific button among a plurality of buttons included in a controller; an operation of identifying a type of web content when a control signal corresponding to the specific button is received from the controller; an operation of identifying a main user action corresponding to the specific button based on the identified type of web content; and an operation of controlling the web content based on the identified main user action.

[0014] FIG. 1 is a drawing for explaining the operation of a display device according to one or more embodiments.

[0015] FIG. 2 is a block diagram for explaining the configuration of a display device according to one or more embodiments.

[0016] FIG. 3 is a diagram illustrating the process of identifying web content types of a display device according to one or more embodiments.

[0017] FIG. 4 is a diagram illustrating the process of identifying user behavior patterns of a display device according to one or more embodiments.

[0018] FIG. 5 is a diagram illustrating the process of identifying main user behavior of a display device according to one or more embodiments.

[0019] FIG. 6 is a diagram illustrating a main user behavior mapping process according to one or more embodiments.

[0020] FIGS. 7a to 7d are specific embodiments of a main user behavior mapping process according to one or more embodiments.

[0021] FIG. 8 is a diagram illustrating the process of changing main user behavior for specific web content according to one or more embodiments.

[0022] FIG. 9 is a diagram illustrating the main user behavior update process of a display device according to one or more embodiments.

[0023] FIG. 10 is a diagram illustrating the process of changing mapping information of a display device according to one or more embodiments.

[0024] FIG. 11 is a diagram illustrating the process of identifying main user behavior through an artificial intelligence model of a display device according to one or more embodiments.

[0025] FIG. 12 is a flowchart illustrating the overall operation of a display device according to one or more embodiments.

[0026] The terms used in the various embodiments of this Disclosure have been selected to be as widely used and general as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been selected at the applicant's discretion, and in such cases, their meanings will be described in detail in the relevant description section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0027] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components such as parts) and do not exclude the presence of additional features.

[0028] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0029] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0030] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0031] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, terms such as “comprising” or “consisting of” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0032] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0033] In the present disclosure, the term "user" may refer to a person using an electronic device or a device used by such person.

[0034] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.

[0035] FIG. 1 is a drawing for explaining the operation of a display device according to one or more embodiments.

[0036] According to one embodiment, the display device (100) can control web content (10) displayed on the display based on a control signal received from the controller (200). The display device (100) can be implemented as various types of display devices such as a smart TV, monitor, kiosk, tablet PC, digital photo frame, mobile phone, LFD (large format display), digital signage, DID (Digital Information Display), video wall, projector display, etc. However, in some cases, it may be implemented as an image processing device (e.g., set-top box, one connected box) connected to the display device to provide video.

[0037] According to one embodiment, the display device (100) can display web content (10) and a cursor pointer (20) for selecting web content (10) through the display.

[0038] Web content (10) may be data or information for providing multiple UI elements included in a web page or web application to a user. Web content (10) may be implemented as various types of content, such as text content, image content, animation content, social media content, and news content.

[0039] The cursor pointer (20) may point to or display any one of the multiple UIs (User Interfaces) included in the web content (10) based on a control signal corresponding to a direction button (or movement button) included in the controller (200). The cursor pointer (20) is not limited thereto and may be referred to in various ways, such as a click pointer, a pointer icon, or a cursor, but in this disclosure, it will be referred to as a cursor pointer.

[0040] According to one embodiment, the controller (200) may be a device for controlling web content (10) displayed on the display device (100) or specific functions (e.g., volume size, channel, power). The controller (200) may be implemented as various types of devices, such as a remote control, a smartphone, a joystick, or a game controller.

[0041] According to one example, the controller (200) can control the web content (10) displayed based on a control signal corresponding to a specific button. For example, the controller (200) can change the position of the cursor pointer (20) displayed based on a control signal corresponding to an arrow key.

[0042]

[0043] * Referring to FIG. 1, a display device (100) can display web content (10) and a cursor pointer (20) through the display. The display device (100) can change the position of the cursor pointer (20) based on a control signal received from a controller (200). When the display device (100) receives a control signal from the controller (200) to select a UI element (30) at the position of the cursor pointer (20), it can select the corresponding UI element (30) and display a URL or link corresponding to the selected UI element (30).

[0044] However, there may be some inconvenience in the process of the user moving the position of the cursor pointer (20) from the UI element (40) at the bottom left to the UI element (50) at the top right through the controller (200).

[0045] According to one embodiment, the display device (100) can control a plurality of UIs included in the web content (10) based on mapping information in which user behavior is mapped according to the web content type.

[0046] Hereinafter, with reference to the drawings, various embodiments will be described in which a display device (100) identifies main user behavior according to web content type and controls a plurality of UIs included in web content (10) based on the identified main user behavior.

[0047] FIG. 2 is a block diagram for explaining the configuration of a display device according to one or more embodiments.

[0048] Referring to FIG. 2, the display device (100) includes a display (110), a memory (120), and one or more processors (120). However, it is not limited thereto, and the display device (100) may be implemented with some components excluded or with other components included.

[0049] The display (110) is configured to display web content including multiple UI elements. The display (110) may be implemented as a display module including a self-emissive element or as a display module including a non-emissive element and a backlight. Additionally, the display (110) may be implemented as an LFD display according to the above description. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, or a QLED (Quantum dot light-emitting diodes). The display (110) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, or an OTFT (organic TFT).

[0050] The memory (120) can store at least one instruction, data, program, etc. required for the operation of the display device (100). For example, the memory (120) can store information about the arrangement order of interaction elements by type of web page.

[0051] Depending on the purpose of data storage, the memory (120) may be implemented in the form of a memory embedded in the display device (100) or in the form of a memory that is detachable from the display device (100). For example, data for driving the display device (100) may be stored in a memory embedded in the display device (100), and data for the expansion function of the display device (100) may be stored in a memory that is detachable from the display device (100).

[0052] In the case of memory embedded in the display device (100), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD).

[0053] The memory (120) may be implemented as a single memory that stores data generated in various operations according to the present disclosure, but is not limited thereto, and the memory (120) may be implemented to include a plurality of memories that each store different types of data or each store data generated in different stages.

[0054] One or more processors (130) control the overall operation of the display device (100). Specifically, one or more processors (130) may be connected to each component of the display device (100) to control the overall operation of the display device (100). For example, one or more processors (130) may be electrically connected to the display (110) and the memory (120) to control the overall operation of the display device (100). One or more processors (130) may include processing circuits and may be composed of one or more processors.

[0055] One or more processors (130) can perform the operation of a display device (100) according to various embodiments by executing one or more instructions stored in memory (120).

[0056] One or more processors (130) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. One or more processors (130) may execute one or more programs or instructions stored in memory. For example, one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in memory.

[0057] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0058] One or more processors (130) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors (130) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure.

[0059] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0060] In the embodiments of the present disclosure, a processor may refer to a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. For convenience of explanation, one or more processors (130) will be referred to as processors (130) below.

[0061] According to one embodiment, the processor (130) can identify a user action pattern based on user action history information by web content type.

[0062] The user's behavior history information may be log data information corresponding to user actions, such as the user clicking a specific UI or scrolling within the web content. When the user performs a specific action within the web content, the display device (100) can collect and store log data corresponding to the action through JavaScript.

[0063] A user behavior pattern may be a behavior pattern in which a user clicks a UI element within web content, scrolls a page, selects an image, plays a video, and enters text. For example, a user behavior pattern may be a behavior pattern in which a user clicks an input box included in web content and enters text into the input box.

[0064] According to one embodiment, the processor (130) can identify main user behavior by web content type based on pattern information corresponding to user behavior patterns.

[0065] Pattern information corresponding to user behavior patterns may be information corresponding to the number of executions and duration of each user behavior pattern per unit of time. For example, if a user clicks a UI element 5 times per minute, the pattern information corresponding to the clicks may be 5 times / min.

[0066] The main user behavior may be the user behavior pattern that is executed most frequently (or has the highest number of occurrences per unit of time) among multiple user behavior patterns, based on pattern information corresponding to each user behavior pattern.

[0067] According to one embodiment, the processor (130) may store in memory a first mapping information in which a main user action identified by a web content type is mapped to a specific button among a plurality of buttons included in the controller. The mapping information may be an action code or an action algorithm corresponding to the mapped user action. For example, the mapping information may be programming data or an algorithm corresponding to the mapped user action.

[0068] According to one embodiment, when the processor (130) receives a control signal corresponding to a specific button from the controller, it can identify the type of web content displayed on the display.

[0069] According to one embodiment, the processor (130) can identify a main user action corresponding to a specific button based on the type of identified web content.

[0070] Web content types can be identified based on tag information of multiple UI elements included in the web content. For example, if it includes image UI elements and text UI elements, it can be identified as a news web content type. For example, if it includes thumbnail UI elements and input UI elements, it can be identified as a social media web content type.

[0071] According to one embodiment, the processor (130) can control the display based on the identified main user behavior.

[0072] FIG. 3 is a diagram illustrating the process of identifying web content types of a display device according to one or more embodiments.

[0073] According to one embodiment, the display device (100) can identify the type of web content based on at least one of the URL (Uniform Resource Locator) information of the web content and the layout information of a plurality of UI elements included in the web content.

[0074] The URL information of the web content may be domain address information indicating the location of a specific web content in a network system. The URL information of the web content may include a domain name corresponding to the type of web content in text form. For example, in the case of news-type web content, the URL information may include text such as 'news'. Accordingly, the display device (100) can identify the type of web content based on the URL information of the web content.

[0075] However, in the case of URL information of a specific web content, it may not include text corresponding to the type of web content. In this case, the display device (100) can identify the type of web content based on layout information of multiple UI elements included in the web content.

[0076] Layout information of UI elements may be data information regarding the size, position, margin status, alignment method, etc., of each of multiple UI elements included in web content. For example, layout information of UI elements may include information regarding the size and position of image UI elements, the position of input box UI elements, and the position and alignment method of text UI elements.

[0077] According to one example, the display device (100) can identify the type of web content based on the layout information of each of the multiple UI elements. For example, if image and text UI elements are positioned in order from top to bottom, the display device (100) can identify it as news-type web content. For example, if thumbnail, text, and button UI elements are positioned within a certain distance, the display device (100) can identify it as social media-type web content.

[0078] Referring to FIG. 3, the display device (100) can identify the type of web content (10) based on at least one of URL information (310) included at the top of the web content (10) and layout information (360) of a plurality of UI elements (320 to 350) included in the web content (10). The display device (100) can identify tag information (370) corresponding to a plurality of UI elements (320 to 350) included in the web content (10). The tag information (370) is unique information corresponding to each of the plurality of UI elements (320 to 350) included in the web content and may include information corresponding to the type and attributes of the UI elements.

[0079] The display device (100) can identify layout information (360) regarding the position and size of each UI element (320 to 350) based on tag information (370) corresponding to each of the plurality of UI elements (320 to 350). The display device (100) can identify web content of type A (380) based on the position and size of the thumbnail UI element (350), text UI element (340), and list UI element (320).

[0080] FIG. 4 is a diagram illustrating the process of identifying user behavior patterns of a display device according to one or more embodiments.

[0081] According to one embodiment, the display device (100) can identify user behavior patterns based on user behavior history information by web content type. The user behavior history information may include log data corresponding to images clicked by the user within the web content, data entered, number of scrolls, number of pages scrolled, video playback time, and whether the user returned to the previous page.

[0082] According to one example, the display device (100) can identify a user's behavior pattern based on log data corresponding to the user's behavior history information. For example, the display device (100) can identify a user behavior pattern of 'click' based on image clicks, link clicks, and text clicks among the behavior history information. For example, the display device (100) can identify a user behavior pattern of 'scroll' based on page scrolling among the behavior history information.

[0083] According to one example, a user behavior pattern may be a user behavior of a higher concept regarding a specific behavior among user behavior history information. For example, a display device (100) may identify image clicks, text clicks, thumbnail clicks, etc., as a user behavior pattern called 'click'.

[0084] According to one embodiment, the display device (100) can identify user behavior patterns by web content type. The display device (100) can identify a 'click' user behavior pattern when the user only clicks on web content of content type A, and 'click', 'scroll', and 'text input' user behavior patterns when the user clicks, scrolls, and inputs text on web content of content type B.

[0085] Referring to FIG. 4, the display device (100) can identify user behavior patterns (420) based on user behavior history information (410) within web content. The display device (100) can store log data corresponding to page scrolling, image clicking, input box selection, and text input, respectively. Based on the log data corresponding to user behavior, the display device (100) can identify user behavior patterns (420) such as 'scrolling', 'image selection', 'clicking', and 'text input'.

[0086] FIG. 5 is a diagram illustrating the process of identifying main user behavior of a display device according to one or more embodiments.

[0087] According to one embodiment, the display device (100) can identify a main user behavior among a plurality of user behavior patterns based on pattern information corresponding to a user behavior pattern.

[0088] The main user behavior may be the user behavior pattern with the highest execution frequency among multiple identified user behavior patterns, based on information corresponding to each user behavior pattern. For example, if a user performs the user behavior patterns of 'clicking', 'scrolling', and 'selecting an image' within web content, and the 'clicking' pattern has the highest execution frequency among these, the main user behavior may be 'clicking'.

[0089] Information corresponding to a user behavior pattern may be information including the number of executions of the user behavior pattern per unit of time. The display device (100) can identify each user behavior pattern based on the same reference time (e.g., 1 minute, 5 minutes, 10 minutes). For example, the display device (100) can identify the number of executions corresponding to each user behavior pattern based on a reference time of 5 minutes.

[0090] Referring to FIG. 5, the display device (100) can identify information (510) corresponding to each user behavior pattern. For example, the display device (100) can identify 5 executions per unit time (1 minute) for 'scrolling'. For example, the display device (100) can identify 20 executions per unit time (1 minute) for 'image clicking'. For example, the display device (100) can identify 5 executions per unit time (1 minute) for 'input box'. For example, the display device (100) can identify 3 executions per unit time (1 minute) for 'text input'.

[0091] The display device (100) can identify the 'image click (520)' (or click) with the highest number of executions per unit time as the main user action (530) based on information (510) corresponding to each user action pattern.

[0092] FIG. 6 is a diagram illustrating a main user behavior mapping process according to one or more embodiments.

[0093] According to one embodiment, the display device (100) can map mapping information corresponding to a main user action to a specific button among a plurality of buttons included in the controller (200). The display device (100) can map mapping information corresponding to a main user action identified by type of web content to a specific button of the controller (200).

[0094] Referring to FIG. 6, the display device (100) can identify a main user action (530) of 'image click' for a social media type. The display device (100) can map mapping information corresponding to the identified main user action (530) to a specific button (610) of the controller (200).

[0095] For example, when the display device (100) receives a control signal corresponding to a specific button (610) of the controller (200), it can move the cursor pointer displayed on the web content up / down / left / right direction to display it. When mapping information corresponding to a main user action (530) is mapped to a specific button (610) of the controller (200), when the display device (100) receives a control signal corresponding to the specific button (610), it can move the cursor pointer in units of images displayed on the web content to display it.

[0096] Referring to FIG. 6, when a control signal corresponding to the right direction button among the specific buttons (610) of the controller (200) is received, the display device (100) can move the cursor pointer from the highlighted left image (620) within the web content to the central image (630) to display it.

[0097] According to one embodiment, the display device (100) identifies the type of web content and, when a control signal corresponding to a specific button is received, can perform a main user action mapped to the specific button based on the type of web content.

[0098] FIGS. 7a to 7d are specific embodiments of a main user behavior mapping process according to one or more embodiments.

[0099] Referring to FIG. 7a, the display device (100) can identify web content of the Webtoon type. The display device (100) can identify a user behavior pattern of scrolling 10 times per unit time in page units based on user behavior history information. The display device (100) can identify 'page unit scrolling' (or scrolling) as a main user behavior and store mapping information in memory (120) in which the main user behavior identified by web content type is mapped to a specific button of the controller (200).

[0100] Referring to FIG. 7b, the display device (100) can identify web content of the News type. Based on user behavior history information, the display device (100) can identify user behavior patterns such as scrolling 3 times per unit time, clicking links 5 times per unit time, and zooming in / out text 3 times per unit time. The display device (100) can identify 'clicking links' (or clicking) as the main user behavior and store mapping information in memory (120) in which the main user behavior identified by web content type is mapped to a specific button of the controller (200).

[0101] Referring to FIG. 7c, the display device (100) can identify map-type web content. Based on user behavior history information, the display device (100) can identify user behavior patterns such as scrolling 3 times per unit time and zooming in / out of images 8 times per unit time. The display device (100) can identify 'zoom in / out' as a main user behavior and store mapping information in memory (120) in which the main user behavior identified by web content type is mapped to a specific button of the controller (200).

[0102] Referring to FIG. 7d, the display device (100) can identify web content of the Portal Site type. Based on user behavior history information, the display device (100) can identify user behavior patterns such as scrolling twice per unit time and clicking an input box five times per unit time. The display device (100) can identify 'clicking an input box' (or clicking) as a main user behavior and store mapping information in memory (120) in which the main user behavior identified by web content type is mapped to a specific button of the controller (200).

[0103] FIG. 8 is a diagram illustrating the process of changing main user behavior for specific web content according to one or more embodiments.

[0104] According to one embodiment, when a main user action corresponding to a specific web content stored in memory (120) is identified, the display device (100) can display a guide UI through the display (110) for changing user action information mapped to a specific button into main user action information.

[0105] Specific web content may be web content configured according to the device manufacturing stage and / or user settings, based on web content frequently used by the user among multiple web contents. For example, specific web content may be web content frequently used by the user, such as news, webtoons, social media, maps, etc.

[0106] According to one example, the display device (100) may store user behavior information mapped to a specific button of a controller (200) for specific web content. For example, in the case of news-type web content, user behavior information of 'page scrolling' may be stored on a specific button of the controller (200). For example, in the case of social media-type web content, user behavior information of 'input box clicking' may be stored on a specific button of the controller (200).

[0107] Referring to FIG. 8, when a main user action corresponding to a specific web content is identified, the display device (100) can display a guide UI (810) through the display (110) to change the user action information (820) mapped to a specific button into the main user action information (830).

[0108] According to one embodiment, when a user input to change user action information is received through the guide UI (810), the display device (100) can change the user action information mapped to a specific button to the main user action information.

[0109] FIG. 9 is a diagram illustrating the main user behavior update process of a display device according to one or more embodiments.

[0110] According to one embodiment, the display device (100) can update the first mapping information by changing the first main user behavior mapped to the first web content to the second main user behavior after the mapping information including the first main user behavior corresponding to the first web content is stored in the memory (120) and the main user behavior for the first web content is changed to the second main user behavior based on the re-identified user behavior pattern information.

[0111] According to one example, the display device (100) can re-identify user behavior pattern information within the first web content after the main user behavior corresponding to the first web content has been identified. For example, even if the main user behavior corresponding to the first web content is identified as 'click', the display device (100) can re-identify the main user behavior as 'scroll' based on the user behavior pattern re-identified within the first web content.

[0112] Referring to FIG. 9, the display device (100) can identify the main user action as 'image click' (920) based on pattern information (910) corresponding to the user action pattern of the first web content. The display device (100) can identify the main user action as 'scroll' (920) based on pattern information (920) corresponding to the re-identified user action pattern.

[0113] In this case, the display device (100) can update the first mapping information by changing the main user action of 'image click' (920) mapped to the first web content to the main user action of 'scroll' (920).

[0114] FIG. 10 is a diagram illustrating the process of changing mapping information of a display device according to one or more embodiments.

[0115] According to one embodiment, after the display device (100) receives a control signal corresponding to a specific operation for a specific button from the controller (200), when the signal corresponding to the specific button is received, the display device (100) can identify control information corresponding to the specific button based on second mapping information in which control information corresponding to a plurality of buttons included in the controller (200) is mapped.

[0116] The second mapping information may be mapping information that is previously set before the identified main user behavior is mapped to a specific button. For example, if the specific button included in the controller (200) is a directional key button, the second mapping information may be mapping information for moving a cursor pointer corresponding to each of the up / down and left / right directional keys.

[0117] A control signal corresponding to a specific operation may be a signal for changing a first mapping information mapped to a specific button into a second mapping information. For example, a control signal corresponding to a specific operation may be a case where a control signal corresponding to a specific button is continuously received by the display device (100) for a preset time, or a case where control signals corresponding to two of a plurality of specific buttons are simultaneously received by the display device (100).

[0118] Referring to FIG. 10, when control signals corresponding to two buttons (1010, 1020) among a plurality of specific buttons are simultaneously received by the display device (100), the display device (100) can identify control information corresponding to specific buttons based on second mapping information. The display device (100) can control the position of a cursor pointer (1030) displayed on the display (110) based on the identified control information.

[0119] FIG. 11 is a diagram illustrating the process of identifying main user behavior through an artificial intelligence model of a display device according to one or more embodiments.

[0120] According to one embodiment, the display device (100) can input type information of web content into an artificial intelligence model to identify main user behavior corresponding to the type of web content.

[0121] An artificial intelligence model may refer to a model that inputs specific input values ​​into a specific function based on learned data and outputs an output value. Here, the artificial intelligence model may be a model trained to identify main user behaviors corresponding to web content types. The artificial intelligence model may be referred to in various ways, such as a neural network model, a deep learning model, a neural network model, or a generative artificial intelligence model, but in this disclosure, it will be collectively referred to as an artificial intelligence model.

[0122] Here, the term "training an artificial intelligence model" may mean that a basic artificial intelligence model (e.g., an artificial intelligence model containing arbitrary random parameters) is trained by a learning algorithm using multiple training data, thereby creating predefined behavioral rules or an artificial intelligence model configured to perform a desired characteristic (or objective). This learning may be performed via a separate server and / or system, but is not limited thereto, and may also be performed in a cooking device. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples mentioned above.

[0123] Here, the artificial intelligence model may be implemented as, for example, CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), RBM (Restricted Boltzmann Machine), DBN (Deep Belief Network), BRDNN (Bidirectional Recurrent Deep Neural Network), or Deep Q-Networks, but is not limited thereto.

[0124] Referring to FIG. 11, the display device (100) can input the type (1110) of identified web content into a learned artificial intelligence model (1120). The display device (100) can identify the main user behavior (1130) for each web content type (1110) through the artificial intelligence model (1120). For example, if the web content type of news is input into the artificial intelligence model (1120), the display device (100) can identify the main user behavior (1130) of 'scrolling' through the artificial intelligence model (1120).

[0125] FIG. 12 is a flowchart illustrating the overall operation of a display device according to one or more embodiments.

[0126] Referring to FIG. 12, in operation 1210, the display device (100) can identify user behavior patterns based on user behavior history information by web content type.

[0127] In operation 1220, the display device (100) can identify main user behavior by web content type based on pattern information corresponding to user behavior patterns.

[0128] In operation 1230, the display device (100) can store first mapping information in the display device (100) in which a main user action identified by web content type is mapped to a specific button among a plurality of buttons included in the controller (200).

[0129] In operation 1240, when the display device (100) receives a control signal corresponding to a specific button from the controller (200), it can identify the type of web content.

[0130] In operation 1250, the display device (100) can identify a main user action corresponding to a specific button based on the type of identified web content.

[0131] In operation 1260, the display device (100) can control web content based on identified main user behavior.

[0132] Since the methods for identifying the type of web content and identifying main user behavior have been specifically explained in the various embodiments described above, a redundant explanation is omitted.

[0133] The control method described in FIG. 12 can be performed by a display device (100) having the configuration of FIG. 2 described above, but is not necessarily limited thereto and can be performed by a display device having various configurations.

[0134] The various embodiments described above may be implemented as individual embodiments, or at least one embodiment may be combined with one another, either wholly or partially, to be implemented together in a single device.

[0135] According to the various embodiments described above, the user can control web content more conveniently based on mapping information mapped to a specific button of the controller for each web content.

[0136] Meanwhile, the various embodiments described above may be applied to a product as embodiments alone, but at least some of their contents may be combined with other embodiments of the present disclosure to be implemented together.

[0137] The various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., a display device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory computer-readable storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0138] In addition, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided by being included in a computer program product.

[0139] Specifically, a non-transient readable storage medium or computer program product may be provided that stores computer commands for performing operations such as: identifying a user behavior pattern based on user behavior history information for each web content type; identifying a main user behavior for each web content type based on pattern information corresponding to the user behavior pattern; storing first mapping information in a display device in which the main user behavior identified for each web content type is mapped to a specific button among a plurality of buttons included in a controller; and, when a control signal corresponding to a specific button is received from the controller, identifying the type of web content; identifying the main user behavior corresponding to a specific button based on the identified web content type; and controlling the web content based on the identified main user behavior.

[0140] Computer program products may be distributed in the form of device-readable storage media (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0141] In addition, computer instructions or programs for performing control methods of display devices according to the various embodiments described above may be stored on a non-transitory computer-readable medium. When computer instructions stored on such a non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and is readable by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of a non-transitory computer-readable medium may include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, ROMs, etc.

[0142] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In a display device, display; Memory for storing instructions; and One or more processors including processing circuitry; and The above one or more processors, When the above instructions are executed individually or collectively, the display device, Identify user action patterns based on user behavior history information by web content type, and Based on pattern information corresponding to the above user behavior patterns, main user behavior by web content type is identified, and A first mapping information in which a main user action identified by the web content type is mapped to a specific button among a plurality of buttons included in the controller is stored in the memory, and When a control signal corresponding to the specific button is received from the controller, the type of web content displayed on the display is identified, and Identifying the main user behavior corresponding to the specific button based on the type of web content identified above, and A display device that controls the display based on the main user behavior identified above.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the display device, A display device that identifies the type of web content based on at least one of the URL (Uniform Resource Locator) information of the web content and the layout information of a plurality of UI elements included in the web content.

3. In Paragraph 1, The above user behavior pattern is, It includes at least one of clicking, scrolling, selecting an image, playing a video, and entering text, and The pattern information corresponding to the above user behavior pattern is, A display device including the number of executions and duration of the above user behavior pattern per unit time.

4. In Paragraph 1, The above memory is, It stores user behavior information mapped to the aforementioned specific button for each specific web content, and When the above instructions are executed individually or collectively by the one or more processors, the display device, When a main user action corresponding to the specific web content stored in the memory is identified, a guide UI for changing the user action information mapped to the specific button to the main user action information is displayed through the display, and A display device that, when user input for changing via the guide UI is received, changes user action information mapped to the specific button to the main user action information.

5. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the display device, A display device that updates the first mapping information by changing the first main user behavior mapped to the first web content to the second main user behavior after the mapping information including the first main user behavior corresponding to the first web content is stored in the memory, and the main user behavior for the first web content is changed to the second main user behavior based on the re-identified user behavior pattern information.

6. In Paragraph 1, The above memory is, It further includes second mapping information to which control information corresponding to the plurality of buttons included in the controller is mapped. When the above instructions are executed individually or collectively by the one or more processors, the display device, After a control signal corresponding to a specific operation for the specific button is received from the controller, if a signal corresponding to the specific button is received, control information corresponding to the specific button is identified based on the second mapping information, and A display device that controls the display based on the above-mentioned identified control information.

7. In Paragraph 2, When the above instructions are executed individually or collectively by the one or more processors, the display device, A display device that inputs type information of the above web content into an artificial intelligence model to identify main user behavior corresponding to the type of the above web content.

8. In a method for controlling a display device, An action that identifies user action patterns based on user action history information by web content type; An operation to identify main user behavior by web content type based on pattern information corresponding to the above user behavior pattern; The operation of storing in the display device first mapping information, wherein a main user action identified by the web content type is mapped to a specific button among a plurality of buttons included in the controller; When a control signal corresponding to the specific button is received from the controller, an operation to identify the type of web content; An action of identifying a main user action corresponding to the specific button based on the type of the web content identified above; and A control method comprising: an action of controlling the web content based on the identified main user action.

9. In Paragraph 8, The operation of identifying the type of the above web content is, A control method further comprising: an operation of identifying the type of the web content based on at least one of the URL (Uniform Resource Locator) information of the web content and the layout information of a plurality of UI elements included in the web content.

10. In Paragraph 8, The above user behavior pattern is, It includes at least one of clicking, scrolling, selecting an image, playing a video, and entering text, and The pattern information corresponding to the above user behavior pattern is, A control method including the number of executions and duration of the above user behavior pattern per unit time.

11. In Paragraph 8, When a main user action corresponding to a specific web content stored in the display device is identified, an operation to display a guide UI for changing user action information mapped to a specific button for each specific web content to the main user action information; and A control method comprising: an action of changing user action information mapped to a specific button to the main user action information when user input for changing via the guide UI is received.

12. In Paragraph 8, A control method comprising: an operation of updating the first mapping information by changing the first main user behavior mapped to the first web content to the second main user behavior when the main user behavior for the first web content is changed to the second main user behavior based on re-identified user behavior pattern information after the mapping information including the first main user behavior corresponding to the first web content is stored in the display device.

13. In Paragraph 8, After receiving a control signal corresponding to a specific operation for the specific button from the controller, when a signal corresponding to the specific button is received, an operation of identifying control information corresponding to the specific button based on the second mapping information to which control information corresponding to the plurality of buttons included in the controller is mapped; and A control method comprising: an operation to control the web content based on the identified control information.

14. In Paragraph 9, A control method comprising: inputting type information of the web content into an artificial intelligence model to identify a main user action corresponding to the type of the web content.

15. A non-transient computer-readable storage medium storing computer instructions that cause the display device to perform an operation when executed by a processor of the display device, wherein the operation is, An action that identifies user action patterns based on user action history information by web content type; An operation to identify main user behavior by web content type based on pattern information corresponding to the above user behavior pattern; The operation of storing in the display device first mapping information, wherein a main user action identified by the web content type is mapped to a specific button among a plurality of buttons included in the controller; When a control signal corresponding to the specific button is received from the controller, an operation to identify the type of web content; An action of identifying a main user action corresponding to the specific button based on the type of the web content identified above; and A non-transient computer-readable storage medium comprising: an operation to control the web content based on the identified main user behavior.

Images