Electronic device and method for controlling electronic device

Abstract

Disclosed are an electronic device and a control method therefor. Specifically, the electronic device may: control a display to display content; acquire information about the context of the content; identify, on the basis of the information about the context and information about a usage history, at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among a plurality of operations related to the content; perform the at least one first operation; and control the display to display a user interface for the at least one second operation.

Description

Electronic devices and methods of controlling electronic devices

[0001] The present disclosure relates to an electronic device and a method for controlling the electronic device, and more particularly, to an electronic device capable of providing a user interface suitable for a user and a method for controlling the same.

[0002] In recent years, technological advancements have led to a diversification of the functions (operations or services) provided by electronic devices. In particular, the types of content that can be provided by electronic devices have diversified. Furthermore, the development of Internet of Things (IoT) technology has led to a growing variety of external devices capable of interacting with electronic devices. Consequently, the functions provided by electronic devices are becoming even more diverse.

[0003] However, as the functions provided by electronic devices become more diverse, it is important to provide a user interface that allows users to conveniently use the various functions.

[0004] However, conventional user interfaces are complexly structured to accommodate the numerous functions of electronic devices. Consequently, conventional technology has been criticized for making it difficult for users to determine which control function must be performed to achieve a desired result, requiring multiple manipulations to find the desired function, resulting in user inconvenience. Furthermore, the interface provides functions that are either unavailable or unnecessary for the current situation, further increasing user confusion.

[0005] The present disclosure is intended to solve the problems of the prior art as described above, and the purpose of the present disclosure is to provide an electronic device and a control method thereof that can provide a user interface suitable for a user who enjoys content.

[0006] According to one or more embodiments of the present disclosure, an electronic device includes a display, a memory storing information about a user's usage history, and one or more processors controlling the display to display content, obtaining information about a context of the content, and identifying, based on the information about the context and the information about the usage history, at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among a plurality of operations related to the content, performing the at least one first operation, and controlling the display to display a user interface for the at least one second operation.

[0007] Meanwhile, the information about the context may include at least one of type information indicating the type of the content, first state information indicating the operating state of the electronic device, second state information indicating the operating state of an external device related to the electronic device, and third state information indicating the external state of the electronic device and the external device.

[0008] Meanwhile, the information about the usage history may include information about at least one of the frequency and pattern of the user using at least one of the electronic device and the external device while the type of content is displayed on the display.

[0009] Meanwhile, the plurality of operations may include at least one of an operation of the electronic device related to the content and an operation of the external device related to the content.

[0010] Meanwhile, the one or more processors may identify an operation related to screen setting and sound setting for the content among the plurality of operations as the at least one first operation.

[0011] Meanwhile, the user interface includes a plurality of category items corresponding to each of a plurality of categories related to the at least one second operation, and the at least one processor, when a first user input for selecting one of the plurality of category items is received, can identify the at least one first operation and the at least one second operation among one or more operations corresponding to the selected category item based on information about the context and information about the usage history.

[0012] Meanwhile, the user interface includes at least one control item corresponding to each of the at least one second operation, and the at least one processor can perform a second operation corresponding to the selected control item when a second user input for selecting one of the at least one control item is received.

[0013] Meanwhile, the one or more processors may update information about the usage history based on at least one of the first user input and the second user input.

[0014] Meanwhile, the one or more processors control the display to display the user interface after performing the at least one first operation, and the user interface may include at least one of a cancel item for canceling the at least one first operation performed and a change item for changing the at least one first operation performed to another operation.

[0015] Meanwhile, the one or more processors identify priorities of each of the plurality of operations based on information about the context and information about the usage history, and identify one or more second operations to be displayed on the user interface among the at least one second operation based on the priorities, and the user interface includes information about the priorities of each of the one or more second operations.

[0016] According to one or more embodiments of the present disclosure, a method for controlling an electronic device includes the steps of displaying content, obtaining information about a context of the content, identifying at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among a plurality of operations related to the content based on the information about the context and information about a user's usage history, performing the at least one first operation, and displaying a user interface for the at least one second operation.

[0017] Meanwhile, the information about the context may include at least one of type information indicating the type of the content, first state information indicating the operating state of the electronic device, second state information indicating the operating state of an external device related to the electronic device, and third state information indicating the external state of the electronic device and the external device.

[0018] Meanwhile, the information about the usage history may include information about at least one of the frequency and pattern of the user using at least one of the electronic device and the external device while the type of content is displayed on the display.

[0019] Meanwhile, the plurality of operations may include at least one of an operation of the electronic device related to the content and an operation of the external device related to the content.

[0020] Meanwhile, the identifying step may include a step of identifying an action related to screen setting and sound setting for the content among the plurality of actions as the at least one first action.

[0021] Meanwhile, the user interface may include a plurality of category items corresponding to each of a plurality of categories related to the at least one second action, and the identifying step may include, when a first user input for selecting one of the plurality of category items is received, identifying the at least one first action and the at least one second action among one or more actions corresponding to the selected category item based on information about the context and information about the usage history.

[0022] Meanwhile, the user interface includes at least one control item corresponding to each of the at least one second operation, and the control method of the electronic device may further include a step of performing a second operation corresponding to the selected control item when a second user input for selecting one of the at least one control item is received.

[0023] Meanwhile, the control method of the electronic device may further include a step of updating information about the usage history based on at least one of the first user input and the second user input.

[0024] Meanwhile, the step of displaying a user interface includes a step of displaying the user interface after performing the at least one first operation, and the user interface may include at least one of a cancel item for canceling the at least one first operation performed and a change item for changing the at least one first operation performed to another operation.

[0025] According to one or more embodiments of the present disclosure, a non-transitory computer-readable recording medium including a program for executing a method for controlling an electronic device includes the steps of displaying content, obtaining information about a context of the content, identifying at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among a plurality of operations related to the content based on the information about the context and the information about the usage history, performing the at least one first operation, and displaying a user interface for the at least one second operation.

[0026] Other aspects, features and advantages of one or more embodiments according to the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

[0027] FIG. 1 is a block diagram briefly illustrating a configuration of an electronic device according to one or more embodiments of the present disclosure;

[0028] FIG. 2 is a block diagram illustrating a plurality of modules according to one or more embodiments of the present disclosure;

[0029] Figures 3 to 6 are drawings for explaining various embodiments related to the user interface according to the present disclosure.

[0030] FIG. 7 is a block diagram detailing the configuration of an electronic device according to one or more embodiments of the present disclosure, and

[0031] FIG. 8 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments of the present disclosure.

[0032] The present embodiments may be modified and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0033] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0034] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0035] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0036] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0037] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0038] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0039] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0040] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0041] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0042] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0043] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0044] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0045] Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that a person having ordinary knowledge in the technical field to which the present disclosure pertains can easily implement the present disclosure.

[0046]

[0047] FIG. 1 is a block diagram briefly illustrating a configuration of an electronic device (100) according to one or more embodiments of the present disclosure, and FIG. 2 is a block diagram illustrating a plurality of modules according to one or more embodiments of the present disclosure.

[0048] As illustrated in FIG. 1, the electronic device (100) may include a display (110), a memory (120), and one or more processors (130) (hereinafter, simply referred to as “processors”).

[0049] An 'electronic device (100)' according to one or more embodiments of the present disclosure refers to a device capable of providing a user interface for content. Specifically, the electronic device (100) can display content on a display (110) of the electronic device (100) and provide a user interface for the displayed content. For example, the electronic device (100) can be implemented as a TV, a smart monitor, a smartphone, a tablet PC, etc., but there is no particular limitation on the type of the electronic device (100).

[0050] The display (110) can output an image under the control of the processor (130). Specifically, the processor (130) can control the display (110) to display an image based on image data stored in the memory (120). The display (110) can also display a user interface (UI) stored in the memory (120). The display (110) can be implemented as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), etc., and in some cases, the display (110) can also be implemented as a flexible display, a transparent display, etc. However, the display (110) according to the present disclosure is not limited to a specific type.

[0051] In particular, in one or more embodiments, the processor (130) may control the display (110) to display content. The content may include content generated by the electronic device (100) as well as content received from an external device. There are no particular restrictions on the type of external device providing the content, nor are there any particular restrictions on the type of content. For example, the content may include broadcast content, game content, and OTT (Over The Top) content.

[0052] The processor (130) can control the display (110) to display a user interface. Various embodiments related to the user interface will be described in more detail with reference to FIGS. 3 to 6.

[0053] At least one instruction regarding the electronic device (100) may be stored in the memory (120). In addition, an O / S (Operating System) for driving the electronic device (100) may be stored in the memory (120). In addition, various software programs or applications for operating the electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (120). In addition, the memory (120) may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

[0054] Specifically, the memory (120) may store various software modules for operating the electronic device (100) according to various embodiments of the present disclosure, and the processor (130) may control the operation of the electronic device (100) by executing the various software modules stored in the memory (120). That is, the memory (120) is accessed by the processor (130), and data reading / recording / modifying / deleting / updating, etc. may be performed by the processor (130).

[0055] Meanwhile, in the present disclosure, the term memory (120) may be used to mean a memory (120), a ROM, a RAM in a processor (130), or a memory card (e.g., a micro SD card, a memory stick) mounted in an electronic device (100).

[0056] In one or more embodiments, the memory (120) may store information about the user's usage history.

[0057] "Information on usage history" is a general term for a user's usage history for at least one of an electronic device (100) and an external device, and may refer to the usage history of a specific user identified based on account information. The term "information on usage history" may be briefly replaced with terms such as "usage history information," "user information," or "user preference level."

[0058] Information about usage history may include information about at least one of the frequency and pattern of use of at least one of the electronic device (100) and the external device by the user under a specific context. Here, what a "specific context" is will be defined in the description of "information about context."

[0059] For example, information about usage history may include information that "the user set the screen brightness of the electronic device (100) to 90 / 100 or higher" under a specific context of "watching a movie in the afternoon." Additionally, information about usage history may include information that "the user set the screen brightness of the electronic device (100) to 90 / 100 or higher 8 times (frequency) out of 10 total usage histories (pattern)" under the context of "watching a movie in the afternoon."

[0060] Additionally, various types of information / data may be stored in the memory (120), such as information about content, information about context, information about user accounts, information about a plurality of identified actions, information about a first action and a second action, etc. In addition, various information necessary within the scope of achieving the purpose of the present disclosure may be stored in the memory (120), and the information stored in the memory (120) may be updated as received from an external device or input by a user.

[0061] The processor (130) controls the overall operation of the electronic device (100). Specifically, the processor (130) is connected to the configuration of the electronic device (100) including the display (110) and the memory (120), and can control the overall operation of the electronic device (100) by executing at least one instruction stored in the memory (120) as described above.

[0062] The processor (130) may be implemented in various ways. For example, the processor (130) may be implemented as at least one of an application-specific integrated circuit (ASIC), an embedded processor, a microprocessor, hardware control logic, a hardware finite state machine (FSM), and a digital signal processor (DSP). Meanwhile, the term "processor (130)" in the present disclosure may be used to mean a central processing unit (CPU), a graphic processing unit (GPU), and a microprocessor unit (MPU).

[0063] In particular, the processor (130) can implement various embodiments according to the present disclosure using a plurality of modules. The plurality of modules may be hardware modules or software modules, and two or more of the modules may be implemented as a single integrated module. The plurality of modules may be implemented as a neural network model (i.e., an artificial intelligence model) including a neural network, or may operate based on rules.

[0064] As illustrated in FIG. 2, the plurality of modules may include a context information acquisition module (1010), a usage history information acquisition module (1020), an operation identification module (1030), a control module (1040), a UI provision module, a user input reception module (1060), and a usage history information update module (1070). For convenience of explanation, the following description will be made on the assumption that the plurality of modules are all included in the electronic device (100) and implemented on-device by the processor (130) included in the electronic device (100). However, depending on the embodiment, at least one module among the plurality of modules may be included in an external device.

[0065] Hereinafter, various embodiments will be described with reference to FIG. 2 together with FIG. 1.

[0066] The processor (130) can obtain information about the context of the content. Referring to FIG. 2, the processor (130) can obtain information about the context using the context information obtaining module (1010). The context information obtaining module (1010) can obtain information about the context using various information / data stored in the memory (120). The various information / data stored in the memory (120) may be generated by the electronic device (100) or may be received from an external device.

[0067] 'Information about context' is a general term for information about events or situations that occur at a specific time and place, and can be replaced with terms such as 'context information' or 'situational information'.

[0068] Information about the context may include at least one of type information indicating the type of content, first state information indicating the operating state of the electronic device (100), second state information indicating the operating state of an external device related to the electronic device (100), and third state information indicating the external state of the electronic device (100) and the external device.

[0069] 'Type information' refers to information that indicates the type of content, and the type of content can be identified by, for example, the genre of the content (e.g., movie, game, sports, music, news, application screen, etc.), the source of the content (e.g., broadcast content, OTT (Over The Top) content, social media content, etc.).

[0070] The processor (130) can obtain type information indicating the type of content by identifying the type of content using Automatic Content Recognition (ACR). Here, ACR may include a process of extracting features of an audio signal or video signal corresponding to the content and comparing the extracted features with a database of content features stored in the memory (120) to identify matching content.

[0071] The processor (130) can obtain type information indicating the type of content based on the Electronic Program Guide (EPG), additional information (or metadata) about the content, etc. Here, the EPG and additional information about the content can be received from an external device that is the source of the content and stored in the memory (120).

[0072] The processor (130) can input information about the content into a neural network model trained to distinguish the type of input content, thereby obtaining type information indicating the type of content. Here, the neural network model may include a convolutional neural network (CNN) trained to identify multiple domains corresponding to the type of content, but there are no particular restrictions on the type of neural network included in the neural network model.

[0073] 'First state information' refers to information indicating the operating state of the electronic device (100), and may include, for example, information on the screen settings of the electronic device (100), information on the sound settings of the electronic device (100), information on the power mode, information on the network connection status, etc. The first state information may be information indicating the operating state of the electronic device (100) related to the content displayed on the display (110) among the operating states of the electronic device (100).

[0074] "Second status information" refers to information indicating the operating status of an external device. Here, the "external device" may be an IoT device registered as a device that forms an IoT (Internet of Things) network together with the electronic device (100). For example, the external device may be a user's smartphone, a smart light, a smart speaker, etc., but is not limited to the examples described above. The second status information may be information indicating the operating status of the external device related to the content displayed on the display (110) of the electronic device (100) among the operating statuses of the external device.

[0075] "Third state information" refers to information indicating the external state, not the internal state of the electronic device (100) or the external device. In other words, third state information can be said to be a general term for information that can affect the control of content, excluding the operation of the electronic device (100) or the operation of the external device. For example, third state information may include information about the current time, information about the current weather, information about the location of the electronic device (100), etc.

[0076] The processor (130) can obtain information about the user's usage history. Referring to FIG. 2, the processor (130) can obtain information about the user's usage history using the usage history information acquisition module (1020). The usage history information acquisition module (1020) can obtain information about the user's usage history using various types of information / data stored in the memory (120). Information about the usage history has been described above in the description of the memory (120).

[0077] Meanwhile, the process of obtaining information about the context and / or usage history of the processor may be performed based on the occurrence of a preset event in the electronic device (100) or an external device, may be performed based on a user input requesting a recommendation of the user interface, or may be performed at preset intervals.

[0078] The processor (130) can identify at least one first action that does not require user confirmation and at least one second action that requires user confirmation among a plurality of actions related to the content based on information about the context and information about the usage history. Referring to FIG. 2, when information about the context is received from the context information acquisition module (1010) and information about the usage history is received from the usage history information acquisition module (1020), the action identification module (1030) can identify a plurality of actions related to the content, the first action and the second action, based on the information about the context and the information about the usage history.

[0079] Specifically, the processor (130) can identify a plurality of actions related to content based on information about the context and information about the usage history, and can identify (or distinguish) a first action and a second action among the identified plurality of actions based on information about the context and information about the usage history.

[0080] "Multiple operations" collectively refers to operations of an electronic device (100) and an external device related to content. Specifically, the multiple operations include at least one of an operation of the electronic device (100) related to content and an operation of an external device related to content, and may refer to operations that a user is likely to want to perform in the current context. Meanwhile, the term "operation" according to the present disclosure may be replaced with terms such as "function" and "service."

[0081] The processor (130) can identify a plurality of operations corresponding to the context information and the usage history information among the operations of the electronic device (100) and the operations of the external device based on the context information and the usage history information. The processor (130) can also identify a plurality of operations by inputting the context information and the usage history information into a neural network model trained to identify a plurality of operations corresponding to the context information and the usage history information.

[0082] For example, if the information about the context indicates that the type of content is a movie and the current time is 10 PM, and the information about the usage history indicates that the user sets the screen brightness of the electronic device (100) to 90 / 100 and turns off the smart light, which is an external device, 90% of the time when watching a movie, the processor (130) can identify an action of controlling playback of the content, an action of setting subtitles for the content, an action of setting the screen brightness of the electronic device (100) to 90 / 100, and an action of turning off the smart light, which is an external device, as actions included in the plurality of actions.

[0083] The processor may identify multiple actions, which are actions of the electronic device (100) and external devices related to the content, and provide a user interface for the identified multiple actions. However, in one or more embodiments, the processor may distinguish at least one first action and at least one second action among the multiple actions, and perform different controls depending on the first action and the second action.

[0084] "First Action" refers to a set of actions related to content that do not require user confirmation. If the set of actions are actions that the user is likely to want to perform in the current context, the first action may refer to an action that the user is likely to want to be automatically performed in the current context. The first action may be predefined by the developer or determined based on user settings. Furthermore, the first action may change as usage history information is updated, as described below.

[0085] For example, the user's setting for the first action may be an automation setting. If the user registers a specific action as a target of automation, the action may be performed without the user's confirmation and may correspond to the first action according to the present disclosure because it conforms to the user's intention. Here, 'automation' refers to registering an action of an IoT device (e.g., electronic device (100), external device) corresponding to a specific condition and a specific condition, and automatically controlling the IoT device to perform the registered action when the registered condition is met. In addition, an action performed according to automation may be referred to as an 'automated action' or an 'automated routine'.

[0086] "Secondary Action" refers to a general term for actions among multiple actions related to content that require user confirmation. If the multiple actions are actions that the user is likely to want to perform in the current context, the secondary action may refer to an action that the user is likely to want to directly control in the current context. The secondary action may be predefined by the developer or determined based on the user's settings. Furthermore, the secondary action may be changed as usage history information is updated, as described below. Since the secondary action refers to actions excluding the primary action among the multiple actions, it may be defined / configured / changed depending on how the primary action is defined / configured / changed.

[0087] As described above, at least one first action and at least one second action may be predefined or set, as well as identified by the processor (130).

[0088] In one or more embodiments, at least one first action and at least one second action may be identified according to the types of the plurality of actions. Specifically, the processor (130) may identify an action corresponding to a preset type among the plurality of actions as a first action, and an action not corresponding to a preset type as a second action. Here, the preset types may be changed according to developer or user settings.

[0089] For example, the processor (130) may identify an action related to screen settings and sound settings for content among a plurality of actions as at least one first action, and an action not related to screen settings and sound settings for content as a second action. As another example, the processor (130) may identify an action that can be simply turned on and off (e.g., turning a TV on and off) among a plurality of actions as the first action, and an action that requires option selection (e.g., various washing modes of a washing machine) as the second action.

[0090] In the above-described example, if an action for controlling playback of content, an action for setting subtitles for the content, an action for setting the screen brightness of the electronic device (100) to 90 / 100, and an action for turning off a smart light, which is an external device, are identified as multiple actions related to the content, the processor (130) may identify the action for setting the screen brightness of the electronic device (100) to 90 / 100 and the action for turning off the smart light, which is an external device, as first actions, which are actions related to screen settings and sound settings for the content among the multiple actions. In addition, the processor (130) may identify the action for controlling playback of the content and the action for setting subtitles for the content, which are actions not related to screen settings and sound settings for the content among the multiple actions, as second actions.

[0091] For another example, at least one first action may be brightness optimization, screen mode switching, sound quality optimization, etc., and at least one second action may be channel change, control of a surrounding IoT device, change of content provision source, application of energy saving mode, etc.

[0092] When at least one first action and at least one second action are identified, the processor (130) can perform at least one first action. Then, the processor (130) can control the display (110) to display a user interface for at least one second action.

[0093] Referring to FIG. 2, when information on at least one first action identified from the action identification module (1030) is received, the control module (1040) can control the configuration of the electronic device (100) to perform at least one first action. Referring to FIG. 2, when information on at least one second action identified from the action identification module (1030) is received, the UI provision module can provide a user interface for at least one second action.

[0094] In one or more embodiments, the user interface may include at least one control item corresponding to each of at least one second operation. When a user input for selecting one of the at least one control item is received, the processor (130) may perform a second operation corresponding to the selected control item. Referring to FIG. 2, after the user interface is provided from the UI providing module, the user input receiving module (1060) may receive a user input and transmit information about the user input to the control module (1040). When information about the user input is received, the control module (1040) may control the configuration of the electronic device (100) to perform an operation corresponding to the user input.

[0095] In other words, the processor (130) can automatically perform at least one first operation that does not require user confirmation among a plurality of operations, and provide a user interface for a second operation that requires user confirmation, thereby receiving user input according to user confirmation, and performing an operation corresponding to the received user input.

[0096] In one or more embodiments, when a user input is received based on a user interface, the processor (130) may update information about the usage history stored in the memory (120) based on the received user input. Referring to FIG. 2, the user input receiving module (1060) may receive the user input and transmit information about the user input to the usage history information updating module (1070).

[0097] When the usage history information is updated by the usage history information update module (1070), the processor (130) can then identify a plurality of actions related to the content, a first action and a second action, based on the updated usage history information together with the context information. For example, if the "brightness optimization" action is identified as the first action and automatically performed, and then usage history information indicating that the user frequently manually uses brightness control is obtained, the "brightness optimization" action can be identified as the second action.

[0098] More specific embodiments related to the user interface and more specific embodiments related to updating information about the usage history based on user input are described in more detail with reference to FIGS. 3 to 6.

[0099] In one or more embodiments, at least one first action or at least one second action may include an action of changing the current content to another content, an action of changing the current channel to another channel, an action of changing the external input device providing the current content to another device, etc. In this way, the electronic device (100) may also perform the role of recommending content to the user by automatically displaying the recommended content or allowing the user to control the content.

[0100] According to various embodiments of the present disclosure, an electronic device (100) can provide a user interface suitable for a user viewing content. In particular, the electronic device (100) can use information about the context of the current content and information about the user's usage history to identify a first action that the user is likely to want to perform automatically and a second action that the user is likely to want to directly control, and can provide the user with automatic control and a user interface.

[0101] Accordingly, the user can be provided with an optimal user experience for the operation required by the user in the current situation without having to search for the operation of the electronic device (100) that must be performed for a desired result or input multiple operations to perform the operation.

[0102]

[0103] FIGS. 3 to 6 are drawings for explaining various embodiments related to the user interface according to the present disclosure.

[0104] As described above, the processor (130) may identify at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among a plurality of operations related to the content based on information about the context and information about the usage history. When at least one first operation and at least one second operation are identified, the processor (130) may perform at least one first operation and control the display (110) to display a user interface for at least one second operation. Specifically, the processor (130) may obtain information for displaying a user interface for at least one second operation and control the display (110) to display a user interface for at least one second operation based on the obtained information.

[0105] The user interface may be provided based on the user's operating method. For example, if the user uses a remote control device, the user interface may be configured to facilitate user input using the remote control device. If the user uses voice control, the user interface may prompt voice utterances and include information indicating the progress of voice recognition.

[0106] The user interface may include various information related to the operation of the electronic device (100) and items for controlling the operation of the electronic device (100). Hereinafter, the term 'item' is used as a term to refer to at least one of the components included in the user interface, and may be replaced with terms such as 'UI item', 'visual element', 'object', etc. The number of items included in the user interface, particularly the number and types of items corresponding to at least one second operation, may be defined in advance and may vary depending on information about the context.

[0107] The user interface may include a plurality of category items, each corresponding to a plurality of categories associated with at least one second action. The term "multiple categories" refers to predefined criteria for classifying at least one second action, and the term "category" may be replaced with terms such as "class," "group," etc.

[0108] For example, multiple categories may include, but are not limited to, content change (e.g., changing channels, changing external inputs, etc.), content setting control (e.g., controlling screen settings, controlling sound settings, etc.), external device control (e.g., controlling IoT devices), and external input selection (e.g., changing content sources). Multiple category items may correspond to each of the multiple categories in the examples described above.

[0109] The processor (130) can identify a plurality of categories corresponding to each of at least one second operation, and include a plurality of category items corresponding to each of the identified categories in the user interface.

[0110] As illustrated in FIGS. 3 to 5, the plurality of category items may include a category item corresponding to a category called 'content change' (e.g., 310 of FIG. 3), a category item corresponding to a category called 'content setting control' (e.g., 410 of FIG. 4), and a category item corresponding to a category called 'external device control' (e.g., 510 of FIG. 5). In addition, as illustrated in FIG. 6, the plurality of category items may further include a category item corresponding to a category called 'external input selection' (e.g., 610 of FIG. 6).

[0111] When a first user input for selecting one of a plurality of category items is received, the processor (130) may identify at least one first action and at least one second action among one or more actions corresponding to the selected category item based on information about the context and information about the usage history. Then, when at least one first action and at least one second action are identified, the processor (130) may control the display (110) to perform at least one first action and display a user interface for at least one second action.

[0112] The term "first user input" is used to refer to a user input for selecting one of a plurality of category items. For example, the first user input may be received based on a user's touch input through a touch display (110), a control signal received from a remote control device, a user's voice utterance, etc. In addition, the first user input may be a user using a remote control device to move a focus (or cursor) displayed on the display (110) to one of the plurality of category items. In addition to the first user input, various user inputs according to the present disclosure may be input / received in various ways, as in the examples described above.

[0113] In Figures 3 to 6, the dotted circles represent one category item selected based on the first user input among multiple category items. There may be other ways to represent the selected category item.

[0114] Referring to FIG. 3, the first user input may be a user input selecting a 'content change' category item (310) from among a plurality of category items. In this case, the processor (130) may identify at least one of the second actions, namely, "Move to 52," "Move to Golf Channel," and "Move to App A's recent videos," which are actions corresponding to the 'content change' category item (310), based on information about the context and information about the usage history.

[0115] Referring to FIG. 4, the first user input may be a user input for selecting a 'content setting control' category item (410) from among a plurality of category items. In this case, the processor (130) may identify "Apply AI mode," an action corresponding to the 'content setting control' category item (410), as at least one second action, based on information about the context and information about the usage history.

[0116] Referring to FIG. 5, the first user input may be a user input selecting an 'external device control' category item (510) from among a plurality of category items. In this case, the processor (130) may identify, based on information about the context and information about the usage history, at least one of the second actions, namely, "apply air conditioner energy saving mode," "display camera screen," and "dim lighting," which are actions corresponding to the 'external device control' category item (510).

[0117] The processor (130) may display a user interface for at least one second action, and in particular, the user interface may include at least one control item corresponding to each of the at least one second action. Then, when a second user input selecting one of the at least one control item is received, the processor (130) may perform a second action corresponding to the selected control item.

[0118] The term "secondary user input" is used to refer to a user input that selects at least one control item. The second user input may be received based on a user's touch input via a touch display (110), a control signal received from a remote control device, a user's voice utterance, etc.

[0119] In the example of FIG. 3, the user interface may include control items (320) corresponding to “Go to 52,” “Go to Golf Channel,” and “Go to App A Recent Videos,” respectively. In the example of FIG. 4, the user interface may include control items (420) corresponding to “Apply AI Mode.” And, in the example of FIG. 5, the user interface may include control items (520) corresponding to “Apply Air Conditioner Energy Saving Mode,” “Display Camera Screen,” and “Dim Lights,” respectively. And, when one of the control items (320, 420, 520) according to the above-described examples is selected, the processor (130) may perform a second operation corresponding to the selected control item.

[0120] As described above, the user interface may include items related to at least one second action (e.g., multiple category items and at least one control item). Furthermore, the user interface may further include items related to at least one first action. That is, the processor (130) may include items related to at least one performed first action in the user interface to enable the user to manually control the at least one first action, if necessary, even after automatically performing the at least one first action.

[0121] Specifically, the processor (130) may control the display (110) to display a user interface after performing at least one first operation, in which case the user interface may include at least one of a cancel item for canceling the performed at least one first operation and a change item for changing the performed at least one first operation to another operation.

[0122] The “Revert” item (620) of FIG. 6 represents an example of a cancel item for canceling (or recovering, reverting, rolling back) at least one first operation that has been performed, and the “Reset” item (630) of FIG. 6 represents an example of a change item for changing at least one first operation that has been performed to another operation.

[0123] When a user input selecting a cancel item is received, the processor (130) may cancel at least one of the first operations performed, thereby restoring the state prior to the at least one first operation being performed. When a user input selecting a change item is received, the processor (130) may display items for changing the at least one of the first operations performed, or display a new user interface.

[0124] Unlike the example in Figure 6, the change item may include items corresponding to each of the first and other actions. For example, the change item may include thumbnail images representing the results of applying each of the various screen modes.

[0125] In one or more embodiments, the processor (130) may identify the priority of each of the plurality of operations based on information about the context and information about the user's usage history. For example, the processor (130) may identify the priority of each of the plurality of operations in descending order of frequency of the user's usage history corresponding to the current context.

[0126] The processor (130) may identify one or more second actions to be displayed on the user interface among at least one second action based on the identified priority. Referring again to the example of FIG. 3, if the number of second actions that may be displayed on the user interface is three, the processor (130) may identify three second actions, namely, "Move to 52," "Move to Golf Channel," and "Move to App A Recent Videos," in descending order of priority among the identified at least one second action.

[0127] The user interface may include information regarding the priority of each of one or more second actions to be displayed on the user interface. For example, in the example of FIG. 3, the user interface displays control items (320) corresponding to "Go to 52," "Go to Golf Channel," and "Go to App A Recent Videos," respectively, from left to right. These may be displayed from left to right in order of identified priority.

[0128] Alternatively, the user interface may directly indicate the priority of each secondary action, such as by displaying numbers around each control item. Furthermore, the processor (130) may place the default focus on the control item corresponding to the secondary action with the highest priority.

[0129] According to the above-described embodiment, the processor (130) can provide a function that best matches the current context and the user's usage history in priority order.

[0130] The user interface may also include a message to inform the user that at least one first action has been automatically performed. For example, the user interface may include a message to inform the user that at least one first action has been automatically performed, such as "The screen mode has been automatically changed to game mode."

[0131] The above describes various types of items displayed on the user interface and various user inputs for selecting those items. However, the processor (130) can update usage history information based on various user inputs received through the user interface.

[0132] Specifically, the processor (130) may update information about the usage history based on at least one of a first user input, which is a user input for selecting one of a plurality of category items, and a second user input, which is a user input for selecting one of at least one control item. In addition, the processor (130) may also update information about the usage history based on at least one of a user input for selecting a cancel item to cancel a first operation that has been automatically performed, and a user input for selecting a change item to change the first operation that has been automatically performed to another operation.

[0133] When the information about the usage history is updated, the processor (130) can then identify a plurality of actions related to the content, a first action and a second action, based on the updated information about the usage history together with information about the context.

[0134] For example, if the information about the context indicates that “game content is currently being displayed,” the processor (130) may identify “an operation of changing the screen mode of the electronic device (100) to game mode” as one of a plurality of operations related to the content. Before the information about the usage history is sufficiently updated, the “operation of changing the screen mode of the electronic device (100) to game mode” may be identified as a first operation according to a default setting. Then, when the information about the usage history is updated based on a user input indicating that the user changes the screen mode to various modes depending on the type of game, the “operation of changing the screen mode of the electronic device (100) to game mode” may be identified as a second operation based on the information about the updated usage history.

[0135] In the above example, before the usage history information is sufficiently updated, the "action of changing the screen mode of the electronic device (100) to game mode" may be identified as the second action, not the first action, according to the default setting. Then, when the usage history information indicating that the user frequently changes the screen mode of the electronic device (100) to game mode when playing a game is updated based on the user input, the "action of changing the screen mode of the electronic device (100) to game mode" may be identified as the first action based on the updated usage history information and may be automatically performed. This may mean generating and providing a user-specific routine based on the updated usage history information. Meanwhile, as described above, the user may set the specific action as the first action according to the present disclosure by registering the specific action as a target of automation.

[0136]

[0137] FIG. 7 is a block diagram detailing the configuration of an electronic device (100) according to one or more embodiments of the present disclosure.

[0138] The electronic device (100) may further include a display (110), a memory (120), and a processor (130), as well as a communication unit (140), an interface unit (150), an input unit (160), and an output unit (170). However, the configurations illustrated in FIGS. 1 and 7 are merely exemplary, and it is to be understood that new configurations may be added or some configurations may be omitted in addition to the configurations illustrated in FIGS. 1 and 7 when implementing the present disclosure.

[0139] The communication unit (140) includes a circuit and can perform communication with an external device. Specifically, the processor (130) can receive various data or information from an external device connected via the communication unit (140) and can also transmit various data or information to the external device.

[0140] The communication unit (140) may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and an Ultra-Wide Band (UWB) module. Specifically, the WiFi module and the Bluetooth module may each perform communication in the WiFi or Bluetooth manner. When using a WiFi module or a Bluetooth module, various connection information, such as an SSID, may be first transmitted and received, and then communication may be established using this, after which various pieces of information may be transmitted and received.

[0141] In addition, the wireless communication module can perform communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), 5G (5th Generation), etc. And, the NFC module can perform communication in the NFC (Near Field Communication) method using the 13.56MHz band among various RF-ID frequency bands such as 135kHz, 13.56MHz, 433MHz, 860~960MHz, 2.45GHz, etc. In addition, the UWB module can accurately measure ToA (Time of Arrival), which is the time it takes for a pulse to reach a target, and AoA (Ange of Arrival), which is the pulse arrival angle at the transmitting device, through communication between UWB antennas, and accordingly, precise distance and location recognition is possible within an error range of several tens of centimeters indoors.

[0142] In particular, in one or more embodiments, the processor (130) may receive information about usage history and information about context from an external device through the communication unit (140). In addition, if the identified at least one first operation or second operation is an operation of the external device, the processor (130) may control the communication unit (140) to transmit information about the at least one first operation or information about the at least one second operation to the external device. As a result, the external device may perform the first operation based on the information about the at least one first operation, and may also display a user interface on the display (110) of the external device based on the information about the second operation.

[0143] The interface unit (150) can transmit and receive video data and / or audio data in relation to an external device. Specifically, the interface unit (150) may include an input port capable of receiving video data and / or audio data from an external device and an output port capable of transmitting video data and / or audio data to the external device. In particular, when the interface unit (150) can transmit and receive both video data and audio data, input / output ports capable of transmitting and receiving video data and audio data may be implemented separately. The interface unit (150) may connect the electronic device (100) and the external device wiredly via a cable, but may also connect the electronic device (100) and the external device wirelessly.

[0144] For example, the interface unit (150) may include an HDMI (High-Definition Multimedia Interface) module, a USB (Universal Serial Bus) module, etc. The HDMI module is one of the uncompressed digital video / audio interface standards and may provide an interface between the electronic device (100) and an external device providing content. The USB module may provide a communication system between the electronic device (100) and the external device providing content using a predefined input / output standard protocol. In addition to the HDMI module and the USB module, the interface unit (150) may of course be implemented with various modules for providing input / output of video / audio data between the electronic device (100) and an external device, such as a DP (Display Port) module, an RGB module, a DVI (Digital Visual Interface) module, and a Thunderbolt module.

[0145] In particular, in various embodiments according to the present disclosure, the processor (130) can receive data on content from an external device through the interface unit (150). In addition, the processor (130) can transmit data for changing content to the external device through the interface unit (150).

[0146]

[0147] *The input unit (160) includes a circuit, and the processor (130) can receive a user command to control the operation of the electronic device (100) through the input unit (160). Specifically, the input unit (160) can be configured with components such as a microphone, a camera, and a remote control signal receiving unit. In addition, the input unit (160) can be implemented in a form included in the display (110) as a touch screen. In particular, the microphone can receive a voice signal and convert the received voice signal into an electrical signal.

[0148] The output unit (170) includes a circuit, and the processor (130) can output various functions that the electronic device (100) can perform through the output unit (170). In addition, the output unit (170) can include at least one of a display (110), a speaker, and an indicator. Since the display (110) has been described with reference to FIG. 1, a duplicate description of the same content will be omitted.

[0149] The speaker can output audio data under the control of the processor (130).

[0150] The indicator can be lit under the control of the processor (130). Specifically, the indicator can be lit in various colors under the control of the processor (130). For example, the indicator can be implemented as a light emitting diode (LED), a liquid crystal display panel (LCD), a vacuum fluorescent display (VFD), etc., but is not limited thereto.

[0151] In particular, in one or more embodiments, the processor (130) may control the display (110) to display a user interface, the user interface including a plurality of category items each corresponding to a plurality of categories associated with at least one second action.

[0152] When a first user input for selecting one of a plurality of category items is received through the input unit (160), the processor (130) can identify at least one first action and at least one second action among one or more actions corresponding to the selected category item based on information about the context and information about the usage history, and can control the display (110) to display a user interface for at least one second action.

[0153] The user interface may include at least one control item corresponding to each of at least one second action, and when a second user input selecting one of the at least one control item is received, the processor (130) may perform a second action corresponding to the selected control item. Various other types of user interfaces have been described above with reference to FIGS. 3 to 6.

[0154] Meanwhile, the processor (130) can receive the user input described above by controlling the speaker to output a voice corresponding to the user interface described above and receiving the user voice through the microphone. To this end, the processor (130) can input text information corresponding to the user interface into a voice synthesis model (e.g., Text-to-Speech Model, TTS model) to obtain a voice corresponding to the user interface. In addition, the processor (130) can input the user voice received through the microphone into a voice recognition model (e.g., Automatic Speech Recognition Model, ASR model) to obtain text information corresponding to the user input. The user interface may include an item that induces the user to speak.

[0155]

[0156] FIG. 8 is a flowchart illustrating a method for controlling an electronic device (100) according to one or more embodiments of the present disclosure.

[0157] As illustrated in FIG. 8, the electronic device (100) can display content (S810). The content may include content generated by the electronic device (100) as well as content received from an external device. There are no specific restrictions on the type of external device providing the content, nor are there any specific restrictions on the type of content.

[0158] The electronic device (100) can identify at least one first action that does not require user confirmation and at least one second action that requires user confirmation among a plurality of actions related to content based on information about the context and information about the user's usage history (S820).

[0159] Specifically, the electronic device (100) can identify a plurality of actions related to content based on information about the context and information about the usage history, and can identify (or distinguish) a first action and a second action among the identified plurality of actions based on information about the context and information about the usage history.

[0160] At least one first action and at least one second action may be identified according to the types of the plurality of actions. Specifically, the electronic device (100) may identify an action corresponding to a preset type among the plurality of actions as a first action, and may identify an action not corresponding to a preset type as a second action.

[0161] The electronic device (100) can perform at least one first operation (S830). The electronic device (100) can display a user interface for at least one second operation (S840).

[0162] In one or more embodiments, the user interface may include at least one control item corresponding to each of at least one second action. When a user input selecting one of the at least one control item is received, the electronic device (100) may perform a second action corresponding to the selected control item.

[0163] In one or more embodiments, when user input is received based on the user interface, the electronic device (100) may update information about the usage history stored in the memory (120) based on the received user input.

[0164] Meanwhile, the control method of the electronic device (100) according to the above-described embodiment may be implemented as a program and provided to the electronic device (100). In particular, the program including the control method of the electronic device (100) may be stored and provided in a non-transitory computer readable medium.

[0165] Specifically, in a non-transitory computer-readable recording medium including a program for executing a method for controlling an electronic device (100), the method for controlling an electronic device (100) may include a step of displaying content, a step of obtaining information about a context of the content, a step of identifying at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among a plurality of operations related to the content based on the information about the context and information about a user's usage history, a step of performing at least one first operation, and a step of displaying a user interface for at least one second operation.

[0166] In the above, a method for controlling an electronic device (100) and a computer-readable recording medium including a program for executing the method for controlling an electronic device (100) have been briefly described, but this is only to omit redundant descriptions, and it goes without saying that various embodiments of the electronic device (100) can also be applied to a method for controlling an electronic device (100) and a computer-readable recording medium including a program for executing the method for controlling an electronic device (100).

[0167] The artificial intelligence-related function according to the present disclosure is operated through the processor (130) and memory (120) of the electronic device (100).

[0168] The processor (130) may be composed of one or more processors (130). At this time, the one or more processors (130) may include at least one of a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and an NPU (Neural Processing Unit), but is not limited to the examples of the processors (130) described above.

[0169] The CPU is a general-purpose processor (130) capable of performing not only general calculations but also artificial intelligence calculations. Its multi-layer cache structure allows for the efficient execution of complex programs. The CPU is advantageous in a serial processing method, enabling organic linking of previous and subsequent calculation results through sequential calculations. The general-purpose processor (130) is not limited to the aforementioned examples, except in cases where it is specifically designated as a CPU.

[0170] A GPU is a processor (130) for large-scale operations such as floating-point operations used in graphic processing, and can perform large-scale operations in parallel by integrating a large number of cores. In particular, a GPU may be advantageous compared to a CPU in parallel processing methods such as convolution operations. In addition, a GPU may be used as a co-processor (130) to supplement the functions of a CPU. The processor (130) for large-scale operations is not limited to the examples described above, except in cases where it is specified as a GPU as described above.

[0171] An NPU is a processor (130) specialized in artificial intelligence operations using an artificial neural network, and each layer constituting the artificial neural network can be implemented with hardware (e.g., silicon). At this time, since the NPU is designed specifically according to the required specifications of the company, it has a lower degree of freedom compared to a CPU or GPU, but it can efficiently process the artificial intelligence operations requested by the company. Meanwhile, as a processor (130) specialized in artificial intelligence operations, the NPU can be implemented in various forms such as a Tensor Processing Unit (TPU), an Intelligence Processing Unit (IPU), a Vision Processing Unit (VPU), etc. The artificial intelligence processor (130) is not limited to the above-described examples, except in cases where it is specified as the above-described NPU.

[0172] Additionally, one or more processors (130) may be implemented as a SoC (System on Chip). In this case, the SoC may further include, in addition to one or more processors (130), a memory (120), and a network interface such as a bus for data communication between the processor (130) and the memory (120).

[0173] When a plurality of processors (130) are included in a SoC (System on Chip) included in an electronic device (100), the electronic device (100) may perform operations related to artificial intelligence (e.g., operations related to learning or inference of an artificial intelligence model) by using some of the plurality of processors (130). For example, the electronic device (100) may perform operations related to artificial intelligence by using at least one of a GPU, an NPU, a VPU, a TPU, and a hardware accelerator specialized in artificial intelligence operations such as convolution operations and matrix multiplication operations among the plurality of processors (130). However, this is merely an example, and it is of course possible to process operations related to artificial intelligence by using a CPU or a general-purpose processor (130).

[0174] In addition, the electronic device (100) can perform operations related to functions related to artificial intelligence by utilizing multiple cores (e.g., dual cores, quad cores, etc.) included in one processor (130). In particular, the electronic device (100) can perform artificial intelligence operations such as convolution operations, matrix multiplication operations, etc. in parallel by utilizing multiple cores included in the processor (130).

[0175] One or more processors (130) are controlled to process input data according to predefined operation rules or artificial intelligence models stored in the memory (120). The predefined operation rules or artificial intelligence models are characterized by being created through learning.

[0176] Here, "created through learning" means that a predefined set of behavioral rules or an AI model with desired characteristics is created by applying a learning algorithm to a large number of learning data. This learning may be performed on the device itself, where the AI ​​according to the present disclosure is implemented, or through a separate server / system.

[0177] An artificial intelligence model may be composed of multiple neural network layers. At least one layer has at least one weight value and performs its operation through the operation result of the previous layer and at least one defined operation. Examples of neural networks include a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, and a transformer. The neural networks in the present disclosure are not limited to the above-described examples unless otherwise specified.

[0178] A learning algorithm is a method for training a target device (e.g., a robot) using a large amount of learning data, enabling the target device to make decisions or predictions on its own. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. Unless otherwise specified, the learning algorithms in this disclosure are not limited to the aforementioned examples.

[0179] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0180] According to one or more embodiments, the method according to the various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read only memory (CD-ROM)) or may be available through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be at least temporarily stored or temporarily created in a device-readable storage medium, such as a manufacturer's server, an application store's server, or a memory (120) of an intermediary server.

[0181] Each of the components (e.g., modules or programs) according to the various embodiments of the present disclosure as described above may be composed of a single or multiple entities, and some of the sub-components described above may be omitted, or other sub-components may be further included in the various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the respective components prior to integration.

[0182] According to various embodiments, operations performed by a module, program or other component may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0183] Meanwhile, the terms "part" or "module" used in the present disclosure include units composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A "part" or "module" may be an integrally composed component, a minimum unit performing one or more functions, or a portion thereof. For example, a module may be composed of an application-specific integrated circuit (ASIC).

[0184] Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device (e.g., an electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored in the storage medium and operating according to the called instructions.

[0185] When the above instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0186] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, display; Memory that stores information about the user's usage history; and Control the above display to display content, Obtain information about the context of the above content, Based on the information about the context and the information about the usage history, at least one first action that does not require the user's confirmation and at least one second action that requires the user's confirmation are identified among a plurality of actions related to the content. performing at least one of the first operations, An electronic device comprising one or more processors controlling the display to display a user interface for at least one of the second actions.

2. In paragraph 1, Information about the above context is: An electronic device including at least one of type information indicating the type of the content, first status information indicating the operating status of the electronic device, second status information indicating the operating status of an external device related to the electronic device, and third status information indicating the external status of the electronic device and the external device.

3. In paragraph 2, Information about the above usage history, An electronic device comprising information about at least one of a frequency and a pattern of use of at least one of the electronic device and the external device by the user while the type of content is displayed on the display.

4. In paragraph 1, The above multiple actions are: An electronic device comprising at least one of an operation of the electronic device related to the content and an operation of the external device related to the content.

5. In paragraph 1, One or more of the above processors, An electronic device that identifies an action related to screen setting and sound setting for the content among the above plurality of actions as at least one first action.

6. In paragraph 1, The above user interface, Containing a plurality of category items corresponding to each of a plurality of categories related to at least one of the second actions, One or more of the above processors, An electronic device that, when a first user input for selecting one of the plurality of category items is received, identifies at least one first action and at least one second action among one or more actions corresponding to the selected category item based on information about the context and information about the usage history.

7. In paragraph 6, The above user interface, comprising at least one control item corresponding to each of the at least one second operation; One or more of the above processors, An electronic device that, when a second user input for selecting at least one of the above control items is received, performs a second action corresponding to the selected control item.

8. In paragraph 7, One or more of the above processors, An electronic device that updates information about the usage history based on at least one of the first user input and the second user input.

9. In paragraph 1, One or more of the above processors, After performing at least one of the first operations, controlling the display to display the user interface; The above user interface, An electronic device comprising at least one of a cancellation item for canceling at least one first operation performed and a change item for changing the at least one first operation performed to another operation.

10. In paragraph 1, One or more of the above processors, Based on the information about the context and the information about the usage history, the priority of each of the plurality of operations is identified, Identifying one or more second actions to be displayed on the user interface among the at least one second action based on the above priorities; The above user interface, An electronic device comprising information about the priority of each of said one or more second operations.

11. In a method for controlling an electronic device, Step to display content; A step of obtaining information about the context of the above content; A step of identifying at least one first action that does not require confirmation by the user and at least one second action that requires confirmation by the user among a plurality of actions related to the content based on information about the context and information about the user's usage history; a step of performing at least one first operation; and A method of controlling an electronic device, comprising: displaying a user interface for at least one of the second operations; 12. In paragraph 11, Information about the above context is: A control method of an electronic device, comprising at least one of type information indicating the type of the content, first status information indicating the operating status of the electronic device, second status information indicating the operating status of an external device related to the electronic device, and third status information indicating the external status of the electronic device and the external device.

13. In paragraph 12, Information about the above usage history, A method for controlling an electronic device, the method comprising information about at least one of a frequency and a pattern of use of at least one of the electronic device and the external device by the user while the type of content is displayed on the display.

14. In paragraph 11, The above multiple actions are: A method for controlling an electronic device, comprising at least one of an operation of the electronic device related to the content and an operation of the external device related to the content.

15. In Article 11, The above identifying step is, A method for controlling an electronic device, comprising: a step of identifying an operation related to screen setting and sound setting for the content among the plurality of operations as at least one first operation;

Images