Electronic device and method for controlling electronic device

Abstract

An electronic device and a control method thereof are disclosed. Specifically, the electronic device can control a display to display content, obtain information about a context of the content, identify at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among a plurality of operations related to the content based on the information about the context and information about a usage history, perform the at least one first operation, and control the display to display a user interface for the at least one second operation.

Description

Technical Field

[0001] This disclosure relates to electronic devices and methods for controlling such electronic devices, and more particularly, to electronic devices capable of providing a user interface suitable for a user and methods for controlling such electronic devices. Background Technology

[0002] In recent years, with the advancement of technology, electronic devices have been able to provide various types of functions (operations or services). Specifically, electronic devices can provide various types of content, and with the advancement of Internet of Things (IoT) technology, various types of external devices can interact with electronic devices, enabling them to provide a wide range of functions.

[0003] When electronic devices offer a variety of functions, there is a need to provide a user interface that allows users to easily use the functions offered by the electronic devices.

[0004] However, existing user interfaces are configured in a complex manner to provide a large number of functions for electronic devices. Therefore, in the prior art, it is difficult to identify which control function to use to achieve the user's desired result, and manipulation is required to determine the desired control function, thus causing inconvenience to the user. Furthermore, it is even possible that functions that are not currently feasible or unnecessary may be provided, further inconveniencing the user. Summary of the Invention

[0005] Solution to the problem

[0006] This disclosure will solve the aforementioned problems of the prior art, and the purpose of this disclosure is to provide an electronic device capable of providing a user interface suitable for users to enjoy content and a method for controlling the electronic device.

[0007] According to one or more embodiments, an electronic device includes: a display; a memory storing information about a user's usage history; and one or more processors configured to: control the display to display content; obtain contextual information about the content; based on the contextual information and the usage history information, identify, among a plurality of operations related to the content, at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation; perform at least one first operation; and control the display to display a user interface related to at least one second operation.

[0008] Additionally, the information about the context may include at least one of the following: type information indicating the type of content, first state information indicating the operating state of the electronic device, second state information indicating the operating state of an external device associated with the electronic device, and third state information indicating the external state of the electronic device and the external device.

[0009] Additionally, information about usage history may include at least one of the frequency and patterns of a user using at least one of electronic devices and external devices when that type of content is displayed on the monitor.

[0010] Meanwhile, multiple operations may include at least one of content-related operations of electronic devices and content-related operations of external devices.

[0011] At the same time, one or more processors can identify content-related screen settings and sound settings associated with multiple operations as at least one first operation.

[0012] Meanwhile, the user interface may include multiple category items corresponding to multiple categories of at least one second operation, and one or more processors may, based on receiving a first user input that selects one of the multiple category items, identify at least one first operation and at least one second operation among the one or more operations corresponding to the selected category item, according to information about the context and information about the usage history.

[0013] Meanwhile, the user interface may include at least one control item corresponding to at least one second operation, and one or more processors may execute a second operation corresponding to the selected control item based on receiving a second user input that selects one of the at least one control item.

[0014] Meanwhile, one or more processors can update information about usage history based on at least one of the first user input and the second user input.

[0015] Meanwhile, one or more processors can perform at least one first operation and then control the display to show a user interface, and the user interface can include at least one of a cancellation item and a change item, wherein the cancellation item is used to cancel the at least one first operation performed, and the change item is used to change the at least one first operation performed to another operation.

[0016] Meanwhile, one or more processors can identify the priority of each of the multiple operations based on information about the context and information about the usage history, and based on the priority, identify one or more second operations to be displayed on the user interface among at least one second operation, and the user interface may include information about the priority of each of the one or more second operations.

[0017] According to one or more embodiments, a method for controlling an electronic device includes: displaying content; obtaining contextual information about the content; based on the contextual information and information about a user's usage history, identifying, among a plurality of operations related to the content, at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation; performing at least one first operation; and displaying a user interface related to at least one second operation.

[0018] Additionally, the information about the context may include at least one of the following: type information indicating the type of content, first state information indicating the operating state of the electronic device, second state information indicating the operating state of an external device associated with the electronic device, and third state information indicating the external state of the electronic device and the external device.

[0019] Additionally, information about usage history may include at least one of the frequency and patterns of a user using at least one of electronic devices and external devices when that type of content is displayed on the monitor.

[0020] Meanwhile, multiple operations may include at least one of content-related operations of electronic devices and content-related operations of external devices.

[0021] Additionally, the identification may include: identifying the associated operations of content-related screen settings and sound settings among multiple operations as at least one first operation.

[0022] Meanwhile, the user interface may include multiple category items corresponding to multiple categories regarding at least one second operation, and identification may include: based on receiving a first user input that selects one of the multiple category items, identifying at least one first operation and at least one second operation among one or more operations corresponding to the selected category item, according to information about the context and information about the usage history.

[0023] Meanwhile, the user interface may include at least one control item corresponding to at least one second operation, and the method may further include: performing a second operation corresponding to the selected control item based on receiving a second user input that selects one of the at least one control item.

[0024] Additionally, the method may include updating information about usage history based on at least one of a first user input and a second user input.

[0025] Additionally, the user interface may include performing at least one first operation and then displaying the user interface, and the user interface may include at least one of a cancellation option and a change option, wherein the cancellation option is used to cancel the at least one first operation performed, and the change option is used to change the at least one first operation performed to another operation.

[0026] According to one or more embodiments, in a non-transitory computer-readable recording medium including a program for performing a method for controlling an electronic device, the method includes: displaying content; obtaining contextual information about the content; identifying, among a plurality of operations related to the content, at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation, based on the contextual information and information about a user's usage history; performing at least one first operation; and displaying a user interface related to at least one second operation. Attached Figure Description

[0027] The features and advantages of one or more embodiments of the present disclosure can be more clearly understood from the following description provided with reference to the accompanying drawings, in which:

[0028] Figure 1 This is a block diagram schematically illustrating the configuration of an electronic device according to one or more embodiments;

[0029] Figure 2 This is a block diagram illustrating multiple modules according to one or more embodiments;

[0030] Figures 3 to 6 These are diagrams used to illustrate various embodiments related to the user interface according to this disclosure;

[0031] Figure 7 It is a block diagram specifically illustrating the configuration of an electronic device according to one or more embodiments; and

[0032] Figure 8 This is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments. Detailed Implementation

[0033] The embodiments of this disclosure can be modified and varied in many different forms. Therefore, specific embodiments are illustrated in the accompanying drawings and described in detail. However, it should be understood that the embodiments set forth herein are not intended to limit the scope of the subject matter of this disclosure and are to be construed as including various modifications, equivalents, and / or alternatives thereof. In describing the drawings, the same reference numerals may be used to indicate the same elements.

[0034] In describing the subject matter of this disclosure, detailed descriptions of known functions or configurations that unnecessarily obscure the main points of this disclosure are omitted.

[0035] Furthermore, the embodiments described below can be modified in various different forms, and it should be understood that the scope of the technical spirit of this disclosure is not limited to the embodiments. Rather, the embodiments are provided to make this disclosure detailed and complete, and to fully convey the technical spirit of this disclosure to those skilled in the art.

[0036] The terminology used herein is for the purpose of describing specific examples only and is not intended to limit the scope of the rights sought. Unless otherwise expressly stated, the singular form includes the plural form.

[0037] In this disclosure, expressions such as “have,” “may have,” “include,” or “may include” are used to indicate the presence of a corresponding feature (e.g., a value, function, operation, or element such as a component) and do not imply the exclusion of the presence of additional features.

[0038] In this disclosure, expressions such as “A or B”, “at least one of A and / or B”, or “one or more of A and / or B” can include all possible combinations of the items listed together. For example, “A or B”, “at least one of A and B”, or “at least one of A or B” can refer to all cases including (1) at least one A, (2) at least one B, or (3) at least one A and at least one B.

[0039] In this disclosure, expressions such as “first,” “second,” “first,” or “second” may be used to refer to various elements regardless of their order and / or importance, and may be used only to distinguish one element from another, but are not intended to limit the elements.

[0040] When an element (e.g., a first element) is referred to as being “(operably or communicatively) coupled to or connected to” another element (e.g., a second element), it should be understood that the first element may be connected to the second element directly or through another element (e.g., a third element).

[0041] On the other hand, when an element (e.g., the first element) is referred to as being “directly coupled to / to or connected to / to” another element (e.g., the second element), it should be understood that there is no other element (e.g., the third element) between the one element and the other element.

[0042] The expression “configured (or set) as…” used in this document may be used interchangeably with, depending on the context, “suitable for…”, “capable of…”, “designed to…”, “adapted to…”, “made as…”, or “capable of…”. The term “configured (or set) as…” does not necessarily mean “specifically designed as…” in terms of hardware.

[0043] Conversely, in some cases, the phrase "a device configured to..." can mean that the device, together with another device or other element, is "capable of performing...". For example, the phrase "a processor configured to perform A, B, and C" can mean a dedicated processor (e.g., an embedded processor) for performing the corresponding operations, or a general-purpose processor (e.g., a CPU or application processor) capable of performing the corresponding operations by executing one or more software programs stored in a storage device.

[0044] In the embodiments, the terms "module" or "unit" may perform at least one function or operation and may be implemented by hardware, software, or a combination of hardware and software. Additionally, multiple "modules" or multiple "units" may be integrated into at least one module and may be implemented as at least one processor (excluding "modules" or "units" that require specific hardware implementation).

[0045] Meanwhile, various elements and areas in the accompanying drawings are shown schematically. Therefore, the technical spirit of this disclosure is not limited to the relative dimensions or distances shown in the drawings.

[0046] In the following description, embodiments of the present disclosure are illustrated with reference to the accompanying drawings, which enable those skilled in the art to readily implement the embodiments.

[0047] Figure 1 This is a block diagram schematically illustrating the configuration of an electronic device 100 according to one or more embodiments, and Figure 2 This is a block diagram illustrating multiple modules according to one or more embodiments.

[0048] like Figure 1 As shown, electronic device 100 may include display 110, memory 120 and one or more processors 130 (hereinafter referred to as "processors").

[0049] According to one or more embodiments, "electronic device 100" can refer to a device capable of providing a user interface for content. Specifically, electronic device 100 can display content on its display 110 and provide a user interface for the displayed content. For example, electronic device 100 can be implemented as a TV, smart monitor, smartphone, tablet PC, etc., but the type of electronic device 100 is not limited.

[0050] The display 110 can output images under the control of the processor 130. Specifically, the processor 130 can control the display 110 to display images based on image data stored in the memory 120. The display 110 can also display a user interface stored in the memory 120. The display 110 can be implemented as a liquid crystal display (LCD) panel, an organic light-emitting diode, etc., and in some cases, it can also be implemented as a flexible display, a transparent display, etc. However, the display 110 according to this disclosure is not limited to a particular form.

[0051] Specifically, according to one or more embodiments, processor 130 can control display 110 to display content. In this document, content may include content received from external devices and content generated by electronic device 100. The type of external device providing the content is not limited, nor is the type of content. For example, content may include broadcast content, game content, and over-the-top (OTT) content.

[0052] The processor 130 can control the display 110 to show the user interface. (Reference) Figures 3 to 6 Various embodiments related to the user interface are described in detail.

[0053] At least one instruction related to the electronic device 100 may be stored in the memory 120. Additionally, an operating system (O / S) for driving the electronic device 100 may be stored in the memory 120. Furthermore, various types of software programs or applications for operating the electronic device 100 according to various embodiments may be stored in the memory 120. Moreover, the memory 120 may include semiconductor memory (e.g., flash memory) or magnetic storage media (e.g., hard disk).

[0054] In detail, various types of software modules for operating the electronic device 100 according to the embodiment can be stored in the memory 120, and the processor 130 can execute the various types of software modules stored in the memory 120 to control the operation of the electronic device 100. In other words, the processor 130 can access the memory 120, and the processor 130 can perform read / record / correct / delete / update operations on data.

[0055] Meanwhile, the term memory 120 in this disclosure may be used as follows: memory has the meaning of including memory 120, ROM, RAM in processor 130, or memory card (e.g., micro SD card, memory stick) installed in electronic device 100.

[0056] According to one or more embodiments, information about a user's usage history can be stored in memory 120.

[0057] "Information about usage history" can be a term used to collectively refer to the usage history of a user associated with at least one of the electronic devices 100 and external devices, and can refer to the usage history of a specific user identified based on account information. The term "information about usage history" can be simply replaced with terms such as "usage history information," "user information," "user preference level," etc.

[0058] Information about usage history may include at least one of the frequency and patterns of a user's use of at least one of the electronic device 100 and the external device in a specific context. In this document, "specific context" may be defined in the description of "information about the context".

[0059] For example, in the specific context of "planning to watch a movie in the afternoon," information about usage history could include the information that "the user sets the screen brightness of electronic device 100 to 90 / 100 or higher." Additionally, in the specific context of "planning to watch a movie in the afternoon," information about usage history could include the information that "the user set the screen brightness of electronic device 100 to 90 / 100 or higher eight times out of ten (out of its entire usage history (pattern)).

[0060] Furthermore, various types of information / data (e.g., information about the content, information about the context, information about the user account, information about multiple identified operations (first operation and second operation), etc.) can be stored in memory 120. Additionally, various types of information required to achieve the purposes of this disclosure can be stored in memory 120, and the information stored in memory 120 can be received from external devices or updated by user input.

[0061] The processor 130 controls the overall operation of the electronic device 100. Specifically, the processor 130 can be connected to components of the electronic device 100, including the display 110 and the memory 120, and executes at least one instruction stored in the memory 120 to control the overall operation of the electronic device 100.

[0062] Processor 130 can be implemented in various different ways. For example, processor 130 can be implemented as at least one of application-specific integrated circuit (ASIC), embedded processor, microprocessor, hardware control logic, hardware finite state machine (FSM), and digital signal processor (DSP). Meanwhile, the term processor 130 in this disclosure can be used in a way that includes meanings such as central processing unit (CPU), graphics processing unit (GPU), and microprocessor unit (MPU).

[0063] Specifically, the processor 130 may use multiple modules to implement embodiments of the present disclosure. These multiple modules may be hardware or software modules, and two or more of these modules may be implemented as an integrated module. The multiple modules may be implemented as a neural network model (i.e., an artificial intelligence (AI) model) including a neural network and operate based on rules.

[0064] like Figure 2 As shown, the multiple modules may include a context information acquisition module 1010, a usage history information acquisition module 1020, an operation recognition module 1030, a control module 1040, a UI providing module, a user input receiving module 1060, and a usage history information updating module 1070. In the following description, for ease of description, it is assumed that all the multiple modules are included in the electronic device 100 and implemented on-device by the processor 130 included in the electronic device 100; however, depending on the embodiment, at least one of the multiple modules may be included in an external device.

[0065] In the following text, see references Figure 1 and Figure 2 Various embodiments are described.

[0066] Processor 130 can obtain contextual information about the content. (Reference) Figure 2 The processor 130 can use the context information acquisition module 1010 to obtain information about the context. The context information acquisition module 1010 can use various types of information / data stored in the memory 120 to obtain information about the context, and the various types of information / data stored in the memory 120 can be generated by the electronic device 100 or received from an external device.

[0067] "Contextual information" can be a general term for information such as events or situations that occur at a specific time and place, and can be replaced with "contextual information," "situational information," etc.

[0068] Information about the context may include at least one of the following: type information indicating the content type, first state information indicating the operating state of the electronic device 100, second state information indicating the operating state of an external device associated with the electronic device 100, and third state information indicating the external state of the electronic device 100 and the external device.

[0069] "Type information" can be a general term for information that indicates the type of content, and the type of content can be identified, for example, based on the content's genre (e.g., movies, games, sports, music, news, app screens, etc.) and the source of the content's provision (e.g., broadcast content, OTT content, social media content, etc.).

[0070] Processor 130 can identify the type of content based on Automatic Content Recognition (ACR) to obtain type information indicating the type of content. Herein, ACR may include: extracting features of an audio or video signal corresponding to the content, comparing the extracted features with a database of content features stored in memory 120, and identifying matching content.

[0071] The processor 130 can obtain type information indicating the type of content based on electronic program guides (EPGs), additional information (or metadata) about the content, etc. The EPGs and additional information about the content can be received from an external device acting as a content provider and stored in memory 120.

[0072] Processor 130 can input information about the content into a neural network model trained to distinguish the type of the input content to obtain type information indicating the type of the content. In this paper, the neural network model may include a convolutional neural network (CNN) trained to recognize multiple domains corresponding to the type of content, but the type of neural network included in the neural network model is not limited.

[0073] "First status information" can be a general term for information indicating the operating status of electronic device 100, and includes, for example, information about the screen settings of electronic device 100, information about the sound settings of electronic device 100, information about the power mode, information about the network connection status, etc. First status information can be information about the operating status of electronic device 100 related to the content displayed on display 110.

[0074] "Second state information" is collectively referred to as the operating state of external devices. In this document, "external device" can be an IoT device registered as part of an Internet of Things (IoT) network with electronic device 100. For example, an external device can be a user's smartphone, smart lighting device, smart speaker, etc., but is not limited to the examples above. Second state information can be information indicating the operating state of an external device related to the content displayed on the display 110 of electronic device 100.

[0075] "Third state information" refers to the external state of electronic device 100 and external devices, not their internal state. In other words, third state information can be a term used to refer to information that affects the control of content, but does not include the operation of electronic device 100 or the operation of external devices. For example, third state information may include information about the current time, information about the current weather, information about the location of electronic device 100, etc.

[0076] Processor 130 can obtain information about the user's usage history. (Reference) Figure 2 The processor 130 can use the usage history information acquisition module 1020 to obtain information about the user's usage history. The usage history information acquisition module 1020 can use various types of information / data stored in the memory 120 to obtain information about the user's usage history. The information about usage history was described above when describing the memory 120.

[0077] Meanwhile, the process by which the processor obtains information about the context and / or about the usage history can be performed based on the occurrence of a predetermined event in the electronic device 100 or an external device, or based on user input requesting a recommended user interface, or within each predetermined cycle.

[0078] Processor 130 can identify, among multiple content-related operations, at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation, based on information about the context and information about usage history. (Reference) Figure 2 The operation identification module 1030 can identify multiple operations related to the content, including a first operation and a second operation, based on information about the context received from the context information acquisition module 1010 and information about the usage history received from the usage history information acquisition module 1020.

[0079] In detail, the processor 130 can identify multiple content-related operations based on information about the context and information about the usage history, and identify (or distinguish) the first operation and the second operation among the multiple identified operations based on information about the context and information about the usage history.

[0080] "Multiple operations" is a collective term for content-related operations of the electronic device 100 and the external device. Specifically, multiple operations may include at least one content-related operation of the electronic device 100 and a content-related operation of the external device, and may refer to an operation that a user is highly likely to want to perform in the current context. Furthermore, the term "operation" according to this disclosure may be replaced by terms such as "function," "service," etc.

[0081] The processor 130 can identify multiple operations corresponding to the context information and the usage history information during the operation of the electronic device 100 and the operation of the external device. The processor 130 can input the context information and the usage history information into a neural network model trained to identify the multiple operations corresponding to the context information and the usage history information, thereby identifying the multiple operations.

[0082] For example, based on contextual information indicating that the content type is a movie and the current time is 10 p.m., and information about usage history indicating that the user sets the screen brightness of the electronic device 100 to 90 / 100 at a frequency of 90% while watching the movie, and indicating that the smart lighting device as an external device is turned off, the processor 130 can recognize the following operations included in multiple operations: controlling the playback of content, setting the subtitles of content, setting the screen brightness of the electronic device 100 to 90 / 100, and turning off the smart lighting device as an external device.

[0083] The processor can identify multiple operations that are content-related operations of the electronic device 100 and external devices, and provide a user interface for the identified multiple operations. However, in one or more embodiments, the processor can distinguish at least one first operation and at least one second operation from the multiple operations, and perform different controls depending on the first operation and the second operation.

[0084] "First action" can be a general term for the action among multiple content-related actions that does not require user confirmation. When multiple actions are those that the user is highly likely to want to perform in the current context, the first action can be the action the user is most likely to want to be performed automatically in the current context. The first action can be predefined by the developer or determined based on user settings. Furthermore, the first action can be changed based on updates to information about usage history, as described below.

[0085] For example, the user settings for the first operation can be automation settings. When a user registers a specific operation as the target of automation, that operation can be executed without user confirmation, and since the operation conforms to the user's intent, it can correspond to the first operation according to this disclosure. In this document, "automation" can mean: registering specific conditions and an operation of an IoT device (e.g., electronic device 100, external device) corresponding to those specific conditions, and performing automatic control to cause the IoT device to perform the registered operation based on the satisfaction of the registered conditions. Furthermore, an operation performed based on automation can be referred to as an "automated operation" or an "automated routine."

[0086] "Secondary action" refers to any action among multiple content-related actions that requires user confirmation. When multiple actions are those that the user is highly likely to want to perform in the current context, the secondary action can be the action that the user is highly likely to want to directly control in the current context. The secondary action can be predefined by the developer or determined based on user settings. Furthermore, the secondary action can be modified based on updates to information about usage history, as described below. The secondary action refers to any action other than the primary action among multiple actions, and its definition / setting / modification depends on how the primary action is defined / set / modified.

[0087] As described above, at least one first operation and at least one second operation can not only be predefined or set, but can also be identified by the processor 130.

[0088] According to one or more embodiments, at least one first operation and at least one second operation can also be identified based on the types of multiple operations. Specifically, among the multiple operations, the processor 130 can identify an operation corresponding to a predetermined type as a first operation and an operation not corresponding to a predetermined type as a second operation. In this document, the predetermined type can be changed by the developer or based on user settings.

[0089] For example, among multiple operations, processor 130 can identify operations related to content picture and sound settings as at least one first operation, and operations unrelated to content picture and sound settings as second operations. As another example, among multiple operations, processor 130 can identify simple on / off operations (e.g., turning a TV on / off) as first operations, and operations requiring selection of options (e.g., various washing modes of a washing machine) as second operations.

[0090] In the above example, when the operation of controlling content playback, setting content subtitles, setting the screen brightness of electronic device 100 to 90 / 100, and turning off the smart lighting device as an external device are identified as multiple operations, processor 130 can identify the operation of setting the screen brightness of electronic device 100 to 90 / 100 and the operation of turning off the smart lighting device as an external device (these two operations are related to the screen and sound settings of the content) as the first operation. Furthermore, processor 130 can identify the operation of controlling content playback and the operation of setting content subtitles (these two operations are unrelated to the screen and sound settings of the content) as the second operation.

[0091] In another example, at least one first operation may include brightness optimization, picture mode switching, sound optimization, etc., while at least one second operation may include changing channels, controlling surrounding IoT devices, changing content providers, and applying power-saving modes, etc.

[0092] Based on the identification of at least one first operation and at least one second operation, the processor 130 can execute at least one first operation. Additionally, the processor 130 can control the display 110 to display a user interface for at least one second operation.

[0093] refer to Figure 2 Based on information received from the operation identification module 1030 regarding at least one identified first operation, the control module 1040 can control the components of the electronic device 100 to perform at least one first operation. (See reference...) Figure 2 Based on information received from the operation identification module 1030 regarding at least one identified second operation, the UI providing module can provide a user interface for at least one second operation.

[0094] According to one or more embodiments, the user interface may include at least one control item corresponding to each of at least one second operation. Additionally, based on received user input for selecting one of the at least one control item, the processor 130 may execute a second operation corresponding to the selected control item. (See reference...) Figure 2 The user input receiving module 1060 can receive user input after the UI providing module provides the user interface, and send information about the user input to the control module 1040. Based on the received information about the user input, the control module 1040 can control the components of the electronic device 100 to perform operations corresponding to the user input.

[0095] In other words, the processor 130 can automatically execute at least one first operation that does not require user confirmation among multiple operations, while for a second operation that requires user confirmation, it provides a user interface to receive user input based on user confirmation and executes the operation corresponding to the received user input.

[0096] According to one or more embodiments, when receiving user input based on a user interface, the processor 130 can update the usage history information stored in the memory 120 based on the received user input. (See reference...) Figure 2 The user input receiving module 1060 can receive user input and send information about the user input to the usage history information update module 1070.

[0097] Based on the usage history information updated by the usage history information update module 1070, the processor 130 can identify multiple content-related operations, a first operation, and a second operation based on the updated usage history information and information about the context. For example, based on usage history information obtained after a "brightness optimization" operation is identified as a first operation and automatically executed, indicating that the user frequently manually adjusts the brightness, the "brightness optimization" operation can be identified as a second operation.

[0098] refer to Figures 3 to 6 Various embodiments related to the user interface and various embodiments related to updating information about usage history based on user input are described in more detail.

[0099] According to one or more embodiments, at least one first operation or at least one second operation may include: changing the current content to another content, changing the current channel to another channel, changing the external input device providing the current content to another device, etc. As described above, the electronic device 100 can serve to recommend content to the user and automatically display that content, or recommend content that allows the user to perform control.

[0100] According to various embodiments, electronic device 100 can provide a user interface suitable for a user to enjoy content. Specifically, electronic device 100 can combine information about the context of the current content and information about the user's usage history to identify a first operation that the user is likely to want to perform automatically and a second operation that the user is likely to want to control directly, and provide the user with automatic control and a user interface.

[0101] Therefore, the user can be provided with the best user experience for the operation required by the user in the current situation, without having to enter multiple operations to search for the operation that the electronic device 100 needs to perform in order to obtain the desired result, or without having to enter multiple operations to perform the operation.

[0102] Figures 3 to 6 These are diagrams used to illustrate various embodiments related to the user interface according to this disclosure.

[0103] As described above, processor 130 can identify at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among multiple content-related operations, based on information about the context and information about the usage history. Based on the identification of at least one first operation and at least one second operation, processor 130 can execute at least one first operation and control display 110 to display a user interface associated with at least one second operation. Specifically, processor 130 can obtain information for displaying the user interface associated with at least one second operation, and based on the obtained information, control display 110 to display the user interface associated with at least one second operation.

[0104] The user interface can be provided based on the user's operating method. For example, when the user is using a remote control device, the user interface can be configured to ensure that the user can easily input using the remote control device, and when the user is using voice control, the user interface can include information to guide the speech and indicate the status of voice recognition in progress.

[0105] The user interface may include various types of information about the operation of the electronic device 100 and items for controlling the operation of the electronic device 100. In the following text, the term "item" may be used to refer to at least one of the elements included in the user interface and may be replaced by terms such as "UI item," "visual element," "object," etc. The number of items included in the user interface (specifically, the number and type of items corresponding to at least one second operation) may be predefined and may vary depending on information about the context.

[0106] The user interface may include multiple category items, each corresponding to a plurality of categories relating to at least one second operation. "Multiple categories" may refer to predetermined criteria used to classify the at least one second operation, and the term "category" may be replaced by terms such as "class," "group," etc.

[0107] For example, multiple categories may include, but are not limited to, changes to content (e.g., changes to channels, changes to external inputs, etc.), control of content settings (e.g., control of screen settings, control of sound settings, etc.), control of external devices (e.g., control of IoT devices), and selection of external inputs (e.g., changes to content sources). Multiple category items may correspond to the multiple categories in the examples above.

[0108] The processor 130 can identify multiple categories that correspond to at least one second operation, and include multiple category items that correspond to the identified multiple categories in the user interface.

[0109] like Figures 3 to 5As shown, multiple category items can include category items corresponding to categories such as "content changes" (e.g., Figure 3 310), and category items corresponding to categories such as "Control of content settings" (e.g., Figure 4 410), and category items corresponding to categories such as "control of external devices" (e.g., Figure 5 (of 510). Additionally, such as Figure 6 As shown, multiple category items can also include category items corresponding to categories such as "selection of external input" (e.g., Figure 6 (610).

[0110] Based on the first user input received, selecting one of multiple category items, and according to information about the context and usage history, the processor 130 identifies at least one first operation and at least one second operation among one or more operations corresponding to the selected category item. Furthermore, based on the identification of at least one first operation and at least one second operation, the processor 130 can execute at least one first operation and control the display 110 to display a user interface for at least one second operation.

[0111] "First user input" is used as a term to refer to user input that selects one of multiple category items. For example, first user input can be received based on user touch input via touch display 110, control signals received from a remote control device, user voice input, etc. Alternatively, first user input can refer to the user moving the focus (or cursor) displayed on display 110 to one of multiple category items using a remote control device. In addition to first user input, various user inputs according to this disclosure can also be input / received based on the various methods shown in the examples above.

[0112] exist Figures 3 to 6 In the diagram, a dashed circle indicates the category selected from multiple categories based on the first user input. The method used to indicate the selected category can vary.

[0113] refer to Figure 3 The first user input may be the user input for selecting the category item 310 of "Content Change" among multiple category items. In this case, based on information about the context and information about the usage history, the processor 130 may identify "Move to Channel 52", "Move to Golf Channel", and "Move to the latest video of Application A" as at least one second operation, which are operations corresponding to the category item 310 of "Content Change".

[0114] refer to Figure 4The first user input may be user input selecting category item 410 of "Content Settings Control" among multiple category items. In this case, based on information about the context and information about the usage history, the processor 130 can identify "Application AI Mode" as an operation corresponding to category item 410 of "Content Settings Control" as at least one second operation.

[0115] refer to Figure 5 The first user input may be the user input for selecting category item 510 of "control of external devices" among multiple category items. In this case, based on information about the context and information about the usage history, the processor 130 may identify "applying air conditioning energy-saving mode", "displaying camera image" and "dimming the lights" as at least one second operation, which are operations corresponding to category item 510 of "control of external devices".

[0116] The processor 130 can display a user interface for at least one second operation. Specifically, the user interface may include at least one control item corresponding to each of the at least one second operation. Furthermore, based on receiving second user input selecting one of the at least one control item, the processor 130 can execute the second operation corresponding to the selected control item.

[0117] "Second user input" is used as a term to refer to user input that selects at least one of the control items. Second user input can be received based on user touch input via touch display 110, control signals received from remote control devices, user voice input, etc.

[0118] exist Figure 3 In the example, the user interface may include controls 320 corresponding to "Move to Channel 52", "Move to the Golf Channel", and "Move to the latest video in app A", respectively. Figure 4 In the example, the user interface may include a control 420 corresponding to "Apply AI Mode". Additionally, in Figure 5 In the example, the user interface may include control items 520 corresponding to "apply air conditioning energy-saving mode", "display camera image", and "dimming lights", respectively. Furthermore, based on selecting one of the control items 320, 420, and 520 in the above example, the processor 130 may execute a second operation corresponding to the selected control item.

[0119] As described above, the user interface may include items related to at least one second operation (e.g., multiple category items and at least one control item). Additionally, the user interface may also include items related to at least one first operation. In other words, even after at least one first operation has been automatically executed, the processor 130 may include items related to the executed first operation in the user interface to allow the user to manually control at least one first operation when needed.

[0120] In detail, the processor 130 may control the display 110 to display a user interface after performing at least one first operation, and in this case, the user interface may include at least one of a cancellation item for canceling the at least one first operation performed and a change item for changing the at least one first operation performed to another operation.

[0121] Figure 6 The “Return” item 620 indicates an example of a cancellation item used to cancel (or restore, return, rollback) at least one first operation performed, and Figure 6 The “Reset” item 630 indicates an example of a change item used to change at least one first operation performed to another operation.

[0122] Based on user input that selects a cancellation option, processor 130 can cancel at least one first operation to return to the state prior to the execution of the at least one first operation. Based on user input that selects a change option, processor 130 can display an item for changing the at least one first operation or display a new user interface.

[0123] and Figure 6 Unlike the example, the changes can also include items corresponding to operations different from the first operation. For example, the changes can also include thumbnails indicating the results of applying each of the various screen modes.

[0124] According to one or more embodiments, processor 130 can identify the priority of each of a plurality of operations based on information about the context and information about the usage history. For example, processor 130 can identify the priority of each of a plurality of operations corresponding to the current context in descending order of frequency of user usage history.

[0125] The processor 130 can identify one or more second operations among at least one second operation to be displayed on the user interface, based on the identified priority. (Return to Reference) Figure 3For example, if the number of second operations that can be displayed on the user interface is 3, the processor 130 can identify three second operations from the identified at least one second operation in order of priority from high to low, such as "move to channel 52", "move to the golf channel", and "move to the latest video of application A".

[0126] The user interface may include information about the priority of each of one or more second operations to be displayed on the user interface. For example, in Figure 3 In the example, the controls 320 corresponding to "Move to Channel 52", "Move to Golf Channel", and "Move to Latest Video in App A" can be displayed as a user interface from the left, and the order can be the order in which they are displayed from the left to the right based on their priority from high to low.

[0127] Conversely, the user interface can also directly indicate the priority of each operation in the second operation, for example, by displaying numbers around each control item. Additionally, the processor 130 can place the default focus on the control item corresponding to the highest priority second operation.

[0128] According to the above embodiments, the processor 130 can first provide functions that are most suitable for the user's current context and the user's usage history based on priority.

[0129] The user interface may also include a message to notify the user that at least one first action has been performed automatically. For example, the user interface may include a message to notify the user that at least one first action has been performed automatically, such as "The screen mode has been automatically changed to game mode".

[0130] The foregoing described the various types of items displayed on the user interface and the various user inputs used to select items. However, the processor 130 can update information about usage history based on the various user inputs entered through the user interface.

[0131] In detail, the processor 130 can update the information about the usage history based on at least one of a first user input (as user input for selecting one of a plurality of category items) and a second user input (as user input for selecting one of at least one control item). Additionally, the processor 130 can also update the information about the usage history based on at least one of user input for selecting a cancel item (which cancels an automatically executed first operation) and user input for selecting a change item (which changes the automatically executed first operation to another operation).

[0132] Then, the processor 130 can be updated based on information about the usage history, and based on the updated information about the usage history and information about the context, identify multiple operations related to the content, including a first operation and a second operation.

[0133] For example, when contextual information indicates "game content is currently being displayed," processor 130 can recognize the operation of "changing the screen mode of electronic device 100 to game mode" as one of several content-related operations. Before fully updating information about usage history, depending on default settings, the operation of "changing the screen mode of electronic device 100 to game mode" can also be recognized as a first operation. Then, based on usage history information updated according to user input (which indicates that the user changes the screen mode to various modes according to the game type), the operation of "changing the screen mode of electronic device 100 to game mode" can be recognized as a second operation based on the updated usage history information.

[0134] In the example above, before fully updating the information about usage history, depending on the default settings, the operation of "changing the screen mode of electronic device 100 to game mode" may be identified as a second operation instead of a first operation. Then, based on the usage history information updated according to user input (which indicates that the user frequently changes the screen mode of electronic device 100 to game mode while playing games), the operation of "changing the screen mode of electronic device 100 to game mode" can be identified as a first operation and automatically executed based on the updated usage history information. This means that a routine for each user is generated and provided based on the updated usage history information. Simultaneously, as mentioned above, the user can register a specific operation as an automation object to set that specific operation as the first operation of this disclosure.

[0135] Figure 7 This is a block diagram illustrating the configuration of an electronic device 100 according to one or more embodiments.

[0136] In addition to a display 110, a memory 120, and a processor 130, the electronic device 100 may also include a communication unit 130, an interface unit 150, an input unit 160, and an output unit 170. However, Figure 1 and Figure 7 The components shown are described as examples, and in implementing the contents of this disclosure, except... Figure 1 and Figure 7 Of course, new components can be added in addition to the existing components, or they can be omitted. Figure 1 and Figure 7 It is a component.

[0137] The communication unit 140 may include circuitry and perform communication with external devices. Specifically, the processor 130 may receive various types of data or information from external devices connected to it via the communication unit 140, and may also send various types of data or information to external devices.

[0138] The communication unit 140 may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, an NFC module, and an ultra-wideband (UWB) module. Specifically, each of the WiFi module and Bluetooth module can perform communication based on WiFi and Bluetooth methods, respectively. When using a WiFi module or Bluetooth, various types of connection information (e.g., SSID, etc.) can be sent and received first, and used to establish a communication connection, and then various types of information can be sent and received.

[0139] Furthermore, the wireless communication module can perform communication according to various communication standards (e.g., IEEE, Zigbee, 3G, 3GPP, LTE, 5G, etc.). Additionally, the NFC module can perform communication based on Near Field Communication (NFC) methods, using the 13.56MHz band among various RF-ID frequency bands (e.g., 135kHz, 13.56MHz, 433MHz, 860-960MHz, 2.45GHz, etc.). Moreover, the UWB module can accurately measure the time of arrival (ToA) (the time it takes for a pulse to reach an object) and angle of arrival (AoA) (the angle of arrival of the pulse in the transmitting device) based on communication between UWB antennas, thus accurately identifying distances and locations in indoor spaces within an error range of tens of centimeters.

[0140] Specifically, according to one or more embodiments, the processor 130 can receive information about usage history, context, etc., from an external device via the communication unit 140. Furthermore, if at least one first operation or second operation is an operation of an external device, the processor 130 can control the communication unit 140 to send information about at least one first operation or at least one second operation to the external device. Therefore, the external device can perform a first operation based on the information about at least one first operation, and display a user interface on the external device's display 110 based on the information about at least one second operation.

[0141] Interface unit 150 can receive and send video data and / or audio data when interacting with external devices. Specifically, interface unit 150 may include an input port capable of receiving video data and / or audio data from external devices, and an output port capable of sending video data and / or audio data to external devices. Specifically, if interface unit 150 can receive and send both video data and audio data, separate input / output ports for receiving and sending video data and audio data can be implemented. Interface unit 150 can connect electronic device 100 and external devices via a wired cable, but can also connect electronic device 100 and external devices wirelessly.

[0142] For example, interface unit 150 may include a High Definition Multimedia Interface (HDMI) module, a Universal Serial Bus (USB) module, etc. An HDMI module, as one of the uncompressed digital video / audio interface standards, can provide an interface between electronic device 100 and external devices providing content. A USB module can use predefined input / output standard protocols to provide a communication system between electronic device 100 and external devices providing content. Besides HDMI and USB modules, interface unit 150 can also be implemented as various types of modules for providing input / output of video / audio data between electronic device 100 and external devices, such as DisplayPort (DP) modules, RGB modules, Digital Video Interface (DVI) modules, and Thunderbolt modules.

[0143] Specifically, according to various embodiments of this disclosure, the processor 130 can receive data about content from an external device via the interface unit 150. Additionally, the processor 130 can send data for modifying content to an external device via the interface unit 150.

[0144] The input unit 160 may include circuitry, and the processor 130 may receive user commands for controlling the operation of the electronic device 100 via the input unit 160. Specifically, the input unit 160 may include components such as a microphone, camera, remote control signal receiver, etc. Alternatively, the input unit 160 may be implemented by including the input unit 160 as a touchscreen in the display 110. Specifically, the microphone may receive voice signals and convert the received voice signals into electrical signals.

[0145] The output unit 170 may include circuitry, and the processor 130 may output various functions executable by the electronic device 100 through the output unit 170. Additionally, the output unit 170 may include at least one of a display 110, a speaker, and an indicator. (See reference) Figure 1 Display 110 has been described, therefore repeated descriptions of its same details are omitted.

[0146] The speaker can output audio data under the control of the processor 130.

[0147] The indicator can be illuminated under the control of the processor 130. Specifically, the indicator can illuminate in various colors under the control of the processor 130. For example, the indicator can be implemented as a light-emitting diode (LED), a liquid crystal display (LCD) panel, a vacuum fluorescent display (VFD), etc., but is not limited to these.

[0148] Specifically, according to one or more embodiments, the processor 130 may control the display 110 to display a user interface, and the user interface may include multiple category items corresponding to multiple categories with respect to at least one second operation.

[0149] Based on the first user input received through the input unit 160 to select one of a plurality of category items, the processor 130 can identify at least one first operation and at least one second operation among one or more operations corresponding to the selected category item based on information about the context and information about the usage history, and control the display 110 to display a user interface associated with at least one second operation.

[0150] The user interface may include at least one control item corresponding to at least one second operation, and based on receiving a second user input that selects one of the at least one control item, the processor 130 may execute the second operation corresponding to the selected control item. (Refer to the above) Figures 3 to 6 Other different types of user interfaces are described.

[0151] Simultaneously, the processor 130 can control the speaker to output speech corresponding to the aforementioned user interface, and receive user speech via a microphone to receive the aforementioned user input. To this end, the processor 130 can input text information corresponding to the user interface into a speech synthesis model (e.g., a text-to-speech (TTS) model) to obtain speech corresponding to the user interface. Additionally, the processor 130 can input user speech received via the microphone into a speech recognition model (e.g., an automatic speech recognition (ASR) model) to obtain text information corresponding to the user input. The user interface may include items to guide the user's speech pronunciation.

[0152] Figure 8 This is a flowchart illustrating a method for controlling an electronic device 100 according to one or more embodiments.

[0153] like Figure 8As shown, the electronic device 100 can display content (S810). The content may include content received from external devices and content generated by the electronic device 100. The type of external device providing the content is not limited, and the type of content is also not limited.

[0154] Electronic device 100 can identify at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation among multiple content-related operations based on information about the context and information about the user's usage history (S820).

[0155] In detail, the electronic device 100 can identify multiple operations related to the content based on information about the context and information about the usage history, and identify (or distinguish) the first operation and the second operation among the identified multiple operations based on information about the context and information about the usage history.

[0156] Alternatively, at least one first operation and at least one second operation can be identified based on the types of multiple operations. Specifically, the electronic device 100 can identify the operation that corresponds to a preset type among the multiple operations as the first operation, and identify the operation that does not correspond to the preset type as the second operation.

[0157] The electronic device 100 can perform at least one first operation (S830). The electronic device 100 can display a user interface related to at least one second operation (S840).

[0158] According to one or more embodiments, the user interface may include at least one control item corresponding to at least one second operation. Additionally, based on receiving user input selecting one of the at least one control item, the electronic device 100 may perform a second operation corresponding to the selected control item.

[0159] According to one or more embodiments, when user input is received based on a user interface, the electronic device 100 can update the usage history information stored in the memory 120 based on the received user input.

[0160] Meanwhile, the method for controlling the electronic device 100 according to the above embodiments can be implemented as a program and provided to the electronic device 100. Specifically, the program, including the method for controlling the electronic device 100, can be stored in and provided on a non-transitory computer-readable medium.

[0161] In detail, in a non-transitory computer-readable recording medium including a program for performing a method for controlling electronic device 100, the method may include: displaying content; obtaining contextual information about the content; identifying, among a plurality of operations related to the content, at least one first operation that does not require user confirmation and at least one second operation that requires user confirmation, based on the contextual information and information about the user's usage history; performing at least one first operation; and displaying a user interface related to at least one second operation.

[0162] In the foregoing, a method for controlling an electronic device 100 and a computer-readable recording medium including a program for executing the method for controlling the electronic device 100 have been described schematically. However, the illustrative description is only for the purpose of avoiding repetition, and various embodiments relating to the electronic device 100 can of course be applied to the method for controlling the electronic device 100 and the computer-readable recording medium including a program for executing the method for controlling the electronic device 100.

[0163] The AI-related functions disclosed herein can be executed by the processor 130 and memory 120 of the electronic device 100.

[0164] Processor 130 may include one or more processors 130. In this case, one or more processors 130 may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), and a neural processing unit (NPU), but are not limited to the above-described examples of processor 130.

[0165] As a general-purpose processor 130 capable of performing both AI and general-purpose calculations, the CPU can efficiently execute complex programs through a multi-level cache structure. The CPU is advantageous in serial processing methods, which enable organic connections between previous and subsequent calculation results based on continuous computation. Unless explicitly specified as the CPU described above, the general-purpose processor 130 is not limited to the examples described.

[0166] As a processor 130 for processing large-scale computations (e.g., floating-point operations), a GPU can perform large-scale computations in parallel by integrating a large number of cores. Specifically, in parallel processing methods (e.g., convolution operations), a GPU can be more advantageous than a CPU. Additionally, a GPU can be used as a coprocessor 130 to supplement the functions of a CPU. Unless explicitly specified as a GPU as described above, the processor 130 for large-scale computations is not limited to the examples given.

[0167] As a processor 130 specifically designed for AI computations using artificial neural networks, the NPU can be implemented in hardware (e.g., silicon) to form each layer of the artificial neural network. In this case, because the NPU is specifically designed according to the specifications required by the business, the NPU has fewer degrees of freedom than a CPU or GPU, but it can efficiently handle the AI ​​computations required by the business. Furthermore, as a processor 130 specifically designed for AI computations, the NPU can be implemented in various forms (e.g., a Tensor Processing Unit (TPU), an Intelligent Processing Unit (IPU), a Visual Processing Unit (VPU), etc.). Unless explicitly specified as an NPU as described above, the AI ​​processor 130 is not limited to the examples described.

[0168] Additionally, one or more processors 130 may be implemented as a system-on-a-chip (SoC). In this case, in addition to one or more processors 130, the SoC may also include memory 120 and a network interface (e.g., bus, etc.) for data communication between the processors 130 and memory 120.

[0169] In cases where the system-on-a-chip (SoC) included in the electronic device 100 comprises multiple processors 130, the electronic device 100 can perform AI-related operations (e.g., operations related to learning or inference of AI models) by using a subset of the multiple processors 130. For example, the electronic device 100 can certainly perform AI-related operations by using at least one of the multiple processors 130, including GPUs, NPUs, VPUs, TPUs, and hardware accelerators specifically designed for AI operations (e.g., convolution operations, matrix multiplication operations, etc.).

[0170] Furthermore, the electronic device 100 can perform AI-related operations by using the multiple cores (e.g., dual-core, quad-core, etc.) included in the processor 130. Specifically, the electronic device 100 can perform AI operations (e.g., convolution operations, matrix multiplication operations, etc.) in parallel by using the multiple cores included in the processor 130.

[0171] One or more processors 103 can perform control to process input data based on predefined operating rules or AI models stored in memory 120. The predefined operating rules or AI models are characterized in that they are built based on learning.

[0172] In this paper, building predefined operating rules or AI models based on learning refers to constructing predefined operating rules or AI models with desired characteristics by applying learning algorithms to a large amount of learning data. This learning can be performed on the device itself that executes publicly available AI, or it can be performed via a separate server / system.

[0173] AI models may include multiple neural network layers. At least one layer has at least one weight value and performs operations on each layer using the results of the operations of the previous layer and at least one predefined operation. Examples of neural networks may include convolutional neural networks (CNNs), deep neural networks (DNNs), recurrent neural networks (RNNs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), deep Q-networks, and transformers, but unless otherwise explicitly stated, the neural networks in this disclosure are not limited to the examples described above.

[0174] A learning algorithm is a method of training a predetermined target device (e.g., a robot) using a large amount of learning data so that the predetermined target device can make decisions or predictions on its own. Examples of learning algorithms may include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but unless otherwise expressly stated, the learning algorithms in this disclosure are not limited to the examples above.

[0175] Meanwhile, machine-readable storage media may be provided in the form of non-transitory storage media. In this document, "non-transitory storage media" refers only to tangible devices and means that signals (e.g., electromagnetic waves) are excluded, and the term does not distinguish between storing data semi-permanently or temporarily in the storage medium. For example, "non-transitory storage media" may include buffers for temporarily storing data.

[0176] The methods described in the embodiments herein can be provided in the form of a computer program product. The computer program product can be traded as a commodity between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or distributed online (e.g., downloaded or uploaded) through an app store (e.g., the Play Store™), or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) can be at least temporarily stored in or temporarily generated in a machine-readable storage medium (such as the memory 120 of a manufacturer's server, an app store's server, or a relay server).

[0177] Furthermore, each of the elements (e.g., modules or programs) according to the above embodiments may include a single entity or multiple entities, and some of the corresponding sub-elements may be omitted, or another sub-element may also be included in the embodiments. Alternatively or additionally, some elements (e.g., modules or programs) may be integrated into one entity to perform the functions performed by each corresponding element prior to integration in the same or similar manner.

[0178] According to embodiments, operations performed by a module, program, or other element may be performed sequentially, in parallel, repeatedly, or heuristically, or at least some of the operations may be performed in a different order, omitted, or another operation may be added to these operations.

[0179] Furthermore, the terms "unit" or "module" as used herein can include units comprised of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A "unit" or "module" can be a component configured as a whole, or the smallest unit or part thereof that performs one or more functions. For example, a module can include an application-specific integrated circuit (ASIC).

[0180] The embodiments described herein can be implemented using software, which includes instructions stored in a storage medium readable by a machine (e.g., a computer). The machine (as a device capable of invoking the stored instructions from the storage medium and operating according to the invoked instructions) may include an electronic device (e.g., electronic device 100) according to the embodiments described herein.

[0181] Based on instructions executed by the processor, the processor can directly perform the function corresponding to the instruction, or perform the function corresponding to the instruction through other components under the control of the processor. Instructions can include code generated or executed by a compiler or interpreter.

[0182] Although exemplary embodiments of the present disclosure have been shown and described above, the embodiments of the present disclosure are not limited to the specific embodiments set forth herein, and those skilled in the art can certainly make various modifications to the exemplary embodiments of the present disclosure without departing from the content of the present disclosure as claimed in the claims, and such modifications should not be construed as departing from the technical spirit or concept of the present disclosure.

Claims

1. An electronic device, comprising: monitor; The memory stores information about the user's usage history. as well as One or more processors, Wherein, the one or more processors: Control the display to show content. To obtain contextual information about the content. Based on information about the context and information about the usage history, among multiple operations related to the content, at least one first operation that does not require the user's confirmation and at least one second operation that requires the user's confirmation are identified. Perform the at least one first operation, and Control the display to show a user interface related to the at least one second operation.

2. The electronic device according to claim 1, in, The context information includes at least one of the following: type information indicating the type of the content, first state information indicating the operating state of the electronic device, second state information indicating the operating state of an external device associated with the electronic device, and third state information indicating the external state of the electronic device and the external device.

3. The electronic device according to claim 2, in, The information regarding usage history includes at least one of the frequency and patterns in which the user uses at least one of the electronic device and the external device when the type of content is displayed on the display.

4. The electronic device according to claim 1, in, The plurality of operations includes at least one of the content-related operations of the electronic device and the content-related operations of the external device.

5. The electronic device according to claim 1, in, The one or more processors identify the associated operations of the screen settings and sound settings related to the content among the plurality of operations as the at least one first operation.

6. The electronic device according to claim 1, in, The user interface includes multiple category items, each corresponding to a plurality of categories relating to the at least one second operation, and Wherein, the one or more processors, based on receiving a first user input that selects one of the plurality of category items, identify at least one first operation and at least one second operation among one or more operations corresponding to the selected category item, according to the information about the context and the information about the usage history.

7. The electronic device according to claim 6, in, The user interface includes at least one control item corresponding to each of the at least one second operation, and The one or more processors perform a second operation corresponding to the selected control item based on receiving a second user input that selects one of the at least one control item.

8. The electronic device according to claim 7, in, The one or more processors update the information about usage history based on at least one of the first user input and the second user input.

9. The electronic device according to claim 1, in, The one or more processors execute the at least one first operation, and then control the display to show the user interface. The user interface includes at least one of a cancellation option and a change option, wherein the cancellation option is used to cancel the at least one first operation being performed, and the change option is used to change the at least one first operation being performed to another operation.

10. The electronic device according to claim 1, in, The one or more processors: Based on the information about the context and the information about the usage history, the priority of each of the plurality of operations is identified, and Based on the priority, one or more second operations to be displayed on the user interface are identified among the at least one second operation, and The user interface includes information about the priority of each of the one or more second operations.

11. A method for controlling an electronic device, the method comprising: Display content, To obtain contextual information about the content. Based on information about the context and information about the user's usage history, among multiple operations related to the content, at least one first operation that does not require the user's confirmation and at least one second operation that requires the user's confirmation are identified. Perform the at least one first operation, and Display a user interface related to the at least one second operation.

12. The method according to claim 11, in, The context information includes at least one of the following: type information indicating the type of the content, first state information indicating the operating state of the electronic device, second state information indicating the operating state of an external device associated with the electronic device, and third state information indicating the external state of the electronic device and the external device.

13. The method according to claim 12, in, The information regarding usage history includes at least one of the frequency and patterns in which the user uses at least one of the electronic device and the external device when the type of content is displayed on the display.

14. The method according to claim 11, in, The plurality of operations includes at least one of the content-related operations of the electronic device and the content-related operations of the external device.

15. The method according to claim 11, The identification includes: The operations related to the screen settings and sound settings that are relevant to the content among the multiple operations are identified as at least one first operation.

Images