Electronic apparatus and control method therefor

Abstract

An electronic apparatus and a control method therefor are disclosed. The electronic apparatus comprises: a display including a touch panel; a memory for storing one or more instructions; a communication interface; and a processor, which executes the display and the one or more instructions so as to: control a display state of a UI screen according to a control signal received from a remote control device through the communication interface, the UI screen including a plurality of GUI items provided through the display, and a focus GUI positioned on a first GUI item from among the plurality of GUI items; and when a touch input for one area of the display is identified, provide a touch mode by rearranging the position of any one GUI item from among the plurality of GUI items while the position of the GUI item related to one area of the display, in which the touch input has been identified, is fixed.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device and a method for providing a UI (user interface) thereof, and more particularly, to an electronic device for controlling a UI screen for navigating a plurality of GUI (graphical user interface) items and a method for providing a UI thereof.

[0002] Advances in electronic technology have led to the development of various types of electronic devices. In particular, display devices such as TVs are providing diverse content types to meet the needs of users seeking newer and more diverse features.

[0003] As the types of content available on TV diversify and the number of content types increases, the importance of navigation functions that enable users to find the content they want is increasing.

[0004] An electronic device comprises a display including a touch panel; one or more memories storing one or more instructions; a communication interface; and one or more processors operatively connected to the display, the memory, and the communication interface for executing the one or more instructions, wherein the electronic device controls a display state of a UI screen according to a control signal received from a remote control device through the communication interface, the UI screen includes a plurality of GUI (Graphic User Interface) items provided through the display, and a focus GUI positioned on a first GUI item among the plurality of GUI items, and when a touch input is identified for one area of ​​the display, the position of the GUI item related to the one area where the touch input is identified is fixed, thereby providing a touch mode by rearranging the position of any one of the plurality of GUI items.

[0005] The one or more commands, when executed by the one or more processors, may be configured to cause the electronic device to control a display state of the UI screen so that the focus GUI disappears from the screen when the touch mode is provided, and to rearrange positions of the GUI items based on a position of the focus GUI and a position of the area before the touch input is identified to provide the touch mode.

[0006] The one or more commands, when executed by the one or more processors, may be configured such that, when the location of the touch input is the first GUI item or the upper region of the first GUI item, the electronic device provides the touch mode by moving a second GUI item below the first GUI item to the upper region to rearrange the locations of the plurality of GUI items, and when the location of the touch input is the lower region of the first GUI item, the electronic device provides the touch mode by moving a third GUI item above the first GUI item to the lower region to rearrange the locations of the plurality of GUI items.

[0007] The one or more commands, when executed by the one or more processors, may be configured to control the display state of the UI screen so that when the focus GUI is located on a menu item included in a side bar area and the side bar area is expanded and a touch input for an area outside the side bar area is identified, the side bar area is reduced and the focus GUI disappears from the screen, and when a touch input for the menu item is identified, an operation corresponding to the menu item is performed.

[0008] The one or more commands, when executed by the one or more processors, are configured to cause the electronic device to provide a floating menu comprising a plurality of menu items corresponding to a plurality of functions in the touch mode, wherein the plurality of functions may include functions that are provideable through the remote control device.

[0009] When one of the plurality of menu items is selected in response to a user command in the touch mode, a sub-floating menu corresponding to the selected menu item may be provided, and when a non-touch screen is displayed in response to a user command in the touch mode, a multi-directional operation UI for controlling a focus GUI provided on the non-touch screen may be provided.

[0010] The one or more commands, when executed by the one or more processors, may be configured to cause the electronic device to, when a control signal is received from the remote control device in the touch mode, identify whether the sidebar area is in an expanded state, and, if the sidebar area is in an expanded state, provide the focus GUI to a menu item corresponding to a category of an area other than the sidebar among menu items included in the sidebar area, and, if the sidebar area is in a collapsed state, provide the focus GUI to a GUI item included in an area other than the sidebar.

[0011] The one or more commands, when executed by the one or more processors, may be configured such that when the electronic device receives a control signal from the remote control device in the touch mode, the electronic device identifies whether a GUI item on which the focus GUI is positioned is provided on the screen according to a preset criterion, and if the GUI item on which the focus GUI is positioned is provided on the screen, the focus GUI is provided to the GUI item, and if not all of the GUI items are provided on the screen, the focus GUI is provided to a GUI item at a preset position among the plurality of GUI items.

[0012] When a GUI item is selected from among the plurality of GUI items in the touch mode, and a control signal is received from the remote control device after entering a lower depth screen corresponding to the selected GUI item, the plurality of GUIs can be rearranged and provided to be located at the GUI item selected in the touch mode depending on whether the focus GUI is a fixed focus GUI or a movable focus GUI.

[0013] When the one or more commands are executed by the one or more processors, the electronic device can rearrange and provide the positions of a plurality of GUI items moved according to the left and right scroll input at the time of release when a left and right scroll input is identified in the touch mode and a touch input corresponding to the left and right scroll input is released.

[0014] When the one or more commands are executed by the one or more processors, the electronic device can rearrange the vertical arrangement positions of a plurality of GUI items according to a preset standard when a control signal is received from the remote control device after providing the touch mode, and provide the focus GUI to a preset GUI item among the rearranged plurality of GUI items.

[0015] A method for controlling an electronic device having a display that receives a touch input comprises: controlling a display state of a UI screen according to a control signal received from a remote control device; and the UI screen includes a plurality of GUI (Graphic User Interface) items provided through the display and a focus GUI positioned on a first GUI item among the plurality of GUI items, and when a touch input is identified for one area of ​​the display, the step of rearranging the position of any one of the plurality of GUI items while keeping the position of the GUI item related to the one area where the touch input is identified fixed, thereby providing a touch mode.

[0016] A non-transitory computer-readable medium storing computer instructions that, when executed by one or more processors of an electronic device having a display for receiving a touch input, cause the electronic device to perform an operation, the medium comprises: a step of controlling a display state of a UI screen according to a control signal received from a remote control device; and a step of providing a touch mode by rearranging the position of any one of the plurality of GUI items while the position of the GUI item related to the one area where the touch input is identified is fixed when a touch input for one area of ​​the display is identified.

[0017] The above and other aspects and features of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0018] FIG. 1 is a drawing for explaining an implementation example of an electronic device according to one embodiment of the present disclosure.

[0019] FIG. 2A is a block diagram showing the configuration of an electronic device according to one embodiment.

[0020] FIG. 2b is a block diagram specifically showing the configuration of an electronic device according to one embodiment.

[0021] FIG. 3 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0022] FIGS. 4A and 4B are drawings illustrating basic operations in focus mode and touch mode according to one or more embodiments.

[0023] FIGS. 5A and 5B are drawings for explaining an operation according to switching from focus mode to touch mode according to one or more embodiments.

[0024] FIG. 6 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0025] FIGS. 7A and 7B are drawings for explaining an operation according to switching from focus mode to touch mode according to one or more embodiments.

[0026] FIG. 8 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0027] FIGS. 9A and 9B are drawings for explaining an operation according to switching from focus mode to touch mode according to one or more embodiments.

[0028] FIG. 10 is a drawing for explaining a control method of an electronic device according to one or more embodiments.

[0029] FIG. 11 is a drawing for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0030] FIGS. 12a, 12b, 12c and 13 are drawings illustrating the configuration and operation of a floating menu according to one or more embodiments.

[0031] FIGS. 14a, 14b, 14c and 14d are drawings illustrating an interaction method of a floating menu according to one or more embodiments.

[0032] FIG. 15 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0033] FIGS. 16A and 16B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0034] FIG. 17 is a drawing for explaining a control method of an electronic device according to one or more embodiments.

[0035] FIGS. 18A and 18B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0036] FIGS. 19A and 19B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0037] FIGS. 20A and 20B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0038] FIGS. 21A and 21B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0039] The terms used in this specification will be briefly explained, and the present disclosure will be described in detail.

[0040] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions or cases of those skilled in the art, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0041] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0042] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to cases where (1) only A is included, (2) only B is included, or (3) both A and B are included.

[0043] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0044] When it is said that a component (e.g., a first component) is “operatively or communicatively coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0045] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0046] In some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0047] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0048] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor, excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0049] The various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacings drawn in the attached drawings.

[0050] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0051] FIG. 1 is a drawing for explaining an implementation example of an electronic device according to one embodiment of the present disclosure.

[0052] According to FIG. 1, the electronic device (100) can be implemented as a display device that can be remotely controlled by a remote control device (200). As an example, the electronic device (100) can be applied to any device that has a display function, such as a TV, a desktop PC, a laptop PC, a large format display (LFD), a digital signage, a digital information display (DID), a video wall, a projector, a refrigerator, an air conditioner, an air purifier, a medical device, etc. Here, the remote control device (200) can be implemented as a remote control, but is not necessarily limited thereto, and can also be implemented as a device that can be remotely controlled using an application, such as a smartphone.

[0053] According to one embodiment, the processor (140) can control the display (110) to display various types of screens controllable by the remote control device (200), such as a UI screen including a plurality of GUI (Graphic User Interface) items, a content playback screen, etc.

[0054] According to one embodiment, the electronic device (100) may provide a UI screen including a plurality of GUI items having various sizes and / or various ratios and a focus GUI (20) positioned on one of the GUI items (10). According to one example, the navigation operation between the plurality of GUI items may be controlled based on various types of focus control methods depending on the implementation form of the electronic device (100), such as a preset navigation input, for example, a pressing operation for a specific button provided on a remote control device (200) (e.g., a long press input), a touch scroll operation, a scroll button operation, a continuous key input in a wheel input device, etc. Herein, the focus control method may include various types, such as a movable focus method and a fixed focus method. Hereinafter, a mode of controlling a UI screen using a focus GUI according to a remote control signal will be referred to as a focus mode.

[0055] According to one embodiment, the display provided in the electronic device (100) may be implemented as a touch screen combined with a touch sensor. Accordingly, the electronic device (100) may switch from focus mode to touch mode according to a user's touch input.

[0056] In this case, it is necessary to provide a UI / UX experience that seamlessly switches between focus mode and touch mode based on the characteristics of each mode while maintaining the context the user was using.

[0057] FIG. 2A is a block diagram showing the configuration of an electronic device according to one embodiment.

[0058] According to FIG. 2a, the electronic device (100) includes a display (110), a memory (120), a communication interface (130), and one or more processors (140).

[0059] The electronic device (100) may be implemented as an input panel such as a touch panel or a touch screen, or may be implemented as an electronic device such as a notebook, laptop, electronic whiteboard, digital signage, kiosk, monitor, etc. having a touch panel or a touch screen.

[0060] The display (110) may be implemented as a display including a self-luminous element or a display including a non-luminous element and a backlight. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. The display (110) may also include a driving circuit, a backlight unit, etc., which may be implemented in a form such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. According to an example, a touch sensor that detects a touch operation in the form of a touch film, a touch sheet, a touch pad, etc. may be disposed on the front of the display (110) so as to be implemented so as to detect various types of touch inputs. For example, the display (110) can detect various types of touch inputs, such as a touch input by a user's hand, a touch input by an input device such as a stylus pen, and a touch input by a specific electrostatic material. Here, the input device can be implemented as a pen-type input device that can be referred to by various terms such as an electronic pen, a stylus pen, an S-pen, etc. According to an example, the display (110) can be implemented as a flat display, a curved display, a flexible display that can be folded or / and rolled, etc.

[0061] The memory (120) can store data required for various embodiments. Depending on the purpose of data storage, the memory (120) may be implemented in the form of memory embedded in the electronic device (100) or may be implemented in the form of one or more memory elements that can be attached or detached from the electronic device (100). For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for expanding the functions of the electronic device (100) may be stored in a memory that can be attached or detached from the electronic device (100). In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)). In addition, in the case of memory that can be attached or detached to the electronic device (100'), it may be implemented as at least one of memory cards (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. It can be implemented.

[0062] Communication interface 130 may be similar to communication 130 described below in the context of FIG. 2b.

[0063] One or more processors (140) control the overall operation of the electronic device (100). Specifically, one or more processors (140) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (140) may be electrically connected to the display (110) and the memory (120) to control the overall operation of the electronic device (100). One or more processors (140) may be configured as one or more processors.

[0064] One or more processors (140) may perform operations of the electronic device (100) according to various embodiments by executing at least one instruction stored in the memory (120). For example, one or more processors (140) may be electrically connected to the display (110) and the memory (120) to control the overall operation of the electronic device (100).

[0065] One or more processors (140) may perform operations of the electronic device (100) according to various embodiments by executing at least one instruction stored in the memory (130).

[0066] The one or more processors (140) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (140) may control one or any combination of other components of the electronic device, and may perform operations related to communication or data processing. The one or more processors (140) may execute one or more programs or instructions stored in a memory. For example, the one or more processors (140) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in the memory (130).

[0067] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0068] One or more processors (140) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (140) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0069] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0070] In the embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. Hereinafter, for the convenience of description, one or more processors (140) will be referred to as a processor (140).

[0071] FIG. 2b is a block diagram specifically showing the configuration of an electronic device according to one embodiment.

[0072] According to FIG. 2b, the electronic device (100') may include a display (110), a memory (120), a communication interface (130), one or more processors (140), a user interface (150), a speaker (160), a sensor (170), and a camera (170). Among the configurations illustrated in FIG. 2b, a detailed description of configurations that overlap with those illustrated in FIG. 2a will be omitted.

[0073] The communication interface (140) may be implemented as various interfaces depending on the implementation example of the electronic device (100'). For example, the communication interface (140) may communicate with an external device, an external storage medium (e.g., a USB memory), an external server (e.g., a web hard drive), etc. through a communication method such as Bluetooth, AP-based Wi-Fi (Wireless Local Area Network), Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), MHL (Mobile High-Definition Link), AES / EBU (Audio Engineering Society / European Broadcasting Union), optical, coaxial, etc. According to one example, the communication interface (140) may communicate with a remote control device or / and a user terminal having a remote control function.

[0074] The user interface (150) may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or as a touch screen that can also perform the display function and operation input function described above.

[0075] The speaker (160) may be configured to output various audio data as well as various notification sounds or voice messages. The processor (140) may control the speaker to output information corresponding to a UI screen or various notifications in audio format according to various embodiments of the present disclosure.

[0076] The camera (170) can be turned on and take pictures according to a preset event. The camera (170) can convert the captured image into an electrical signal and generate image data based on the converted signal. For example, the subject can be converted into an electrical image signal through a semiconductor optical element (CCD; Charge Coupled Device), and the converted image signal can be amplified and converted into a digital signal and then signal processed.

[0077] The electronic device (100') may additionally include a microphone, a tuner, and a demodulator, depending on the implementation example. The microphone is configured to receive a user's voice or other sounds and convert them into audio data. However, according to another embodiment, the electronic device (100') may receive a user's voice input via an external device through the communication interface (140).

[0078] The tuner can receive RF (Radio Frequency) broadcast signals by tuning to a channel selected by the user or all previously stored channels among RF broadcast signals received through the antenna. The demodulator can receive and demodulate the digital IF signal (DIF) converted by the tuner and can also perform channel decoding, etc.

[0079] FIG. 3 is a drawing for explaining a control method of an electronic device according to one or more embodiments.

[0080] According to FIG. 3, in operation S310, the electronic device (100) may provide a UI screen including a plurality of GUI items and a focus GUI located on one of the plurality of GUI items. Here, the GUI item may include various forms of images and / or text corresponding to various types of content, such as image content, video content, application, and advertising content. For example, the GUI item may be a thumbnail, representative image, title, description, etc. representing the corresponding content, but may also include an image and / or text that can identify the corresponding content.

[0081] For example, GUI items may be arranged in a specific direction, such as horizontal, vertical, or diagonal, and may have a specific shape (e.g., square, rounded square, circle, diamond, etc.). The focus GUI may be a highlighted shape on the border of the GUI item, but is not necessarily limited to this, and may highlight the entire GUI item or a portion of the border. Here, the highlight may include various effects, such as an illumination effect, a gradient effect, or a glow effect, in which adjacent areas are emphasized.

[0082] In operation S320, the electronic device (100) can control the display state of the UI screen according to a control signal received from the remote control device (200). Hereinafter, a mode in which the UI screen is controlled using the focus GUI according to the control signal received from the remote control device (200) will be referred to as a focus mode. For example, the electronic device (100) can control the movement of the focus GUI or the movement of a GUI item according to a control signal according to a pressing operation of a four-way key provided in the remote control device (200).

[0083] In operation S330, if a touch input is identified for an area of ​​the display while the electronic device (100) is operating in focus mode (S330:Y), the electronic device (100) may rearrange the positions of a plurality of GUI items while keeping the positions of the GUI items related to the area where the touch input is identified fixed in operation S340 to provide a touch mode. For example, the electronic device (100) may rearrange the positions of the GUI items so that the GUI items rise from the bottom to the top or descend from the top to the bottom based on the touch input point.

[0084] The operations described in FIG. 3 are arranged in a given order for convenience of explanation, but the order of the operations is not necessarily limited to the order discussed herein. FIGS. 4A and 4B are drawings for explaining basic operations in focus mode and touch mode according to one or more embodiments.

[0085] According to FIG. 4A, the electronic device (100) may provide a first UI screen (410) including a plurality of GUI items in a focus mode and a focus GUI (10) located at one of the plurality of GUI items (411). The electronic device (100) may control the first UI screen (410) by moving the focus GUI (10) or fixing the position of the focus GUI (10) and moving the position of the GUI item based on a control signal received from a remote control device (200). For example, the first UI screen (410) may include an area (412) that provides detailed information of the GUI item on which the focus GUI (10) is located. According to an example, UI feedback may be provided to the GUI item on which the focus GUI (10) is located. The UI feedback may be UI feedback that emphasizes the GUI item on which the focus GUI is located. For example, it may include at least one of UI feedback that alternately changes the transparency of the corresponding GUI item, UI feedback that alternately changes the luminance (or brightness) of the corresponding GUI item, UI feedback that enlarges the size of the corresponding GUI item, or UI feedback that alternately changes the size of the corresponding GUI item.

[0086] According to one embodiment, as illustrated in FIG. 4A, when a touch input is identified while the first UI screen (410) is provided, the electronic device (100) may provide a second UI screen (420) in which a specialized UX in focus mode, for example, a focus GUI (10) and an area (412) providing detailed information on a GUI item where the focus GUI (10) is located, disappear from the screen. For example, the second UI screen (420) may include a floating menu (421) that is displayed as an overlay on the screen. For example, the floating menu (421) may include a plurality of menu items corresponding to a plurality of functions that can be provided through the remote control device (200). For example, the electronic device (100) may output the second UI screen (420) and the floating menu (421) to different display layers. For example, the electronic device (100) can output the second UI screen (420) to the first display layer and output the floating menu (421) to the second display layer before the first display layer. Accordingly, even if the second UI screen (420) includes an OSD (On Screen Display) menu, the floating menu (421) can always be placed at the top of the screen. According to an example, the electronic device (100) can obtain an output image by alpha blending the second UI screen (420) and the floating menu (421). Here, alpha blending refers to a method of mixing the background RGB value and the RGB value above it by assigning a new value called A (Alpha) to the color value RGB in order to produce a transparent effect when overlaying another image on top of the image.

[0087] For example, as illustrated in FIG. 4A, when the focus GUI (10) and the area (412) providing detailed information about the GUI item (411) where the focus GUI (10) is located disappear, the remaining GUI items may be rearranged so that the positions of the GUI items related to the position of the touch input point do not change. For example, the GUI items may be rearranged by moving up to the top of the GUI items below the area (412) providing detailed information about the GUI item (411) where the focus GUI (10) is located.

[0088] According to one embodiment, as illustrated in FIG. 4B, when a control signal is received from the remote control device (200) while the second UI screen (420) is provided, the electronic device (100) may provide a first UI screen (410) including a region (412) that provides detailed information on a focus GUI (10) and a GUI item on which the focus GUI (10) is located. For example, the focus GUI (10) may be provided to a GUI item (411) corresponding to a preset criterion depending on whether the focus GUI (10) is fixed or movable. The movable focus GUI is an item for controlling the scrolling of a list according to a movable focus method, and the movable focus GUI may be moved in one direction according to a scroll input, and GUI items included in the list may be moved in the opposite direction. The fixed focus GUI is an item for controlling the scrolling of a list according to a fixed focus method, and the position of the fixed focus GUI is fixed according to a scroll input, and GUI items included in the list are moved in the scroll direction, and a new GUI item that is not provided on the UI screen may be provided on the UI screen.

[0089] FIGS. 5A and 5B are drawings for explaining an operation according to switching from focus mode to touch mode according to one or more embodiments.

[0090] According to FIGS. 5a and 5b, the electronic device (100) can switch to the touch mode when a touch input is identified while the first UI screen (410) is provided in the focus mode.

[0091] According to FIG. 5A, when a touch input is identified in the second GUI (412) while the focus GUI (10) is provided to the first GUI item (411), the focus GUI (10) may disappear and a touch feedback screen (430) corresponding to the second GUI item (412) may be provided. For example, the touch feedback may mean an action of executing a function corresponding to the touch input. For example, a lower depth screen (430) of the second GUI item (412) may be provided. For example, the lower depth screen (430) of the second GUI item (412) may include a floating menu (431) in a default location (e.g., the lower right).

[0092] According to FIG. 5b, when a touch input is identified in the second GUI (412) while the focus GUI (10) is provided to the first GUI item (411), the focus GUI (10) disappears, and a touch gesture is identified according to a subsequent touch input, and an operation corresponding to the identified touch gesture can be performed. For example, a movement after a touch can be identified as a drag input, a release after a touch can be identified as a tap input, and a touch for a certain period of time or longer can be identified as a hold input. For example, as shown in FIG. 5b, when the second GUI item (412) is dragged, the GUI items can be moved and displayed in the drag direction. For example, different operations can be performed depending on the type of touch input. For example, in the case of a hold input, the hold input can provide additional information about the identified GUI item, provide a pop-up UI, or provide an edit mode. In this case, the touch mode is maintained, so the floating menu (421) can be maintained at the default location (e.g., the lower right).

[0093] FIG. 6 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0094] According to FIG. 6, in operation S610, the electronic device (100) may provide a UI screen including a plurality of GUI items and a focus GUI located on one of the plurality of GUI items.

[0095] In operation S620, the electronic device (100) can control the display state of the UI screen according to a control signal received from the remote control device (200). For example, the electronic device (100) can control the display state of the UI screen using the focus GUI according to the control signal received from the remote control device (200) in a focus mode in which the focus GUI is provided.

[0096] In operation S630, if a touch input to an area of ​​the display (110) in the focus mode is identified (S630:Y), the electronic device (100) can control the display state of the UI screen so that the focus GUI disappears from the screen in operation S640.

[0097] In operation S650, if the location of the touch input is the first GUI item where the focus GUI is located or the upper area of ​​the first GUI item (S650:Y), in operation S660, the electronic device (100) can provide a touch mode by moving the second GUI item below the first GUI item to the upper side to rearrange the locations of the plurality of GUI items.

[0098] In operation S670, if the location of the touch input is the lower area of ​​the first GUI item where the focus GUI is located (S670:Y), in operation S680, the electronic device (100) can provide a touch mode by moving the third GUI item above the first GUI item to the lower area to rearrange the locations of the plurality of GUI items.

[0099] In FIG. 6, the operations mentioned are arranged in a given order for convenience of explanation, but the order of the operations is not necessarily limited to the order discussed herein. FIGS. 7A and 7B are drawings for explaining operations according to switching from focus mode to touch mode according to one or more embodiments.

[0100] According to FIGS. 7A and 7B, the electronic device (100) may provide a first UI screen (710) including a plurality of GUI items and a focus GUI (10) located on one of the plurality of GUI items (711). For example, the first UI screen (711) may include an area (712) that provides detailed information on the GUI item (711) on which the focus GUI (10) is located.

[0101] For example, when a touch input is identified on the first UI screen (710), the area (712) providing details of the focus GUI (10) and GUI items (711) may disappear and the screen may be switched to touch mode.

[0102] For example, when a touch input is identified in the upper area of ​​the GUI item (711) where the focus GUI (10) is located as illustrated in FIG. 7A, the electronic device (100) may provide a second UI screen (720) corresponding to the touch mode while pushing up and rearranging the GUI items at the bottom of the GUI item (711) to the disappeared area (712). For example, the second UI screen (720) may include a floating menu (721) in a default location (e.g., the lower right).

[0103] For example, when a touch input is identified in the lower area of ​​the GUI item (711) where the focus GUI (10) is located as illustrated in FIG. 7b, the electronic device (100) may provide a second UI screen (720) corresponding to the touch mode while pushing down and rearranging the GUI items above the location where the touch input is identified to the disappeared area (712). For example, the second UI screen (720) may include a floating menu (721) in a default location (e.g., the lower right).

[0104] According to the above-described embodiment, the electronic device (100) can provide the most seamless screen transition possible while maintaining text on the UX side even when the input mode is changed by preventing the UI screen from moving as much as possible based on the location touched by the user.

[0105] FIG. 8 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0106] According to FIG. 8, in operation S810, the electronic device (100) may provide a UI screen including a content area including a plurality of GUI items and a sidebar area including a plurality of menu items. In one example, the sidebar area may include a menu item for selecting a UI home type, a setting menu item, and the like.

[0107] In operation S820, the electronic device (100) can control the display state of the UI screen according to a control signal received from the remote control device (200). For example, the electronic device (100) can control the display state of the UI screen using the focus GUI according to the control signal received from the remote control device (200) in a focus mode in which the focus GUI is provided.

[0108] In operation S830, the electronic device (100) can identify whether the touch input is for an area outside the sidebar area while the sidebar area is expanded by positioning the focus GUI on a menu item included in the sidebar area.

[0109] In operation S830, if the electronic device (100) identifies the touch input as a touch input for an area other than the sidebar area (S830:Y), in operation S840, the electronic device (100) can control the display state of the UI screen to reduce (or close) the sidebar area and cause the focus GUI to disappear from the screen.

[0110] In operation S830, if the electronic device (100) identifies the touch input as a touch input for a GUI item included in the side bar area (S850:Y), in operation S860, the electronic device can perform an operation corresponding to the GUI item for which the touch input is identified.

[0111] In FIG. 8, the operations mentioned are arranged in a given order for convenience of explanation, but the order of the operations is not necessarily limited to the order discussed herein. FIGS. 9A and 9B are drawings for explaining operations according to switching from focus mode to touch mode according to one or more embodiments.

[0112] According to FIGS. 9A and 9B, the electronic device (100) may provide a first UI screen (910) including a sidebar area (910-1) and a content area (910-2) in a focus mode. For example, the sidebar area (910-1) may be in an expanded state and the focus GUI (10) may be positioned on a menu item (911) included in the sidebar area.

[0113] According to FIG. 9A, when a touch input for a GUI item (912) located in an area other than the sidebar area (910-1), for example, the content area (910-2), is identified, the electronic device (100) may reduce the sidebar area (910-1) and provide a second UI screen (920) in which the focus GUI (10) disappears. For example, the content area (910-2) in the first UI screen (910) may be maintained in the second UI screen (920), and a floating menu (921) may be provided in a default location (for example, the lower right) of the second UI screen (920).

[0114] According to FIG. 9B, when a touch input is identified for an arbitrary area within the side bar area (910-1) where the focus GUI (10) is located, the electronic device (100) may perform an operation corresponding to the subsequent touch input after a subsequent touch input is received. For example, when the subsequent touch input is an input for tapping a menu item (911) of a specific category located in the side bar area (910-1), the electronic device (100) may provide a third UI screen (930) corresponding to the corresponding menu item (911). For example, the content area (910-2) in the first UI screen (910) may be changed to a content area corresponding to the menu item (911) in the third UI screen (930), and a floating menu (931) may be provided at a default location (e.g., the lower right) of the third UI screen (930). In this case, the electronic device (100) can reduce the sidebar area (910-1) when a touch input is identified for any area in the sidebar area (910-1) where there is no menu item.

[0115] As another example, when a touch input for a menu item (911) where the focus GUI (10) is located is identified, the electronic device (100) may immediately reduce the side bar area (910-1) and provide a third UI screen (930) corresponding to the menu item (911) where the focus GUI (10) is located.

[0116] FIG. 10 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0117] According to FIG. 9, in operation S1010, the electronic device (100) may provide a UI screen including a plurality of GUI items and a focus GUI located on one of the plurality of GUI items.

[0118] In operation S1020, the electronic device (100) can control the display status of the UI screen according to a control signal received from the remote control device (200).

[0119] In operation S1030, if a touch input is identified for an area of ​​the display (110) (S1030:Y), the electronic device (100) may provide a touch mode including a floating menu in operation S1040. For example, the floating menu may include a plurality of menu items corresponding to a plurality of functions that can be provided via the remote control device (200).

[0120] In operation S1050, when one of a plurality of menu items included in a floating menu is selected in response to a user command in a touch mode (S1050:Y), in operation S1060, the electronic device (100) may provide a sub-floating menu corresponding to the selected menu item. For example, the sub-floating menu may include menu items corresponding to sub-menus of the selected menu item.

[0121] In operation S1070, if a non-touch screen is displayed in response to a user command in touch mode (S1070:Y), the electronic device (100) may provide a four-way manipulation UI for controlling a focus GUI provided on the non-touch screen in operation S1080. For example, an application screen provided by a specific third party may not support the touch mode. In this case, since the electronic device (100) provides the touch mode, it may provide a four-way manipulation UI for controlling the focus GUI provided on the application screen.

[0122] FIG. 11 is a drawing for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0123] According to FIG. 11, the electronic device (100) can provide a second UI screen (1120) including a floating menu (1121) in touch mode.

[0124] For example, as illustrated in FIG. 11, when a control signal is received from a remote control device (200) while a second UI screen (1120) is provided in touch mode, the electronic device (100) may switch to focus mode by providing a first UI screen (1110) that includes a focus GUI (10) and an area (1112) that provides detailed information of a GUI item (1111) where the focus GUI (10) is located, and does not include a floating menu (1121). For example, since an area (1112) that provides detailed information of a GUI item (1111) where the focus GUI (10) is located is newly displayed in the first UI screen (1110), the display positions of the remaining GUI items may be rearranged.

[0125] After this, the electronic device (100) can perform an operation corresponding to a control signal from the remote control device (200) in focus mode. For example, as illustrated in FIG. 11, the electronic device (100) can move the focus GUI (10) to a GUI item (1112) according to a control signal for moving the focus GUI (10).

[0126] FIGS. 12a, 12b, 12c and 13 are drawings illustrating the configuration and operation of a floating menu according to one or more embodiments.

[0127] According to FIG. 12A, the basic floating menu (1210) may include basic menu items (1211, 1212, 1213, 1214) corresponding to a plurality of functions that can be provided through the remote control device (200). For example, it may include menu items corresponding to Return, Home, Quick Panel, and Volume, respectively. In FIG. 12A, the basic floating menu (1210) is illustrated as having four basic menu items, but the present invention is not necessarily limited thereto. For example, basic menu items such as Channel, Source, and Touch lock may be further included in the basic floating menu (1210). For example, the basic menu items may be provided in a form in which they are displayed simultaneously or additionally displayed by scrolling.

[0128] According to FIG. 12B, when any one of the basic menu items (1211, 1212, 1213, 1214) included in the basic floating menu (1210) is selected by a touch input, information (1221, 1222, 1223) corresponding to a sub-menu of the selected basic menu item may be provided through a sub-floating menu (1220). For example, information related to a variation of the basic floating menu item may be provided through the sub-floating menu (1220). For example, the information (1221, 1222, 1223) corresponding to the sub-menu may include detailed information (text or image) of the selected basic menu item, a sub-menu item corresponding to the sub-menu, etc. For example, when the “Volume” item is selected in the basic floating menu (1210), sub-menu items corresponding to the Volume - / + Button of the remote control device (200) may be provided through the sub-floating menu (1220).

[0129] According to FIG. 12c, in addition to the basic floating menu (1210), an additional floating menu (1230) may be provided. For example, when entering a screen that does not support touch input, for example, an application screen that does not support touch input, a UI (e.g., a four-way operation UI) for navigating the focus GUI provided on the application screen may be provided as an additional floating menu (1230). In this case, the user can control the movement of the focus GUI provided on the application screen through a touch input on the additional floating menu (1230).

[0130] According to FIG. 13, a floating menu (1321) may be provided at a preset default location on a UI screen (1320) provided in touch mode. For example, the floating menu (1321) may be provided in the lower right area of ​​the UI screen (1320).

[0131] For example, the floating menu (1321) may be moved to a plurality of preset locations based on a user's touch input. For example, as illustrated in FIG. 13, the floating menu (1321) may be moved to any one of the four corner areas of the UI screen (1320) based on a user's touch and hold input. However, the preset locations are not limited thereto, and may be determined as a plurality of locations within the right border line area of ​​the UI screen (1320) or a plurality of locations within the left border line area.

[0132] For example, if a floating menu (1321) is moved to a location other than a preset location based on a user's touch input, it may be automatically moved and positioned to the preset location closest to the moved location based on a magnetic effect.

[0133] As described above, a floating menu that is always overlaid on the screen in touch mode can be provided so that the user can easily access the main functions of the electronic device (100) and enable navigation and content viewing.

[0134] FIGS. 14A to 14D are drawings for explaining an interaction method of a floating menu according to one or more embodiments.

[0135] According to FIG. 14A, when one of the menu items included in the floating menu (1421) provided on the UI screen (1420) in the touch mode is selected by a user's touch input, the electronic device (100) can provide a sub-floating menu (1422) (or sub-panel) corresponding to the selected menu item. For example, when the menu item selected by the user's touch input is re-selected or an area outside the floating menu (1421) is selected, the electronic device (100) can make the sub-floating menu (1422) disappear.

[0136] According to FIG. 14B, when a specific GUI item is selected by a user's touch input and a non-touch screen is provided while a UI screen (1420) including a floating menu (1421) is provided in a touch mode, the electronic device (100) may provide an additional floating menu (1423). For example, the electronic device (100) may provide an additional floating menu (1423) in an upper area of ​​the floating menu (1421). For example, when entering an application screen that does not support touch input, the electronic device (100) may provide a UI (e.g., a four-way manipulation UI) for navigating a focus GUI provided on an application screen as an additional floating menu (1423). In this case, the user may control the movement of the focus GUI provided on the application screen through a touch input on the additional floating menu (1423). For example, the electronic device (100) may make the additional floating menu (1423) disappear when returning to a touch-supported screen.

[0137] According to FIG. 14c, the electronic device (100) can hide the floating menu (1421) outside the screen and display only the handler GUI in response to a user's touch drag input or touch flick input while the UI screen (1420) including the floating menu (1421) is provided in touch mode. In this case, the electronic device (100) can provide the floating menu (1421) back on the screen in response to the user's touch drag input or touch flick input to the handler GUI.

[0138] According to FIG. 14d, the electronic device (100) may cause the floating menu (1421) to disappear from the screen if no touch input is identified for a preset period of time while the UI screen (1420) including the floating menu (1421) is provided in touch mode. In this case, the electronic device (100) may display the floating menu (1421) again when the touch input is identified.

[0139] FIG. 15 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0140] According to FIG. 15, in operation 1510, when a control signal is received from a remote control device (200) in touch mode (S1510:Y), the electronic device (100) can identify whether the side bar area is in an expanded state in operation S1520.

[0141] In operation S1520, if the electronic device (100) identifies the sidebar area as being in an expanded state (S1520:Y), in operation S1530, the electronic device (100) may provide a focus GUI to a menu item corresponding to a category in an area other than the sidebar among the menu items included in the sidebar area. For example, if the electronic device (100) switches from touch mode to focus mode according to a control signal received from the remote control device (200) and the sidebar area is in an expanded state, the electronic device (100) may provide a focus GUI to a menu item in the sidebar area corresponding to a category provided in the content area.

[0142] In operation S1520, if the electronic device (100) determines that the sidebar area is not in an expanded state (S1520:N), in operation S1540, the electronic device (100) may provide a focus GUI to a GUI item included in an area other than the sidebar. For example, if the electronic device (100) switches from touch mode to focus mode according to a control signal received from the remote control device (200) and the sidebar area is not in an expanded state, the electronic device (100) may provide a focus GUI to a GUI item at a preset position among the GUI items included in the content area.

[0143] FIGS. 16A and 16B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0144] According to FIGS. 16A and 16B , the electronic device (100) may provide a second UI screen (1620) including a sidebar area (1610-1) and a content area (1610-2) in touch mode. For example, a floating menu (1621) may be provided in the lower right area of ​​the second UI screen (1620). Thereafter, the electronic device (100) may switch from the touch mode to the focus mode according to a control signal received from the remote control device (200).

[0145] According to FIG. 16A, when a control signal is received from a remote control device (200) in a state where the sidebar area (1210-1) is expanded, the electronic device (100) can provide a focus GUI (10) to a menu item (1622) of a category corresponding to the content area (1610-2) among the menu items included in the sidebar area (1610-1). This is because the user has a relatively high probability of manipulating the sidebar area (1610-1) because the focus mode is switched while the sidebar area (1210-1) is being operated in an expanded state, i.e., a touch mode.

[0146] According to FIG. 16b, when a control signal is received from a remote control device (200) in a state where the sidebar area (1210-1) is reduced (or closed), the electronic device (100) can provide a focus UI (10) to a GUI item (1623) at a preset position included in the content area (1610-2). This is because the sidebar area (1210-1) is reduced, that is, the user is operating the content area (1610-2) in touch mode, and thus the focus mode is switched, so that the user has a relatively high probability of operating the content area (1610-2).

[0147] FIG. 17 is a drawing for explaining a control method of an electronic device according to one or more embodiments.

[0148] According to FIG. 17, in operation 1710, when a control signal is received from a remote control device (200) in touch mode (S1710:Y), in operation 1720, the electronic device (100) can identify whether a default GUI item according to a preset standard is provided on the screen. Here, the preset standard may vary depending on the manufacturer, the control method of the focus GUI, the type of the UI screen, etc.

[0149] In operation 1730, if the electronic device (100) identifies that the default GUI item is fully provided on the screen (S1730:Y), in operation 1740, the electronic device may provide a focus GUI to the GUI item. Here, the GUI item being fully provided on the screen may mean that the entire graphic of the GUI item is displayed on the screen.

[0150] In operation 1750, if it is determined that the default GUI item is not provided on the screen or only a portion of the default GUI items are provided on the screen (S1750:Y), in operation 1760, a focus GUI may be provided to another GUI item at a preset location. Here, the preset location may vary depending on the manufacturer, the control method of the focus GUI, the type of UI screen, etc.

[0151] FIGS. 18A and 18B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0152] According to one embodiment, the electronic device (100) may provide a focus GUI for default items included in the screen when switching from touch mode to focus mode. For example, the focus GUI may be provided for items selected by the focus GUI within the screen according to preset criteria. Here, the preset criteria may vary depending on the manufacturer, the focus GUI control method, the UI screen type, etc.

[0153] According to FIG. 18A, the electronic device (100) can provide a second UI screen (1820) including a floating menu (1821) and a pop-up UI (1822) in a touch mode. For example, the second UI screen (1820) can be a non-scrollable UI screen. In this case, when a control signal is received from a remote control device (200) while the second UI screen (1820) is provided, the electronic device (100) can switch to a focus mode by providing a focus GUI (10) to a selection menu button (1822-1, 1822-2) included in the pop-up UI (822).

[0154] According to FIG. 18B, the electronic device (100) can provide a second UI screen (1820) including a floating menu (1821) in touch mode. For example, the second UI screen (1820) can be a scrollable UI screen. In this case, when a control signal is received from a remote control device (200) while the second UI screen (1810) is provided, the electronic device (100) can identify whether a default item (1811) (e.g., the top leftmost item in the item list) according to a preset standard is fully displayed on the screen. When the default item (1811) is fully displayed on the screen, the electronic device (100) can provide a focus GUI (10) to switch to focus mode.

[0155] FIGS. 19A and 19B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0156] According to FIGS. 19A and 19B, the electronic device (100) may provide a second UI screen (1920) including a floating menu (1921) in touch mode. For example, the second UI screen (1920) may be a scrollable UI screen and may be in a state where a scroll operation has occurred in touch mode.

[0157] According to FIG. 19a, the electronic device (100) may provide a focus GUI (10) to another GUI item (1911) at a preset position when a default item (e.g., the topmost leftmost item in the item list) is not fully displayed on the screen. For example, the electronic device (100) may provide a focus GUI (10) to the topmost leftmost item (1911) that is fully displayed on the screen.

[0158] According to FIG. 19b, if a default item (e.g., the topmost leftmost item in the item list) is not fully displayed on the screen, the electronic device (100) may provide a focus GUI (10) to another GUI item (1911) at a preset location. For example, the electronic device (100) may provide a focus GUI (10) to the topmost leftmost item (1911) that is fully displayed on the screen, and display detailed information (1912) corresponding to the item (1911) on which focus is located in a lower area of ​​the item (1911).

[0159] FIGS. 20A and 20B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0160] According to FIGS. 20A and 20B , the electronic device (100) may provide a second UI screen (2020) including a floating menu (2021) in a touch mode. In one example, a specific GUI item (2022) may be selected on the second UI screen (2020) to enter a lower depth screen (2030). In this case, the floating menu (2021) may be maintained on the lower depth screen (2030). If a control signal is received from the remote control device (200) while the lower depth screen (2030) is provided, a focus GUI (10) may be provided on an area of ​​the lower depth screen (2030). If the original screen is returned to the original screen in response to a control signal (e.g., a return signal) from the remote control device (200), the focus GUI (10) may be positioned on the GUI item (2022) executed on the previous screen. In this case, the electronic device (100) can provide a first UI screen (2010) by rearranging GUI items according to the control method of the focus GUI (10).

[0161] According to FIG. 20a, when the focus GUI (10) is a fixed focus GUI displayed at the leftmost side of the center line, the electronic device (100) can rearrange the GUI items by moving them to the left so that the GUI item (2022) executed on the previous screen is located on the focus GUI (10) displayed at the leftmost side of the center line.

[0162] According to FIG. 20b, when the focus GUI (10) is movable, the electronic device (100) can rearrange the GUI items by moving them upward so that the GUI item (2022) executed on the previous screen is fully displayed on the screen, and provide the focus GUI (10) to the fully displayed GUI item (2022).

[0163] FIGS. 21A and 21B are drawings for explaining an operation according to switching from touch mode to focus mode according to one or more embodiments.

[0164] According to FIG. 21a, the electronic device (100) may provide a second UI screen (2120) including a floating menu (2121) in touch mode. In one example, the electronic device (100) may perform GUI item alignment according to scroll input in touch mode in different ways depending on whether the scroll input is in the left-right direction or the up-down direction.

[0165] For example, as illustrated in FIG. 21a, when a left or right scroll touch input is identified on the second UI screen (2120), the positions of GUI items can be rearranged and displayed at the time of touch release. For example, as illustrated in FIG. 21a, when the positions of GUI items (2122, 2123, ..) included in the second GUI list are not aligned with the GUI items included in other GUI lines due to a leftward scroll touch input on the second GUI list, the GUI items (2122, 2123, ..) can be rearranged. Thereafter, when a control signal is received from the remote control device (200), the focus GUI (10) can be displayed on the already rearranged GUI items (2123) when switching to the focus mode, so there is no need to rearrange the items. For example, when a focus GUI (10) is displayed on a GUI item (2123) in the first UI screen (2110) provided in focus mode, detailed information corresponding to the GUI item (2123) may be provided in the lower area (2124) of the GUI item (2123).

[0166] For example, as illustrated in FIG. 21b, when an upward or downward scroll touch input is identified on the second UI screen (2120), the positions of GUI items can be moved and displayed at the time of touch release. Thereafter, when a control signal is received from the remote control device (200), the positions of GUI items can be rearranged and displayed depending on whether the focus GUI (10) is fixed or movable when switching to focus mode.

[0167] According to the various embodiments described above, there is a need to provide a UI / UX experience that seamlessly switches between focus mode and touch mode based on the characteristics of each mode while maintaining the context the user was using when switching between focus mode and touch mode on a screen that allows both remote control input and touch input.

[0168] The methods according to the various embodiments of the present disclosure described above may be implemented in the form of applications installable on existing electronic devices. Alternatively, the methods according to the various embodiments of the present disclosure described above may be performed using a deep learning-based artificial neural network (or deep artificial neural network), i.e., a learning network model.

[0169] Additionally, the methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for an existing electronic device.

[0170] Additionally, the various embodiments of the present disclosure described above can also be performed through an embedded server provided in an electronic device, or an external server of the electronic device.

[0171] According to an exemplary embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device (e.g., electronic device A) according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When an instruction is executed by a processor, the processor may directly or under the control of the processor perform a function corresponding to the instruction using other components. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0172] Furthermore, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0173] In addition, each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the corresponding sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the corresponding components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0174] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, A display including a touch panel; One or more memories that store one or more instructions; Communication interface; and one or more processors operatively connected to the display, the one or more memories and the communication interface for executing the one or more instructions; When said one or more instructions are executed by said one or more processors, said electronic device, Controls the display status of the UI (User Interface) screen according to a control signal received from a remote control device through the above communication interface, The above UI screen includes a plurality of GUI (Graphic User Interface) items provided through the display and a focus GUI located on a first GUI item among the plurality of GUI items. An electronic device configured to provide a touch mode by re-arranging the position of one of the plurality of GUI items while keeping the position of the GUI item related to the area where the touch input is identified fixed when a touch input is identified for an area of ​​the display.

2. In paragraph 1, The one or more commands, when executed by the one or more processors, cause the electronic device to control the display state of the UI screen so that the focus GUI disappears from the screen if the touch mode is provided. An electronic device configured to provide the touch mode by re-arranging the positions of the GUI items based on the position of the focus GUI and the position of the area before the touch input is identified.

3. In paragraph 2, When the one or more commands are executed by the one or more processors, the electronic device provides the touch mode by moving the second GUI item below the first GUI item to the top when the location of the touch input is the first GUI item or the upper area of ​​the first GUI item, thereby rearranging the locations of the plurality of GUI items. An electronic device configured to provide the touch mode by rearranging the positions of the plurality of GUI items by moving the third GUI item above the first GUI item to the bottom when the location of the touch input is the lower area of ​​the first GUI item.

4. In paragraph 1, The one or more commands, when executed by the one or more processors, cause the electronic device to control the display state of the UI screen so that when the focus GUI is located on a menu item included in a side bar area and the side bar area is expanded, and a touch input to an area outside the side bar area is identified, the side bar area is reduced and the focus GUI disappears from the screen. An electronic device configured to perform an action corresponding to the menu item when a touch input for the menu item is identified.

5. In paragraph 1, The one or more commands, when executed by the one or more processors, cause the electronic device to provide a floating menu comprising a plurality of menu items corresponding to a plurality of functions in the touch mode, The above multiple functions are: An electronic device comprising functions capable of being provided via said remote control device.

6. In paragraph 5, The one or more commands, when executed by the one or more processors, cause the electronic device to provide a sub-floating menu corresponding to the selected menu item when any one of the plurality of menu items is selected in response to a user command in the touch mode. An electronic device configured to provide a multi-directional operation UI for controlling a focus GUI provided on a non-touch screen when a non-touch screen is displayed according to a user command in the above touch mode.

7. In paragraph 1, The one or more instructions, when executed by the one or more processors, cause the electronic device to identify whether the side bar area is in an expanded state when a control signal is received from the remote control device in the touch mode; When the above sidebar area is in an expanded state, the focus GUI is provided to a menu item corresponding to a category in an area other than the sidebar among the menu items included in the above sidebar area, An electronic device configured to provide the focus GUI to a GUI item included in an area other than the side bar when the side bar area is in a collapsed state.

8. In paragraph 1, The one or more commands, when executed by the one or more processors, cause the electronic device to, when receiving a control signal from the remote control device in the touch mode, identify whether a GUI item on which the focus GUI is positioned is provided on the screen according to a preset criterion, If a GUI item on which the above focus GUI is positioned is provided on the screen, the focus GUI is provided to the GUI item, An electronic device that provides the focus GUI to a GUI item at a preset position among the plurality of GUI items when the entirety of the GUI items is not provided on the screen.

9. In paragraph 1, An electronic device wherein, when the one or more commands are executed by the one or more processors, the electronic device, when a GUI item is selected from among the plurality of GUI items in the touch mode, enters a lower depth screen corresponding to the selected GUI item, and when a control signal is received from the remote control device, the electronic device rearranges and provides the plurality of GUIs to be located at the GUI item selected in the touch mode depending on whether the focus GUI is a fixed focus GUI or a movable focus GUI.

10. In paragraph 1, An electronic device, wherein when the one or more commands are executed by the one or more processors, the electronic device, when a left-right scroll input is identified in the touch mode and a touch input corresponding to the left-right scroll input is released, rearranges and provides the positions of a plurality of GUI items moved according to the left-right scroll input at the time of release.

11. In paragraph 1, When the one or more commands are executed by the one or more processors, the electronic device, upon receiving a control signal from the remote control device after providing the touch mode, rearranges the upper and lower arrangement positions of a plurality of GUI items according to preset criteria. An electronic device that provides the focus GUI to a preset GUI item among the plurality of rearranged GUI items.

12. A method for controlling an electronic device having a display that receives touch input, A step of controlling the display status of a UI screen according to a control signal received from a remote control device; and The above UI screen includes a plurality of GUI (Graphic User Interface) items provided through the display and a focus GUI located on a first GUI item among the plurality of GUI items. A control method comprising: a step of providing a touch mode by re-arranging the position of one of the plurality of GUI items while fixing the position of the GUI item related to the area where the touch input is identified, when a touch input for an area of ​​the display is identified; 13. In paragraph 12, The step of providing the above touch mode is: When the above touch mode is provided, a step of controlling the display state of the UI screen so that the focus GUI disappears from the screen; and A control method comprising: providing the touch mode by rearranging the positions of the GUI items based on the position of the focus GUI and the position of the area before a touch input is identified; 14. In paragraph 13, The step of providing the above touch mode is: If the location of the touch input is the first GUI item or the upper area of ​​the first GUI item, a step of providing the touch mode by moving the second GUI item below the first GUI item to the upper area to rearrange the locations of the plurality of GUI items; and A control method, comprising: a step of providing the touch mode by moving a third GUI item above the first GUI item to the bottom to rearrange the positions of the plurality of GUI items when the location of the touch input is the lower area of ​​the first GUI item.

15. A non-transitory computer-readable medium storing computer instructions that, when executed by one or more processors of an electronic device having a display for receiving touch input, cause the electronic device to perform an operation, The above actions are, A step of controlling the display state of the UI screen according to a control signal received from a remote control device; and The above UI screen includes a plurality of GUI (Graphic User Interface) items provided through the display and a focus GUI located on a first GUI item among the plurality of GUI items. A non-transitory computer-readable medium comprising: a step of providing a touch mode by re-arranging the position of one of the plurality of GUI items while fixing the position of the GUI item related to the area where the touch input is identified, when a touch input for an area of ​​the display is identified;

Images