Electronic device and control method therefor

Abstract

This electronic device displays, on a display, a pattern input user interface (UI) including a plurality of UI elements, when a first user input including a first command instructing that a first selection is performed is received while focus is positioned on a first UI element from among the plurality of UI elements, displays the first UI element so as to be distinguished from remaining UI elements from among the plurality of UI elements, when a second user input including a second command instructing that a first movement is performed in a first direction is received while the first UI element is selected, moves focus from the first UI element to a second UI element from among the plurality of UI elements disposed in the first direction in the first UI element and displays a first guide trajectory coupling the first UI element and the second UI element, and, when a third user input including a third command instructing that a second selection is performed is received while focus is positioned on the second UI element and the first guide trajectory is displayed, displays the first and second UI elements so as to be distinguished from the remaining UI elements from among the plurality of UI elements, and changes the first guide trajectory to a first selection trajectory and displays same.

Description

Electronic device and method of controlling the same

[0001] The present disclosure generally relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device capable of receiving pattern input through a User Interface (UI) displayed on a display and a method for controlling the same.

[0002] Recently, passwords can be entered via pattern input on portable electronic devices, such as touchscreen-based mobile devices. For example, this method allows users to draw patterns by directly touching UI elements on the touchscreen; it was introduced to serve as a means of inputting values ​​into electronic devices while also protecting user privacy.

[0003] However, the pattern input method is not suitable for electronic devices controlled based on remote controls and / or other input devices rather than touch screens, such as TVs. In other words, users may experience difficulties in performing actions such as entering passwords through the pattern input described above.

[0004] Therefore, it may be necessary to explore ways to perform pattern input using input devices such as remote controls on electronic devices without touch screens.

[0005] Meanwhile, the information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0006] An electronic device according to one embodiment of the present disclosure comprises: a display; a memory for storing instructions; The electronic device comprises: a processor; wherein, when the instructions are executed individually or collectively by the processor, the electronic device displays a pattern input UI (user interface) on the display, the pattern input UI includes a plurality of UI elements; when a first user input is received, the first user input includes a first command instructing to perform a first selection while focus is placed on a first UI element among the plurality of UI elements, the first user input is displayed in a manner distinguishable from the remaining UI elements among the plurality of UI elements; and when a second user input is received, the second user input includes a second command instructing to perform a first movement in a first direction while the first UI element is selected, the first user input moves the focus from the first UI element to a second UI element among the plurality of UI elements arranged in the first direction from the first UI element and displays a first guide trajectory coupling the first UI element and the second UI element, and a third command instructs to perform a second selection while focus is placed on the second UI element and the first guide trajectory is displayed. When a third user input is received, the first and second UI elements are displayed in a manner distinct from the remaining UI elements among the plurality of UI elements, and the first guide trajectory is changed to a first selection trajectory and displayed.

[0007] When the above instructions are executed individually or collectively by the processor, the electronic device may additionally move the focus from the second UI element to the third UI element among the plurality of UI elements positioned in the second direction from the second UI element and display a second guide trajectory when a fourth user input is received that includes a fourth command for performing a second movement in a second direction while the focus is positioned on the second UI element and the first guide trajectory is displayed.

[0008] If the second direction is the same direction as the first direction, the second guide trajectory can couple the first UI element and the second UI element with the third UI element.

[0009] When the above instructions are executed individually or collectively by the processor, the electronic device may additionally display the first UI element, the second UI element, and the third UI element in a manner distinct from the remaining UI elements among the plurality of UI elements, and change the second guide trajectory to a second selection trajectory when a fifth user input is received, which includes a fifth command to perform a third selection while the focus is placed on the third UI element and the second guide trajectory is displayed.

[0010] If the second direction is a diagonal direction of the first direction, the second guide trajectory can couple only the first UI element and the third UI element positioned diagonally to the first UI element.

[0011] When the above instructions are executed individually or collectively by the processor, the electronic device may additionally display the first UI element and the third UI element in a manner distinct from the remaining UI elements among the plurality of UI elements and change the second guide trajectory to a third selection trajectory when a sixth user input is received, which includes a sixth command instructing to perform a fourth selection while the focus is placed on the third UI element and the second guide trajectory is displayed.

[0012] When the above instructions are executed individually or collectively by the processor, the electronic device may additionally provide a feedback effect by changing the color of the first guide trajectory when the first guide trajectory is changed to the first selection trajectory.

[0013] When the above instructions are executed individually or collectively by the processor, the electronic device may additionally display a number UI configured to select a number using an arrow key, together with the pattern input UI.

[0014] When the above instructions are executed individually or collectively by the processor, the electronic device may additionally receive a fourth user input including a fourth command instructing to perform a second movement in the direction of the first number when a first number included in the number UI is selected once, and receive a fifth user input including a fifth command instructing to perform a third selection for the second number when a second number included in the number UI is selected twice.

[0015] Meanwhile, a control method for an electronic device according to one embodiment of the present disclosure comprises: displaying a pattern input UI including a plurality of UI elements on a display of the electronic device; receiving a first user input including a first command instructing to perform a first selection while a focus is positioned on a first UI element among the plurality of UI elements, displaying the first UI element in a manner distinguishable from the remaining UI elements among the plurality of UI elements; receiving a second user input including a second command instructing to perform a first movement in a first direction while the first UI element is selected, moving the focus from the first UI element onto a second UI element among the plurality of UI elements arranged in the first direction from the first UI element, and displaying a first guide trajectory that couples the first UI element and the second UI element. and when a third user input is received that includes a third command instructing to perform a second selection while the focus is placed on the second UI element and the first guide trajectory is displayed, the first and second UI elements are displayed in a manner distinct from the remaining UI elements among the plurality of UI elements, and the first guide trajectory is changed and displayed as a first selection trajectory;

[0016] The above control method may further include the step of, when a fourth user input including a fourth command for performing a second movement in a second direction while the focus is positioned on the second UI element and the first guide trajectory is displayed is received, moving the focus from the second UI element to a third UI element among the plurality of UI elements positioned in the second direction from the second UI element, and displaying a second guide trajectory that couples the first UI element and the third UI element.

[0017] If the second direction is the same direction as the first direction, the second guide trajectory can couple the first UI element and the second UI element with the third UI element.

[0018] The above control method may further include the step of, when a fifth user input including a fifth command to perform a third selection while the focus is placed on the third UI element and the second guide trajectory is displayed is received, displaying the first UI element, the second UI element, and the third UI element in a manner distinguishable from the remaining UI elements among the plurality of UI elements, and changing and displaying the second guide trajectory as a second selection trajectory.

[0019] If the second direction is a diagonal direction of the first direction, the second guide trajectory can couple only the first UI element and the third UI element positioned diagonally to the first UI element.

[0020] The above control method may further include the step of, when a sixth user input is received that includes a sixth command instructing to perform a fourth selection while the focus is placed on the third UI element and the second guide trajectory is displayed, displaying the first UI element and the third UI element in a manner distinguishable from the remaining UI elements among the plurality of UI elements, and changing and displaying the second guide trajectory as a third selection trajectory.

[0021] The above control method may further include the step of providing a feedback effect by changing the color of the first guide trajectory when the first guide trajectory is changed to the first selection trajectory.

[0022] The above plurality of UI elements include numbers corresponding to the UI elements, and the control method may further include the step of displaying a number UI configured to select a number using an arrow key together with the pattern input UI.

[0023] The above control method may further include: a step of receiving a fourth user input including a fourth command instructing to perform a second movement in the direction of the first number when a first number included in the number UI is selected once; and a step of receiving a fifth user input including a fifth command instructing to perform a third selection for the second number when a second number included in the number UI is selected twice.

[0024] Additional aspects may be described in the following description, may become obvious from the following description, or may be learned through the implementation of the presented embodiments.

[0025] The above-described and other aspects, features, and advantages of specific embodiments of the present disclosure may become more apparent from the accompanying drawings and description, which are as follows.

[0026] FIG. 1 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0027] FIGS. 2A and 2B are flowcharts illustrating a method for controlling a UI (user interface) for pattern input according to one embodiment of the present disclosure.

[0028] FIGS. 3a to 3i are drawings illustrating a method for controlling a pattern input UI according to one embodiment of the present disclosure.

[0029] FIGS. 4a and 4b are drawings illustrating a method for performing user authentication using a pattern input UI and a number UI according to an embodiment of the present disclosure.

[0030] FIG. 5 is a flowchart illustrating a method for performing user authentication using a pattern input UI and a number UI according to one embodiment of the present disclosure.

[0031] FIG. 6 is a drawing illustrating an electronic device and a user terminal according to one embodiment of the present disclosure.

[0032] FIGS. 7a and 7b are drawings illustrating an embodiment in which an electronic device and a user terminal perform pattern input in conjunction according to an embodiment of the present disclosure.

[0033] FIG. 8 is a drawing illustrating an embodiment of performing pattern input through user voice according to one embodiment of the present disclosure, and,

[0034] FIG. 9 is a drawing illustrating an embodiment of performing pattern input through a user gesture according to one embodiment of the present disclosure.

[0035] The various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments.

[0036] In relation to the description of the drawings, similar reference numerals may be used for similar or related components.

[0037] The singular form of the noun corresponding to an item may include one or plural items, unless the relevant context clearly indicates otherwise.

[0038] In the present disclosure, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “at least one of A, B, or C” may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” may refer to cases including (1) at least one A, (2) at least one B, or (3) both at least one A and at least one B.

[0039] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another component and do not limit the components in other aspects (e.g., importance or order).

[0040] Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that the component may be connected to the other component directly (e.g., via a wire), wirelessly, or through a third component.

[0041] Terms such as "include" or "have" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in this document, and do not preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0042] When it is said that a component is "connected," "combined," "supported," or "in contact" with another component, this includes not only cases where the components are directly connected, combined, supported, or in contact, but also cases where they are indirectly connected, combined, supported, or in contact through a third component.

[0043] When it is said that a component is located "on" another component, this includes not only cases where one component is in contact with the other, but also cases where another component exists between the two components.

[0044] The term "and / or" includes a combination of multiple related described components or any of the multiple related described components.

[0045] In some situations, the expression “device configured to do something” may mean that the device is “capable of doing something” in conjunction with other devices or components. For example, the phrase “processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing the said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or application processor) capable of performing said operations by executing one or more software programs stored in a memory device.

[0046] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor, except for a "module" or "part" that may need to be implemented in specific hardware.

[0047] The various elements and areas in the drawings are depicted schematically. Accordingly, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0048] Throughout this specification, where phrases such as "one embodiment," "one embodiment," "exemplary embodiment," or similar expressions are used, they may imply that specific features, structures, or characteristics described in relation to such embodiments are included in at least one embodiment of the present invention. Accordingly, phrases such as "in one embodiment," "in one embodiment," and "in an exemplary embodiment" in this specification do not necessarily refer to the same embodiment, but may refer to different embodiments. Since the embodiments described herein are exemplary embodiments, the present invention is not limited thereto and may be implemented in various forms.

[0049] The specific order or hierarchy of blocks in a process or flowchart according to the present disclosure should be understood as an exemplary approach. Depending on design preferences, the specific order or hierarchy of blocks in a process or flowchart may be changed. Additionally, some blocks may be combined or omitted. The appended claims present the elements of each block in an exemplary order and are not limited to a specific order or hierarchy.

[0050] The embodiments described herein may be described and illustrated in the form of blocks as shown in the drawings, each block being designed to perform one or more functions. These blocks may also be referred to by names such as "unit," "module," or "device," "logic," "circuit," "controller," "counter," "comparator," "generator," "converter," etc., and may be physically implemented as analog and / or digital circuits (logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive / active components, optical components, etc.).

[0051] Articles used in this specification are intended to include one or more objects and may be used interchangeably to mean "one or more." When referring to only one object, "one" or a similar expression is used. For example, "processor" may refer to a single processor or multiple processors. Even when a processor is described to perform an operation, if additional operations are described, it implies that a single processor or multiple processors (one of them or a combination thereof) may all perform multiple operations.

[0052] The present disclosure will be described in more detail below with reference to the drawings.

[0053] FIG. 1 is a block diagram showing the configuration of an electronic device according to the present embodiment of the present disclosure. An electronic device (100) according to various embodiments of the present disclosure may include a user input unit (110), a camera (120), a microphone (130), a sensor (140), a display (150), a memory (160), a communication interface (170), and a processor (190), as shown in FIG. 1. However, this is merely one embodiment, and it is understood that some components may be removed or added depending on the type of electronic device (100). For example, if the electronic device (100) is implemented as a set-top box (STB), the electronic device (100) may not include a display (150).

[0054] The user input unit (110) is configured to receive user input for controlling the electronic device (100) and may include a button, lever, switch, touch interface, keyboard, mouse, etc. In particular, the user input unit (110) may include a remote control including directional keys for moving in four directions (e.g., up, down, right, left) and keys for selection. Meanwhile, "user input" may be referred to by various terms such as "user command," "user interaction," etc., but is not limited thereto.

[0055] The camera (120) can capture still images and / or video. A camera (120) according to various embodiments of the present disclosure may include one or more lenses, an image sensor, an image signal processor, and a flash. One or more lenses may include a telephoto lens, a wide-angle lens, and a super-wide-angle lens disposed on the surface of the electronic device (100), and may include a three-dimensional depth lens, but is not limited thereto. Alternatively, the camera (120) may be disposed on the surface (e.g., rear or front) of the electronic device (100), but is not limited to such configurations. For example, various embodiments according to the present disclosure may be implemented by a camera (120) that exists separately outside the electronic device (100).

[0056] In one embodiment of the present disclosure, the camera (120) can photograph a user and acquire an image including a user gesture for controlling an electronic device (100). For example, the camera (120) can photograph a gesture including a user's hand movement.

[0057] A microphone (130) may refer to a device capable of detecting sound and converting it into an electrical signal. For example, the microphone (130) may detect voice in real time and convert the detected voice into an electrical signal, allowing the electronic device (100) to perform an action corresponding to the electrical signal. The microphone (130) may include a TTS module or an STT module. The microphone (130) may be included as a component of the electronic device (100) and / or as a component of an input device.

[0058] In one embodiment of the present disclosure, the microphone (130) may receive user voice for controlling a UI for pattern input. For example, the user voice may include a plurality of numbers and / or words.

[0059] The sensor (140) can detect the state of the electronic device (100) (e.g., movement) and / or the state of an external environment (e.g., user state) and generate an electrical signal and / or data value corresponding to the detected state. The sensor (140) may include, for example, a gesture sensor, an accelerometer, etc., but is not limited thereto.

[0060] Additionally, the sensor (140) may include a Time of Flight (ToF) sensor, such as an infrared sensor or an ultrasonic sensor, to obtain information about the distance to an object (e.g., a user's hand), but is not limited thereto.

[0061] The display (150) may be composed of or include various types of display panels, such as an LCD (Liquid Crystal Display) panel, an OLED (Organic Light Emitting Diodes) panel, an AM-OLED (Active-Matrix Organic Light-Emitting Diode), an LcoS (Liquid Crystal on Silicon), a QLED (Quantum dot Light-Emitting Diode) and DLP (Digital Light Processing), a PDP (Plasma Display Panel) panel, an inorganic LED panel, and a micro LED panel, but is not limited thereto. In one embodiment, the display (150) may form a touchscreen together with a touch panel. Alternatively, the display (150) may be composed of or include a flexible panel.

[0062] In one embodiment of the present disclosure, a display (150) may display a UI for pattern input. Here, the pattern input UI may include a plurality of UI elements and may be a UI for inducing (and receiving) the selection of a plurality of UI elements in succession. That is, the pattern input UI may receive not only information regarding the order in which a plurality of UI elements are to be displayed, but also information regarding which UI element has been selected, which may be different from the related password input UIs. Accordingly, user authentication can be performed using the pattern input UI in a manner that is more secure compared to the related password input UI. In one embodiment of the present disclosure, the pattern input UI may include a plurality of UI elements, and each of the plurality of UI elements may include an indicator (or icon) such as a number or a character, but is not limited thereto.

[0063] In one embodiment of the present disclosure, the display (150) may display a number UI along with a pattern input UI. As described below with reference to FIG. 4a, FIG. 4b and FIG. 5, the number UI may be a UI that displays a plurality of numbers in a row.

[0064] The memory (160) may store an operating system (OS) for controlling the overall operation of the components of the electronic device (100) and instructions and / or data related to the components of the electronic device (100). That is, the memory (160) may include a plurality of modules for controlling a pattern input UI. For example, when a plurality of modules for controlling a pattern input UI are executed, the electronic device (100) may load data for various modules to perform various operations stored in non-volatile memory into volatile memory. In the present disclosure, loading means the operation of retrieving data stored in non-volatile memory so that the processor (190) can access it, and storing the retrieved data in volatile memory.

[0065] The memory (160) may be composed of or include non-volatile memory (e.g., hard disk, SSD (Solid state drive), flash memory), volatile memory (memory within the processor (190)), etc.

[0066] In one embodiment, the memory (160) may store preset pattern information for performing user authentication. For example, if the preset pattern information matches the pattern information entered through the pattern input UI, the electronic device (100) may perform user authentication.

[0067] The communication interface (170) includes at least one circuit and can communicate with various types of external devices and / or servers. The communication interface (170) may be composed of or include at least one of a BLE (Bluetooth Low Energy) module, a Wi-Fi communication module, a cellular communication module, a 3G (3rd generation) mobile communication module, an Ultra Wideband (UWB) communication module, a 4G (4th generation) mobile communication module, a 4G LTE (Long Term Evolution) communication module, and a 5G (5th generation) mobile communication module.

[0068] In one embodiment of the present disclosure, the communication interface (170) can communicate with an external user terminal and can transmit pattern information entered on the pattern input UI to the external user terminal.

[0069] An input / output (I / O) interface (180) may include a configuration for inputting and / or outputting at least one of an audio or video signal. For example, the input / output interface (180) may include an HDMI (High Definition Multimedia Interface). Alternatively, the input / output interface (180) may include at least one of an interface such as MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), or DVI (Digital Visual Interface). For example, the input / output interface (180) may include a first port for inputting and / or outputting only an audio signal and a second port for inputting and / or outputting only a video signal as separate ports. Alternatively, the input / output interface (180) may include one or more ports for inputting and / or outputting both an audio signal and a video signal. In one embodiment, the electronic device (100) can acquire at least one input image through an input / output interface (180).

[0070] The processor (190) can control the overall operation of the electronic device (100) according to at least one instruction stored in memory (160).

[0071] In one embodiment, the processor (190) may include one or more processors. For example, one or more processors may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. One or more processors may control one or any combination of other components of an electronic device and may perform operations or data processing related to communication. One or more processors may execute one or more programs or instructions stored in memory individually or collectively. For example, one or more processors may perform a method according to one embodiment of the present disclosure by executing one or more instructions stored in memory individually or collectively.

[0072] That is, in the case of a method including multiple operations, the multiple operations may be performed by a single processor or by multiple processors. For example, if a first operation, a second operation, and a third operation are to be performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence (AI) dedicated processor).

[0073] One or more processors may be implemented as a single-core processor comprising one core, or as one or more multicore processors comprising multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, but is not limited thereto, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and / or execute program instructions for implementing a method according to one embodiment of the present disclosure, and may also read and / or execute program instructions for implementing a method in a manner in which all (or some) of the multiple cores are linked.

[0074] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0075] In embodiments of the present disclosure, the processor (190) may mean a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator or machine learning accelerator, etc., but the embodiments of the present disclosure are not limited thereto.

[0076] For example, the processor (190) can display a pattern input UI including a plurality of UI elements on the display (150) by executing at least one instruction, and when a first user input including a first command instructing to perform a first selection while focus is placed on a first UI element among the plurality of UI elements, the first UI element can be displayed in a manner distinguished from the remaining UI elements among the plurality of UI elements, and when a second user input including a second command instructing to perform a first movement in a first direction while the first UI element is selected, the focus can be moved from the first UI element to a second UI element among the plurality of UI elements arranged in a first direction from the first UI element, and a first guide trajectory coupling the first UI element and the second UI element can be displayed, and when a third user input including a third command instructing to perform a second selection while focus is placed on the second UI element and the first guide trajectory is displayed, the first and second UI elements are the remaining UI elements among the plurality of UI elements It can be displayed in a way that is distinct from the element, and the first guide trajectory can be changed to the first selection trajectory.

[0077] According to one or more embodiments, when a fourth user input including a move command in a second direction is received while the focus is placed on a second UI element and a first guide line is displayed, the processor (190) may move the focus to a third II element located in the second direction of the second UI element and display a second guide trajectory connecting the first UI element and the third UI element.

[0078] According to one or more embodiments, if the second direction is the same direction as the first direction, the second guide trajectory may be a trajectory connecting the first UI element, the second UI element, and the third UI element. In this embodiment, when a fifth user input including a selection command is received while the focus is placed on the third UI element and the second guide line connecting the first UI element, the second UI element, and the third UI element is displayed, the processor (190) may display the first UI element, the second UI element, and the third UI element in a manner distinct from other UI elements and change the second guide trajectory to a second selection trajectory.

[0079] According to one or more embodiments, if the second direction is a diagonal direction of the first direction, the second guide trajectory may be a trajectory connecting only the first UI element and the third UI element located diagonally opposite the first UI element. However, embodiments according to the present disclosure are not limited thereto, and the second direction may be a direction perpendicular to the first direction, and the second guide trajectory accordingly may be a trajectory connecting only the first UI element and the third UI element positioned perpendicular to the first direction from the first UI element. In such embodiments, when a sixth user input including a selection command is received while the focus is placed on the third UI element and the second guide line connecting the first UI element and the third UI element is displayed, the processor (190) may display the first UI element and the third UI element in a manner distinguishable from other UI elements and change the second guide trajectory to a third selection trajectory.

[0080] According to one or more embodiments, when the processor (190) changes the first guide trajectory to the first selection trajectory, it can change and display the first selection trajectory while providing a feedback effect that changes the color of the first guide trajectory.

[0081] In one or more embodiments, a plurality of UI elements may include numbers corresponding to the UI elements. The processor (190) may display a number UI for selecting numbers using directional keys together with a pattern input UI on the display (150). In this embodiment, when a number included in the number UI is selected once, the processor (190) receives user input including a command to move in the direction of the selected number, and when a number included in the number UI is selected twice, the processor (190) may receive user input including a command to select the selected number.

[0082] FIGS. 2a and 2b are flowcharts illustrating a method for controlling a UI for pattern input according to one embodiment of the present disclosure.

[0083] Referring to FIGS. 2a and 2b, each operation of the method (200) for controlling the pattern input UI may be performed sequentially, but may not necessarily be performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0084] According to one embodiment, S205 to S285 can be performed by a processor (e.g., processor (190) of FIG. 1) of an electronic device (e.g., electronic device (100) of FIG. 1).

[0085] According to the control method (200), the electronic device (100) can display a pattern input UI including a plurality of UI elements (S205). Referring to FIG. 3a, an example of a pattern input UI is illustrated. As illustrated in FIG. 3a, the pattern input UI (310) may include a plurality of UI elements that can be arranged in a square shape (e.g., a first UI element (311), a second UI element (312), a third UI element (313), a fourth UI element (314), a fifth UI element (315), a sixth UI element (316), a seventh UI element (317), an eighth UI element (318), a ninth UI element (319)). However, embodiments of the present disclosure are not limited thereto, and the pattern input UI (310) may include UI elements of a different number (e.g., a number less than or greater than 9). As another example, the pattern input UI (310) may include other UI elements (e.g., 0, *, #, AZ, etc.). Each of the multiple UI elements (311 to 319) may include a corresponding number. For example, as illustrated in FIG. 3a, the first UI element (311) may correspond to the number 1, the second UI element (312) may correspond to the number 2, the third UI element (313) may correspond to the number 3, the fourth UI element (314) may correspond to the number 4, the fifth UI element (315) may correspond to the number 5, the sixth UI element (316) may correspond to the number 6, the seventh UI element (317) may correspond to the number 7, the eighth UI element (318) may correspond to the number 8, and the ninth UI element (319) may correspond to the number 9.

[0086] The electronic device (100) can display a pattern input UI (310) such that the focus is positioned on the first UI element (311) among a plurality of UI elements (311 to 319) (S210). The focus can serve as an indicator to guide the user to the currently selectable element among the plurality of UI elements (311 to 319). In one embodiment, the focus may be displayed on the outer edge of the UI element. For example, as shown in FIG. 3b, the focus may be positioned on the first UI element (311) among the plurality of UI elements (311 to 319), and the focus may be indicated by displaying the first UI element (311) with a thicker border compared to the border of the remaining UI elements among the plurality of UI elements (311 to 319). However, the embodiment according to the present disclosure is not limited thereto, and the focus may be positioned on the UI element where the focus was most recently positioned among the plurality of UI elements (311 to 319). Alternatively, the focus may be placed on a UI element specified by the user. As another example, the focus can be indicated by modifying one or more attributes of the selected UI element (e.g., size, shape, color, font, etc.). Here, the focus may be referred to as a highlight, etc.

[0087] The electronic device (100) can identify whether a first user input including a selection command has been received (or acquired, input, etc.) (S215). The first user input including a selection command may include user input that selects or presses a key or button (e.g., "Enter" button, "Select" button, etc.) that may be included in an input device (e.g., remote control, keyboard, touch screen, etc.) of the electronic device (100).

[0088] When a first user input including a selection command is received (S215-Y), the electronic device (100) may display the first UI element (311) in a manner distinct from other UI elements (312 to 319). Alternatively, if it is identified that the first user input has not been received (S215-N), the electronic device (100) may return to the S210 operation and wait for the first user input.

[0089] In one or more embodiments, as illustrated in FIG. 3b, when a first user input including a selection command is received while focus is displayed on a first UI element (311) (S215-Y), the electronic device (100) may display the selected first UI element (311) in a manner distinct from other (or remaining) UI elements (312 to 319), as illustrated in FIG. 3c. For example, the electronic device (100) may display the first UI element (311) distinct from other UI elements (312 to 319) by adjusting the brightness, color, saturation, etc. of the selected first UI element (311).

[0090] The electronic device (100) may receive a second user input including a command to move in a first direction (S225). The second user input including a command to move in a first direction may include a user input selecting a first direction among the direction buttons included in the remote control. However, embodiments of the present disclosure are not limited thereto.

[0091] The electronic device (100) can move the focus onto a second UI element (312) located in a first direction of a first UI element (311) and display a first guide trajectory connecting the first UI element (311) and the second UI element (312) (S230). The guide trajectory may include a line to guide the selected trajectory when the user selects the UI element where the focus is located (e.g., the first UI element (311)). In one or more embodiments, as illustrated in FIG. 3c, when user input to move to the right is received while the first UI element (311) is selected, the electronic device (100) may move the focus to the second UI element (312) located to the right of the first UI element (311), as illustrated in FIG. 3d, and display a first guide trajectory (320) connecting the first UI element (311) and the second UI element (312).

[0092] The electronic device (100) can identify whether a third user input including a selection command has been received (S235). The first user input including a selection command may include a user input selecting an "Enter" button and / or a "Select" button that may be included in a remote control. However, embodiments of the present disclosure are not limited thereto.

[0093] When a third user input including a selection command is received (S235-Y), the electronic device (100) may display the first and second UI elements (311, 312) in a manner distinct from other UI elements (313 to 319) and change the first guide trajectory (320) to the first selection trajectory (330) and display it (S240). Alternatively, if it is identified that the third user input has not been received (S235-N), the electronic device (100) may proceed with the S245 operation.

[0094] In one or more embodiments, as illustrated in FIG. 3d, when a first UI element (311) is selected and a third user input including a selection command is received while focus is placed on a second UI element (312) (S235-Y), the electronic device (100) may display the first and second UI elements (311, 312) in a manner distinct from other UI elements (313 to 319), as illustrated in FIG. 3e, and change the first guide trajectory (320) to a first selection trajectory (330). The selection trajectory may represent a line indicating a trajectory selected by the user input including the selection command. In one embodiment, the selection trajectory may be displayed in a manner different from the way the guide trajectory is displayed. For example, as illustrated in FIG. 3d and FIG. 3e, the first guide trajectory (320) may be displayed thinner than the first selection trajectory (330). However, embodiments of the present disclosure are not limited thereto, and the color, brightness, blinking speed, etc. of the first guide trajectory (320) and the first selection trajectory (330) may be displayed differently.

[0095] According to one embodiment of the present disclosure, the electronic device (100) may provide a feedback effect when changing the first guide trajectory (320) to the first selection trajectory (330). For example, the electronic device (100) may change and display the first selection trajectory (330) while providing a feedback effect that changes the color of the first guide trajectory (320). However, the embodiments of the present disclosure are not limited thereto, and the electronic device (100) may change and display the first guide trajectory (320) to the first selection trajectory (330) while providing a feedback effect that changes the thickness, brightness, blinking speed, etc. of the first guide trajectory (320). Here, the feedback effect may be referred to as an image effect, trajectory feedback, etc.

[0096] If a third user input including a selection command is not received (S235-N), the electronic device (100) may receive a fourth user input including a movement command to a second direction (S245). The electronic device (100) may perform different operations depending on whether the second direction is the same direction as the first direction or a diagonal direction of the first direction.

[0097] If the second direction is the same direction as the first direction (S250-Y), the electronic device (100) may place the focus on the third UI element (313) and display a second guide trajectory connecting the first, second, and third UI elements (311 to 313) (S255). In one or more embodiments, as shown in FIG. 3d, when the first UI element (311) is selected and a fourth user input including a command to move to the right is received while the focus is placed on the second UI element (312) (S250-Y), the electronic device (100) may place the focus on the third UI element (313) and display a second guide trajectory (340) connecting the first to third UI elements (311 to 313), as shown in FIG. 3f.

[0098] The electronic device (100) can receive a fifth user input including a selection command (S260).

[0099] The electronic device (100) can display the first UI element (311), the second UI element (312), and the third UI element (313) in a manner distinct from other UI elements (e.g., 314 to 319) in response to a selection command, and change the second guide trajectory (340) into the second selection trajectory (350) and display it (S265). In one embodiment of the present disclosure, as shown in FIG. 3f, when a user input including a selection command is received while the focus is placed on the third UI element (313) and the second guide trajectory (340) is displayed on the first to third UI elements (311 to 313), the electronic device (100) may display the first UI element (311), the second UI element (312), and the third UI element (313) in a manner distinct from other UI elements (314 to 319), as shown in FIG. 3g, and change the second guide trajectory (340) into a second selection trajectory (350). By simultaneously selecting the first to third UI elements (311 to 313) in the same manner as the S255 to S265 operation (e.g., selecting from the same input), a multi-selection input can be made to simultaneously select the first to third UI elements (311 to 313) without a direct command to select the second UI element (312). By doing so, a selection trajectory connecting the first to third UI elements (311 to 313) can be entered more easily.

[0100] If the second direction is not the same as the first direction (S250-N), the second direction may be a diagonal direction of the first direction (S270).

[0101] In this case, the electronic device (100) may place focus on the fifth UI element (315) and display a third guide trajectory (360) connecting the first and fifth UI elements (311, 315) (S275). In one or more embodiments, as shown in FIG. 3d, when the first UI element (311) is selected and a fourth user input including a command to move downward is received while focus is placed on the second UI element (312), the electronic device (100) may place focus on the fifth UI element (315) located diagonally opposite the first UI element (311), as shown in FIG. 3h, and display a third guide trajectory (360) connecting the first and fifth UI elements (311, 315).

[0102] And, the electronic device (100) can receive a sixth user input including a selection command (S280).

[0103] The electronic device (100) can display the first UI element (311) and the fifth UI element (315) in a manner distinct from other UI elements (e.g., 312, 313, 314, 316 to 319) in response to a selection command, and change the third guide trajectory (360) into the third selection trajectory (370) and display it (S280). In one embodiment of the present disclosure, as shown in FIG. 3h, when a user input including a selection command is received while the focus is placed on the fifth UI element (315) and the third guide trajectory (360) is displayed on the first and fifth UI elements (311, 315), the electronic device (100) may display the first UI element (311) and the fifth UI element (315) in a manner distinct from other UI elements (312, 313, 314, 316 to 319), as shown in FIG. 3i, and change the third guide trajectory (360) into a third selection trajectory (370). By selecting the first and fifth UI elements (311, 315) located diagonally in a manner similar to operations S270 to S285, a selection trajectory connecting UI elements located diagonally rather than in a straight line can be more easily input.

[0104] As described with reference to FIG. 3h and FIG. 3i, FIG. 2b illustrates an example in which the second direction is diagonal to the first direction and the fifth UI element (315) is selected (S270 to S285), but embodiments of the present disclosure are not limited thereto. For example, the second direction may be perpendicular to the first direction and the fourth UI element (314) may be selected.

[0105] That is, the electronic device (100) can input a pattern trajectory for user authentication by selecting a plurality of selection trajectories through direction movement commands and selection commands, as described in FIGS. 3a to 3i. Then, the electronic device (100) can perform user authentication by comparing the input pattern trajectory with a previously stored pattern trajectory.

[0106] According to one or more embodiments, as described with reference to FIGS. 4a to 5, the electronic device (100) may display a number UI for selecting a number using a directional key together with a pattern input UI.

[0107] As illustrated in FIG. 4a, the electronic device (100) may display a number UI (420) for selecting numbers using directional keys together with a pattern input UI (410). The pattern input UI (410) may include or be similar in many respects to the pattern input UI (310) described with reference to FIG. 2a, FIG. 2b and FIG. 3a through FIG. 3i, and may include additional features not described above. Therefore, for convenience, a repetitive description of the pattern input UI (410) with reference to FIG. 2a, FIG. 2b and FIG. 3a through FIG. 3i may be omitted.

[0108] The pattern input UI (410) and the number UI (420) may include corresponding numbers. Additionally, the electronic device (100) can input a pattern on the pattern input UI (410) by selecting one or more numbers from a plurality of numbers included in the number UI (420) through a directional key and a selection key.

[0109] For example, when multiple user inputs are received, such as selecting number 1, selecting number 3, selecting number 5, selecting number 7, and selecting number 9 through the number UI (420), the electronic device (100) can display a pattern trajectory corresponding to the multiple user inputs on the pattern input UI (410) as illustrated in FIG. 4b. In one embodiment, the electronic device (100) can select numbers using a directional key and a selection key. That is, when multiple user inputs are received such that the focus is placed on number 1 and the selection key is selected, the focus is moved to number 3 via the arrow key and the selection key is selected while the focus is placed on number 3, the focus is moved to number 5 via the arrow key and the selection key is selected while the focus is placed on number 5, the focus is moved to number 7 via the arrow key and the selection key is selected while the focus is placed on number 7, the focus is moved to number 9 via the arrow key and the selection key is selected while the focus is placed on number 9, the electronic device (100) can receive multiple user inputs such as selecting number 1, selecting number 3, selecting number 5, selecting number 7, and selecting number 9.

[0110] And, the electronic device (100) can perform user authentication by identifying whether the input pattern trajectory and the stored pattern trajectory match.

[0111] FIG. 5 is a flowchart illustrating a method for performing user authentication using a pattern input UI and a number UI according to one embodiment of the present disclosure.

[0112] Referring to FIG. 5, each operation of the method (500) for performing user authentication may be performed sequentially, but it is not necessary to perform them sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0113] According to one embodiment, S510 to S570 can be performed by a processor (e.g., processor (190) of FIG. 1) of an electronic device (e.g., electronic device (100) of FIG. 1).

[0114] The electronic device (100) can display a number UI along with a pattern input UI (S510). In one or more embodiments, the electronic device (100) can display a pattern input UI (410) and a number UI (420) together, as shown in FIG. 4a.

[0115] The electronic device (100) can identify whether a number included in the number UI has been selected once (S520). For example, a number included in the number UI can be selected using the number keys included in the remote control, or can be selected via the directional keys and the select key.

[0116] When a number included in the number UI is selected once (S520-Y), the electronic device (100) can move the highlight to the selected number (S530). That is, when a number included in the number UI is selected once, the electronic device (100) can move the highlight (or focus) of the number UI (420) to the selected number. For example, when 3 among the numbers included in the number UI is selected once, the electronic device (100) can move the highlight to 3 among the numbers included in the number UI (420). Or, if a number included in the number UI is not selected (S520-N), the electronic device (100) can return to the S520 operation and wait for a selection.

[0117] The electronic device (100) can identify whether a number included in the number UI has been selected once more (S540). For example, a number included in the number UI can be selected once more (e.g., twice) using the number keys included in the remote control, or can be selected once more (e.g., twice) through the selection key.

[0118] If a number included in the number UI is selected one more time (e.g., twice) (S540-Y), the electronic device (100) can select the selected number (S550). That is, the electronic device (100) can select the number where the highlight (or focus) is located. Alternatively, if a number included in the number UI is not selected one more time (S540-N), the electronic device (100) can return to the S520 operation and wait for a selection.

[0119] The electronic device (100) can identify whether it matches a previously stored pattern (S560). That is, the electronic device (100) can identify whether the pattern obtained through the selected number matches a previously stored pattern.

[0120] If the acquired pattern does not match a previously stored pattern (S560-N), the electronic device (100) may return to the S520 operation and perform the S520 to S550 operations to acquire pattern information. The electronic device (100) may acquire pattern information by selecting multiple numbers in this manner.

[0121] If the acquired pattern matches a previously stored pattern (S560-Y), the electronic device (100) can authenticate the user (S570).

[0122] The method (500) illustrated in FIG. 5 describes a method for authenticating a user based on a pattern obtained using a numeric UI (420) together with a pattern input UI (410), but embodiments of the present disclosure are not limited thereto. For example, S560 and S570 may be performed using pattern information obtained in a manner similar to the pattern input UI (310) described with reference to FIG. 2a, 2b and FIG. 3a through 3i.

[0123] According to one embodiment of the present disclosure, an electronic device (100) can perform user authentication through pattern input in conjunction with a user terminal, as described with reference to FIGS. 6 to 7b.

[0124] FIG. 6 is a drawing illustrating an electronic device and a user terminal according to an embodiment of the present disclosure. The user terminal (600) may include a smartphone as shown in FIG. 6. However, the embodiment of the present disclosure is not limited thereto and may be implemented as various user terminals such as a tablet, a laptop, a PC, etc.

[0125] In one embodiment, an electronic device (100) and a user terminal (200) can be connected to each other for communication. For example, when the electronic device (100) and the user terminal (200) are in close proximity, the electronic device (100) and the user terminal (200) can be connected to each other for communication via a short-range wireless communication interface (e.g., Bluetooth).

[0126] Referring to FIG. 7a, the electronic device (100) may display a pattern input UI (710), and a user may input a pattern trajectory using the method described in FIG. 2a, FIG. 2b, FIG. 3a to FIG. 3i, FIG. 4a, FIG. 4b, and FIG. 5. That is, the pattern input UI (710) may be similar to the pattern input UI (310) and pattern input UI (410) described with reference to FIG. 2a, FIG. 2b, FIG. 3a to FIG. 3i, FIG. 4a, FIG. 4b, and FIG. 5, and may include additional features not described above. Accordingly, for convenience, a repetitive description of the pattern input UI (710) described with reference to FIG. 2a, FIG. 2b, FIG. 3a to FIG. 3i, FIG. 4a, FIG. 4b, and FIG. 5 may be omitted.

[0127] In one embodiment, a user terminal (600) may request information about a pattern trajectory previously entered from an electronic device (100). For example, the user terminal (600) may request information about a pattern trajectory based on user input for drawing a pattern trajectory. However, embodiments of the present disclosure are not limited thereto. For example, when the user terminal (600) approaches the electronic device (100), the user terminal (600) may request information about a pattern trajectory previously entered from the electronic device (100).

[0128] When the electronic device (100) accepts a request received from a user terminal (600), the electronic device (100) can transmit information about a previously entered pattern trajectory to the user terminal (600). For example, the electronic device (100) can accept the request through user input. However, embodiments of the present disclosure are not limited thereto, and the electronic device (100) can accept the request if the user terminal (600) is a terminal previously registered with the electronic device (100).

[0129] In one embodiment, the user terminal (600) may receive pattern information including a previously entered pattern trajectory. For example, as shown in (A) of FIG. 7b, the user terminal (600) may display a guidance message (720) such as "Please continue entering the pattern on the mobile."

[0130] As illustrated in (B) of FIG. 7b, the user terminal (600) can display a pattern input UI (730) and a previously entered pattern trajectory based on information regarding a previously entered pattern trajectory included in the received pattern information. The pattern input UI (730) may be similar to the pattern input UI (310), pattern input UI (410), and pattern input UI (710) described with reference to FIG. 2a, FIG. 2b, FIG. 3a to FIG. 3i, FIG. 4a, FIG. 4b, FIG. 5, and FIG. 7a, and may include additional features not described above. Accordingly, for convenience, a repetitive description of the pattern input UI (730) described with reference to FIG. 2a, FIG. 2b, FIG. 3a to FIG. 3i, FIG. 4a, FIG. 4b, FIG. 5, and FIG. 7a may be omitted.

[0131] The user terminal (600) can obtain a final pattern trajectory by receiving a user input (740) (e.g., drag input) that draws the remaining pattern trajectory on the previously entered pattern trajectory, as shown in (C) of FIG. 7b.

[0132] The user terminal (600) can transmit information about the final pattern trajectory to the electronic device (100), and the electronic device (100) can perform user authentication based on whether the final pattern trajectory matches a previously stored pattern trajectory. Alternatively, the user terminal (600) can perform user authentication based on whether the final pattern trajectory matches a previously stored pattern trajectory and provide the user authentication result to the electronic device (100).

[0133] Accordingly, the electronic device (100) and the user terminal (600) can input a pattern trajectory by interacting with each other, potentially increasing user convenience.

[0134] According to one embodiment of the present disclosure, as described with reference to FIG. 8, an electronic device (100) can perform pattern input through user voice or user gesture.

[0135] FIG. 8 is a drawing illustrating an embodiment of performing pattern input through user voice according to one embodiment of the present disclosure.

[0136] In one embodiment, the electronic device (100) can perform pattern input through user voice containing numbers corresponding to (or assigned to) UI elements. For example, when the user (800) speaks, "Draw the pattern as 1, 3, 7, 9" or "Draw the pattern as 1, 2, 3, 5, 7, 8, 9," the electronic device (100) can input a pattern trajectory (810) as shown in FIG. 8 based on the user voice.

[0137] In one embodiment, when the electronic device (100) recognizes a spoken number, it can provide a feedback effect in real time (e.g., simultaneously with the spoken number). For example, when a user speaks "1" and "3", the electronic device (100) can display a selection trajectory connecting 1 and 3 after selecting "1" and "3", and can provide a feedback effect to the selection trajectory almost simultaneously.

[0138] And, the electronic device (100) can perform user authentication by identifying whether a pattern trajectory generated based on the user's voice matches a previously stored pattern trajectory.

[0139] FIG. 9 is a drawing illustrating an embodiment of performing pattern input through a user gesture according to one embodiment of the present disclosure.

[0140] The electronic device (100) can perform pattern input by selecting UI elements according to user gestures. That is, the electronic device (100) can move the focus through a hover gesture, as shown in (A) of FIG. 9. For example, the electronic device (100) can move the focus to one of a plurality of UI elements of the pattern input UI (910) (e.g., UI element (911)) through a hover gesture.

[0141] As illustrated in (B) of FIG. 9, the electronic device (100) can select the UI element where the focus is located through a grab gesture. For example, the electronic device (100) can input a pattern trajectory (940) by selecting the second UI element (922) through a grab gesture while the focus is located on the second UI element (922) of the pattern input UI (920), moving the focus to the fourth UI element (924) using a hover gesture, selecting the fourth UI element (924) through a grab gesture while the focus is located on the fourth UI element (924), moving the focus to the ninth UI element (929) using a hover gesture, and selecting the ninth UI element (929) through a grab gesture.

[0142] The electronic device (100) can authenticate a user by identifying whether the input pattern trajectory (940) matches a previously stored pattern trajectory. In one embodiment, as shown in (C) of FIG. 9, the electronic device (100) can provide a pattern input UI (930) indicating that user authentication is complete.

[0143] By using the method described above, the electronic device (100) can perform pattern input through various input methods, and thereby perform user authentication using a pattern input UI that can be displayed on a screen other than a touch screen.

[0144] Methods according to various embodiments of the present disclosure may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0145] A method according to various embodiments of the present disclosure may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions.

[0146] Meanwhile, a device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, a 'non-transitory storage medium' may include a buffer in which data is stored temporarily.

[0147] When the above instruction is executed by a processor, the processor may perform the function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or an interpreter.

[0148] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In an electronic device, display; Memory for storing instructions; and Includes a processor; When the above instructions are executed individually or collectively by the processor, the electronic device, A pattern input UI is displayed on the above display, and the pattern input UI includes a plurality of UI elements. When a first user input is received that includes a first command instructing to perform a first selection while focus is placed on a first UI element among the plurality of UI elements, the first UI element is displayed in a manner distinguishable from the remaining UI elements among the plurality of UI elements, and When a second user input is received that includes a second command instructing to perform a first movement in a first direction while the first UI element is selected, the focus is moved from the first UI element to the second UI element among the plurality of UI elements arranged in the first direction from the first UI element, and a first guide trajectory is displayed that couples the first UI element and the second UI element. An electronic device that, upon receiving a third user input including a third command instructing to perform a second selection while focus is placed on the second UI element and the first guide trajectory is displayed, displays the first and second UI elements in a manner distinguishable from the remaining UI elements among the plurality of UI elements and changes the first guide trajectory into a first selection trajectory.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the processor, the electronic device additionally, An electronic device that, when a fourth user input including a fourth command for performing a second movement in a second direction while the focus is positioned on the second UI element and the first guide trajectory is displayed is received, moves the focus from the second UI element to a third UI element among the plurality of UI elements positioned in the second direction from the second UI element, and displays a second guide trajectory coupling the first UI element and the third UI element.

3. In Paragraph 2, An electronic device in which, if the second direction is the same direction as the first direction, the second guide trajectory couples the first UI element and the second UI element with the third UI element.

4. In Paragraph 3, When the above instructions are executed individually or collectively by the processor, the electronic device additionally, An electronic device that, upon receiving a fifth user input including a fifth command to perform a third selection while the focus is placed on the third UI element and the second guide trajectory is displayed, displays the first UI element, the second UI element, and the third UI element in a manner distinguishable from the remaining UI elements among the plurality of UI elements, and changes and displays the second guide trajectory as a second selection trajectory.

5. In Paragraph 2, An electronic device in which, if the second direction is a diagonal direction of the first direction, the second guide trajectory couples only the first UI element and the third UI element positioned diagonally to the first UI element.

6. In Paragraph 5, When the above instructions are executed individually or collectively by the processor, the electronic device additionally, An electronic device that, upon receiving a sixth user input including a sixth command instructing to perform a fourth selection while focus is placed on the third UI element and the second guide trajectory is displayed, displays the first UI element and the third UI element in a manner distinguishable from the remaining UI elements among the plurality of UI elements and changes and displays the second guide trajectory as a third selection trajectory.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the processor, the electronic device additionally, An electronic device that provides a feedback effect by changing the color of the first guide trajectory when the first guide trajectory is changed to the first selection trajectory.

8. In Paragraph 1, The above plurality of UI elements includes a number corresponding to the UI element, and When the above instructions are executed individually or collectively by the processor, the electronic device additionally, An electronic device configured to display a number UI configured to select numbers using directional keys, together with the pattern input UI.

9. In Paragraph 8, When the above instructions are executed individually or collectively by the processor, the electronic device additionally, When a first number included in the above number UI is selected once, a fourth user input is received that includes a fourth command instructing to perform a second movement in the direction of the first number, and An electronic device that receives a fifth user input including a fifth command to perform a third selection for the second number when a second number included in the above number UI is selected twice.

10. In a method for controlling an electronic device, A step of displaying a pattern input UI including a plurality of UI elements on the display of the electronic device; When a first user input is received that includes a first command instructing to perform a first selection while focus is placed on a first UI element among the plurality of UI elements, the first UI element is displayed in a manner distinguishable from the remaining UI elements among the plurality of UI elements; When a second user input is received that includes a second command instructing to perform a first movement in a first direction while the first UI element is selected, the method comprises the step of moving the focus from the first UI element to a second UI element among the plurality of UI elements positioned in the first direction from the first UI element and displaying a first guide trajectory that couples the first UI element and the second UI element; and A control method comprising the step of, when a third user input is received that includes a third command instructing to perform a second selection while the focus is placed on the second UI element and the first guide trajectory is displayed, displaying the first and second UI elements in a manner distinguishable from the remaining UI elements among the plurality of UI elements, and changing and displaying the first guide trajectory as a first selection trajectory.

11. In Paragraph 10, The above control method is, A control method further comprising the step of, when a fourth user input including a fourth command for performing a second movement in a second direction while the focus is positioned on the second UI element and the first guide trajectory is displayed is received, moving the focus from the second UI element to a third UI element among the plurality of UI elements positioned in the second direction from the second UI element, and displaying a second guide trajectory coupling the first UI element and the third UI element.

12. In Paragraph 11, A control method in which, if the second direction is the same direction as the first direction, the second guide trajectory couples the first UI element and the second UI element with the third UI element.

13. In Paragraph 12, The above control method is, A control method further comprising the step of, when a fifth user input including a fifth command to perform a third selection while the focus is placed on the third UI element and the second guide trajectory is displayed is received, displaying the first UI element, the second UI element, and the third UI element in a manner distinguishable from the remaining UI elements among the plurality of UI elements, and changing and displaying the second guide trajectory as a second selection trajectory.

14. In Paragraph 11, A control method in which, if the second direction is a diagonal direction of the first direction, the second guide trajectory couples only the first UI element and the third UI element positioned diagonally to the first UI element.

15. In Paragraph 14, The above control method is, A control method further comprising the step of, when a sixth user input is received that includes a sixth command instructing to perform a fourth selection while the focus is placed on the third UI element and the second guide trajectory is displayed, displaying the first UI element and the third UI element in a manner distinguishable from the remaining UI elements among the plurality of UI elements, and changing and displaying the second guide trajectory as a third selection trajectory.

Images