Wearable electronic device and method for displaying GUI

The method for displaying GUIs on wearable electronic devices addresses the challenge of small screen size by utilizing multi-touch inputs and rotation detection to change and enhance GUI displays, improving usability and functionality.

WO2025127701A1PCT designated stage expired Publication Date: 2025-06-19SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/020257
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-02-07
Filing Date
2024-12-11
Publication Date
2025-06-19

AI Technical Summary

Technical Problem

Wearable electronic devices, such as smartwatches, face challenges in effectively operating due to their small screen size, necessitating technologies for changing watch faces, customizing bands, and enhancing display functionality.

Method used

A method for a wearable electronic device to display a GUI involves displaying a first GUI on a main display area, receiving multi-touch inputs on a sub-display area corresponding to a band portion, determining if the device is rotated, and changing the display of the first GUI accordingly, while also displaying a second preset GUI on the sub-display area if the device is not rotated.

Benefits of technology

This solution enhances the operational effectiveness of wearable electronic devices by allowing users to interact with GUIs on a small screen through multi-touch inputs and rotation detection, thereby improving usability and functionality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024020257_19062025_PF_FP_ABST
    Figure KR2024020257_19062025_PF_FP_ABST
Patent Text Reader

Abstract

Provided are a wearable electronic device and a method for displaying a GUI. The method for displaying a GUI by a wearable electronic device may comprise: an operation of displaying a first GUI on a main display area of the wearable electronic device; an operation of receiving a first user input of multi-touching a sub-display area corresponding to a band part of the wearable electronic device; an operation of receiving a second user input of moving the multi-touch while the multi-touch is maintained; an operation of determining whether the wearable electronic device is rotated while the second user input is received; and an operation of changing the display of the first GUI when it is determined that the wearable electronic device is rotated.
Need to check novelty before this filing date? Find Prior Art

Description

Wearable electronic device and method for displaying a GUI

[0001] The present disclosure relates to a wearable electronic device and method for displaying a GUI, and more particularly, to a wearable electronic device and method for displaying a GUI based on multi-touch.

[0002] With the advancement of communication technology and flexible display technology, various types of wearable electronic devices, including flexible displays, are being provided. In particular, wearable electronic devices such as smartwatches typically feature relatively small screens, making it difficult for users to effectively operate them. This necessitates the development of technologies that allow for changing watch faces, customizing watch bands, and utilizing the displays provided by the bands. Furthermore, there is a need to expand the display of wearable electronic devices and effectively present a graphical user interface (GUI) based on user input.

[0003] According to one embodiment, a method for a wearable electronic device to display a GUI may include: displaying a first GUI on a main display area of ​​the wearable electronic device (e.g., operation 400); receiving a first user input of multi-touching a sub-display area corresponding to a band portion of the wearable electronic device (e.g., operation 410); receiving a second user input of moving the multi-touch while the multi-touch is maintained (e.g., operation 420); determining whether the wearable electronic device has been rotated while the second user input is being received; and changing the display of the first GUI if it is determined that the wearable electronic device has been rotated (e.g., operation 450). In addition, the method may include displaying a second GUI preset in relation to the first GUI on the sub-display area if it is determined that the wearable electronic device has not been rotated (e.g., operation 440).

[0004] Additionally, according to one embodiment, one or more displays (e.g., 1060, 2360) providing a main display area and a sub-display area; one or more sensors (e.g., 1076, 2376); a memory (e.g., 1030, 1076) storing commands; And one or more processors (e.g., 1020, 2320); wherein the instructions stored in the memory, when executed by the one or more processors, cause the wearable electronic device to: display a first GUI on the main display area of ​​the wearable electronic device, receive a first user input of multi-touching on the sub-display area corresponding to a band portion of the wearable electronic device, receive a second user input of moving the multi-touch while the multi-touch is maintained, and control the one or more sensors to determine whether the wearable electronic device has been rotated while the second user input is being received, and change the display of the first GUI if it is determined that the wearable electronic device has been rotated. In addition, the wearable electronic device can be provided to display a second GUI preset in relation to the first GUI on the sub-display area if it is determined that the wearable electronic device has not been rotated.

[0005] In addition, according to one embodiment, a computer-readable recording medium having recorded thereon a program for executing a method for displaying a GUI, the method comprising: displaying a first GUI on a main display area of ​​a wearable electronic device; receiving a first user input of multi-touching a sub-display area corresponding to a band portion of the wearable electronic device; receiving a second user input of moving the multi-touch while the multi-touch is maintained; determining whether the wearable electronic device has been rotated while the second user input is being received; changing the display of the first GUI when it is determined that the wearable electronic device has been rotated; and displaying a second GUI preset in relation to the first GUI on the sub-display area when it is determined that the wearable electronic device has not been rotated.

[0006] In addition, according to one embodiment, a method for a wearable electronic device to display a GUI may include: an operation of displaying a first GUI on a main display area of ​​the wearable electronic device (e.g., operation 400); an operation of receiving a first user input of multi-touching on a sub-display area of ​​the wearable electronic device (e.g., operation 410); an operation of receiving a second user input of moving the multi-touch while the multi-touch is maintained (e.g., operation 420); an operation of determining whether the wearable electronic device is rotated while the second user input is received; and an operation of changing the display of the first GUI based on whether the wearable electronic device is rotated (e.g., operation 450).

[0007] FIG. 1 is a diagram for explaining an overview of how a GUI displayed on a wearable electronic device changes according to a user input for the wearable electronic device according to one embodiment.

[0008] FIG. 2 is a drawing for explaining a main display area and a sub-display area of ​​a wearable electronic device according to one embodiment.

[0009] FIG. 3 is a drawing for explaining a main display area and a sub-display area of ​​a wearable electronic device according to one embodiment.

[0010] FIG. 4 is a flowchart of a method for displaying a GUI on a wearable electronic device according to a user input, according to one embodiment.

[0011] FIG. 5 is a diagram illustrating an example of a user input moving multi-touch for a wearable electronic device according to one embodiment.

[0012] FIG. 6 is a diagram illustrating an example of a user input moving a portion of a multi-touch for a wearable electronic device according to one embodiment.

[0013] FIG. 7 is a diagram illustrating an example of a user input moving a portion of a multi-touch for a wearable electronic device according to one embodiment.

[0014] FIG. 8 is a diagram illustrating an example of a user input for rotating a wearable electronic device according to one embodiment.

[0015] FIG. 9 is a diagram illustrating an example of a multi-touch movement on a wearable electronic device according to a user input of rotating the wearable electronic device according to one embodiment.

[0016] FIG. 10 is a diagram illustrating an example of maintaining multi-touch on a wearable electronic device according to a user input of rotating the wearable electronic device according to one embodiment.

[0017] FIG. 11 is a flowchart of a method for a wearable electronic device according to one embodiment to display a second GUI related to a first GUI in response to a user input moving a multi-touch.

[0018] FIG. 12 is a flowchart of a method for changing the display of a first GUI according to a user input of rotating the wearable electronic device according to one embodiment.

[0019] FIG. 13 is a flowchart of a method for displaying a GUI when multi-touch is released for a wearable electronic device according to one embodiment.

[0020] FIG. 14 is a diagram illustrating an example in which, when a notification is generated in a wearable electronic device according to one embodiment, the first GUI of the watch application is switched to the second GUI of the application in which the notification is generated as the multi-touch on the sub-display area is moved.

[0021] FIG. 15 is a diagram illustrating an example in which a first GUI of a watch application changes as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0022] FIG. 16 is a diagram illustrating an example in which a second GUI including weather information is additionally displayed as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0023] FIG. 17 is a diagram illustrating an example in which a second GUI including detailed weather information is additionally displayed on a first GUI of a weather application as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0024] FIG. 18 is a diagram illustrating an example in which a second GUI including detailed schedule information is additionally displayed on a first GUI of a schedule application as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0025] FIG. 19 is a diagram illustrating an example in which a first GUI of a watch application is changed and the changed first GUI is maintained as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment and the wearable electronic device is rotated.

[0026] FIG. 20 is a diagram illustrating an example of a first GUI displayed on a wearable electronic device rotating as a multi-touch is moved on a sub-display area of ​​the wearable electronic device according to one embodiment.

[0027] FIG. 21 is a diagram illustrating an example in which a first GUI displayed on a wearable electronic device is rotated and the rotated first GUI is fixed as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment and the wearable electronic device is rotated.

[0028] FIG. 22 is a diagram illustrating an example in which, when a notification is generated in a wearable electronic device according to one embodiment, a GUI of an application in which a notification is generated is displayed and fixed in the sub-display area as a multi-touch on the sub-display area is moved by rotation of the wearable electronic device.

[0029] FIG. 23 is a block diagram of a wearable electronic device according to one embodiment.

[0030] FIG. 24 is a block diagram of an electronic device within a network environment according to various embodiments.

[0031] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0032] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, for the purpose of clearly explaining the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar parts are designated with similar reference numerals throughout the specification.

[0033] The terms used in this disclosure are described as currently common terms, taking into account the functions mentioned herein. However, these terms may mean various other terms depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but rather based on the meanings of the terms and the overall content of this disclosure.

[0034] Additionally, while terms such as first, second, etc. may be used to describe various components, the components should not be limited by these terms. These terms are used to distinguish one component from another.

[0035] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where the parts are "directly connected" but also the cases where the parts are "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather includes other components, unless otherwise stated.

[0036] The phrases “in one embodiment” and the like appearing in various places throughout this disclosure do not necessarily all refer to the same embodiment.

[0037] An embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented by algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations.

[0038] Additionally, the connecting lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and / or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.

[0039] The present disclosure will be described in detail with reference to the attached drawings below.

[0040] FIG. 1 is a diagram for explaining an overview of how a GUI displayed on a wearable electronic device changes according to a user input for the wearable electronic device according to one embodiment.

[0041] Referring to FIG. 1, when a wearable electronic device (1000) is worn on a user's wrist, the wearable electronic device (1000) can display a first GUI (graphical user interface) on a main display area (10) of the wearable electronic device (1000). The first GUI may be a GUI provided by an application installed on the wearable electronic device (1000).

[0042] In a state where a first GUI is displayed on a main display area (10) of a wearable electronic device (1000), the wearable electronic device (1000) can receive a user's touch input to a band portion of the wearable electronic device (1000). The band portion of the wearable electronic device (1000) can include a sub-display area, and for example, the wearable electronic device (1000) can receive a multi-touch input including a first touch to a first portion (11) of the sub-display area and a second touch to a second portion (12) of the sub-display area. In addition, the user can move at least one of the first touch and the second touch, and the wearable electronic device (1000) can detect the movement of at least one of the first touch and the second touch.

[0043] Additionally, as the user's wrist rotates (13), the wearable electronic device (1000) can detect rotation about an axis corresponding to the user's forearm.

[0044] The wearable electronic device (1000) may change the first GUI displayed on the wearable electronic device (1000) based on at least one of movement of a multi-touch input or rotation of the wearable electronic device (1000). For example, the wearable electronic device (1000) may additionally display a second GUI related to the first GUI or change the display of the first GUI.

[0045] A wearable electronic device (1000) is an electronic device worn by a user, and may be, for example, an electronic device worn on the user's body or clothing. For example, the wearable electronic device (1000) may be, for example, a smart watch, a wearable computer, smart glasses, and smart wear. However, the present invention is not limited thereto, and the wearable electronic device (1000) may include any type of device that can be worn by a user and provide visual feedback to the user.

[0046] FIG. 2 is a drawing for explaining a main display area and a sub-display area of ​​a wearable electronic device according to one embodiment.

[0047] Identification number 2a of FIG. 2 is a drawing showing a wearable electronic device (1000) viewed from the front, identification number 2b is a drawing showing a wearable electronic device (1000) viewed from the side, and identification number 2c is a drawing showing a side view of a wearable electronic device (1000) worn by a user.

[0048] Referring to FIG. 2, a wearable electronic device (1000) may include at least one display (20), a body (26), and a fastening portion (27, 28).

[0049] At least one display (20) may include a main display area (21) and sub-display areas (22, 23). The main display area (21) and the sub-display areas (22, 23) may be implemented as a single display, but are not limited thereto. For example, the main display area (21) and the sub-display areas (22, 23) may be implemented by two or more displays.

[0050] Additionally, at least one display (20) may be a flexible display. For example, when the main display area (21) and the sub-display areas (22, 23) are implemented as one display, the main display area (21) and the sub-display areas (22, 23) may be provided by one flexible display. For example, when the main display area (21) and the sub-display areas (22, 23) are implemented by two or more displays, the sub-display areas (22, 23) may be provided by a flexible display.

[0051] The main display area (21) may be a display area where a GUI provided by an application of the wearable electronic device (1000) is mainly displayed. The main display area (21) may be an area set to display, for example, a watch face screen and an application execution screen by default. The main display area (21) may be an area corresponding to the body part (26) of the wearable electronic device (1000), and for example, at least a part of the body part (26) of the wearable electronic device (1000) may be placed below the main display area (21). For example, when the wearable electronic device (1000) is placed so that the main display area (21) of the wearable electronic device (1000) is exposed toward the +z-axis direction based on the three axes (x, y, z), at least a part of the body part (26) may be placed below the main display area (21) based on the z-axis (e.g., placed in the -z-axis direction).

[0052] The sub-display area (22, 23) may be a display area where a GUI provided by an application of the wearable electronic device (1000) is auxiliaryly displayed. For example, additional information provided by the application may be displayed in the sub-display area (22, 23). For example, the GUI displayed in the main display area (21) may be moved to the sub-display area (22, 23). For example, the sub-display area (22, 23) may correspond to a band portion of a smart watch, but is not limited thereto.

[0053] The body (26) can be equipped with electronic components necessary to execute the operation of the wearable electronic device (1000).

[0054] The fastening portions (27, 28) are formed at the ends of the sub-display areas (22, 23) and fastened to each other, thereby enabling the wearable electronic device (1000) to be worn on the user's body (e.g., wrist).

[0055] FIG. 3 is a drawing for explaining a main display area and a sub-display area of ​​a wearable electronic device according to one embodiment.

[0056] Identification number 3a of FIG. 3 is a drawing showing a wearable electronic device (1000) viewed from the front, identification number 3b is a drawing showing a wearable electronic device (1000) viewed from the side, and identification number 3c is a drawing showing a side view of a wearable electronic device (1000) worn by a user.

[0057] Referring to FIG. 3, a wearable electronic device (1000) may include at least one display (30), a body (36), and a fastening portion (37, 38).

[0058] At least one display (30) may include a main display area (31) and a sub-display area (32). The main display area (31) and the sub-display area (32) may be implemented as a single display, but are not limited thereto. For example, the main display area (31) and the sub-display area (32) may be implemented as two displays.

[0059] Additionally, at least one display (30) may be a flexible display. For example, when the main display area (31) and the sub-display area (32) are implemented as one display, the main display area (31) and the sub-display area (32) may be provided by one flexible display. For example, when the main display area (31) and the sub-display area (32) are implemented as two displays, the sub-display area (32) may be provided by a flexible display.

[0060] The main display area (31) may be a display area where a GUI provided by an application of the wearable electronic device (1000) is mainly displayed. The main display area (31) may be an area where, for example, a watch face screen and an application execution screen are set to be displayed by default. The main display area (31) may be an area corresponding to the body part (36) of the wearable electronic device (1000), and for example, at least a portion of the body part (36) of the wearable electronic device (1000) may be placed below the main display area (31). For example, when the wearable electronic device (1000) is placed so that the main display area (31) of the wearable electronic device (1000) is exposed toward the +z-axis direction based on the three axes (x, y, z), at least a portion of the body part (36) may be placed below the main display area (31) based on the z-axis (e.g., placed in the -z-axis direction).

[0061] The sub-display area (32) may be a display area where a GUI provided by an application of the wearable electronic device (1000) is auxiliaryly displayed. For example, additional information provided by the application may be displayed in the sub-display area (32). For example, at least a portion of the GUI displayed in the main display area (31) may be moved to the sub-display area (32). For example, the sub-display area (32) may correspond to a band portion of a smart watch, but is not limited thereto.

[0062] The body (36) can be equipped with electronic components necessary to execute the operation of the wearable electronic device (1000).

[0063] The fastening portions (37, 38) are formed at one end of the body portion (36) and the end of the sub-display area (32) and fastened to each other, thereby enabling the wearable electronic device (1000) to be worn on the user's body (e.g., wrist).

[0064] FIG. 4 is a flowchart of a method for displaying a GUI on a wearable electronic device according to a user input, according to one embodiment.

[0065] In operation 400, the wearable electronic device (1000) may display a first GUI on a main display area (e.g., the main display area (21) of FIG. 2 or the main display area (31) of FIG. 3). The wearable electronic device (1000) may display a first GUI provided by an application running on the wearable electronic device (1000) on the main display area. The application running on the wearable electronic device (1000) may include, but is not limited to, a clock application, a weather application, a schedule application, and a health application, for example, and may include all types of applications that can be run by the wearable electronic device (1000).

[0066] In operation 410, the wearable electronic device (1000) may receive a first user input that multi-touches a sub-display area (e.g., sub-display areas 22 and 23 of FIG. 2 ) or sub-display area (32) of FIG. 3 ). The wearable electronic device (1000) may receive a first user input that touches a first portion and a second portion of the sub-display area together. The first user input may be a multi-touch input that includes a first touch on the first portion of the sub-display area and a second touch on the second portion of the sub-display area.

[0067] In one embodiment, the first portion of the sub-display area and the second portion of the sub-display area may be portions spaced apart from each other by the main display area. For example, the first portion of the sub-display area may be a portion adjacent to the bottom of the main display area, and the second portion of the sub-display area may be a portion adjacent to the top of the main display area.

[0068] In operation 420, the wearable electronic device (1000) may receive a second user input that moves a multi-touch. If the first user input is a multi-touch input that includes a first touch on a first portion of the sub-display area and a second touch on a second portion of the sub-display area, the wearable electronic device (1000) may receive a second user input that moves at least one of the first touch or the second touch.

[0069] For example, the wearable electronic device (1000) may receive a second user input for moving the first touch and the second touch. In this case, the wearable electronic device (1000) may obtain information regarding the movement of the first touch and the second touch. For example, the wearable electronic device (1000) may identify information regarding the starting position of the movement of the first touch, the moving direction of the first touch, the moving distance of the first touch, the starting position of the movement of the second touch, the moving direction of the second touch, and the moving distance of the second touch.

[0070] For example, the wearable electronic device (1000) may receive a second user input for moving the first touch among the first touch and the second touch. In this case, the wearable electronic device (1000) may obtain information regarding the movement of the first touch. For example, the wearable electronic device (1000) may identify information regarding the starting position of the movement of the first touch, the movement direction of the first touch, and the movement distance of the first touch.

[0071] For example, the wearable electronic device (1000) may receive a second user input for moving a second touch among the first and second touches. In this case, the wearable electronic device (1000) may obtain information regarding the movement of the second touch. For example, the wearable electronic device (1000) may identify information regarding the starting position of the movement of the second touch, the movement direction of the second touch, and the movement distance of the second touch.

[0072] For convenience of explanation, the first user input and the second user input are described as separate inputs in the above description, but this is not limited thereto. The first user input and the second user input may also be a single user input. For example, the wearable electronic device (1000) may recognize multi-touch and multi-touch movement input as a single user input.

[0073] In operation 430, the wearable electronic device (1000) can determine whether the wearable electronic device (1000) is rotated. For example, when the wrist of the user wearing the wearable electronic device (1000) is rotated, the wearable electronic device (1000) can rotate around an axis corresponding to the user's forearm. In this case, the wearable electronic device (1000) can detect the rotation of the wearable electronic device (1000) using at least one sensor within the wearable electronic device (1000), thereby obtaining information regarding the rotation of the wearable electronic device (1000). For example, the wearable electronic device (1000) can obtain information regarding the rotation direction and rotation angle of the wearable electronic device (1000).

[0074] According to one embodiment, the wearable electronic device (1000) can determine whether the wearable electronic device (1000) has rotated while the multi-touch is moving. The wearable electronic device (1000) can determine whether the rotation of the wearable electronic device (1000) has been detected while the movement of the multi-touch is detected.

[0075] According to one embodiment, the wearable electronic device (1000) can compare information about the movement of the first touch and the second touch included in the multi-touch with information about the rotation of the wearable electronic device (1000). For example, through the comparison, the wearable electronic device (1000) can identify whether the movement of the multi-touch is movement due to the rotation of the wearable electronic device (1000) or whether the movement of the multi-touch is movement unrelated to the rotation of the wearable electronic device (1000).

[0076] According to one embodiment, when it is determined that the wearable electronic device (1000) is not rotated, the wearable electronic device (1000) may display a second GUI related to the first GUI in the sub-display area at operation 440. When it is determined that the wearable electronic device (1000) is not rotated while a second user input moving the multi-touch is received, the wearable electronic device (1000) may display a preset second GUI in the sub-display area according to the movement of the multi-touch.

[0077] According to one embodiment, the second GUI may be a GUI provided by an application that provided the first GUI, and the second GUI related to the first GUI may be a preset GUI. In this case, the wearable electronic device (1000) may identify the second GUI related to the first GUI by considering an identification value of the first GUI, an identification value of the application that provided the first GUI, and information about an input moving a multi-touch. However, the present invention is not limited thereto, and the second GUI may be a GUI provided by an application different from the application that provided the first GUI.

[0078] According to one embodiment, the wearable electronic device (1000) may display a second GUI in a portion of the sub-display area adjacent to the main display area. For example, the wearable electronic device (1000) may additionally display the second GUI in a portion of the sub-display area adjacent to the top of the main display area. For example, the wearable electronic device (1000) may additionally display the second GUI in a portion of the sub-display area adjacent to the bottom of the main display area.

[0079] Although the wearable electronic device (1000) has been described above as displaying the second GUI in the sub-display area, this is not limited thereto. For example, the wearable electronic device (1000) may display the second GUI by overlapping it with the first GUI displayed in the main display area. Furthermore, for example, the wearable electronic device (1000) may display the second GUI across the main display area and the sub-display area.

[0080] Although the wearable electronic device (1000) has been described above as additionally displaying a second GUI, this is not limited thereto. For example, the wearable electronic device (1000) may also display the second GUI in place of the first GUI. In this case, the wearable electronic device (1000) may remove the first GUI and display the second GUI on the main display area.

[0081] Although the wearable electronic device (1000) has been described above as displaying a second GUI, this is not limiting. The wearable electronic device (1000) may also expand the first GUI and display the expanded first GUI on at least a portion of the main display area and the sub-display area. In this case, the expanded first GUI may include more information than the first GUI before being expanded.

[0082] According to one embodiment, when it is determined that the wearable electronic device (1000) has been rotated, the wearable electronic device (1000) can change the display of the first GUI at operation 450. When it is determined that the wearable electronic device (1000) has been rotated while a second user input moving a multi-touch is received, the wearable electronic device (1000) can change the display of the first GUI according to the rotation of the wearable electronic device (1000).

[0083] For example, the wearable electronic device (1000) may display the first GUI by rotating it within the main display area. In this case, the wearable electronic device (1000) may determine the rotation angle of the first GUI based on the rotation direction and rotation angle of the wearable electronic device (1000).

[0084] For example, the wearable electronic device (1000) can move the display position of the first GUI from the main display area to the sub-display area. In this case, the wearable electronic device (1000) can determine the movement direction and movement distance of the first GUI based on the rotation direction and rotation angle of the wearable electronic device (1000).

[0085] FIG. 5 is a diagram illustrating an example of a user input moving multi-touch for a wearable electronic device according to one embodiment.

[0086] Referring to identification number 5a of FIG. 5, the wearable electronic device (1000) can receive a multi-touch input including a first touch (51) and a second touch (52) on the sub-display area.

[0087] Referring to the identification number 5b of FIG. 5, a user can move the first touch (51) and the second touch (52) together while maintaining the touch states of the first touch (51) and the second touch (52). Accordingly, the wearable electronic device (1000) can detect the starting position of the movement of the first touch (51), the moving direction of the first touch (51), the moving distance of the first touch (51), the starting position of the movement of the second touch (52), the moving direction of the second touch (52), and the moving distance of the second touch (52).

[0088]

[0089] FIG. 6 is a diagram illustrating an example of a user input moving a portion of a multi-touch for a wearable electronic device according to one embodiment.

[0090] Referring to identification number 6a of FIG. 6, the wearable electronic device (1000) can receive a multi-touch input including a first touch (61) and a second touch (62) on the sub-display area.

[0091] Referring to identification number 6b of FIG. 6, a user can move only the second touch (62) among the first touch (61) and the second touch (62) while maintaining the touch states of the first touch (61) and the second touch (62). Accordingly, the wearable electronic device (1000) can detect the touch position of the first touch (61), the starting position of the movement of the second touch (62), the movement direction of the second touch (62), and the movement distance of the second touch (62).

[0092] FIG. 7 is a diagram illustrating an example of a user input moving a portion of a multi-touch for a wearable electronic device according to one embodiment.

[0093] Referring to the identification number 7a of FIG. 7, the wearable electronic device (1000) can receive a multi-touch input including a first touch (71) and a second touch (72) on the sub-display area.

[0094] Referring to identification number 7b of FIG. 7, a user can move only the first touch (71) among the first touch (71) and the second touch (72) while maintaining the touch states of the first touch (71) and the second touch (72). Accordingly, the wearable electronic device (1000) can detect the starting position of the movement of the first touch (71), the movement direction of the first touch (71), the movement distance of the first touch (71), and the touch position of the second touch (72).

[0095]

[0096] FIG. 8 is a diagram illustrating an example of a user input for rotating a wearable electronic device according to one embodiment.

[0097] Referring to FIG. 8, a wearable electronic device (1000) can be worn on a user's wrist. As the wrist of a user wearing the wearable electronic device (1000) rotates, the wearable electronic device (1000) can be rotated around an axis (80) in the direction toward which the user's forearm faces. The wearable electronic device (1000) can be rotated clockwise or counterclockwise around the axis (80). Accordingly, the wearable electronic device (1000) can obtain information regarding the rotation direction and rotation angle of the wearable electronic device (1000).

[0098] FIG. 9 is a diagram illustrating an example of a multi-touch movement on a wearable electronic device according to a user input of rotating the wearable electronic device according to one embodiment.

[0099] Referring to identification number 9a of FIG. 9, the wearable electronic device (1000) can receive a first touch (91) and a second touch (92) for the wearable electronic device (1000).

[0100] Referring to the identification number 9b of FIG. 9, the wearable electronic device (1000) may be rotated while the first touch (91) and the second touch (92) on the wearable electronic device (1000) are maintained in a touch state. As the wearable electronic device (1000) is rotated, the positions of the first touch (91) and the second touch (92) on the wearable electronic device (1000) may move.

[0101] For example, the wearable electronic device (1000) can be rotated by rotating the wrist while the user inputs the first touch (91) and the second touch (92) with his or her finger.

[0102] For example, a user may touch a finger to the wearable electronic device (1000) so that the finger moves on the wearable electronic device (1000) by the rotation of the wearable electronic device (1000), and in this case, as the wearable electronic device (1000) rotates, the positions of the first touch (91) and the second touch (92) may move on the wearable electronic device (1000) by the rotation of the wearable electronic device (1000). In this case, the movement direction of the positions of the first touch (91) and the second touch (92) may be in a direction opposite to the rotation direction of the wearable electronic device (1000). In addition, the movement amount of the positions of the first touch (91) and the second touch (92) may be determined by the rotation amount of the wearable electronic device (1000).

[0103] In addition, the wearable electronic device (1000) can identify the rotation direction and rotation angle of the wearable electronic device (1000), and the movement direction and movement distance of the first touch (91) and the second touch (92). The wearable electronic device (1000) can compare the rotation direction and rotation angle of the wearable electronic device (1000) with the movement direction and movement distance of the first touch (91) and the second touch (92). Based on the comparison result, the wearable electronic device (1000) can identify whether the movement of the first touch (91) and the second touch (92) with respect to the wearable electronic device (1000) is due to the user action of FIG. 9.

[0104] FIG. 10 is a diagram illustrating an example of maintaining multi-touch on a wearable electronic device according to a user input of rotating the wearable electronic device according to one embodiment.

[0105] Referring to identification number 10a of FIG. 10, the wearable electronic device (1000) can receive a first touch (101) and a second touch (102) for the wearable electronic device (1000).

[0106] Referring to the identification number 10b of FIG. 10, the wearable electronic device (1000) may be rotated while the first touch (101) and the second touch (102) on the wearable electronic device (1000) are maintained in a touch state. Although the wearable electronic device (1000) is rotated, the positions of the first touch (101) and the second touch (102) on the wearable electronic device (1000) may not move.

[0107] For example, when a user inputs a first touch (101) and a second touch (102) with a finger, the wearable electronic device (1000) can be rotated by rotating the wrist while maintaining the touch positions of the first touch (101) and the second touch (102).

[0108] For example, a user can touch the wearable electronic device (1000) with a finger so that the positions of the first touch (101) and the second touch (102) on the wearable electronic device (1000) are maintained even if the wearable electronic device (1000) is rotated, and in this case, even if the wearable electronic device (1000) is rotated, the positions of the first touch (101) and the second touch (102) can be maintained on the wearable electronic device (1000) by the rotation of the wearable electronic device (1000).

[0109] Accordingly, the wearable electronic device (1000) can identify the rotation direction and rotation angle of the wearable electronic device (1000), and can identify that the positions of the first touch (101) and the second touch (102) are maintained.

[0110] FIG. 11 is a flowchart of a method for a wearable electronic device according to one embodiment to display a second GUI related to a first GUI in response to a user input moving a multi-touch.

[0111] Actions 1110 to 1160 of FIG. 11 may correspond to action 440 of FIG. 4.

[0112] In operation 1110, the wearable electronic device (1000) can identify a starting position of a multi-touch. Before the first touch and the second touch are moved to the sub-display area, the wearable electronic device (1000) can identify a starting position of the first touch and a starting position of the second touch on the sub-display area. For example, the starting position of the first touch may be within a partial area within a predetermined distance range from the bottom of the main display in the sub-display area. For example, the starting position of the second touch may be within a partial area within a predetermined distance range from the top of the main display in the sub-display area.

[0113] In operation 1120, the wearable electronic device (1000) can identify the movement direction and movement distance of the multi-touch. As the first touch and the second touch are moved on the sub-display area, the wearable electronic device (1000) can identify the movement direction and movement distance of the first touch and the second touch. For example, the movement direction of the first touch may include, but is not limited to, a direction approaching the main display area and a direction away from the main display area. For example, the movement direction of the second touch may include, but is not limited to, a direction approaching the main display area and a direction away from the main display area.

[0114] If only some of the first and second touches are moved, the wearable electronic device (1000) can identify the movement direction and movement distance of the moved some of the touches.

[0115] In operation 1130, the wearable electronic device (1000) can identify an application that provides a first GUI. The first GUI can be displayed on the main display area of ​​the wearable electronic device (1000) by an application running on the wearable electronic device (1000), and the wearable electronic device (1000) can identify the application that provides the first GUI.

[0116] In operation 1140, the wearable electronic device (1000) can identify a second GUI related to the first GUI. The wearable electronic device (1000) can identify a preset second GUI based on at least one of a starting position, a moving direction, or a moving distance of the multi-touch as the multi-touch is moved. For example, the second GUI related to the first GUI can be preset based on the starting positions of the first touch and the second touch included in the multi-touch, the number of touches moved among the first touch and the second touch, the moving direction of the first touch and / or the second touch, and the moving distance of the first touch and / or the second touch.

[0117] In one embodiment, the second GUI associated with the first GUI may be a GUI provided by the application that provided the first GUI. Alternatively, the second GUI may be a GUI provided by an application different from the application that provided the first GUI. Alternatively, the second GUI may be a GUI that includes a GUI provided by the application that provided the first GUI and a GUI provided by an application different from the application that provided the first GUI.

[0118] According to one embodiment, the wearable electronic device (1000) can identify a second GUI related to the first GUI by considering an identification value of the first GUI, an identification value of an application that provides the first GUI, and information about an input that moves the multi-touch (e.g., a starting position of the multi-touch, a movement direction, and a movement distance).

[0119] For example, the first GUI may be a GUI that includes time information of the current region provided by the clock application, and the second GUI may be a GUI that includes time information of another region provided by the clock application.

[0120] For example, the first GUI may be a GUI that includes weather information provided by a weather application, and the second GUI may be a GUI that includes weekly weather forecast information provided by the weather application.

[0121] For example, the first GUI may be a GUI that includes information related to the user's health (e.g., water intake, menstrual cycle, sleep pattern, stress, heart rate, food, daily activity, and blood oxygen) provided by the health application, and the second GUI may be a GUI that includes additional information for guiding the user's health management provided by the health application.

[0122] For example, the first GUI may be a GUI that includes dual clock information (e.g., the time of the current region and the time of another designated region) provided by a clock application, and the second GUI may be a GUI that includes at least one of battery status information, weather information, or fine dust information provided by at least one other application.

[0123] For example, the first GUI may be a GUI that includes information about peripheral devices (e.g., media devices, batteries, buds controllers) provided by an application that provides IoT (internet of things) services, and the second GUI may be a GUI that includes additional information related to the peripheral devices.

[0124] For example, if the peripheral device connected to the wearable electronic device (1000) is a TV, the first GUI may include an identification value of the TV, and the second GUI may be a GUI including remote control information for controlling the TV and / or TV channel information. For example, the first GUI may be a GUI including contact information provided by a contact application, and the second GUI may be additional information provided by the contact application.

[0125] For example, the first GUI may be a GUI that includes a list of contacts that are registered as favorites or frequently used by the user, and the second GUI may be a GUI that includes information on recently used contacts, recent messages, and / or recent calls.

[0126] For example, the first GUI may be a GUI that includes schedule information provided by a schedule application, and the second GUI may be a GUI that includes schedule details provided by the schedule application.

[0127] For example, the first GUI may be a GUI that includes a map of the current location provided by a map application, and the second GUI may be a GUI that includes POI (point of interest) information (e.g., gas stations, parking lots, schools, and department stores) around the current location.

[0128] For example, the first GUI may be a watch face screen of a watch application, and the second GUI may be a message screen provided by a message application.

[0129] In operation 1150, the wearable electronic device (1000) identifies a display position of a second GUI based on at least one of a start position, a movement direction, and a movement distance of the multi-touch, and in operation 1160, the wearable electronic device (1000) can display the second GUI. The wearable electronic device (1000) can identify the display position of the second GUI based on at least one of the start position, the movement direction, and the movement distance of the multi-touch as the multi-touch is moved. For example, the display position of the second GUI can be preset based on the start positions of the first touch and the second touch included in the multi-touch, the number of touches moved among the first touch and the second touch, the movement direction of the first touch and / or the second touch, and the movement distance of the first touch and / or the second touch.

[0130] According to one embodiment, the wearable electronic device (1000) may display a second GUI in a portion of the sub-display area adjacent to the main display area. For example, the wearable electronic device (1000) may additionally display the second GUI in a portion of the sub-display area adjacent to the top of the main display area. For example, the wearable electronic device (1000) may additionally display the second GUI in a portion of the sub-display area adjacent to the bottom of the main display area.

[0131] Although the wearable electronic device (1000) has been described above as displaying the second GUI in the sub-display area, this is not limited thereto. For example, the wearable electronic device (1000) may display the second GUI by overlapping it with the first GUI displayed in the main display area. Furthermore, for example, the wearable electronic device (1000) may display the second GUI across the main display area and the sub-display area.

[0132] Although the wearable electronic device (1000) has been described above as additionally displaying a second GUI, this is not limited thereto. For example, the wearable electronic device (1000) may also display the second GUI in place of the first GUI. In this case, the wearable electronic device (1000) may remove the first GUI and display the second GUI on the main display area.

[0133] Although the wearable electronic device (1000) has been described above as displaying a second GUI, this is not limiting. The wearable electronic device (1000) may also expand the first GUI and display the expanded first GUI on at least a portion of the main display area and the sub-display area. In this case, the expanded first GUI may include more information than the first GUI before being expanded.

[0134] FIG. 12 is a flowchart of a method for changing the display of a first GUI according to a user input of rotating the wearable electronic device according to one embodiment.

[0135] Actions 1210 to 1240 of FIG. 12 may correspond to action 450 of FIG. 4.

[0136] In operation 1210, the wearable electronic device (1000) can identify a starting position of a multi-touch. Before the first touch and the second touch are moved to the sub-display area, the wearable electronic device (1000) can identify the position of the first touch and the position of the second touch on the sub-display area. For example, the starting position of the first touch may be within a partial area within a predetermined distance range from the bottom of the main display among the sub-display area. For example, the starting position of the second touch may be within a partial area within a predetermined distance range from the top of the main display among the sub-display area.

[0137] In operation 1220, the wearable electronic device (1000) can identify the rotation direction and rotation angle of the wearable electronic device (1000). As the wearable electronic device (1000) rotates while the touch states of the first touch and the second touch on the sub-display area are maintained, the wearable electronic device (1000) can detect the rotation of the wearable electronic device (1000) using a sensor within the wearable electronic device (1000). For example, the rotation direction of the wearable electronic device (1000) can include a clockwise direction and a counterclockwise direction with respect to a rotation axis (e.g., an axis in a direction in which a forearm faces). For example, the rotation angle of the wearable electronic device (1000) can include an angle by which the wearable electronic device (1000) is rotated with respect to a rotation axis (e.g., an axis in a direction in which a forearm faces).

[0138] In operation 1230, the wearable electronic device (1000) can identify an application that provides a first GUI. The first GUI can be displayed on the main display area of ​​the wearable electronic device (1000) by an application running on the wearable electronic device (1000), and the wearable electronic device (1000) can identify the application that provides the first GUI.

[0139] In operation 1240, the wearable electronic device (1000) may change the display of the first GUI based on the rotational direction and rotational angle of the wearable electronic device (1000) and the identified application. When it is determined that the wearable electronic device (1000) has rotated while a second user input moving a multi-touch is received, the wearable electronic device (1000) may change the display of the first GUI based on the rotation of the wearable electronic device (1000).

[0140] For example, the wearable electronic device (1000) may display the first GUI by rotating it within the main display area. In this case, the wearable electronic device (1000) may determine the rotation angle of the first GUI based on the rotation direction and rotation angle of the wearable electronic device (1000).

[0141] For example, the wearable electronic device (1000) can move the display position of the first GUI from the main display area to the sub-display area. In this case, the wearable electronic device (1000) can determine the movement direction and movement distance of the first GUI based on the rotation direction and rotation angle of the wearable electronic device (1000).

[0142] FIG. 13 is a flowchart of a method for displaying a GUI when multi-touch is released for a wearable electronic device according to one embodiment.

[0143] Operations 1310 to 1340 of FIG. 13 may be performed after operation 440 or operation 450 of FIG. 4.

[0144] In operation 1310, the wearable electronic device (1000) may identify that multi-touch is released. As the user's finger, which has multi-touched the wearable electronic device (1000), moves away from the wearable electronic device (1000), multi-touch on the wearable electronic device (1000) may be released.

[0145] In operation 1320, the wearable electronic device (1000) can identify whether the wearable electronic device has been rotated. The wearable electronic device (1000) can determine whether the wearable electronic device (1000) has been rotated while the multi-touch is moving. For example, the wearable electronic device (1000) can identify whether the wearable electronic device (1000) has been rotated while the multi-touch is moving by referring to the determination result in operation 430.

[0146] As it is determined that the wearable electronic device (1000) was not rotated while the multi-touch was moving, the wearable electronic device (1000) can remove the displayed second GUI in operation 1340. The wearable electronic device (1000) can restore the display state of the wearable electronic device (1000) to the state before the second GUI was displayed. For example, the wearable electronic device (1000) can remove the display of the second GUI in operation 440. For example, if the second GUI was additionally displayed while the first GUI was maintained, the wearable electronic device (1000) can remove the display of the second GUI. For example, if the second GUI was displayed instead of the first GUI, the wearable electronic device (1000) can remove the display of the second GUI and display the first GUI.

[0147] As it is determined that the wearable electronic device (1000) has rotated while the multi-touch is moving, the wearable electronic device (1000) can maintain the display change of the first GUI in operation 1330. For example, the wearable electronic device (1000) can maintain the display change of the first GUI in operation 450.

[0148] FIG. 14 is a diagram illustrating an example in which, when a notification is generated in a wearable electronic device according to one embodiment, the first GUI of the watch application is switched to the second GUI of the application in which the notification is generated as the multi-touch on the sub-display area is moved.

[0149] Referring to identification number 14a of FIG. 14, a first GUI (140) of a watch application is displayed on a main display area (146) of a wearable electronic device (1000), and a multi-touch input including a first touch (141) and a second touch (142) can be input to a sub-display area (147, 148) of the wearable electronic device (1000). The first GUI (140) can include current time information provided by the watch application.

[0150] Referring to identification number 14b of FIG. 14, the first touch (141) and the second touch (142) may be moved. For example, while the touch state of the first touch (141) is maintained, the position of the first touch (141) may be moved in a direction away from the main display area (146), and while the touch state of the second touch (142) is maintained, the position of the second touch (142) may be moved in a direction away from the main display area (146). In this case, the wearable electronic device (1000) may not be rotated.

[0151] According to one embodiment, as the first touch (141) and the second touch (142) move, the wearable electronic device (1000) can identify the movement of the multi-touch input to the sub-display area (147, 148). Accordingly, the wearable electronic device (1000) can display a second GUI (145) including notification information provided by the message application on the main display area (146). The second GUI (140) is a notification generated by the message application and can include a message received from an external source. The wearable electronic device (1000) can remove the first GUI (140) displayed on the main display area (146) and display a second GUI (145) indicating a message received by the message application on the main display area (146).

[0152] Referring to the identification number 14c of FIG. 14, the moved first touch (141) and second touch (142) can be released. As the first touch (141) and second touch (142) are moved away from the sub-display area (147, 148), the first touch (141) and second touch (142) on the wearable electronic device (1000) can be released. As the moved first touch (141) and second touch (142) are released, the wearable electronic device (1000) can restore the display state of the main display (146) to the state before the first touch (141) and second touch (142) were moved. For example, the wearable electronic device (1000) may remove the second GUI (145) displayed on the main display area (146) and display the first GUI (140) provided by the watch application on the main display area (146).

[0153] Meanwhile, referring to FIG. 22, when a notification is generated in a wearable electronic device (1000) according to one embodiment, as the position of the multi-touch for the sub-display area (227) moves by rotation of the wearable electronic device (1000), the GUI of the application for which the notification was generated can be displayed and fixed in the sub-display area (227).

[0154] Referring to identification number 22a of FIG. 22, a first GUI (220) of a watch application is displayed on a main display area (226) of a wearable electronic device (1000), and the first GUI (220) may include current time information provided by the watch application. In addition, while the first GUI (220) of the watch application is displayed on the main display area (226), the wearable electronic device (1000) may receive a message through a message application. According to one embodiment, when a message is received through the message application, a notification may be generated on the wearable electronic device (1000).

[0155] Referring to identification number 22b of FIG. 22, after a message is received through a message application, a multi-touch input including a first touch (221) and a second touch (222) may be input to some areas of a sub-display area (227) of the wearable electronic device (1000) (e.g., some areas close to the main display area (226)). In addition, as the user of the wearable electronic device (1000) rotates his or her forearm while the multi-touch input including the first touch (221) and the second touch (222) is maintained, the wearable electronic device (1000) may rotate around an axis corresponding to the user's forearm.

[0156] Referring to identification number 22c of FIG. 22, as the wearable electronic device (1000) rotates around an axis corresponding to the user's forearm, the touch locations of the first touch (221) and the second touch (222) move, and a message (223) received by the message application can be displayed on the sub-display area (227) of the electronic device (1000) between the first touch (221) and the second touch (222).

[0157] Referring to identification number 22d of FIG. 22, the first touch (221) and the second touch (222) may be terminated, and the display of the message (223) may be fixed on the sub-display area (227).

[0158] FIG. 15 is a diagram illustrating an example in which a first GUI of a watch application changes as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0159] Referring to identification number 15a of FIG. 15, a first GUI (150) of a watch application is displayed on a main display area (156) of a wearable electronic device (1000), and a multi-touch input including a first touch (151) and a second touch (152) can be input to a sub-display area (157, 158) of the wearable electronic device (1000). The first GUI (150) can include an area (150-1) where time information of a current area provided by the watch application is displayed and an area (150-2) where time information of a preset area is displayed.

[0160] Referring to identification number 15b of FIG. 15, the first touch (151) and the second touch (152) may be moved. For example, while the touch state of the first touch (151) is maintained, the position of the first touch (151) may be moved in a direction away from the main display area (156), and while the touch state of the second touch (152) is maintained, the position of the second touch (152) may be moved in a direction away from the main display area (156). In this case, the wearable electronic device (1000) may not be rotated.

[0161] According to one embodiment, as the first touch (151) and the second touch (152) move, the wearable electronic device (1000) can identify the movement of the multi-touch input to the sub-display area (157, 158). Accordingly, the wearable electronic device (1000) can expand and display the first GUI (150). For example, the wearable electronic device (1000) can expand the area (150-1) where visual information of the current region is displayed, and display the expanded area (150-1) on the main display area (156) of the wearable electronic device (1000). In addition, the wearable electronic device (1000) can display the area (150-2) where visual information of a preset region is displayed on the sub-display area (157). In this case, the shape of the extended area (150-1) can be changed to fit the shape of the main display area (156), and the shape of the area (150-2) can be changed to fit the shape of the sub display area (157).

[0162] Referring to the identification number 15c of FIG. 15, the moved first touch (151) and second touch (152) can be released. As the first touch (151) and second touch (152) are moved away from the sub-display area (157, 158), the first touch (151) and second touch (152) on the wearable electronic device (1000) can be released. As the moved first touch (151) and second touch (152) are released, the wearable electronic device (1000) can restore the display state of the main display (156) to the state before the first touch (151) and second touch (152) were moved. For example, the wearable electronic device (1000) may display a first GUI (150) including an area (150-1) in which time information of the current area provided by the watch application is displayed and an area (150-2) in which time information of a preset area is displayed, on the main display area (156).

[0163] FIG. 16 is a diagram illustrating an example in which a second GUI including weather information is additionally displayed as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0164] Referring to identification number 16a of FIG. 16, a first GUI (160) of a watch application is displayed on a main display area (164) of a wearable electronic device (1000), and a multi-touch input including a first touch (161) and a second touch (162) can be input to a sub-display area (163, 165) of the wearable electronic device (1000). The first GUI (160) can include time information of a current area provided by the watch application and time information of a preset area.

[0165] Referring to the identification number 16b of FIG. 16, the first touch (161) and the second touch (162) may be moved. For example, while the touch state of the first touch (161) is maintained, the position of the first touch (161) may be moved in a direction away from the main display area (164), and while the touch state of the second touch (162) is maintained, the position of the second touch (162) may be moved in a direction away from the main display area (164). In this case, the wearable electronic device (1000) may not be rotated.

[0166] According to one embodiment, as the first touch (161) and the second touch (162) move, the wearable electronic device (1000) can identify the movement of the multi-touch input to the sub-display areas (163, 165). Accordingly, the wearable electronic device (1000) can additionally display a GUI (167) and a GUI (166) including additional information related to the first GUI (160). For example, the wearable electronic device (1000) can display a GUI (166) including weather information of a current region on a sub-display area (165) close to a portion where visual information of the current region is displayed. For example, the wearable electronic device (1000) can display a GUI (167) including weather information of a preset region on a sub-display area (163) close to a portion where visual information of the preset region is displayed.

[0167] Referring to the identification number 16c of FIG. 16, the moved first touch (161) and second touch (162) can be released. As the first touch (161) and second touch (162) are moved away from the sub-display areas (163, 165), the first touch (161) and second touch (162) on the wearable electronic device (1000) can be released. As the moved first touch (161) and second touch (162) are released, the wearable electronic device (1000) can restore the display state of the main display area (164) to the display state before the first touch (161) and second touch (162) were moved. For example, the wearable electronic device (1000) can remove the GUI (167) and GUI (166) displayed on the sub-display areas (163, 165).

[0168] FIG. 17 is a diagram illustrating an example in which a second GUI including detailed weather information is additionally displayed on a first GUI of a weather application as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0169] Referring to identification number 17a of FIG. 17, a first GUI (170) of a weather application is displayed on a main display area (174) of a wearable electronic device (1000), and a multi-touch input including a first touch (171) and a second touch (172) can be input to a sub-display area (173, 175) of the wearable electronic device (1000). The first GUI (170) can include current weather information of the current area provided by the weather application.

[0170] Referring to identification number 17b of FIG. 17, the first touch (171) and the second touch (172) may be moved. For example, while the touch state of the first touch (171) is maintained, the position of the first touch (171) may be moved in a direction away from the main display area (174), and while the touch state of the second touch (172) is maintained, the position of the second touch (172) may be moved in a direction away from the main display area (174). In this case, the wearable electronic device (1000) may not be rotated.

[0171] According to one embodiment, as the first touch (171) and the second touch (172) move, the wearable electronic device (1000) can identify the movement of the multi-touch input to the sub-display area (173, 175). Accordingly, the wearable electronic device (1000) can additionally display a GUI (177) and a GUI (176) including additional information related to the first GUI (170). For example, the wearable electronic device (1000) can include hourly weather information of the current area in the GUI (176) and the GUI (177). In addition, the wearable electronic device (1000) can additionally display the GUI (176) in the sub-display area (175) and the GUI (177) in the sub-display area (173).

[0172] Referring to the identification number 17c of FIG. 17, the moved first touch (171) and second touch (172) can be released. As the first touch (171) and second touch (172) are moved away from the sub-display areas (173, 175), the first touch (171) and second touch (172) on the wearable electronic device (1000) can be released. As the moved first touch (171) and second touch (172) are released, the wearable electronic device (1000) can restore the display state of the main display area (174) to the display state before the first touch (171) and second touch (172) were moved. For example, the wearable electronic device (1000) can remove the GUI (177) and GUI (176) displayed on the sub-display areas (173, 175).

[0173] FIG. 18 is a diagram illustrating an example in which a second GUI including detailed schedule information is additionally displayed on a first GUI of a schedule application as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment.

[0174] Referring to identification number 18a of FIG. 18, a first GUI (180) of a schedule application is displayed on a main display area (184) of a wearable electronic device (1000), and a multi-touch input including a first touch (181) and a second touch (182) can be input to a sub-display area (183, 185) of the wearable electronic device (1000). The first GUI (180) can include a calendar screen provided by the schedule application.

[0175] Referring to identification number 18b of FIG. 18, the first touch (181) and the second touch (182) may be moved. For example, while the touch state of the first touch (181) is maintained, the position of the first touch (181) may be moved in a direction away from the main display area (184), and while the touch state of the second touch (182) is maintained, the position of the second touch (182) may be moved in a direction away from the main display area (184). In this case, the wearable electronic device (1000) may not be rotated.

[0176] According to one embodiment, as the first touch (181) and the second touch (182) move, the wearable electronic device (1000) can identify the movement of the multi-touch input to the sub-display area (183, 185). Accordingly, the wearable electronic device (1000) can additionally display a GUI (186) including additional information related to the first GUI (180). For example, the wearable electronic device (1000) can display a GUI (186) including detailed information related to the schedule of a date selected from a calendar within the first GUI on the sub-display area (183).

[0177] Referring to the identification number 18c of FIG. 18, the moved first touch (181) and second touch (182) can be released. As the first touch (181) and second touch (182) are moved away from the sub-display areas (183, 185), the first touch (181) and second touch (182) on the wearable electronic device (1000) can be released. As the moved first touch (181) and second touch (182) are released, the wearable electronic device (1000) can restore the display state of the main display area (184) to the display state before the first touch (181) and second touch (182) were moved. For example, the wearable electronic device (1000) can remove the GUI (186) displayed on the sub-display area (183).

[0178] FIG. 19 is a diagram illustrating an example in which a first GUI of a watch application is changed and the changed first GUI is maintained as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment and the wearable electronic device is rotated.

[0179] Referring to identification number 19a of FIG. 19, a first GUI (190) of a watch application is displayed on a main display area (194) of a wearable electronic device (1000), and a multi-touch input including a first touch (191) and a second touch (192) can be input to a sub-display area (193, 195) of the wearable electronic device (1000). The first GUI (190) can include an area (190-1) where time information of a current area provided by the watch application is displayed and an area (190-2) where time information of a preset area is displayed.

[0180] Referring to identification number 19b of FIG. 19, the first touch (191) and the second touch (192) may move as the wearable electronic device (1000) rotates. The first touch (191) and the second touch (192) may move as the wearable electronic device (1000) rotates. For example, as the wearable electronic device (1000) rotates, the position of the first touch (191) may move away from the main display area (194) due to the rotation of the wearable electronic device (1000), and the position of the second touch (192) may move from the sub display area (195) to the main display area (194).

[0181] According to one embodiment, as the first touch (191) and the second touch (192) are moved, the wearable electronic device (1000) can identify that the wearable electronic device (1000) is rotated while the multi-touch is maintained. Accordingly, the wearable electronic device (1000) can expand and display the first GUI (190). For example, the wearable electronic device (1000) can expand an area (190-1) in which visual information of the current region is displayed, and display the expanded area (190-1) in the main display area (194) of the wearable electronic device (1000). In addition, the wearable electronic device (1000) can display an area (190-2) in which visual information of a preset region is displayed in the sub-display area (193). In this case, the shape of the extended area (190-1) can be changed to fit the shape of the main display area (194), and the shape of the area (190-2) can be changed to fit the shape of the sub display area (193).

[0182] Referring to the identification number 19c of FIG. 19, the moved first touch (191) and second touch (192) can be released. As the first touch (191) is moved away from the sub-display area (193) and the second touch (192) is moved away from the main display area (194), the first touch (191) and the second touch (192) on the wearable electronic device (1000) can be released. Even if the moved first touch (191) and second touch (192) are released, the wearable electronic device (1000) can maintain the display state after the first touch (191) and the second touch (192) are moved. For example, the wearable electronic device (1000) can maintain the display state of the main display area (194) and the display state of the sub-display area (193) in the identification number 19b.

[0183]

[0184] FIG. 20 is a diagram illustrating an example of a first GUI displayed on a wearable electronic device rotating as a multi-touch is moved on a sub-display area of ​​the wearable electronic device according to one embodiment.

[0185] Referring to identification number 20a of FIG. 20, a first GUI (200) of an application for guiding riding of a bicycle is displayed on a main display area (204) of a wearable electronic device (1000), and a multi-touch input including a first touch (201) and a second touch (202) can be input to a sub-display area (203, 205) of the wearable electronic device (1000). The first GUI (200) can include information about riding a bicycle (e.g., riding time, riding distance, speed, and calories consumed).

[0186] Referring to identification numbers 20b and 20c of FIG. 20, the first touch (201) and the second touch (202) may be moved. For example, while the touch state of the first touch (201) is maintained, the position of the first touch (201) may be moved in a direction away from the main display area (204), and while the touch state of the second touch (202) is maintained, the position of the second touch (202) may be moved in a direction away from the main display area (204). In this case, the first touch (201) and the second touch (202) may be moved in a direction away from the main display area (204) while the wearable electronic device (1000) is not rotated around a rotation axis (e.g., an axis in the direction in which the forearm is facing).

[0187] According to one embodiment, as the first touch (201) and the second touch (202) are moved away from the main display area (204), the first GUI (200) displayed on the main display area (204) may rotate. For example, as the first touch (201) and the second touch (202) are moved away from the main display area (204), the first GUI (200) displayed on the main display area (204) may rotate clockwise. For example, as the first touch (201) and the second touch (202) are moved toward the main display area (204), the first GUI (200) displayed on the main display area (204) may rotate counterclockwise. However, the direction in which the first GUI (200) rotates is not limited thereto.

[0188] According to one embodiment, as the first touch (201) and the second touch (202) move away from the main display area (204), the movement distance of the first touch (201) and the movement distance of the second touch (202) may increase. Additionally, as the movement distance of the first touch (201) and the movement distance of the second touch (202) increase, the rotation angle of the first GUI (200) displayed on the main display area (204) may increase.

[0189] FIG. 21 is a diagram illustrating an example in which a first GUI displayed on a wearable electronic device is rotated and the rotated first GUI is fixed as a multi-touch is moved on a sub-display area of ​​a wearable electronic device according to one embodiment and the wearable electronic device is rotated.

[0190] Referring to identification number 21a of FIG. 21, a first GUI (210) of an application for guiding riding of a bicycle is displayed on a main display area (214) of a wearable electronic device (1000), and a multi-touch input including a first touch (211) and a second touch (212) can be input to a sub-display area (213, 215) of the wearable electronic device (1000). The first GUI (210) can include information about riding a bicycle (e.g., riding time, riding distance, speed, and calories consumed).

[0191] Referring to identification number 21b of FIG. 21, the first touch (211) and the second touch (212) may move as the wearable electronic device (1000) rotates. The first touch (211) and the second touch (212) may move as the wearable electronic device (1000) rotates. For example, as the wearable electronic device (1000) rotates, the position of the first touch (211) may move away from the main display area (214) due to the rotation of the wearable electronic device (1000), and the position of the second touch (212) may move from the sub display area (215) to the main display area (214).

[0192] According to one embodiment, as the first touch (211) and the second touch (212) are moved by the rotation of the wearable electronic device (1000), the first GUI (210) displayed on the main display area (214) may be rotated. For example, as the position of the first touch (211) is moved away from the main display area (214) and the position of the second touch (212) is moved from the sub-display area (215) to the main display area (214) by the rotation of the wearable electronic device (1000), the first GUI (210) displayed on the main display area (214) may be rotated clockwise. However, the direction in which the first GUI (210) is rotated is not limited thereto.

[0193] According to one embodiment, as the rotation amount of the wearable electronic device (1000) increases, the movement distance of the first touch (211) and the movement distance of the second touch (212) may increase. Additionally, as the rotation amount of the wearable electronic device (1000) increases, the rotation angle of the first GUI (210) displayed on the main display area (214) may increase.

[0194] Referring to the identification number 21c of FIG. 21, the moved first touch (211) and second touch (212) can be released. As the first touch (211) is moved away from the sub-display area (213) and the second touch (212) is moved away from the main display area (214), the first touch (211) and the second touch (212) on the wearable electronic device (1000) can be released. Even if the moved first touch (211) and second touch (212) are released, the display state of the main display area (214) after the wearable electronic device (1000) is rotated can be maintained. For example, the wearable electronic device (1000) can maintain the display state of the rotated first GUI (210) in the identification number 21b.

[0195] According to one embodiment, a method for a wearable electronic device to display a GUI may include: displaying a first GUI on a main display area of ​​the wearable electronic device (e.g., operation 400); receiving a first user input of multi-touching a sub-display area corresponding to a band portion of the wearable electronic device (e.g., operation 410); receiving a second user input of moving the multi-touch while the multi-touch is maintained (e.g., operation 420); determining whether the wearable electronic device has been rotated while the second user input is being received; and changing the display of the first GUI if it is determined that the wearable electronic device has been rotated (e.g., operation 450). In addition, the method may include displaying a second GUI preset in relation to the first GUI on the sub-display area if it is determined that the wearable electronic device has not been rotated (e.g., operation 440).

[0196] Additionally, the sub-display area may include a first portion and a second portion separated by the main display area.

[0197] Additionally, the multi-touch may include a first touch on the first portion of the sub-display area, and a second touch on the second portion of the sub-display area.

[0198] Additionally, the operation of receiving the second user input for moving the multi-touch may include an operation of receiving a user input for moving at least one of the first touch or the second touch.

[0199] Additionally, the operation of determining whether the wearable electronic device has been rotated may include an operation of determining whether the wearable electronic device has been rotated about a preset axis by rotation of the wrist of the user wearing the wearable electronic device.

[0200] In addition, the operation of determining whether the wearable electronic device has been rotated may further include an operation of determining whether the rotation direction and rotation amount of the wearable electronic device correspond to the movement direction and movement distance of the multi-touch; and the operation of changing the display of the first GUI may include an operation of changing the display of the first GUI as the rotation direction and rotation amount of the wearable electronic device correspond to the movement direction and movement distance of the multi-touch.

[0201] Additionally, the operation of changing the display of the first GUI may include an operation of moving the display position of the first GUI from the main display area to the sub display area.

[0202] In addition, the method may include an operation of changing the display of the first GUI, an operation of rotating and displaying the first GUI on the main display area.

[0203] Additionally, the method may further include an operation of removing the second GUI displayed in the sub-display area when the multi-touch is released.

[0204] Additionally, the method may further include an operation of maintaining the changed display of the first GUI displayed in the sub-display area as the multi-touch is released.

[0205] Additionally, the first GUI may be provided by an application running on the wearable electronic device, and the display change of the first GUI and the second GUI may be preset for the application.

[0206] FIG. 23 is a block diagram of a wearable electronic device according to one embodiment.

[0207] Referring to FIG. 23, a wearable electronic device (1000) according to one embodiment may include at least one processor (1020), a display module (1060), a sensor module (1076), and a memory (1030). The wearable electronic device (1000) may correspond to the electronic device (2301) of FIG. 24, which will be described later. In addition, at least one processor (1020), a display module (1060), a sensor module (1076), and a memory (1030) of FIG. 23 may correspond to the processor (2320), the display module (2360), the sensor module (2376), and the memory (2330) of FIG. 24, respectively.

[0208] The processor (1020) may, for example, execute software to control at least one other component (e.g., a hardware or software component) of the wearable electronic device (1000) connected to the processor (1020), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (1020) may store commands or data received from another component (e.g., a sensor module (1076)) in a volatile memory, process the commands or data stored in the volatile memory, and store result data in a non-volatile memory. According to one embodiment, the processor (1020) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the wearable electronic device (1000) includes a main processor and a secondary processor, the secondary processor may be configured to use less power than the main processor or to be specialized for a specific function. The secondary processor may be implemented separately from the main processor or as part of the main processor.

[0209] The memory (1030) can store various data used by at least one component (e.g., the processor (1020) or the sensor module (1076)) of the wearable electronic device (1000). The data can include, for example, software (e.g., a program) and input data or output data for commands related thereto. The memory (1030) can include volatile memory or non-volatile memory.

[0210] The display module (1060) can visually provide information to an external party (e.g., a user) of the wearable electronic device (1000). The display module (1060) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module (1060) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch. The display module (1060) may include one or more displays, and a main display area and one or more sub-display areas may be provided by the one or more displays.

[0211] The sensor module (1076) can detect the operating status (e.g., power or temperature) of the wearable electronic device (1000) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1076) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0212] According to one embodiment, the instructions stored in the memory (1030) may cause the wearable electronic device (1000) to perform the operations of FIGS. 1 to 23 when executed by at least one processor (1020).

[0213] According to one embodiment, at least one processor (1020) can display a first GUI on a main display area (e.g., the main display area (21) of FIG. 2 or the main display area (31) of FIG. 3). At least one processor (1020) can display a first GUI provided by an application running on the wearable electronic device (1000) on the main display area. The application running on the wearable electronic device (1000) may include, but is not limited to, a clock application, a weather application, a schedule application, and a health application, for example, and may include all types of applications executable by the wearable electronic device (1000).

[0214] According to one embodiment, at least one processor (1020) can receive a first user input that multi-touches a sub-display area (e.g., sub-display areas 22, 23 of FIG. 2 , or sub-display area (32) of FIG. 3 ). At least one processor (1020) can receive a first user input that touches a first portion and a second portion of the sub-display area together. The first user input can be a multi-touch input that includes a first touch on the first portion of the sub-display area and a second touch on the second portion of the sub-display area.

[0215] In one embodiment, the first portion of the sub-display area and the second portion of the sub-display area may be portions spaced apart from each other by the main display area. For example, the first portion of the sub-display area may be a portion adjacent to the bottom of the main display area, and the second portion of the sub-display area may be a portion adjacent to the top of the main display area.

[0216] According to one embodiment, at least one processor (1020) may receive a second user input that moves a multi-touch. If the first user input is a multi-touch input that includes a first touch on a first portion of the sub-display area and a second touch on a second portion of the sub-display area, at least one processor (1020) may receive a second user input that moves at least one of the first touch or the second touch.

[0217] For example, the wearable electronic device (1000) may receive a second user input for moving the first touch and the second touch. In this case, at least one processor (1020) may obtain information regarding the movement of the first touch and the second touch. For example, at least one processor (1020) may identify information regarding the starting position of the movement of the first touch, the moving direction of the first touch, the moving distance of the first touch, the starting position of the movement of the second touch, the moving direction of the second touch, and the moving distance of the second touch.

[0218] For example, the wearable electronic device (1000) may receive a second user input for moving the first touch among the first touch and the second touch. In this case, at least one processor (1020) may obtain information regarding the movement of the first touch. For example, at least one processor (1020) may identify information regarding the starting position of the movement of the first touch, the movement direction of the first touch, and the movement distance of the first touch.

[0219] For example, the wearable electronic device (1000) may receive a second user input for moving a second touch among the first and second touches. In this case, at least one processor (1020) may obtain information regarding the movement of the second touch. For example, at least one processor (1020) may identify information regarding the starting position of the movement of the second touch, the movement direction of the second touch, and the movement distance of the second touch.

[0220] For convenience of explanation, the first user input and the second user input are described as separate inputs in the above description, but this is not limited thereto. The first user input and the second user input may also be a single user input. For example, the wearable electronic device (1000) may recognize multi-touch and multi-touch movement input as a single user input.

[0221] According to one embodiment, at least one processor (1020) can determine whether the wearable electronic device (1000) is rotated. For example, when the wrist of a user wearing the wearable electronic device (1000) is rotated, the wearable electronic device (1000) can rotate around an axis corresponding to the user's forearm. In this case, the at least one processor (1020) can control the sensor module (1076) within the wearable electronic device (1000) to detect the rotation of the wearable electronic device (1000), thereby obtaining information regarding the rotation of the wearable electronic device (1000). For example, the at least one processor (1020) can obtain information regarding the rotation direction and rotation angle of the wearable electronic device (1000).

[0222] According to one embodiment, at least one processor (1020) can determine whether the wearable electronic device (1000) has rotated while the multi-touch is moving. At least one processor (1020) can determine whether the rotation of the wearable electronic device (1000) has been detected while the movement of the multi-touch is detected.

[0223] According to one embodiment, at least one processor (1020) may compare information regarding movement of the first touch and the second touch included in the multi-touch with information regarding rotation of the wearable electronic device (1000). For example, through the comparison, at least one processor (1020) may identify whether the movement of the multi-touch is movement due to rotation of the wearable electronic device (1000) or whether the movement of the multi-touch is movement unrelated to rotation of the wearable electronic device (1000).

[0224] According to one embodiment, when it is determined that the wearable electronic device (1000) is not rotated, at least one processor (1020) can display a second GUI related to the first GUI in the sub-display area. When it is determined that the wearable electronic device (1000) is not rotated while a second user input moving the multi-touch is received, at least one processor (1020) can display a preset second GUI in the sub-display area according to the movement of the multi-touch.

[0225] According to one embodiment, the second GUI may be a GUI provided by an application that provided the first GUI, and the second GUI related to the first GUI may be a preset GUI. In this case, at least one processor (1020) may identify the second GUI related to the first GUI by considering an identification value of the first GUI, an identification value of the application that provided the first GUI, and information about an input moving a multi-touch. However, the present invention is not limited thereto, and the second GUI may be a GUI provided by an application different from the application that provided the first GUI.

[0226] According to one embodiment, at least one processor (1020) may display a second GUI in a portion of the sub-display area adjacent to the main display area. For example, at least one processor (1020) may additionally display the second GUI in a portion of the sub-display area adjacent to the top of the main display area. For example, at least one processor (1020) may additionally display the second GUI in a portion of the sub-display area adjacent to the bottom of the main display area.

[0227] Although the above description describes at least one processor (1020) displaying the second GUI in the sub-display area, the present invention is not limited thereto. For example, the at least one processor (1020) may display the second GUI by overlapping the first GUI displayed in the main display area. Furthermore, for example, the at least one processor (1020) may display the second GUI across the main display area and the second display area.

[0228] Although the above description describes at least one processor (1020) as additionally displaying a second GUI, this is not limited thereto. For example, at least one processor (1020) may display the second GUI in place of the first GUI. In this case, at least one processor (1020) may remove the first GUI and display the second GUI on the main display area.

[0229] Although the above description describes at least one processor (1020) as displaying a second GUI, this is not limited thereto. At least one processor (1020) may also expand the first GUI and display the expanded first GUI on at least a portion of the main display area and the sub-display area. In this case, the expanded first GUI may include more information than the first GUI before being expanded.

[0230] According to one embodiment, when it is determined that the wearable electronic device (1000) has been rotated, at least one processor (1020) can change the display of the first GUI. When it is determined that the wearable electronic device (1000) has been rotated while a second user input moving a multi-touch is received, at least one processor (1020) can change the display of the first GUI according to the rotation of the wearable electronic device (1000).

[0231] For example, at least one processor (1020) may display the first GUI by rotating it within the main display area. In this case, at least one processor (1020) may determine the rotation angle of the first GUI based on the rotation direction and rotation angle of the wearable electronic device (1000).

[0232] For example, at least one processor (1020) may move the display position of the first GUI from the main display area to the sub-display area. In this case, at least one processor (1020) may determine the movement direction and movement distance of the first GUI based on the rotation direction and rotation angle of the wearable electronic device (1000).

[0233] FIG. 24 is a block diagram of an electronic device (2301) within a network environment (2300) according to various embodiments. Referring to FIG. 24, in the network environment (2300), the electronic device (2301) may communicate with the electronic device (2302) via a first network (2398) (e.g., a short-range wireless communication network), or may communicate with the electronic device (2304) or a server (2308) via a second network (2399) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (2301) may communicate with the electronic device (2304) via the server (2308). According to one embodiment, the electronic device (2301) may include a processor (2320), a memory (2330), an input module (2350), an audio output module (2355), a display module (2360), an audio module (2370), a sensor module (2376), an interface (2377), a connection terminal (2378), a haptic module (2379), a camera module (2380), a power management module (2388), a battery (2389), a communication module (2390), a subscriber identification module (2396), or an antenna module (2397). In some embodiments, the electronic device (2301) may omit at least one of these components (e.g., the connection terminal (2378)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (2376), camera module (2380), or antenna module (2397)) may be integrated into a single component (e.g., display module (2360)).

[0234] The processor (2320) may, for example, execute software (e.g., a program (2340)) to control at least one other component (e.g., a hardware or software component) of the electronic device (2301) connected to the processor (2320) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (2320) may store commands or data received from other components (e.g., a sensor module (2376) or a communication module (2390)) in a volatile memory (2332), process the commands or data stored in the volatile memory (2332), and store result data in a non-volatile memory (2334). According to one embodiment, the processor (2320) may include a main processor (2321) (e.g., a central processing unit or an application processor) or an auxiliary processor (2323) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (2321). For example, when the electronic device (2301) includes the main processor (2321) and the auxiliary processor (2323), the auxiliary processor (2323) may be configured to use less power than the main processor (2321) or to be specialized for a given function. The auxiliary processor (2323) may be implemented separately from the main processor (2321) or as a part thereof.

[0235] The auxiliary processor (2323) may control at least a portion of functions or states associated with at least one component (e.g., the display module (2360), the sensor module (2376), or the communication module (2390)) of the electronic device (2301), for example, on behalf of the main processor (2321) while the main processor (2321) is in an inactive (e.g., sleep) state, or together with the main processor (2321) while the main processor (2321) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (2323) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (2380) or a communication module (2390)). In one embodiment, the auxiliary processor (2323) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (2301) where the artificial intelligence is performed, or can be performed through a separate server (e.g., server (2308)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0236] The memory (2330) can store various data used by at least one component (e.g., the processor (2320) or the sensor module (2376)) of the electronic device (2301). The data can include, for example, software (e.g., the program (2340)) and input data or output data for commands related thereto. The memory (2330) can include volatile memory (2332) or non-volatile memory (2334).

[0237] The program (2340) may be stored as software in memory (2330) and may include, for example, an operating system (2342), middleware (2344), or an application (2346).

[0238] The input module (2350) can receive commands or data to be used in a component of the electronic device (2301) (e.g., a processor (2320)) from an external source (e.g., a user) of the electronic device (2301). The input module (2350) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0239] The audio output module (2355) can output audio signals to the outside of the electronic device (2301). The audio output module (2355) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0240] The display module (2360) can visually provide information to an external party (e.g., a user) of the electronic device (2301). The display module (2360) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display module (2360) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0241] The audio module (2370) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (2370) can acquire sound through the input module (2350), output sound through the sound output module (2355), or an external electronic device (e.g., electronic device (2302)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (2301).

[0242] The sensor module (2376) can detect the operating status (e.g., power or temperature) of the electronic device (2301) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (2376) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0243] The interface (2377) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (2301) with an external electronic device (e.g., the electronic device (2302)). In one embodiment, the interface (2377) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0244] The connection terminal (2378) may include a connector through which the electronic device (2301) may be physically connected to an external electronic device (e.g., the electronic device (2302)). In one embodiment, the connection terminal (2378) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0245] The haptic module (2379) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (2379) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0246] The camera module (2380) can capture still images and videos. In one embodiment, the camera module (2380) may include one or more lenses, image sensors, image signal processors, or flashes.

[0247] The power management module (2388) can manage the power supplied to the electronic device (2301). According to one embodiment, the power management module (2388) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0248] A battery (2389) may power at least one component of the electronic device (2301). In one embodiment, the battery (2389) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0249] The communication module (2390) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (2301) and an external electronic device (e.g., electronic device (2302), electronic device (2304), or server (2308)), and the performance of communication through the established communication channel. The communication module (2390) may operate independently from the processor (2320) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (2390) may include a wireless communication module (2392) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (2394) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (2304) via a first network (2398) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (2399) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (2392) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (2396) to verify or authenticate the electronic device (2301) within a communication network such as the first network (2398) or the second network (2399).

[0250] The wireless communication module (2392) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (2392) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (2392) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (2392) may support various requirements specified in the electronic device (2301), an external electronic device (e.g., the electronic device (2304)), or a network system (e.g., the second network (2399)). According to one embodiment, the wireless communication module (2392) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0251] The antenna module (2397) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (2397) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (2397) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (2398) or the second network (2399), may be selected from the plurality of antennas by, for example, the communication module (2390). A signal or power may be transmitted or received between the communication module (2390) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (2397).

[0252] According to various embodiments, the antenna module (2397) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0253] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0254] According to one embodiment, commands or data may be transmitted or received between the electronic device (2301) and an external electronic device (2304) via a server (2308) connected to a second network (2399). Each of the external electronic devices (2302 or 2304) may be the same or a different type of device as the electronic device (2301). According to one embodiment, all or part of the operations executed in the electronic device (2301) may be executed in one or more of the external electronic devices (2302, 2304, or 2308). For example, when the electronic device (2301) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (2301) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (2301). The electronic device (2301) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (2301) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (2304) may include an Internet of Things (IoT) device. The server (2308) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (2304) or server (2308) may be included within the second network (2399). The electronic device (2301) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0255] The electronic device (2301) of FIG. 24 may correspond to the wearable electronic device (1000) of FIGS. 1 to 23, and the instructions stored in the memory (2330) of the electronic device (2301) may cause the electronic device (2301) to perform the operations of the wearable electronic device (1000) of FIGS. 1 to 23 when executed by the processor (2320).

[0256] According to one embodiment, one or more displays (e.g., 1060, 2360) providing a main display area and a sub-display area; one or more sensors (e.g., 1076, 2376); a memory (e.g., 1030, 1076) storing commands; And one or more processors (e.g., 1020, 2320); wherein the instructions stored in the memory, when executed by the one or more processors, cause the wearable electronic device to: display a first GUI on the main display area of ​​the wearable electronic device, receive a first user input of multi-touching on the sub-display area corresponding to a band portion of the wearable electronic device, receive a second user input of moving the multi-touch while the multi-touch is maintained, and control the one or more sensors to determine whether the wearable electronic device has been rotated while the second user input is being received, and change the display of the first GUI if it is determined that the wearable electronic device has been rotated. In addition, the wearable electronic device can be provided to display a second GUI preset in relation to the first GUI on the sub-display area if it is determined that the wearable electronic device has not been rotated.

[0257] Additionally, the sub-display area may include a first portion and a second portion separated by the main display area.

[0258] Additionally, the multi-touch may include a first touch on the first portion of the sub-display area, and a second touch on the second portion of the sub-display area.

[0259] Additionally, the instructions stored in the memory, when executed by the one or more processors, may cause the wearable electronic device to: receive a user input moving at least one of the first touch or the second touch.

[0260] Additionally, the instructions stored in the memory, when executed by the one or more processors, may cause the wearable electronic device to: determine whether the wearable electronic device has been rotated about a preset axis by rotation of the wrist of the user wearing the wearable electronic device.

[0261] In addition, the instructions stored in the memory, when executed by the one or more processors, may cause the wearable electronic device to: determine whether the rotation direction and rotation amount of the wearable electronic device correspond to the movement direction and movement distance of the multi-touch, and change the display of the first GUI according to whether the rotation direction and rotation amount of the wearable electronic device correspond to the movement direction and movement distance of the multi-touch.

[0262] Additionally, the instructions stored in the memory, when executed by the one or more processors, may cause the wearable electronic device to: move the display position of the first GUI from the main display area to the sub-display area.

[0263] Additionally, the instructions stored in the memory, when executed by the one or more processors, may cause the wearable electronic device to: rotate and display the first GUI on the main display area.

[0264] Additionally, the instructions stored in the memory, when executed by the one or more processors, may cause the wearable electronic device to: remove the second GUI displayed in the sub-display area when the multi-touch is released.

[0265] Additionally, the instructions stored in the memory, when executed by the one or more processors, may cause the wearable electronic device to: maintain the changed display of the first GUI displayed in the sub-display area when the multi-touch is released.

[0266] According to one embodiment, a computer-readable recording medium having recorded thereon a program for executing a method for displaying a GUI, the method comprising: displaying a first GUI on a main display area of ​​a wearable electronic device; receiving a first user input of multi-touching a sub-display area corresponding to a band portion of the wearable electronic device; receiving a second user input of moving the multi-touch while the multi-touch is maintained; determining whether the wearable electronic device has been rotated while the second user input is being received; changing the display of the first GUI when it is determined that the wearable electronic device has been rotated; and displaying a second GUI preset in relation to the first GUI on the sub-display area when it is determined that the wearable electronic device has not been rotated.

[0267] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0268] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0269] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0270] Various embodiments of the present document may be implemented as software (e.g., a program (2340)) including one or more instructions stored in a storage medium (e.g., an internal memory (2336) or an external memory (2338)) readable by a machine (e.g., an electronic device (2301)). For example, a processor (e.g., a processor (2320)) of the machine (e.g., an electronic device (2301)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0271] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0272] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. A method for a wearable electronic device to display a GUI, An action of displaying a first GUI in a main display area of ​​the wearable electronic device; An operation of receiving a first user input that multi-touches a sub-display area corresponding to a band portion of the wearable electronic device; An action of receiving a second user input moving the multi-touch while the multi-touch is maintained; An action of determining whether the wearable electronic device is rotated while the second user input is being received; An action of changing the display of the first GUI when it is determined that the wearable electronic device has been rotated; and An action of displaying a second GUI preset in relation to the first GUI in the sub-display area when it is determined that the wearable electronic device is not rotated; A method comprising:

2. In paragraph 1, The above sub-display area includes a first portion and a second portion separated by the main display area, A method wherein the multi-touch includes a first touch on the first portion of the sub-display area and a second touch on the second portion of the sub-display area.

3. In paragraph 2, A method, wherein the action of receiving the second user input moving the multi-touch comprises an action of receiving a user input moving at least one of the first touch or the second touch.

4. In either paragraph 1 or paragraph 2, A method for determining whether the wearable electronic device is rotated, the method comprising: determining whether the wearable electronic device is rotated about a preset axis by rotation of the wrist of the user wearing the wearable electronic device.

5. In any one of paragraphs 1, 2 or 4, The operation of determining whether the above wearable electronic device has been rotated is as follows: An operation for determining whether the rotation direction and rotation amount of the wearable electronic device correspond to the movement direction and movement distance of the multi-touch; Including more, The action of changing the display of the above first GUI is: A method comprising: an operation of changing the display of the first GUI according to a rotational direction and rotational amount of the wearable electronic device corresponding to a movement direction and movement distance of the multi-touch.

6. In any one of paragraphs 1, 2, 4 or 5, The action of changing the display of the above first GUI is: An action of moving the display position of the first GUI from the main display area to the sub display area; A method comprising:

7. In any one of paragraphs 1, 2, 4, 5 or 6, The action of changing the display of the above first GUI is: An action of rotating and displaying the above first GUI on the main display area; A method comprising:

8. In any one of paragraphs 1, 2, 4, 5, 6 or 7, An action of removing the second GUI displayed in the sub-display area when the multi-touch is released; How to include more.

9. In any one of paragraphs 1, 2, 4, 5, 6, 7 or 8, An action of maintaining the changed display of the first GUI displayed in the sub-display area as the multi-touch is released; How to include more.

10. In paragraph 1, The above first GUI is provided by an application running on the wearable electronic device, A method for changing the display of the first GUI and the second GUI being preset for the application.

11. In wearable electronic devices, One or more displays providing a main display area and a sub-display area; One or more sensors: memory for storing commands; and One or more processors; Including, The instructions stored in the memory, when executed by the one or more processors, cause the wearable electronic device to: Displaying a first GUI on the main display area of ​​the wearable electronic device; Receiving a first user input that multi-touches the sub-display area corresponding to the band portion of the wearable electronic device, Receiving a second user input moving the multi-touch while the multi-touch is maintained; By controlling one or more of the sensors, determining whether the wearable electronic device has been rotated while the second user input is being received; If it is determined that the wearable electronic device has been rotated, the display of the first GUI is changed, A wearable electronic device, which, when it is determined that the wearable electronic device is not rotated, displays a second GUI preset in relation to the first GUI on the sub-display area.

12. In paragraph 11, The above sub-display area includes a first portion and a second portion separated by the main display area, A wearable electronic device, wherein the multi-touch includes a first touch on the first portion of the sub-display area and a second touch on the second portion of the sub-display area.

13. In either of paragraphs 11 or 12, The instructions stored in the memory, when executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device that determines whether the wearable electronic device has been rotated around a preset axis by rotation of the wrist of the user wearing the wearable electronic device.

14. In any one of paragraphs 11, 12 or 13, The instructions stored in the memory, when executed by the one or more processors, cause the wearable electronic device to: Determine whether the rotation direction and rotation amount of the wearable electronic device correspond to the movement direction and movement distance of the multi-touch, A wearable electronic device, wherein the display of the first GUI is changed according to the rotation direction and rotation amount of the wearable electronic device corresponding to the movement direction and movement distance of the multi-touch.

15. In any one of paragraphs 11, 12, 13 or 14, The instructions stored in the memory, when executed by the one or more processors, cause the wearable electronic device to: A wearable electronic device, wherein the second GUI displayed on the sub-display area is removed when the multi-touch is released.

Citation Information

Patent Citations

  • Mobile terminal and method for controlling the same

    KR1020160039948A

  • Electronic device and method for controlling the same

    KR1020160092443A

  • Mobile terminal and method for controlling the same

    KR1020170017112A

  • Flexable electronic device and a operating method thereof

    KR1020170071194A

  • Information processing apparatus, information processing method, and program

    US20160342280A1