Electronic device for providing route guidance service and operation method thereof

Abstract

According to an embodiment, an electronic device may include at least one sensor. The electronic device may include a GPS module. The electronic device may include a display module. The electronic device may include a processor operatively connected to the at least one sensor, the GPS module, and the display module. The processor may be configured to identify the current location of the electronic device on the basis of at least one piece of first data provided from the GPS module. The processor may be configured to identify an intermediate destination for route guidance corresponding to destination information on the basis of the destination information and the current location of the electronic device. The processor may be configured to identify a direction in which the electronic device faces, on the basis of at least one piece of second data from the at least one sensor. The processor may be configured to control the display module to express an object corresponding to a range including a difference between a reference direction for route guidance from the current location of the electronic device to the intermediate destination and the direction in which the electronic device faces.

Description

Electronic device providing route guidance service and method of operation thereof

[0001] The present disclosure relates to an electronic device providing a route guidance service and an operating method thereof.

[0002] A route guidance service (or navigation service) can calculate and provide an optimal route from the current location of an electronic device (or vehicle) to a desired destination. For example, the electronic device can determine the current location of the electronic device using a global positioning system (GPS). The electronic device can determine at least one intermediate destination (waypoint) from the current location to the destination, and can provide route guidance based on the at least one intermediate destination. As examples of route guidance, the electronic device can provide the distance from the current location to the next intermediate destination, the direction of travel to the next intermediate destination, and / or the direction of travel from the next intermediate destination, but examples of route guidance are not limited.

[0003] Route guidance services can be provided not only while driving, but also while walking. Users can utilize route guidance services using electronic devices, such as smartphones (or tablet PCs). Users can navigate to their destination while carrying the electronic device and viewing content related to the route guidance displayed on the device's display module.

[0004] The above information may be provided as background information to aid in understanding this document. None of the above is claimed to be prior art related to this document or can be used to determine prior art.

[0005] According to one embodiment, an electronic device may include at least one sensor. The electronic device may include a GPS module. The electronic device may include a display module. The electronic device may include a processor operatively connected to the at least one sensor, the GPS module, and the display module. The processor may be configured to determine a current location of the electronic device based on at least one first data provided from the GPS module. The processor may be configured to determine an intermediate destination for route guidance corresponding to the destination information based on destination information and the current location of the electronic device. The processor may be configured to determine a direction toward which the electronic device is facing based on at least one second data from the at least one sensor. The processor may be configured to control the display module to display an object corresponding to a range including a difference between a reference direction for route guidance from the current location of the electronic device to the intermediate destination and a direction toward which the electronic device is facing.

[0006] According to one embodiment, a method of operating an electronic device including at least one sensor, a GPS module, and a display module may be provided. The method may include an operation of confirming a current location of the electronic device based on at least one first data provided from the GPS module. The method may include an operation of confirming an intermediate destination for route guidance corresponding to the destination information based on destination information and the current location of the electronic device. The method may include an operation of confirming a direction toward which the electronic device is facing based on at least one second data from the at least one sensor. The method may include an operation of controlling the display module to display an object corresponding to a range including a difference between a reference direction for route guidance from a current location of the electronic device to the intermediate destination and a direction toward which the electronic device is facing.

[0007] According to one embodiment, a storage medium storing at least one computer-readable instruction may be provided. According to one embodiment, the at least one instruction, when executed by at least one processor of an electronic device, may cause the electronic device to perform at least one operation. The operating method may include an operation of determining a current location of the electronic device based on at least one first data provided from a GPS module of the electronic device. The operating method may include an operation of determining an intermediate destination for route guidance corresponding to the destination information based on destination information and the current location of the electronic device. The operating method may include an operation of determining a direction toward which the electronic device is facing based on at least one second data from at least one sensor of the electronic device. The operating method may include an operation of controlling a display module of the electronic device to display an object corresponding to a range that includes a difference between a reference direction for route guidance from a current location of the electronic device to the intermediate destination and a direction toward which the electronic device is facing.

[0008] According to one embodiment, a storage medium storing at least one computer-readable instruction may be provided. The at least one instruction, when executed by a processor of an electronic device, may cause the electronic device to perform at least one operation. The at least one operation may include an operation of presenting content associated with movement of at least a portion of a user's body according to a specified rule. The at least one operation may include an operation of obtaining information associated with a position of at least a portion of the user's body while the content is being presented. The at least one operation may include an operation of determining depth information for presenting an object corresponding to the user based on the information associated with the position of at least a portion of the body. The at least one operation may include an operation of detecting an event that causes the presentation of a first object. The at least one operation may include an operation of presenting, in response to the detection of the event, the first object based on the depth information corresponding to the user.

[0009] According to one embodiment, an electronic device may include a memory storing at least one instruction. The electronic device may include at least one sensor. The electronic device may include a display module. The electronic device may include a processor operatively connected to the memory, the at least one sensor, and the display module. The at least one instruction, when executed by the processor, may cause the electronic device to perform at least one operation. The at least one operation may include an operation of presenting content associated with movement of at least a portion of a user's body according to a specified rule. The at least one operation may include an operation of obtaining information associated with a position of at least a portion of the user's body while the content is being presented. The at least one operation may include an operation of determining depth information for presenting an object corresponding to the user based on the information associated with the position of at least a portion of the body. The at least one operation may include an operation of detecting an event that causes presentation of a first object. The at least one action may include, in response to detection of the event, an action of representing the first object based on the depth information corresponding to the user.

[0010] According to one embodiment, a method of operating an electronic device may be provided. The method of operating the electronic device may include an operation of presenting content associated with movement of at least a part of a user's body according to a specified rule. The method of operating the electronic device may include an operation of obtaining information associated with a position of at least a part of the user's body while the content is being presented. The method of operating the electronic device may include an operation of determining depth information for presenting an object corresponding to the user based on the information associated with the position of at least a part of the body. The method of operating the electronic device may include an operation of detecting an event that causes presentation of a first object. The method of operating the electronic device may include an operation of presenting, in response to detection of the event, the first object based on the depth information corresponding to the user.

[0011] FIG. 1 is a block diagram of an electronic device according to one embodiment.

[0012] FIG. 2a is a drawing for explaining terrain for route guidance according to one embodiment.

[0013] FIG. 2b is a drawing for explaining the difference between the reference direction and the direction in which the electronic device is facing according to one embodiment.

[0014] Figures 3a to 3d are drawings for explaining objects expressed according to embodiments.

[0015] FIG. 4A illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0016] FIG. 4b illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0017] FIG. 4c illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0018] FIG. 4d illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0019] FIG. 5 illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0020] FIG. 6 is a drawing for explaining a plurality of ranges according to one embodiment.

[0021] FIG. 7A illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0022] FIG. 7b illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0023] Figure 8 is a drawing for explaining the implementation of an object according to one embodiment.

[0024] FIG. 9a is a drawing for explaining an example of an object according to one embodiment.

[0025] FIG. 9b is a drawing for explaining an example of an object according to one embodiment.

[0026] FIG. 9c is a drawing for explaining an example of an object according to one embodiment.

[0027] FIG. 10 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0028] FIGS. 11A and 11B are drawings showing the front and back of a wearable electronic device (1100) according to one embodiment.

[0029] FIG. 12a is a diagram illustrating the representation of an object for a virtual service according to one embodiment.

[0030] FIG. 12b is a drawing for explaining depth information of an object according to one embodiment.

[0031] FIG. 12c is a drawing for explaining whether or not an object can be selected based on the length of a user's arm according to a comparative example for comparison with an embodiment.

[0032] Fig. 13 is a flowchart for explaining an operating method of an electronic device according to one embodiment.

[0033] Figure 14a is a drawing for explaining content according to one embodiment.

[0034] FIG. 14b is a diagram for explaining information associated with a location that is confirmed while content is provided according to one embodiment.

[0035] Figure 14c is a drawing for explaining the expression of content according to one embodiment.

[0036] FIG. 15 is a drawing for explaining an example of content according to one embodiment.

[0037] Fig. 16 is a flowchart for explaining an operating method of an electronic device according to one embodiment.

[0038] Figure 17a is a drawing for explaining content according to one embodiment.

[0039] Figure 17b is a drawing for explaining depth information according to one embodiment.

[0040] FIG. 18a is a flowchart for explaining an operating method of an electronic device according to one embodiment.

[0041] Figure 18b is a drawing for explaining the representation of an object according to one embodiment.

[0042] Fig. 19 is a flowchart for explaining an operating method of an electronic device according to one embodiment.

[0043] FIG. 20 is a diagram for explaining the performance of related functions by multiple areas according to one embodiment.

[0044] FIG. 21 is a flowchart illustrating an operation method of an electronic device according to one embodiment.

[0045] FIG. 1 is a block diagram of an electronic device according to one embodiment.

[0046] According to one embodiment, the electronic device (101) may include a processor (120), a display module (160), a GPS module (170), and / or a sensor (180). In some embodiments, the electronic device (101) may omit at least one of these components, or may have one or more other components added. In some embodiments, some of these components may be integrated into a single component, and there is no limitation on the implementation thereof.

[0047] The processor (120) may, for example, execute software (e.g., a program) to control at least one other component of the electronic device (101) and perform various data processing or calculations. As at least part of the data processing or calculations, the processor (120) may store commands or data received from other components in a memory (not shown), process the commands or data stored in the memory (not shown), and store result data in the memory (not shown). The processor (120) may include a main processor (e.g., a central processing unit) or an auxiliary processor (e.g., a graphics processing unit, a neural network processing unit, an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor.

[0048] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). For example, when the electronic device (101) is implemented as a smart phone, a tablet PC, a video see through (VST) device, or a head-mounted device (HMD), the display module (160) may be implemented to include, for example, a liquid crystal display (LCD) and a control means (for example, a display driving integrated circuit (DDI)). The display module (160) may further include a touch screen panel (TSP) for touch detection and / or a control means (for example, a TSP integrated circuit (TSP IC)). For example, when the electronic device (101) is implemented as an augmented reality (AR) glasses device, the display module (160) may be implemented to include, for example, a light irradiation device, an optical waveguide, and / or a control means. The processor (120) may control the display module (160) to express an object. The expression of the object will be described later. For example, The processor (120) can provide control data to the display module (160) to cause the expression of an object, and this can be expressed as the processor (120) controlling the display module (160).

[0049] The GPS module (170) can receive at least one satellite signal from each of at least one satellite. The GPS module (170) can process the at least one received satellite signal and provide first data associated with the processing result to the processor (120). The processor (120) can identify (or detect, recognize, determine, calculate) the current location of the electronic device (101) based on the first data. In one example, the GPS module (170) can process at least one satellite signal from each of at least one satellite to calculate the current location, and in this case, can provide the current location as first data to the processor (120). In one example, the GPS module (170) can provide the result of processing at least one satellite signal as first data to the processor (120), and in this case, the processor (120) can also calculate the current location using the first data. The current location may refer to the location where the electronic device (101) (or GPS module (170)) is located, which is confirmed based on processing of data confirmed by the GPS module (170), and may be expressed as, for example, GPS coordinates and / or latitude / longitude coordinates, but there is no limitation on the format of expression. As described above, the current location may be confirmed by the GPS module (170) and provided to the processor (120), or may be confirmed by the processor (120). The processor (120) may additionally (or alternatively) use data from an entity other than the GPS module (170) to confirm the current location of the electronic device (101).For example, the current location may be determined not only by GPS, but also additionally (or alternatively) by using WPS (Wifi positioning system) and / or SLAM (simultaneous localization and mapping), and there is no limitation on the method of determining the current location.

[0050] The sensor (180) may include at least one sub-sensor, for example, a gyroscope, a magnetometer, and / or an accelerometer, but there is no limitation on the type of device (or module) that the sensor (180) includes. The sensor (180) may be implemented as, for example, a motion processing unit (MPU) and / or an inertial measurement unit (IMU), but there is no limitation on the implementation examples. The sensor (180) may process sensing data of each of the at least one sub-sensors to provide second data. In one example, the sensor (180) may process sensing data of each of the at least one sub-sensors to calculate a direction toward which the electronic device (101) is facing, and in this case, may provide the direction toward which the electronic device (101) is facing as second data to the processor (120). In one example, the sensor (180) may provide the result of processing the sensing data of each of at least one sub-sensor as second data to the processor (120), in which case the processor (120) may use the second data to calculate the direction in which the electronic device (101) is facing. The direction in which the electronic device (101) is facing may be, for example, at least one degree of rotation from at least one reference point (or reference angle) based on at least one axis (for example, three axes in the case of three dimensions, but there is no limitation on the number of dimensions) passing through the electronic device (101), but there is no limitation. For example, the direction in which the electronic device (101) is facing may also be named as the orientation of the electronic device (101), the degree of inclination based on at least one reference of the electronic device (101), etc.The direction in which the electronic device (101) is facing can be expressed in, for example, a three-axis angle (e.g., roll / pitch / yaw) format, an Euler angle format, and / or a quaternion format, but there is no limitation on the format of the expression. As described above, the direction in which the electronic device (101) is facing can be identified by the sensor (180) and provided to the processor (120), or the processor (120) can calculate the direction based on the data from the sensor (180), and there is no limitation on the subject of the identification. In one example, the three-axis angle (e.g., roll / pitch / yaw) can be identified based on sensing data by a gyro sensor (e.g., based on an integration result). At least a part of the three-axis angles (e.g., yaw, but there is no limitation) can be corrected based on sensing data from a magnetic field sensor. At least some of the three-axis angles (e.g., roll / pitch, but not limited thereto) can be compensated based on sensing data from an accelerometer. The compensation process (or data combining process) can utilize, for example, a Kalman filter, but not limited thereto. The three-axis angles can be converted into, for example, Euler angle format and / or quaternion format, but there is no limitation on the format in which they are represented. Hereinafter, the representation of an object by an electronic device (101) will be described with reference to FIGS. 2A and 2B.

[0051] FIG. 2A is a diagram illustrating a terrain for route guidance according to one embodiment. FIG. 2B is a diagram illustrating the difference between a reference direction and a direction toward which an electronic device is facing according to one embodiment.

[0052] According to one embodiment, the processor (120) may determine the current location of the electronic device (101) based on at least one first data from the GPS module (170). As described above, the current location of the electronic device (101) may be calculated by the processor (120) or may be calculated by the GPS module (170).

[0053] The processor (120) can identify an intermediate destination for route guidance corresponding to the destination information (e.g., location information of the destination) based on the destination information and the current location of the electronic device (101). For example, as shown in FIG. 2A, the processor (120) can identify the current location (202) as shown in FIG. 2A. The processor (120) can obtain destination information for the destination (210). For example, the processor (120) can execute an application for route guidance (or may be referred to as a navigation application). The processor (120) can identify destination information based on user input (e.g., text and / or voice) received through the user interface of the application. The processor (120) can identify information for route guidance based on information on the current location (202) of the electronic device (101) and information on the destination (210). Information for route guidance may include, for example, at least one intermediate destination (203, 204, 205, 206) between the current location (202) and the destination (210), a distance from one point to the next point, a distance from one point to the next point, a direction from one point to the next point, and a direction of travel from the next intermediate destination, but there is no limitation on its type. At least one intermediate destination (203, 204, 205, 206) may be set as a point requiring a change in direction of travel (e.g., a right turn or a left turn, but there is no limitation) among the paths from the current location (202) to the destination (210), a point requiring selection of one of a plurality of candidate routes, and / or a point requiring guidance on the direction of travel, but there is no limitation on the criteria for setting the same.Route guidance from the current location may include, for example, information about the distance from the current location to the next intermediate destination, the direction of travel from the current location to the next intermediate destination, and / or the direction of travel from the next intermediate destination, but the type of information is not limited. Meanwhile, intermediate destinations may be named as destinations, next destinations, nodes, passing points, etc., and there are no restrictions on how they are expressed. Furthermore, a route may be established from the current location to the destination without intermediate destinations, in which case the intermediate destinations may be replaced with the destination. For example, those skilled in the art will understand that if the path from the current location to the destination is confirmed as a single straight line, an intermediate destination may not be established.

[0054] The processor (120) can identify a reference direction for route guidance from the current location (202) to the next intermediate destination (203). The reference direction may be a direction corresponding to (or associated with, for) route guidance from the current location (202) to the next intermediate destination (203). For example, the reference direction may be set as a direction toward the next intermediate destination (203) based on the current location (202), but there is no limitation on the setting method. For example, a reference direction (for example, a vector of coordinate values ​​having multiple components, but there is no limitation) within a coordinate system may be set based on a difference (for example, subtraction) between the coordinate values ​​within the coordinate system of the current location (202) and the coordinate values ​​of the intermediate destination (203), but this is merely exemplary, and there is no limitation on the method of identifying the reference direction. For example, the reference direction may be expressed in the same format as the direction in which the electronic device (101) is facing, or a conversion may be performed between the reference direction and the direction in which the electronic device (101) is facing for comparison. For example, the processor (120) may identify as route guidance "go straight ahead 25 m from the current location (202) to the intermediate destination (203), and turn right at that point." The direction in which the electronic device (101) is facing must substantially match the reference direction (or be within a difference considering the tolerance) so that the user can move in the correct direction while carrying the electronic device (101). If the direction in which the electronic device (101) is facing is opposite to the reference direction and the user moves forward according to the route guidance provided by the electronic device (101), the user is likely to move to the opposite location rather than the intermediate destination (203). Accordingly, provision of information related to the degree of alignment between the direction in which the electronic device (101) is facing and the reference direction for route guidance may be required.

[0055] For example, referring to FIG. 2B, the processor (120) can identify a reference direction (221) for route guidance from the current location (202) corresponding to the first time point (t1) to the next intermediate destination (203). The reference direction (221) can be set as the direction from the current location (202) to the intermediate destination (203) as described above, but there is no limitation on the setting method. The processor (120) can identify the direction in which the electronic device (101) is facing (or the posture of the electronic device (101)) based on at least one second data corresponding to the first time point (t1) from the sensor (180). For example, at the first time point (t1), the user can gaze in the first direction (222) while wearing the electronic device (101) on the head, and the direction in which the electronic device (101) is facing can be identified as the first direction (222).

[0056] The processor (120) can determine a first difference between a reference direction (221) corresponding to a first time point (t1) and a first direction (222) toward which the electronic device (101) is directed. Here, the first difference may include, but is not limited to, the size of the angle between the two directions (221, 222) and / or the direction toward the first direction (222) toward which the electronic device (101) is directed based on the reference direction (221). For example, when the reference direction (221) is expressed in the same format as the first direction (222) toward which the electronic device (101) is directed, the electronic device (101) can determine the difference between the two directions (221, 222). If the reference direction (221) and the first direction (222) toward which the electronic device (101) is directed are expressed in different formats, the processor (120) can check the difference between the two directions (221, 222) after converting the format of one direction into the format of the other direction for format unification, but there is no limitation.

[0057] The processor (120) can check the range in which the first difference is included. For example, as shown in FIG. 2b, the processor (120) can check the first range (231) in which the first difference is included among a plurality of ranges (231, 232a, 232b, 233a, 233b, 234). The plurality of ranges (231, 232a, 232b, 233a, 233b, 234) are illustrated, for example, as respective coordinate systems, but this is exemplary and there is no limitation on the setting criteria and / or dimensions thereof. In the example of each coordinate system, an angle (or vector) corresponding to the reference direction (221) can be the reference of each coordinate system. For example, the angle corresponding to the reference direction (221) can be 0°, in which case the range can be exemplarily set as shown in Table 1.

[0058] Range angle system 1 Range (231) - θ1 or more + less than θ1 System 2-1 Range (232a) + θ1 or more + less than θ2 System 2-2 Range (232b) - θ2 or more - less than θ1 System 3-1 Range (233a) + θ2 or more + less than θ3 System 3-2 Range (233b) - θ3 or more - less than θ2 System 4 Range (232a) + θ3 or more - less than θ3

[0059] Meanwhile, as in Table 1, for example, the 2-1 range (232a) and the 2-2 range (232b) are set symmetrically, and this is merely exemplary and there is no limitation, and there is no limitation on the number of ranges. Meanwhile, in Table 1, although each coordinate system is expressed based on a two-dimensional coordinate system, there is no limitation on the dimension. Meanwhile, when the range is expressed in two dimensions, a person skilled in the art will understand that a conversion (for example, projection, but there is no limitation) of a physical quantity other than two dimensions (for example, the direction in which the electronic device (101) expressed in three dimensions faces) to two dimensions may be performed.

[0060] The processor (120) can control the display module (160) to express (for example, display, provide, present, reproduce, render, light-emitting, and / or light path control, but is not limited to) an object (for example, UI element, UI object, icon, text, button, image, visual element, visual component, avatar, thumbnail, pop-up, animation, key, and / or button, but is not limited to) corresponding to the first range (231) in which the first difference is included. The object corresponding to the first range (231) can mean, for example, a direction in which the electronic device (101) is facing that can substantially match (or, coincide, correspond, and / or align) with the reference direction (231), but is not limited to. The expression of objects will be explained with reference to Figures 3a to 3d.

[0061] Meanwhile, at the second time point (t2), the user can stay at the current location (202) and only turn his / her head in a different direction. The processor (120) can determine, based on data corresponding to the second time point (t2) provided from the sensor (180), that the direction in which the electronic device (101) is facing is the second direction (223). The processor (120) can determine a second difference between the reference direction (221) and the direction in which the electronic device (101) is facing, which is the second direction (223). The processor (120) can determine that the second difference is included in the 3-1 range (233a). The processor (120) can control the display module (160) to display an object corresponding to the 3-1 range (233a) in which the first difference is included. An object corresponding to the 3-1 range (233a) may, for example, indicate that the direction in which the electronic device (101) is facing does not substantially match (or, coincide, correspond, and / or align) with the reference direction (231), but is not limited thereto. The expression of the object will be described with reference to FIGS. 3a to 3d . As described above, the user can recognize the degree of alignment between the viewing direction and the reference direction for route guidance, and thus can move along the correct route. Even if the direction in which the electronic device (101) is facing is the second direction (233), if the route guidance of "go straight for 25 m and then turn right" set based on the current location (202) is provided, the user is likely to go straight in the second direction (233). The electronic device (101) can express an object indicating the degree of alignment between the direction in which the electronic device (101) is facing and the reference direction, in addition to the route guidance of "go straight for 25 m and then turn right." Accordingly, the user can turn his head so that the direction in which the electronic device (101) is facing (i.e., the direction in which the user is looking) and the reference direction are aligned, and then move along the correct path.

[0062] Meanwhile, if the difference is included in the 2-1 range (232a) or the 2-2 range (232b), the processor (120) may be set to maintain the display of the object corresponding to the 1st range (231). For example, the 2-1 range (232a) or the 2-2 range (232b) may be a range for tolerance. For example, the object may not change (or move) whenever the user turns his / her head to the left or right while moving, or faces left or right while moving. Meanwhile, it is merely exemplary that the 2-1 range (232a) or the 2-2 range (232b) is set as a range for tolerance, and those skilled in the art will understand that the 1st range (231) may be set taking tolerance into consideration.

[0063] Figures 3a to 3d are drawings for explaining objects expressed according to embodiments.

[0064] Referring to FIG. 3A, the processor (120) can control the display module (160) so that the first object (303) is expressed as being positioned within the display area (302). For example, the electronic device (101) can be implemented as an AR glass type device. In this case, the user can wear the electronic device (101) and gaze at the first foreground (301). Among these, the display module (160) can be controlled so that the first object (303) is expressed as being positioned within at least one display area (302) of the display module (160) of the electronic device (101). The first object (303) is implemented as including, for example, a plurality of circular sub-objects, but this is exemplary and not limiting. The first object (303) is illustrated as being displayed, for example, in the relatively upper center of the display area (302), but this is exemplary and there is no limitation on its display location. The processor (120) can control the display module (160) to display an object (305) for route guidance. In the example of Fig. 3a, the object (305) for route guidance is illustrated as text, such as "Turn right after 25 m," but this is exemplary and there is no limitation on the implementation of the object. Based on the first object (303), the user can recognize that he will turn right after going straight for 25 m in the direction he is currently looking at.

[0065] Referring to FIG. 3B, the processor (120) may control the display module (160) so that the second object (313) is expressed as being located within the display area (312). For example, the user may turn his / her head to the right as in FIG. 2B while wearing the electronic device (101). Accordingly, the second foreground (311) located relatively to the right compared to the first foreground (301) of FIG. 3A may be gazed at by the user. As described with reference to FIG. 2B, the processor (120) may control the display module (160) so that the second object (313) corresponding to the 3-1 range (233a) is expressed as being located within at least one display area (312) based on the fact that the second difference between the reference direction for route guidance and the direction in which the electronic device (101) is facing is included within the 3-1 range (233a). The second object (313) may be implemented to include, for example, a relatively smaller number of circular sub-objects than the first object (303), but this is exemplary and there is no limitation on its shape. The second object (313) may also be implemented to have substantially the same shape as the first object (303), in which case the first object (303) and the second object (313) may have different display positions and / or different properties (for example, color, transparency, but not limited thereto). The second object (313) is illustrated as being displayed, for example, on the relatively upper left side of the display area (312), but this is exemplary and there is no limitation on its display position. For example, the display position corresponding to the 3-1 range (233a) described in FIG. 2b may be set to the relatively upper left of the display area (312), so that the user can intuitively recognize that he or she must turn his or her head to the left in order to look in the reference direction.If the difference is included in the 3-2 range (233b), the processor (120) may control the display module (160) to display the object as if it were positioned on the upper right corresponding to the 3-2 range (233b), but there is no limitation. The processor (120) may control the display module (160) to display the object (315) for path guidance. The user may recognize that he or she must turn his or her head to the left from the current gaze direction and then proceed straight for 25 m based on the second object (313). For example, as the user turns his or her head to the left from the current gaze direction, the processor (120) may determine that the difference is included in the first range (231) again. Accordingly, the processor (120) may control the display module (160) to display the first object (303) corresponding to the first range (231). Accordingly, the user can recognize that the first object (303) will move in the direction of the current gaze by recognizing it again.

[0066] Referring to FIG. 3C, the processor (120) may control the display module (160) so that the third object (323) is expressed as being located within the display area (322). For example, the user may turn his / her head more to the right than in FIG. 2B while wearing the electronic device (101). Accordingly, the user may gaze at the third foreground (321), which is located relatively to the right compared to the second foreground (311) of FIG. 3B. Based on the fact that the third difference between the reference direction for route guidance and the direction in which the electronic device (101) is facing is included in the fourth range (234), the processor (120) may control the display module (160) so that the third object (323) corresponding to the fourth range (234) is expressed as being located within at least one display area (322).

[0067] The third object (323) may be implemented to include, for example, a plurality of circular sub-objects, the same number as the second object (313), but the spacing between the plurality of sub-objects of the third object (323) may be smaller than the spacing between the plurality of sub-objects of the second object (313). Accordingly, the user may recognize that he or she must turn his or her head relatively more to the left in order to gaze at the reference direction based on the shape of the third object (323), but there is no limitation on the method of expression thereof. The spacing between the sub-objects may be set based on, for example, the size of the difference between the reference direction and the direction in which the electronic device (101) is facing, but there is no limitation. The processor (120) may control the display module (160) to display the object (325) for path guidance. The user can recognize that he / she should turn his / her head relatively far to the left from the current gaze direction based on the third object (323) and then move straight for 25 m. For example, as the user turns his / her head to the left from the current gaze direction, the processor (120) can confirm that the difference is sequentially included in the 3-2 range (233a) and the first range (231). Accordingly, the processor (120) can control the display module (160) so that the second object (313) and the first object (303) are sequentially displayed. Accordingly, the user can recognize that he / she should move in the current gaze direction by recognizing the first object (303).

[0068] In another example, as in FIG. 3d, the processor (120) may control the display module (160) to display an object (341) including text indicating to look back corresponding to the fourth range (234), based on the third difference between the reference direction for route guidance and the direction in which the electronic device (101) is facing being included in the fourth range (234).

[0069] FIG. 4A illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0070] According to one embodiment, the electronic device (101) can, in operation 401, determine the current location of the electronic device (101) based on at least one first data provided from the GPS module (170). The determination of the current location based on the data from the GPS module (170) is merely exemplary, and those skilled in the art will understand that the electronic device (101) may additionally (or alternatively) determine the current location of the electronic device (101) based on the WPS and / or SLAM method. Meanwhile, although in FIG. 1, the determination of the current location of the electronic device (101) in operation 401 is illustrated as being performed first compared to other operations, this is exemplary, and there is no limitation on the timing of the determination of the current location.

[0071] The electronic device (101), in operation 403, can identify an intermediate destination for route guidance corresponding to the destination information based on the destination information and the current location of the electronic device. For example, the electronic device (101), as described with reference to FIG. 2A, can identify at least one intermediate destination based on the destination information from the current location. The electronic device (101), for example, can identify an intermediate destination for route guidance after identifying the current location in operation 401 (or, based on identifying the current location, using the identified current location, in response to identifying the current location, if or when identifying the current location), but there is no limitation.

[0072] The electronic device (101) can, in operation 405, determine the direction in which the electronic device (101) is facing based on at least one second data from the sensor (180). Although the electronic device (101) has been described as determining the direction in which the electronic device (101) is facing in operation 405, there is no limitation on the time point at which the electronic device (101) determines the direction in which the electronic device (101) is facing. The direction in which the electronic device (101) is facing at a time point used in the embodiment of FIG. 4A may be determined, for example, before or after the determination of the current location. For example, the electronic device (101) may determine the direction in which the electronic device (101) is facing periodically or based on event detection, but there is no limitation on the event for determining the direction.

[0073] The electronic device (101), in operation 407, can control the display module (160) to display an object corresponding to a range that includes a difference between a reference direction and a direction in which the electronic device (101) is facing. For example, the electronic device (101), after confirming the current location and the intermediate destination (or, in response to confirming the current location and the intermediate destination by using the confirmed current location and the intermediate destination based on the confirmation of the current location and the intermediate destination, confirms the current location and the intermediate destination), can confirm a reference direction for route guidance from the current location to the intermediate destination. The reference direction may be, for example, a direction from the current location to the intermediate destination, but there is no limitation on the setting method thereof. After the electronic device (101) has confirmed the reference direction and the direction in which the electronic device (101) is facing (or, based on the confirmation of the reference direction and the direction in which the electronic device (101) is facing, in response to the confirmation of the reference direction and the direction in which the electronic device (101) is facing, using the confirmed reference direction and the direction in which the electronic device (101) is facing), the electronic device (101) can confirm the difference between the reference direction and the direction in which the electronic device (101) is facing, for example, as described with reference to FIG. 2B. If the reference direction and the direction in which the electronic device (101) is facing are expressed in the same format, the electronic device (101) can confirm the magnitude and / or direction of the difference between the two directions, for example, based on a vector difference. If the reference direction and the direction in which the electronic device (101) is directed are expressed in different formats, the electronic device (101) can unify the formats between the two directions and then check the size and / or direction of the difference between the two directions, for example, based on a vector difference. However, the above-described difference checking method is exemplary and there is no limitation on the checking method.The electronic device (101) can, after confirming the difference between the two directions (or, in response to confirming the difference between the two directions using the confirmed difference between the two directions based on the confirmation of the difference between the two directions), confirm the range in which the difference is included. The electronic device (101) can, after confirming the range in which the difference is included (or, in response to confirming the range in which the difference is included using the range in which the difference is included based on the confirmation of the range in which the difference is included), confirm the object corresponding to the range in which the difference is included. The electronic device (101) can control the display module (160) so that the confirmed object is displayed.

[0074] FIG. 4b illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0075] According to one embodiment, the electronic device (101) can, in operation 411, determine the current location of the electronic device (101) based on at least one first data provided from the GPS module (170). In operation 413, the electronic device (101) can determine an intermediate destination for route guidance corresponding to the destination information based on the destination information and the current location of the electronic device. In operation 415, the electronic device (101) can determine a first direction toward which the electronic device (101) is headed based on at least one second data corresponding to a first point in time from the sensor (180). In operation 417, the electronic device (101) can control the display module (160) to display a first object corresponding to the first range based on the difference between the reference direction and the first direction being included in the first range.

[0076] In operation 419, the electronic device (101) can identify a second direction in which the electronic device (101) is facing based on at least one third data corresponding to a second time point after the first time point from the sensor (180). In operation 421, the electronic device (101) can control the display module (160) to display a second object corresponding to the second range instead of the first object based on the difference between the reference direction and the second direction being outside the first range and included in the second range. For example, the first object corresponding to the first range and the second object corresponding to the second range may have different shapes. For example, the first object corresponding to the first range and the second object corresponding to the second range may have substantially the same shape but different properties (for example, color, transparency, and / or size, but without limitation). For example, a first object corresponding to a first range and a second object corresponding to a second range may have substantially the same shape and / or the same properties, but may be expressed at different locations. For example, a first object corresponding to a first range and a second object corresponding to a second range may have different shapes and / or different properties, and may also be expressed at different locations.

[0077] FIG. 4c illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0078] According to one embodiment, the electronic device (101) can, in operation 431, determine the current location of the electronic device (101) based on at least one first data provided from the GPS module (170). In operation 433, the electronic device (101) can determine an intermediate destination for route guidance corresponding to the destination information based on the destination information and the current location of the electronic device. In operation 435, the electronic device (101) can determine the direction in which the electronic device (101) is headed based on at least one data from the sensor (180). In operation 437, the electronic device (101) can control the display module (160) to display a first object corresponding to a range that includes a difference between the reference direction and the direction in which the electronic device (101) is headed.

[0079] The electronic device (101) may, in operation 439, determine a direction in which the electronic device (101) is facing (e.g., an updated direction or a new direction) based on at least one piece of data from the sensor (180). In operation 441, the electronic device (101) may determine whether a difference between a reference direction and a direction in which the electronic device (101) is facing (e.g., an updated direction or a new direction) is outside a pre-existing range. If it is determined that the difference between the reference direction and the direction in which the electronic device (101) is facing (e.g., an updated direction or a new direction) is outside a pre-existing range (operation 441 - Yes), the electronic device (101) may adjust a position, shape, and / or property of the first object. For example, the electronic device (101) may adjust the position, shape, and / or properties of the first object in response to a range that is newly included beyond the existing range by a difference between the reference direction and the direction in which the electronic device (101) is facing (e.g., an updated direction or a new direction), but is not limited thereto. This may be referred to as the electronic device (101) representing a second object that is different from the first object in response to a range in which the difference between the reference direction and the direction in which the electronic device (101) is facing (e.g., an updated direction or a new direction) is newly included beyond the existing range. If it is confirmed that the difference between the reference direction and the direction in which the electronic device (101) is facing (e.g., an updated direction or a new direction) does not exceed the existing range (Operation 441 - No), the electronic device (101) may maintain the display of the first object in Operation 445.Accordingly, even if the user rotates his / her head within a range that can be tolerated as tolerance while wearing the electronic device (101), and / or even if a relatively small error occurs in the GPS module (170) and / or the sensor (180), adjustment of the object being expressed (or change of the object) can be prevented from being performed relatively frequently.

[0080] FIG. 4d illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0081] According to one embodiment, the electronic device (101) can, in operation 461, determine the current location of the electronic device (101) based on at least one first data provided from the GPS module (170). In operation 463, the electronic device (101) can determine an intermediate destination for route guidance corresponding to the destination information based on the destination information and the current location of the electronic device. In operation 465, the electronic device (101) can determine a first direction toward which the electronic device (101) is headed based on at least one second data corresponding to a first point in time from the sensor (180). In operation 467, the electronic device (101) can control the display module (160) to display a first object corresponding to the first range and a third object for route guidance based on the fact that the difference between the reference direction and the first direction is included in the first range. For example, the electronic device (101) may express a third object for route guidance, such as the text "Go straight for 50m and then turn right", but this is merely exemplary and there is no limitation on the type (or implementation form) of the object for route guidance. The third object may also be expressed in various formats, such as a UI element, a UI object, an icon, text, a button, an image, a visual element, a visual component, an avatar, a thumbnail, a pop-up, an animation, a key, and / or a button.

[0082] In operation 469, the electronic device (101) can determine a second direction in which the electronic device (101) is facing based on at least one third data corresponding to a second time point after the first time point from the sensor (180). In operation 471, the electronic device (101) can control the display module (160) to display a third object for path guidance together with a second object corresponding to the second range instead of the first object, based on the difference between the reference direction and the second direction being outside the first range and included in the second range. For example, in a case where the user does not move while wearing the electronic device (101) but only turns his / her head, the third object for path guidance can remain displayed substantially as is. Meanwhile, in another example, the third object may be represented differently (e.g., its shape, properties, and / or location may be changed) than before, so that the second object and the third object can be represented together by representing the second object in place of the first object.

[0083] FIG. 5 illustrates a flowchart for explaining an operating method of an electronic device according to one embodiment. The embodiment of FIG. 5 will be described with reference to FIG. 6. FIG. 6 is a diagram for explaining a plurality of ranges according to one embodiment.

[0084] According to one embodiment, the electronic device (101) can, in operation 501, determine the current location of the electronic device (101) based on at least one first data provided from the GPS module (170). In operation 503, the electronic device (101) can determine an intermediate destination for route guidance corresponding to the destination information based on the destination information and the current location of the electronic device. In operation 505, the electronic device (101) can determine the direction in which the electronic device (101) is heading based on at least one data from the sensor (180).

[0085] The electronic device (101) may set a plurality of ranges associated with the difference in operation 507. Meanwhile, in FIG. 1, there is no limitation on the timing at which the setting of the plurality of ranges in operation 507 is performed. For example, the electronic device (101) may periodically perform the setting of the plurality of ranges. For example, the electronic device (101) may perform the setting of the plurality of ranges based on the confirmation of the current location and / or the confirmation of the direction toward which the electronic device (101) is facing. For example, the electronic device (101) may perform the setting of the plurality of ranges before the confirmation of the current location and / or the confirmation of the direction toward which the electronic device (101) is facing, but the above-described confirmation timing and / or the event for confirmation are all exemplary and not limited. The electronic device (101) may, in operation 509, confirm a range that includes a difference between the reference direction and the direction toward which the electronic device (101) is facing, among the set plurality of ranges. The electronic device (101) can control the display module (160) to display a first object corresponding to the identified range in operation 511.

[0086] Referring to Fig. 6, various examples of setting multiple ranges may be possible. For example, according to the first setting (610), multiple ranges (611, 612a, 612b, 613) may be set. For example, in Fig. 6, settings (610, 620, 630) are illustrated with respective coordinate systems, but this is exemplary and there is no limitation on the setting criteria and / or dimensions. In the examples of each coordinate system, an angle (or vector) corresponding to a reference direction may be the reference of each coordinate system. For example, the angle corresponding to the reference direction may be 0°, in which case the ranges may be set as examples, as shown in Table 2.

[0087] Range angle 1 range (611)-θ 1-1 Ideal +θ 1-1Less than 2-1 range (612a)+θ 1-1 Ideal +θ2 less than 2-2 range (612b) -θ2 or more -θ 1-1 Less than 3 ranges (613) + θ2 or more - less than θ2

[0088] Meanwhile, according to the second setting (620), a plurality of ranges (621, 622a, 622b, 623) may be set. According to the third setting (630), a plurality of ranges (631, 632a, 632b, 633) may be set. Table 3 may be exemplary ranges (621, 622a, 622b, 623) of the second setting (620), and Table 4 may be exemplary ranges (631, 632a, 632b, 633) of the third setting (630).

[0089] Range angle 1 range (621)-θ 1-2 Ideal +θ 1-2 Less than 2-1 range (622a)+θ 1-2 Ideal +θ2 less than 2-2 range (622b) -θ2 or more -θ 1-2 Less than 3 ranges (623) + θ2 or more - less than θ2

[0090] Range angle 1 range (631)-θ 1-3 Ideal +θ 1-3 Less than 2-1 range (632a)+θ 1-3 Ideal +θ2 less than 2-2 range (632b) -θ2 or more -θ 1-3 Less than 3 ranges (633) + θ2 or more - less than θ2

[0091] For example, θ representing the boundary of the first range (621) in the second setting (620) 1-2 θ represents the boundary of the first range (611) in the first setting (610). 1-1 It can be set larger. For example, θ representing the boundary of the first range (631) in the third setting (630) 1-3 θ represents the boundary of the first range (621) in the second setting (620). 1-2It can be set larger. As described above, the first range (621) in the second setting (620) may be relatively wider than the first range (611) in the first setting (610), and the first range (631) in the third setting (630) may be relatively wider than the first range (621) in the second setting (620).

[0092] For example, the electronic device (101) has a difference between the reference direction and the direction in which the electronic device (101) is facing, which is θ. N It can be confirmed that θ. N This is greater than 0 and +θ 1-1 Let's assume that it is less than θ. The electronic device (101) is configured to select θ in all cases where the first setting (610) is selected, the second setting (620) is selected, and the third setting (630) is selected. N It can be confirmed that it is included in the first range (611, 621, or 631). The electronic device (101) can control the display module (160) to display an object corresponding to the first range (611, 621, or 631). The object corresponding to the first range (611, 621, or 631) may be, for example, an object indicating that the user is actually looking in a reference direction.

[0093] θ N This +θ 1-1 Greater than +θ 1-2 Let's assume that it is less than θ. The electronic device (101) selects the first setting (610), θ NIt can be confirmed that it is included in this 2-1 range (612a). In this case, the electronic device (101) can control the display module (160) to express an object corresponding to the 2-1 range (612a). The object corresponding to the 2-1 range (612a) can be, for example, an object indicating that the user is substantially looking to the right relative to the reference direction. Meanwhile, if the electronic device (101) selects the 2nd setting (620) or the 3rd setting (630), θ N It can be confirmed that it is included in the first range (621 or 631). The electronic device (101) can control the display module (160) to display an object corresponding to the first range (621, or 631). The object corresponding to the first range (621, or 631) can be, for example, an object indicating that the user is actually looking in a reference direction.

[0094] θ N This +θ 1-2 Greater than +θ 1-3 Let's assume that it is less than θ. The electronic device (101) selects the first setting (610) or the second setting (620), θ N It can be confirmed that it is included in the 2-1 range (612a or 622a). In this case, the electronic device (101) can control the display module (160) to express an object corresponding to the 2-1 range (612a or 622a). The object corresponding to the 2-1 range (612a or 622a) can be, for example, an object indicating that the user is substantially looking to the right relative to the reference direction. Meanwhile, if the electronic device (101) selects the 3rd setting (630), θ NIt can be confirmed that it is included in this first range (631). The electronic device (101) can control the display module (160) to display an object corresponding to the first range (631). The object corresponding to the first range (631) may be, for example, an object indicating that the user is actually looking in a reference direction.

[0095] As described above, depending on the setting of the ranges, the same difference (e.g., the above-described θ N ) may also be different for the object being expressed. The narrower the first range is, the higher the object's display maintenance sensitivity can be expressed. For example, in the first setting (610), the difference (θ N ) is +θ 1-2 Ideal +θ 1-3 If less than, the second object corresponding to the 2-1 range (612-a) is expressed, and in the second setting (620), the first object corresponding to the first range (621) can be expressed. Accordingly, when the first object is initially expressed, the first range, which is the range in which the expression of the first object can be maintained, may be relatively narrower in the first setting (610) than in the second setting (620), and accordingly, the display maintenance sensitivity of the object in the first setting (610) may be relatively higher than the display maintenance sensitivity of the object in the second setting (620).

[0096] The electronic device (101) can select the settings of the ranges based on various conditions. For example, the electronic device (101) can select the settings of the ranges based on map information acquired for route guidance, as described with reference to FIG. 7A. For example, the electronic device (101) can select the settings of the ranges based on sensed data, as described with reference to FIG. 7B. Alternatively, the electronic device (101) can select the settings of the ranges based on user selection, and there are no restrictions on the selection method.

[0097] FIG. 7A illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0098] According to one embodiment, the electronic device (101) may, in operation 701, determine the current location of the electronic device (101) based on at least one first data provided from the GPS module (170). In operation 703, the electronic device (101) may determine an intermediate destination for route guidance corresponding to the destination information based on the destination information and the current location of the electronic device (101). In operation 705, the electronic device (101) may obtain map information corresponding to the current location of the electronic device (101). Meanwhile, the time point of obtaining the map information of the electronic device (101) in operation 705 is exemplary and there is no limitation on the time point. In operation 707, the electronic device (101) may set a plurality of ranges based on the map information. For example, the map information may be at least one piece of information for representing a map associated with the current location. The information for representing the map may include, for example, information on the terrain and / or features around the current location. For example, the electronic device (101) can set a plurality of ranges based on information about the terrain and / or objects around the current location.

[0099] In one example, the electronic device (101) may select a setting with a relatively low sensitivity for maintaining the expression of an object when, based on map information, there are a relatively large number of buildings (e.g., relatively tall buildings, but there is no limitation) around the current location, for example, when the number is greater than or equal to a threshold number (which may be a natural number greater than or equal to 1). For example, the electronic device (101) may select a setting with a relatively high sensitivity for maintaining the expression of an object when, based on map information, there are a relatively small number of buildings around the current location, for example, when the number is less than or equal to a threshold number (which may be a natural number greater than or equal to 1).

[0100] For example, if it is determined that the number of buildings around the current location is 0, the electronic device (101) may select the first setting (610) described in FIG. 6. For example, if it is determined that the number of buildings around the current location is 1, the electronic device (101) may select the second setting (620) described in FIG. 6. For example, if it is determined that the number of buildings around the current location is 2, the electronic device (101) may select the third setting (630) described in FIG. 6. For example, the more relatively tall buildings are located in the vicinity, the higher the possibility that errors will occur in the sensing data of the GPS module (170) and / or the sensor (180). If, despite a high possibility of error occurrence, the sensitivity of maintaining the object's expression is high (e.g., when the first setting (610) is selected), the electronic device (101) may be more likely to perform changes to the object relatively frequently in response to an error occurrence. In a case where the possibility of error occurrence is relatively high, the electronic device (101) may select a setting (e.g., the third setting (630)) with a low sensitivity of maintaining the object's expression. Accordingly, even if an error occurs, the possibility of changing the object relatively frequently may be reduced.

[0101] For example, in the example of FIG. 2A, when the electronic device (101) is located at a location of 202, a setting with a low sensitivity for maintaining the expression of an object (e.g., a third setting (630)) can be selected based on the fact that there are relatively many buildings in the surroundings. For example, when the electronic device (101) is located at a location of 204, a setting with a high sensitivity for maintaining the expression of an object (e.g., a first setting (610)) can be selected based on the fact that there are relatively few buildings in the surroundings.

[0102] Meanwhile, the electronic device (101) may also set ranges based on the number of forks around the current location based on map information. For example, if it is determined that the number of forks around the current location is 0 (i.e., there is only 1 path corresponding to the direction of travel), the electronic device (101) may select the third setting (630) described in FIG. 6 . For example, if it is determined that the number of forks around the current location is 1, the electronic device (101) may select the second setting (620) described in FIG. 6 . For example, if it is determined that there are 2 forks around the current location, the electronic device (101) may select the first setting (610) described in FIG. 6 . For example, if there are relatively many forks, the user may be more likely to deviate from the path, and thus, it is required to provide correct path guidance by having the user keep their eyes on the reference direction. Accordingly, in cases where there are relatively many forks, a setting with high sensitivity for maintaining the expression of the object (e.g., the first setting (610)) may be selected. On the other hand, in cases where there are relatively few or no forks, a setting with low sensitivity for maintaining the expression of the object (e.g., the third setting (630)) may be selected.

[0103] For example, in the example of FIG. 2A, when the electronic device (101) is located at a position of 202, a setting with a low sensitivity for maintaining the expression of the object (e.g., a third setting (630)) can be selected based on the absence of a fork in the surroundings. For example, when the electronic device (101) is located at a position of 204, a setting with a high sensitivity for maintaining the expression of the object (e.g., a first setting (610)) can be selected based on the presence of relatively many forks in the surroundings.

[0104] FIG. 7b illustrates a flowchart for explaining a method of operating an electronic device according to one embodiment.

[0105] According to one embodiment, the electronic device (101) may, in operation 711, determine the current location of the electronic device (101) based on at least one first data provided from the GPS module (170). In operation 713, the electronic device (101) may determine an intermediate destination for route guidance corresponding to the destination information based on the destination information and the current location of the electronic device (101). In operation 715, the electronic device (101) may determine the direction in which the electronic device (101) is headed based on at least one second data from the sensor (180). In operation 717, the electronic device (101) may set a plurality of ranges based on at least one first data and / or at least one second data. Meanwhile, the timing of setting the plurality of ranges in operation 717 is exemplary and there is no limitation on the timing. For example, the electronic device (101) can determine the possibility of an error occurring based on at least one first data and / or at least one second data.

[0106] For example, the electronic device (101) can check the strength of a GPS satellite signal from the GPS module (170). The electronic device (101) can check the possibility of an error based on the strength of the GPS satellite signal. For example, it can be determined that the possibility of an error is relatively higher when the strength of the GPS satellite signal is relatively low, but there is no limitation. For example, the electronic device (101) can check the possibility of an error based on analysis of time-series data based on data checked at least one previous point in time, as well as at least one first data and / or at least one second data. For example, the electronic device (101) can check whether the time-series data satisfies a condition indicating a possibility of an error, and / or check the possibility of an error based on an inference result of an AI model for determining a possibility of an error, but there is no limitation on the method. If, despite a high possibility of error occurrence, the sensitivity of maintaining the expression of an object is high (e.g., when the first setting (610) is selected), the electronic device (101) may be more likely to perform changes to the object relatively frequently in response to an error occurrence. In a case where the possibility of error occurrence is relatively high, the electronic device (101) may select a setting (e.g., the third setting (630)) in which the sensitivity of maintaining the expression of an object is low. Accordingly, even if an error occurs, the possibility of changing the object relatively frequently may be reduced.

[0107] Figure 8 is a drawing for explaining the implementation of an object according to one embodiment.

[0108] According to one embodiment, the electronic device (101) may be configured to express different objects corresponding to the same range, depending on the selected setting. For example, the electronic device (101) may select a setting with high sensitivity for maintaining the expression of an object (e.g., the first setting (610) in FIG. 6). For example, referring to the first foreground (801), there may be no buildings around the electronic device (101). As described above, the electronic device (101) may select a setting with high sensitivity for maintaining the expression of an object (e.g., the first setting (610) in FIG. 6) depending on the absence of buildings. Meanwhile, the electronic device (101) may determine that the difference between the reference direction and the direction in which the electronic device (101) is facing is included in the first range (611). The electronic device (101) can control the display module (160) so that a first object (804) corresponding to a first range (611) of a first setting (610) is displayed within at least one display area (802) of the display module (160). The electronic device (101) can control the display module (160) so that an object (803) for route guidance is displayed.

[0109] For example, the electronic device (101) may select a setting with low sensitivity for maintaining the expression of an object (e.g., the third setting (630) in FIG. 6). For example, referring to the second foreground (811), a building may be placed around the electronic device (101). As described above, the electronic device (101) may select a setting with low sensitivity for maintaining the expression of an object (e.g., the third setting (630) in FIG. 6) due to the presence of a building. Meanwhile, the electronic device (101) may determine that the difference between the reference direction and the direction in which the electronic device (101) is facing is included in the first range (631). The electronic device (101) can control the display module (160) so that a first object (814) corresponding to a first range (631) of a third setting (630) is displayed within at least one display area (812) of the display module (160). The electronic device (101) can control the display module (160) so that an object (813) for route guidance is displayed.

[0110] In the example of FIG. 8, the shapes of the first object (804) corresponding to the first range (611) of the first setting (610) and the first object (814) corresponding to the first range (631) of the third setting (630) may be implemented to be different. For example, the gap between the sub-objects constituting the first object (804) corresponding to the first range (611) of the first setting (610) may be smaller than the gap between the sub-objects constituting the first object (814) corresponding to the first range (631) of the third setting (630). Meanwhile, the different shapes of the two objects (804, 814) are merely exemplary, and the shapes, properties, and / or positions of the two objects (804, 814) may be expressed differently. Meanwhile, depending on the implementation, both objects (804, 814) may be expressed identically.

[0111] FIG. 9a is a drawing for explaining an example of an object according to one embodiment.

[0112] According to one embodiment, the electronic device (101) may control the display module (160) to display an object corresponding to the first range based on whether the difference between the reference direction and the direction in which the electronic device (101) is facing falls within the first range. Furthermore, the electronic device (101) may control the display module (160) to display an object corresponding to the first range based on whether the difference between the reference direction and the direction in which the electronic device (101) is facing falls outside the first range and falls within the second range. The object (901) is an example of an object corresponding to the first range and may be, for example, a graphic object indicating that the user is looking forward. Meanwhile, if it is determined that the difference falls outside the first range and falls within the second range, the object (911) may be displayed instead of the object (901). For example, the object (911) may be a graphic object indicating that the user is looking to the left compared to the reference direction. For example, the electronic device (101) may represent an object (911) indicating that the user is gazing to the left relative to the reference direction based on whether the difference is included in the 2-2 area (232b) or the 3-2 area (233b) of FIG. 2B. Meanwhile, this is exemplary, and the electronic device (101) may be implemented to represent the object (911) based on whether the difference is included in the 2-1 area (232a) or the 3-1 area (233a) of FIG. 2B (i.e., when it is determined that the user is gazing to the right relative to the reference direction). In this case, a relatively leftward arrow of the object (911) may mean that the user must gaze to the left relative to the current point in order to gaze in the reference direction.Those skilled in the art will appreciate that the objects described in this and other embodiments may be expressed not only when the user is determined to be looking in a specific direction relative to a reference direction, but also when the user is determined to be looking in a direction opposite to the specific direction.

[0113] For example, sub-objects (902a, 902b) may be examples of objects corresponding to the first range. The sub-object (902a) may be, for example, a graphic object indicating a reference direction. The sub-object (902b) may, for example, indicate a direction in which a user is looking (or a direction in which a user must look in order to look at the reference direction) based on the reference direction. In the first range, the coordinates of the center of the sub-object (902b) along the first axis (e.g., the horizontal axis) may be set to be substantially the same as the coordinates of the sub-object (902a) along the first axis, but there is no limitation. If it is confirmed that the difference is outside the first range and falls within the second range, sub-objects (912a, 912b) may be expressed instead of the sub-objects (902a, 902b). The sub-object (912a) may be, for example, a graphic object indicating a reference direction, and may be expressed in substantially the same shape and / or position as the sub-object (912a). The sub-object (912b) may, for example, indicate a direction in which the user is looking (or a direction in which the user must look in order to look at the reference direction) with respect to the reference direction. For example, the sub-object (912b) may be a graphic object indicating that the user is looking to the left compared to the reference direction (or that the user must look relatively to the left in order to look at the reference direction). The coordinates of the center of the sub-object (912b) on the first axis (e.g., the horizontal axis) may be set relatively to the left of the coordinates on the first axis of the sub-object (902a), for example, but there is no limitation.

[0114] For example, object (903) may be an example of an object corresponding to a first range. Object (903) may be represented to include candidate locations and an indicator for selecting one of the candidate locations. The indicator and the remaining candidate locations may be represented to be visually distinct. The indicator in object (903) may be represented to be positioned at a candidate location that is substantially centered (or to cover an object corresponding to the candidate location). If the difference is determined to be outside the first range and included in a second range, object (913) may be represented in place of object (903). The indicator in object (913) may be represented to be positioned at a candidate location that is relatively to the left (or to cover an object corresponding to the candidate location). Accordingly, by recognizing object (913), the user may recognize that the user is looking to the left compared to a reference direction (or that the user must look to the left relatively to look to the reference direction).

[0115] For example, object (904) may be an example of an object corresponding to the first range. Object (904) may be, for example, a graphical object indicating that the user is substantially gazing in a reference direction. If it is determined that the difference is outside the first range and falls within a second range, sub-objects (914, 915) may be expressed instead of object (904). Sub-object (915) may be, for example, a graphical object indicating the reference direction, and may be expressed at substantially the same location as object (904). Sub-object (914) may indicate, for example, a direction in which the user is gazing (or a direction in which the user must gaze in order to gaze in the reference direction) with respect to the reference direction. For example, sub-object (914) may be a graphical object indicating that the user is gazing to the left compared to the reference direction (or that the user must gaze relatively to the left in order to gaze in the reference direction). The coordinates on the first axis (e.g., horizontal axis) of the center of the sub-object (914) may be set relatively to the left of the coordinates on the first axis of the sub-object (915), for example, but there is no limitation. Accordingly, the user can recognize that the user is looking to the left compared to the reference direction (or, the user must look to the left relatively to look to the reference direction) by recognizing the sub-objects (914, 915). For example, the object (904) may be expressed in a shape that is a combination of the sub-objects (914, 915), and accordingly, the user may perform an action of rotating the head until the object (904) is expressed.

[0116] FIG. 9b is a drawing for explaining an example of an object according to one embodiment.

[0117] For example, object (921) is an example of an object corresponding to the first range, and may be a graphic object indicating, for example, that the user is looking forward. For example, object (921) may be expressed on (or covering) a portion of sub-objects representing an elliptical orbit. Object (921) may have a shape corresponding to a line connecting a portion of the elliptical orbit, but is not limited thereto. Meanwhile, if it is determined that the difference falls outside the first range and falls within the second range, object (931) may be expressed instead of object (921). For example, object (931) may be a graphic object indicating that the user is looking to the right compared to the reference direction (or that the user must look relatively to the right in order to look in the reference direction). Object (931) may be expressed on (or covering) a portion corresponding to the relatively right of the elliptical orbit. Depending on the implementation, the object (931) may be represented with different properties (such as, but not limited to, color, size, and / or transparency) than the object (921), for example, but without limitation.

[0118] For example, sub-objects (922a, 922b, 922c, 922d) may be examples of objects corresponding to the first range. Sub-objects (922c, 922d) may be graphic objects for representing, for example, the boundaries of the first range. Sub-objects (922a, 922b) may mean, for example, a direction in which a user is looking (or a direction in which a user must look in order to look at the reference direction) with respect to a reference direction. For example, when the difference between the reference direction and the direction in which the electronic device (101) is facing is included in the first range, the sub-object (922a) may be expressed as being located between the sub-objects (922c, 922d). In addition, when the difference between the reference direction and the direction in which the electronic device (101) is facing is included in the first range, the sub-object (922b) may be expressed as an arrow pointing in a direction corresponding to the first range, but there is no limitation. If the difference is determined to be outside the first range and included in the second range, sub-objects (932a, 932b) may be expressed instead of sub-objects (922a, 922b). Meanwhile, sub-objects (932c, 932d) may be expressed substantially identically to sub-objects (922c, 922d) in the first range. Sub-object (932a) may be expressed to be outside sub-objects (922c, 922d), for example. Sub-object (932b) may be expressed as an arrow pointing in a direction corresponding to the second range, but there is no limitation.

[0119] For example, sub-objects (923a, 923b) may be examples of objects corresponding to the first range. For example, when the difference between the reference direction and the direction toward which the electronic device (101) is facing is included in the first range, the sub-object (923a) may be expressed, and when the difference is included in the second range, the sub-object (933a) may be expressed. The attribute of the sub-object (923a) may be set differently from that of the sub-object (933a), but is not limited thereto. When the difference between the reference direction and the direction toward which the electronic device (101) is included in the first range, the sub-object (923b) may be expressed, and when the difference is included in the second range, the sub-object (933b) may be expressed. The attribute of the sub-object (923b) may be set differently from that of the sub-object (933b), but is not limited thereto.

[0120] FIG. 9c is a drawing for explaining an example of an object according to one embodiment.

[0121] For example, object (942) may be an example of an object corresponding to the first range, and may be expressed together with (or on) an object (941) for route guidance to an intermediate destination (or destination), for example. Meanwhile, object (952) may be an example of an object corresponding to the second range, and may be expressed together with (or on) an object (951) for route guidance, for example.

[0122] For example, sub-objects (944a, 944b) may be examples of objects corresponding to the first range, and may be expressed together with (or on) an object (943) for route guidance to an intermediate destination (or destination), for example. For example, sub-objects (954a, 954b) may be examples of objects corresponding to the second range. For example, if the difference is outside the first range, the expression of the object for route guidance may not be maintained, but there is no limitation.

[0123] FIG. 10 is a perspective view illustrating the internal configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0124] Referring to FIG. 10, a wearable electronic device (1000) according to one embodiment of the present disclosure may include at least one of a light output module (1011), a display member (1001), and a camera module (1050).

[0125] According to one embodiment of the present disclosure, the light output module (1011) may include a light source capable of outputting an image, and a lens for guiding the image to the display member (1001). According to one embodiment of the present disclosure, the light output module (1011) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

[0126] According to one embodiment of the present disclosure, the display member (1001) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (1011) incident on one end of the optical waveguide may be propagated inside the optical waveguide and provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide an output image of the optical output module (1011) to a user's eye by using at least one diffractive element or reflective element.

[0127] According to one embodiment of the present disclosure, the camera module (1050) can capture still images and / or moving images. According to one embodiment, the camera module (1050) can be positioned within a lens frame and arranged around the display member (1001).

[0128] According to one embodiment of the present disclosure, the first camera module (1051) can capture and / or recognize the trajectory of the user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (1051) can periodically or aperiodically transmit information related to the trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).

[0129] According to one embodiment of the present disclosure, the second camera module (1053) can capture an external image.

[0130] According to one embodiment of the present disclosure, the third camera module (1055) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. According to one embodiment of the present disclosure, the third camera module (1055) can be used for 3 degrees of freedom (3DoF), 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. According to one embodiment of the present disclosure, the second camera module (1053) can also be used for hand detection and tracking, and user gesture recognition. According to one embodiment of the present disclosure, at least one of the first camera module (1051) to the third camera module (1055) can be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module can include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0131] FIGS. 11A and 11B are drawings showing the front and back of a wearable electronic device (1100) according to one embodiment.

[0132] Referring to FIGS. 11A and 11B, in one embodiment, camera modules (1111, 1112, 1113, 1114, 1115, 1116) and / or depth sensors (1117) for obtaining information related to the surrounding environment of the wearable electronic device (1100) may be arranged on a first surface (1110) of the housing.

[0133] In one embodiment, the camera modules (1111, 1112) can acquire images related to the environment surrounding the wearable electronic device.

[0134] In one embodiment, the camera modules (1113, 1114, 1115, 1116) can acquire images while the wearable electronic device is worn by a user. The camera modules (1113, 1114, 1115, 1116) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. The camera modules (1113, 1114, 1115, 1116) can be used for 3DoF, 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the camera modules (1111, 1112) can also be used for hand detection and tracking, and user gesture.

[0135] In one embodiment, a depth sensor (1117) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (1117), the distance to an object may be determined based on camera modules (1113, 1114, 1115, 1116).

[0136] According to one embodiment, a camera module (1125, 1126) for facial recognition and / or a display (1121) (and / or a lens) may be disposed on the second side (1120) of the housing.

[0137] In one embodiment, a face recognition camera module (1125, 1126) adjacent to the display may be used to recognize a user's face, or may recognize and / or track both eyes of the user.

[0138] In one embodiment, the display (1121) (and / or lens) may be disposed on the second side (1120) of the wearable electronic device (1100). In one embodiment, the wearable electronic device (1100) may not include camera modules (1115, 1116) among the plurality of camera modules (1113, 1114, 1115, 1116). Although not illustrated in FIGS. 3A and 3B , the wearable electronic device (1100) may further include at least one of the configurations illustrated in FIG. 2 .

[0139] As described above, according to one embodiment, the wearable electronic device (1100) may have a form factor for being worn on a user's head. The wearable electronic device (1100) may further include a strap and / or a wearing member for being secured to a body part of the user. The wearable electronic device (1100) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0140] FIG. 12A is a diagram illustrating the representation of an object for a virtual service according to one embodiment. The embodiment of FIG. 12A will be described with reference to FIG. 12B. FIG. 12B is a diagram illustrating depth information of an object according to one embodiment.

[0141] According to one embodiment, the electronic device (101) may represent an object based on detection of an event that causes the representation of the object. For example, the electronic device (101) may provide an AR service or a mixed reality (MR) service (or may be referred to as an XR service). In this case, the electronic device (101) may represent information associated with an object included in a real environment (or a real scene), information independent therefrom, and / or represent an object for executing (or calling) a function. In FIG. 12A, for example, objects (1201, 1203, 1205) may be represented as being placed within a real environment (or a real scene) shown to the user through a transparent display member (1001) for an AR service. For example, the electronic device (101) can set the depth information of each specific object (1220a, 1220b, 1220c) as z1, z2, z3, as shown in FIG. 12B. For example, it is assumed that each of the specific objects (1220a, 1220b, 1220c) has the same shape. The depth information can be information for expressing the distance (or degree) in the direction away from the user (1210) (or from the electronic device (101)), for example, within a three-dimensional space (for example, in the case of an AR service, it can be a real environment, or in the case of a VR service, it can be a virtual environment). For example, when the depth information is expressed as a depth value, it can be expressed as being placed relatively farther away from the user (1210) (or the electronic device (101)) as the depth value is relatively larger. For example, assume that the depth information corresponding to the object (1220a) is z1, and the depth information corresponding to the object (1220b) is z2.The electronic device (101) may be expressed so that the object (1201) corresponding to the object (1220a) and the object (1203) corresponding to the object (1220b) are recognized as being relatively closer to the user (1210) (or the electronic device (101)), as shown in FIG. 12A. For example, assume that the depth information corresponding to the object (1220b) is z2 and the depth information corresponding to the object (1220c) is z3. The electronic device (101) may be expressed so that the object (1202) corresponding to the object (1220b) and the object (1205) corresponding to the object (1220c) are recognized as being relatively closer to the user (1210) (or the electronic device (101)), as shown in FIG. 12A. In Fig. 12a, for example, an object positioned relatively closer to the user (1210) may be expressed as being relatively larger in size, but this is merely exemplary and there is no limitation on the method for expressing the near / far placement of objects. Meanwhile, the AR service described above is merely exemplary and, for example, the electronic device (101) may provide a VR service, and may express information related to a virtual environment, information independent therefrom, and / or objects for executing a function.

[0142] Again, referring to FIG. 12B, the electronic device (101) can identify the position of the finger (1211) as a part of the user's body. Meanwhile, as shown in FIG. 12B, identifying the position of the finger (1211) is merely exemplary, and there is no limitation on the part of the body through which the electronic device (101) selects (or manipulates, interacts with, controls, designates, or confirms) an object. In addition to the body, the position of an external electronic device (e.g., a controller, a ring, but there is no limitation) can also be identified. As described above, the electronic device (101) can continuously identify the position of the finger (1211), and this can also be referred to as tracking. The electronic device (101) can, for example, identify the three-dimensional position of the finger (1211). For example, the electronic device (101) can confirm the position of the finger (1211) as (z4, θ4, φ4) in the three-dimensional coordinate system. Meanwhile, the electronic device (101) can also set the positions of each of the objects (1220a, 1220b, 1220c) as (z1, θ1, φ1), (z2, θ2, φ2), and (z3, θ3, φ3). For example, when the distance between the position (z4, θ4, φ4) of the finger (1211) and the position (z2, θ2, φ2) of the object (1220b) is less than or equal to a threshold distance, the electronic device (101) can confirm that the object (1220b) has been selected by the finger (1211), but there is no limitation on the method of confirming whether or not it has been selected. Meanwhile, the positions (z1, θ1, φ1), (z2, θ2, φ2), (z3, θ3, φ3) of each of the objects (1220a, 1220b, 1220c) can be preset. Accordingly, depending on the length of the arm of the user (1210), a situation in which the selection is difficult may occur, which will be explained with reference to FIG. 12c.

[0143] FIG. 12c is a drawing for explaining whether or not an object can be selected based on the length of a user's arm according to a comparative example for comparison with an embodiment.

[0144] For example, a user (1231) may have an arm of a first length (1232), and a user (1241) may have an arm of a second length (1242). The electronic device (101) may detect an event set to cause the presentation of, for example, an object (1220b), and in response, present the object (1220b) as being positioned at a position z2 from each of the users (1231, 1241) (or from the electronic device (101). As described above, the electronic device (101) may track at least a portion of the body of each of the users (1231, 1241) (for example, but not limited to, a finger). The electronic device (101) may determine the position of at least a portion of the body in real time, and may determine whether the object (1220b) is selected by the user based on the determined position. For example, a user (1231) may change the position of a finger using an arm having a relatively long first length (1232). In this case, based on whether the position of the finger corresponds to the position of the object (1220b) (e.g., the difference in position is less than a threshold value), the electronic device (101) may determine that the object (1220b) is selected by the user (1231).

[0145] Meanwhile, in the comparative example, the electronic device (101) may represent the object (1220b) as being uniformly placed at the same location (e.g., at a location z2 away from the user) without considering the arm lengths of the users (1231, 1241). Meanwhile, the user (1241) may attempt to select the object (1220b) with a finger using an arm of a relatively short second length (1242). However, since the second length (1242) is relatively short, the user (1241) may have difficulty selecting the object (1220b). Accordingly, the location at which the object (1220b) is placed needs to be set by considering physical conditions such as the arm length of the user (1241). According to embodiments of the present disclosure, the electronic device (101) may provide content for confirming a user's physical condition (or confirming an object's expression location), and may confirm the user's physical condition (or the object's expression location) based on sensing data confirmed during (or after) the content provision. The electronic device (101) may set the object's expression location based on the confirmed user's physical condition (or the object's expression location). For example, since the second length (1242) of the user's (1241) arm is relatively short, the electronic device (101) may express that the object (1220b) is positioned closer than z2, which will be described later.

[0146] FIG. 13 is a flowchart illustrating an operating method of an electronic device according to one embodiment. The embodiment of FIG. 13 will be described with reference to FIGS. 14A to 14C. FIG. 14A is a diagram illustrating content according to one embodiment. FIG. 14B is a diagram illustrating information associated with a location confirmed while providing content according to one embodiment. FIG. 14C is a diagram illustrating the presentation of content according to one embodiment.

[0147] Referring to FIG. 13, according to one embodiment, the electronic device (101) may, in operation 1301, present content associated with movement of at least a portion of the user's body according to a specified rule. For example, the electronic device (101) may present contents (1401, 1403) as in FIG. 14A. The content (1401) may be, for example, a pop-up window including text such as "Start measurement," but there is no limitation on the method and / or type of presentation of the content. The content (1403) may be a pop-up window including text associated with movement of at least a portion of the user's body according to a specified rule. For example, the text may be text explaining a specified rule, such as "Please draw a large circle by swinging your arm." Meanwhile, the method of explaining the specified rule is not limited to text, and may be expressed as a video for recognizing the rule, and there is no limitation on the method of presentation.

[0148] Referring back to FIG. 13, the electronic device (101) may, in operation 1303, obtain information associated with the position of at least a portion of the body while the content is being presented. For example, referring back to FIG. 14A, the electronic device (101) may present content (1405, 1406). The content (1405) may have a shape representing a progress bar having a length corresponding to the number of tasks for completing a specified rule, for example. The content (1406) of an indicator indicating progress may be presented on the content (1405) of the progress bar. For example, the content (1406) of the indicator may be presented to have a length corresponding to a number of tasks already performed among tasks associated with the specified rule, but is not limited thereto. Accordingly, the user can check the number (or ratio) of tasks remaining to complete a given rule by checking the length of the indicator relative to the length of the entire progress bar. For example, as more tasks for rule completion are performed, the electronic device (101) may display content (1407) corresponding to the updated indicator, as shown in FIG. 14.

[0149] For example, a user may perform a motion of swinging an arm in a circular motion, which is a requested motion, based on text in the content (1403). In one example, the electronic device (101) may track the user's hands (1421a, 1421b). The electronic device (101) may represent tracking trajectories (1411, 1412) of the user's hands (1421a, 1421b), but this is exemplary and not limiting. The tracking trajectories (1411, 1412) may be replaced with updated tracking trajectories (1413, 1414) according to additional movements of the user's hands (1421a, 1421b). The electronic device (101) may identify at least one location of the user's hands (1421a, 1421b) as information associated with a location of at least a part of the body. In one example, the electronic device (101) can identify at least one position of the user's hand (1421a, 1421b) based on at least one image identified based on a deployed camera module and / or a depth camera module. For example, the electronic device (101) can identify a three-dimensional position based on the at least one image, but there is no limitation on the method of identifying the three-dimensional position. In one example, the electronic device (101) can receive data sensed by an external electronic device (1422a, 1422b) held by the user's hand (1421a, 1421b). For example, the external electronic device (1422a, 1422b) can obtain sensing data based on at least one sensor for measuring movement (for example, an acceleration sensor, a gyro sensor, and / or a geomagnetic sensor, but there is no limitation). The electronic device (101) can determine the three-dimensional position of the user's hand (1421a, 1421b) based on sensed data received from an external electronic device (1422a, 1422b). Meanwhile, the above-described tracking method is merely exemplary, and there is no limitation to the tracking method.

[0150] Again, referring to FIG. 13, in operation 1305, the electronic device (101) can identify depth information for representing an object corresponding to the user based on information associated with the location. For example, the electronic device (101) can identify the length of an arm as depth information. For example, the electronic device (101) can identify information on an area that can be reached by a hand as depth information. For example, referring to FIG. 14b, the electronic device (101) can identify information associated with at least one location (1433, 1434) according to the movement of each of the user's hands (1431, 1432). The electronic device (101) can identify an area and area information (1435) based on information associated with the locations (1433, 1434). For example, the electronic device (101) can check the area information (1435) based on performing smoothing on the connecting lines of the locations (1433, 1434), but there is no limitation on the method of checking the area information (1435). The area information (1435) can include, for example, an area of ​​-θ1° to 0° based on the length of L1, and an area of ​​0° to +θ2° based on the length of L2. Meanwhile, the area information expression in each of the two-dimensional coordinate systems described above is merely exemplary, and the area information can also be expressed three-dimensionally, in which case a component in the φ direction can additionally be included. For example, the electronic device (101) can manage the length of the user's left arm (L1) and the length of the user's right arm (L2), respectively. In this case, when the electronic device (101) expresses an object located relatively to the left of the virtual space, the electronic device (101) can express the object based on the length (L1) and / or area (area of ​​-θ1° to 0° based on the length of L1) of the user's left arm.When expressing an object located relatively to the right of a virtual space, the electronic device (101) can express the object based on the length (L2) and / or area (area of ​​-0° to +θ2° based on the length of L2) of the user's right arm.

[0151] Again, referring to FIG. 13, the electronic device (101) may detect an event causing the representation of a first object in operation 1307. Based on the event detection, the electronic device (101) may represent the first object based on depth information in operation 1309. For example, referring to FIG. 14c, the electronic device (101) may identify depth information for representing an object corresponding to a user (1231). For example, the electronic device (101) may identify a first length (1232) of an arm of the user (1231) as depth information, but this is exemplary and may identify area information corresponding to the user (1231) as in FIG. 14b as depth information. In addition, the electronic device (101) may identify depth information for representing an object corresponding to the user (1241). For example, the electronic device (101) can identify the second length (1242) of the arm of the user (1241) as depth information, but this is exemplary and can identify area information corresponding to the user (1241) as depth information as in FIG. 14B. The electronic device (101) can detect an event set for representing the object (1220b) and represent the object (1220b) accordingly. For example, the representation position of the object (1220b) in the depth direction can be z2. The electronic device (101) can represent the object (1220b) as being positioned at z2 based on the fact that the first length (1232) of the arm of the user (1231) is greater than the representation position z2. For example, the electronic device (101) may represent that the object (1220) is positioned at an adjusted depth z2' based on the second length (1242) of the arm of the user (1241) being less than the expression location z2. In one example, the adjusted depth z2' may be set based on z2, or may be set independently from z2, but there is no limitation on the setting method.For example, z2' can be expressed as being located at a distance shorter than the second length (1242) of the arm of the user (1241) (or as being included in the area information corresponding to the user (1241). When the object (1220b) is expressed as being located at z2, the user (1241) had difficulty in specifying the object (1220b). As the object (1220b) is expressed as being located at z2', the user (1241) can easily specify the object (1220b). As described above, since different depth information is managed for each user, the same object can be expressed as being located at different depth direction locations for each user.

[0152] FIG. 15 is a drawing for explaining an example of content according to one embodiment.

[0153] According to one embodiment, the electronic device (101) may display contents (1571, 1581). The content (1571) may be a pop-up window including text such as "Start measurement," but there is no limitation on the method and / or type of displaying the content. The content (1581) may be a pop-up window including text associated with movement of at least a portion of the user's body according to a specified rule. For example, the text may be text explaining a specified rule such as "Stretch your arm out." The electronic device (101) may also display contents (1582, 1583) for explaining the direction of arm extension, but there is no limitation on the method of displaying the content. For example, the electronic device (101) may display content representing the shape of a hand. While displaying the content (1591), the electronic device (101) may identify the user's hand (1592, 1593). For example, the electronic device (101) can determine the length of the user's arm and / or the area information corresponding to the user as depth information based on the position of the hand (1592, 1593). The electronic device (101) can express an object based on the length of the user's arm and / or the area information corresponding to the user.

[0154] FIG. 16 is a flowchart illustrating an operating method of an electronic device according to one embodiment. The embodiment of FIG. 16 will be described with reference to FIGS. 17A and 17B. FIG. 17A is a diagram illustrating content according to one embodiment. FIG. 17B is a diagram illustrating depth information according to one embodiment.

[0155] Referring to FIG. 16, according to one embodiment, in operation 1601, the electronic device (101) may present content associated with movement of at least a part of the user's body according to a specified first rule. In operation 1603, the electronic device (101) may obtain first information associated with the position of at least a part of the body while the content is being presented. In operation 1605, the electronic device (101) may determine first depth information for representing an object corresponding to the user based on the first information. For example, as described with reference to FIG. 14A, the electronic device (101) may present content associated with movement according to the first rule of drawing a circle with an extended arm. Accordingly, the area information (1435) as in FIG. 14B or FIG. 17B may be determined as the first depth information. Meanwhile, as described above, the first depth information may be expressed as arm length information rather than area information (1435).

[0156] The electronic device (101) may, in operation 1607, present content associated with movement of at least a portion of the user's body according to a specified second rule. In operation 1609, the electronic device (101) may obtain second information associated with the position of at least a portion of the body while presenting the content. In operation 1611, the electronic device (101) may determine second depth information for presenting an object corresponding to the user based on the second information. For example, as shown in FIG. 17A , the electronic device (101) may present contents (1701, 1702, 1703). The contents (1701) may include the text "For more accurate calibration, would you like to perform additional measurements?" Each of the contents (1702, 1703) may be an icon corresponding to approval or rejection. If content (1702) corresponding to the approval is specified, the electronic device (101) may present content (1704). The content (1704) may include text associated with movement of at least a portion of the body according to the specified second rule. For example, the text may be text explaining the second rule of moving the arm after fixing the elbow, but there are no restrictions on the method of expression.

[0157] The electronic device (101) can display content (1708) corresponding to an indicator on content (1707) corresponding to a progress bar. The content (1708) corresponding to the indicator can be set based on, for example, the ratio of tasks performed up to the present point among tasks for completing the second rule, but there is no limitation. The electronic device (101) can also display movement trajectories (1711, 1712) of hands (1721a, 1721b). The electronic device (101) can confirm the movement trajectories (1711, 1712) based on the photographing results of the hands (1721a, 1721b) and / or sensing information of external electronic devices (1722a, 1722b), but there is no limitation on the confirmation method.

[0158] The electronic device (101) can identify the region information (1732) as the second depth information, as in FIG. 17B. For example, the electronic device (101) can identify the region information (1732) based on the movement trajectories (1711, 1712) of the hands (1721a, 1721b) (e.g., by performing smoothing on the connecting lines), but there is no limitation on the method of identifying the region information (1732). The region information (1732) can include, for example, a region of -θ3° to 0° based on the length of L3, and a region of 0° to +θ4° based on the length of L4. Meanwhile, the region information expression in each of the two-dimensional coordinate systems described above is merely exemplary, and the region information can also be expressed three-dimensionally, in which case a component in the φ direction can be additionally included. Accordingly, the electronic device (101) can confirm the region information (1732) as the second depth information. As described above, the electronic device (101) can confirm the region information (1435) as the first depth information and the region information (1732) as the second depth information. For example, the electronic device (101) may manage objects corresponding to each piece of depth information differently. For example, the electronic device (101) may use the first depth information to determine whether to adjust and / or adjust the depth-direction position of an object that is placed relatively far from the user (or an object that is used less frequently). For example, the electronic device (101) may use the second depth information to determine whether to adjust and / or adjust the depth-direction position of an object that is placed relatively close to the user (or an object that is used more frequently).

[0159] FIG. 18A is a flowchart illustrating an operating method of an electronic device according to one embodiment. The embodiment of FIG. 18A will be described with reference to FIG. 18B. FIG. 18B is a diagram illustrating the representation of an object according to one embodiment.

[0160] Referring to FIG. 18A, according to one embodiment, the electronic device (101) may store multiple pieces of region information in operation 1801. For example, as in FIG. 17B, the electronic device (101) may identify and store region information (1435) as first depth information and region information (1732) as second depth information. In operation 1803, the electronic device (101) may detect an event that causes the expression of a first object. In operation 1805, the electronic device (101) may identify region information corresponding to the first object. For example, the electronic device (101) may manage region information to be used for each object in a corresponding manner. For example, the electronic device (101) may use the area information corresponding to the first depth information to determine whether to adjust and / or adjust the depth-direction position of an object (or an object with low usage frequency) that is placed relatively far from the user. For example, the electronic device (101) may use the area information corresponding to the second depth information to determine whether to adjust and / or adjust the depth-direction position of an object (or an object with high usage frequency) that is placed relatively close to the user. The electronic device (101) may, in operation 1807, express the first object based on the area information.

[0161] For example, referring to FIG. 18B, the electronic device (101) can set the presentation positions of objects (1801, 1802) corresponding to the presentation position information (1435) based on the presentation position information (1435). For example, objects (1801, 1802) that are placed relatively far from the user (or objects that are used less frequently) can set their presentation positions based on the presentation position information (1435) and / or determine whether to adjust their presentation positions. For example, objects (1803) that are placed relatively close to the user (or objects that are used more frequently) can set their presentation positions based on the presentation position information (1732) and / or determine whether to adjust their presentation positions.

[0162] Fig. 19 is a flowchart illustrating an operating method of an electronic device according to one embodiment. The embodiment of Fig. 19 will be described with reference to Fig. 20. Fig. 20 is a diagram illustrating the execution of related functions for each of a plurality of areas according to one embodiment.

[0163] Referring to FIG. 19, according to one embodiment, the electronic device (101) may store a plurality of pieces of region information in operation 1901. For example, as in FIG. 20, the electronic device (101) may store first region information (2021) for content sharing and other region information. The first region information (2021) may be set based on at least one location of a body part and / or a controller identified while the electronic device (101) provides content, as described above, but there is no limitation on the setting method. For example, the electronic device (101) may express text indicating that a region for sharing content with another user is to be set, and may set the first region information (2021) for content sharing based on at least one location of a body part and / or a controller identified while the content is being displayed, but there is no limitation on the setting method.

[0164] The electronic device (101) may, in operation 1903, identify a command for associating a first object with a first area. The electronic device (101) may, in operation 1905, execute a function associated with the first object and the first area. For example, referring to FIG. 20 , the first electronic device (2002) worn by the first user (2001) may identify a user command for moving a shared object (2021) to the first area information (2021) for content sharing. The first electronic device (2002) may transmit data for causing a representation of the shared object (2021) to the second electronic device (2004) worn by the second user (2003) based on the fact that the location of the shared object (2021) is included in the first area information (2021) (or at least partially overlaps with it). The second electronic device (2004) can express a shared object (2021) based on the received data. Meanwhile, the first electronic device (2002) can express objects (2011, 2012, 2013) recognized only by the first user together with the shared object (2021). The second electronic device (2004) can express the shared object (2021) together with objects (2031, 2032, 2033) recognized only by the second user. Accordingly, only the shared object (2021) can be recognized by both users (2001, 2003).

[0165] FIG. 21 is a flowchart illustrating an operation method of an electronic device according to one embodiment.

[0166] According to one embodiment, the electronic device (101) may, in operation 2101, identify a shared area and a non-shared area. The shared area may be set based on, for example, a body part and / or at least one location of a controller identified while the electronic device (101) provides content, as described above, but there is no limitation on how it may be set. For example, the electronic device (101) may express text indicating that an area for sharing content with other users should be set, and the content sharing area may be set based on, for example, a body part and / or at least one location of a controller identified while the content is being displayed, but there is no limitation on how it may be set. For example, the non-shared area may be set based on, for example, a body part and / or at least one location of a controller identified while the electronic device (101) provides content, as described above, but there is no limitation on how it may be set. Alternatively, the electronic device (101) may set an area other than the shared area as a non-shared area.

[0167] The electronic device (101) may, in operation 2103, represent at least one non-shared object associated with the non-shared area. The electronic device (101) may, in operation 2105, represent at least one shared object associated with the shared area. The electronic device (101) may, in operation 2107, transmit information for representing at least one shared object. The electronic device (101) may transmit the information for representing at least one shared object to an external electronic device. The external electronic device may represent the shared object based on the received information for representing at least one shared object. Accordingly, the shared object may be represented by the electronic device (101) and the external electronic device. The non-shared object may be represented only by the electronic device (101) and may not be represented by the external electronic device.

[0168] According to one embodiment, the electronic device (101) may include at least one sensor (180). The electronic device (101) may include a GPS module (170). The electronic device (101) may include a display module (160). The electronic device (101) may include a processor (120) operatively connected to the at least one sensor (180), the GPS module (170), and the display module (160). The processor (120) may be configured to determine a current location of the electronic device (101) based on at least one first data provided from the GPS module (170). The processor (120) may be configured to determine an intermediate destination for route guidance corresponding to the destination information based on destination information and the current location of the electronic device (101). The processor (120) may be configured to determine the direction in which the electronic device (101) is facing based on at least one second data from the at least one sensor (180). The processor (120) may be configured to control the display module (160) to display an object corresponding to a range that includes a difference between a reference direction for route guidance from a current location of the electronic device (101) to the intermediate destination and the direction in which the electronic device (101) is facing.

[0169] According to one embodiment, the processor (120) may be configured to control the display module (160) to display a route guidance object for route guidance from the current location to the intermediate destination together with an object corresponding to the range in which the difference is included, as at least part of the operation of controlling the display module (160) to display an object corresponding to the range in which the difference is included.

[0170] According to one embodiment, the processor (120) may be further configured to control the display module (160) to display an object corresponding to a range in which the difference is included, at a point in time after controlling the display module (160), determine that another direction in which the electronic device (101) is facing and another difference in the reference direction at the point in time are included in a range different from the range, and control the display module (160) to display an object corresponding to the other range instead of the object corresponding to the range based on the other difference being included in the other range.

[0171] According to one embodiment, the processor (120) may be further configured to, at a point in time after controlling the display module (160) to express an object corresponding to a range in which the difference is included, determine that another direction in which the electronic device (101) is facing and another difference in the reference direction at the point in time are included in the range, and control the display module (160) so that the expression of the object corresponding to the range is maintained based on the other difference being included in the range.

[0172] According to one embodiment, the processor (120) may be configured to identify a plurality of ranges associated with a difference between the reference direction and the direction toward which the electronic device (101) is facing. The processor (120) may be configured to identify a range in which the difference is included among the plurality of ranges.

[0173] According to one embodiment, the processor (120) may be configured to determine the plurality of ranges based on map information associated with the current location and / or the intermediate destination, at least as part of the operation of determining the plurality of ranges associated with a difference between the reference direction and the direction in which the electronic device (101) is facing.

[0174] According to one embodiment, the processor (120) may be configured to, at least as part of the operation of checking the plurality of ranges based on the map information, check the plurality of ranges corresponding to the presence of an object, the number of objects, and / or the size of an object around the current location included in the map information.

[0175] According to one embodiment, the processor (120) may be configured to, at least as part of an operation of identifying the plurality of ranges associated with a difference between the reference direction and the direction in which the electronic device (101) is facing, identify the plurality of ranges based on at least a portion of the at least one first data and the at least one second data.

[0176] According to one embodiment, the processor (120) may be configured to, at a point in time after controlling the display module (160) to display an object corresponding to a range in which the difference is included, check a plurality of ranges other than the plurality of ranges, and control the display module (160) to display an object corresponding to a range in which the difference is included among the other plurality of ranges.

[0177] According to one embodiment, the shape, size, and / or properties of an object corresponding to a range in which the difference is included among the plurality of ranges may be at least partially different from the shape, size, and / or properties of an object corresponding to a range in which the difference is included among the other plurality of ranges.

[0178] According to one embodiment, an operating method of an electronic device (101) including at least one sensor (180), a GPS module (170), and a display module (160) may be provided. The operating method may include an operation of confirming a current location of the electronic device (101) based on at least one first data provided from the GPS module (170). The operating method may include an operation of confirming an intermediate destination for route guidance corresponding to the destination information based on destination information and the current location of the electronic device (101). The operating method may include an operation of confirming a direction toward which the electronic device (101) is headed based on at least one second data from the at least one sensor (180). The operating method may include an operation of controlling the display module (160) to display an object corresponding to a range including a difference between a reference direction for route guidance from a current location of the electronic device (101) to the intermediate destination and a direction toward which the electronic device (101) is headed.

[0179] According to one embodiment, the operation of controlling the display module (160) may control the display module (160) to display a route guidance object for route guidance from the current location to the intermediate destination together with an object corresponding to the range in which the difference is included.

[0180] According to one embodiment, the operating method may include, at a point in time after controlling the display module (160) to display an object corresponding to a range in which the difference is included, an operation of confirming that another direction in which the electronic device (101) is facing and another difference in the reference direction at the point in time are included in a range different from the range, and an operation of controlling the display module (160) to display an object corresponding to the other range instead of the object corresponding to the range based on the other difference being included in the other range.

[0181] According to one embodiment, the operating method may include, at a point in time after controlling the display module (160) to express an object corresponding to a range in which the difference is included, an operation of confirming that another difference between another direction toward which the electronic device (101) is facing and the reference direction at the point in time is included in the range, and an operation of controlling the display module (160) so that the expression of the object corresponding to the range is maintained based on the other difference being included in the range.

[0182] According to one embodiment, the operating method may include an operation of identifying a plurality of ranges associated with a difference between the reference direction and the direction in which the electronic device (101) is facing. The operating method may include an operation of identifying a range in which the difference is included among the plurality of ranges.

[0183] According to one embodiment, the operation of identifying the plurality of ranges associated with the difference between the reference direction and the direction in which the electronic device (101) is facing may identify the plurality of ranges based on map information associated with the current location and / or the intermediate destination.

[0184] According to one embodiment, the operation of checking the plurality of ranges based on the map information may check the plurality of ranges corresponding to the presence of an object around the current location included in the map information, the number of objects, and / or the size of the object.

[0185] According to one embodiment, the operation of identifying the plurality of ranges associated with the difference between the reference direction and the direction in which the electronic device (101) is facing may identify the plurality of ranges based on at least a portion of the at least one first data and the at least one second data.

[0186] According to one embodiment, the operating method may include, at a point in time after controlling the display module (160) to display an object corresponding to a range in which the difference is included, an operation of checking a plurality of ranges other than the plurality of ranges, and an operation of controlling the display module (160) to display an object corresponding to a range in which the difference is included among the other plurality of ranges.

[0187] According to one embodiment, the shape, size, and / or properties of an object corresponding to a range in which the difference is included among the plurality of ranges may be at least partially different from the shape, size, and / or properties of an object corresponding to a range in which the difference is included among the other plurality of ranges.

[0188] According to one embodiment, a storage medium storing at least one computer-readable instruction may be provided. The at least one instruction, when executed by a processor (120) of an electronic device (101), may cause the electronic device (101) to perform at least one operation. The at least one operation may include an operation of presenting content associated with movement of at least a part of a user's body according to a specified rule. The at least one operation may include an operation of obtaining information associated with a position of at least a part of the user's body while the content is presented. The at least one operation may include an operation of determining depth information for presenting an object corresponding to the user based on the information associated with the position of at least a part of the body. The at least one operation may include an operation of detecting an event that causes the presentation of a first object. The at least one operation may include an operation of presenting, in response to the detection of the event, the first object based on the depth information corresponding to the user.

[0189] According to one embodiment, the content may include text for explaining the specified rule, and / or may include a video for the specified rule.

[0190] According to one embodiment, the at least one action may include an action representing a trajectory representing movement of at least a portion of the body, based on information associated with a position of at least a portion of the body.

[0191] According to one embodiment, the operation of representing the first object based on the depth information corresponding to the user may represent the first object as being positioned at the designated depth direction location based on the position of the first object in the designated depth direction being less than or equal to the length of an arm included in the depth information.

[0192] According to one embodiment, the operation of representing the first object based on the depth information corresponding to the user may represent the first object as being positioned at an adjusted position different from the designated depth direction position based on the position of the first object in the designated depth direction exceeding the length of the arm included in the depth information.

[0193] According to one embodiment, the operation of representing the first object based on the depth information corresponding to the user may represent the first object as being positioned within an area included in the depth information.

[0194] According to one embodiment, the operation of determining depth information for representing an object corresponding to the user based on information associated with a position of at least a part of the body may determine the depth information based on a trajectory of at least a part of the body determined based on information associated with a position of at least a part of the body.

[0195] According to one embodiment, the operation of determining depth information for representing an object corresponding to the user based on information associated with a position of at least a part of the body may determine the depth information based on a position of at least a part of the body determined based on information associated with a position of at least a part of the body.

[0196] According to one embodiment, the at least one action may include an action of presenting other content associated with movement of at least a portion of the user's body according to another specified rule. The at least one action may include an action of obtaining other information associated with a position of at least a portion of the user's body while the other content is being presented. The at least one action may include an action of determining other depth information for presenting an object corresponding to the user based on the other information associated with the position of at least a portion of the body.

[0197] According to one embodiment, in response to detection of the event, the operation of representing the first object based on the depth information corresponding to the user may include an operation of confirming that the first object corresponds to the depth information among the depth information and the other depth information. The operation of representing the first object based on the depth information corresponding to the user may include an operation of representing the first object based on the depth information corresponding to the user based on confirming that the first object corresponds to the depth information.

[0198] According to one embodiment, an electronic device (101) may include a memory that stores at least one instruction. The electronic device (101) may include at least one sensor (180). The electronic device (101) may include a display module (160). The electronic device (101) may include a processor (120) operatively connected to the memory, the at least one sensor (180), and the display module (160). The at least one instruction, when executed by the processor (120), may cause the electronic device (101) to perform at least one action. The at least one action may include an action of presenting content associated with movement of at least a part of a user's body according to a specified rule. The at least one action may include an action of obtaining information associated with a position of at least a part of the user's body while the content is presented. The at least one action may include an action of determining depth information for representing an object corresponding to the user based on information associated with a position of at least a part of the body. The at least one action may include an action of detecting an event that causes the representation of a first object. The at least one action may include an action of representing the first object based on the depth information corresponding to the user in response to the detection of the event.

[0199] According to one embodiment, the content may include text for explaining the specified rule, and / or may include a video for the specified rule.

[0200] According to one embodiment, the at least one action may include controlling the display module (160) to display a trajectory representing movement of at least a portion of the body based on information associated with a position of at least a portion of the body.

[0201] According to one embodiment, the operation of controlling the display module (160) to display the first object based on the depth information corresponding to the user may control the display module (160) to display the first object as if it were placed at the specified depth direction location, based on the specified depth direction location of the first object being less than or equal to the length of an arm included in the depth information.

[0202] According to one embodiment, the operation of controlling the display module (160) to display the first object based on the depth information corresponding to the user may control the display module (160) to display the first object as if it were positioned at an adjusted position different from the specified depth direction position, based on the specified depth direction position of the first object exceeding the length of the arm included in the depth information.

[0203] According to one embodiment, the operation of controlling the display module (160) to display the first object based on the depth information corresponding to the user may control the display module (160) to display the first object as being positioned within an area included in the depth information.

[0204] According to one embodiment, the operation of determining depth information for representing an object corresponding to the user based on information associated with a position of at least a part of the body may determine the depth information based on a trajectory of at least a part of the body determined based on information associated with a position of at least a part of the body.

[0205] According to one embodiment, the operation of determining depth information for representing an object corresponding to the user based on information associated with a position of at least a part of the body may determine the depth information based on a position of at least a part of the body determined based on information associated with a position of at least a part of the body.

[0206] According to one embodiment, the at least one operation may include an operation of controlling the display module (160) to display other content associated with movement of at least a part of the user's body according to another specified rule. The at least one operation may include an operation of obtaining other information associated with a position of at least a part of the user's body while the other content is displayed. The at least one operation may include an operation of identifying other depth information for displaying an object corresponding to the user based on the other information associated with the position of at least a part of the body.

[0207] According to one embodiment, in response to detection of the event, the operation of controlling the display module (160) to display the first object based on the depth information corresponding to the user may include an operation of confirming that the first object corresponds to the depth information among the depth information and the other depth information. The operation of controlling the display module (160) to display the first object based on the depth information corresponding to the user may include an operation of controlling the display module (160) to display the first object based on the depth information corresponding to the user, based on confirming that the first object corresponds to the depth information.

[0208] According to one embodiment, a method of operating an electronic device (101) may be provided. The method of operating the electronic device (101) may include an operation of presenting content associated with movement of at least a part of a user's body according to a specified rule. The method of operating the electronic device (101) may include an operation of obtaining information associated with a position of at least a part of the user's body while the content is being presented. The method of operating the electronic device (101) may include an operation of determining depth information for presenting an object corresponding to the user based on the information associated with the position of at least a part of the body. The method of operating the electronic device (101) may include an operation of detecting an event that causes presentation of a first object. The method of operating the electronic device (101) may include an operation of presenting, in response to detection of the event, the first object based on the depth information corresponding to the user.

[0209] Electronic devices according to embodiments disclosed herein may take various forms. Electronic devices may include, for example, wearable electronic devices (e.g., but not limited to, glass-type electronic devices, HMD devices, and VST devices), portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.

[0210] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0211] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0212] One embodiment of the present document may be implemented as software (e.g., a program) including one or more instructions stored in a storage medium (e.g., built-in memory or external memory) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0213] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0214] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), At least one sensor (180); GPS module (170); display module (160); and A processor (120) operatively connected to at least one sensor (180), the GPS module (170) and the display module (160), The above processor (120): The current location of the electronic device (101) is determined based on at least one first data provided from the GPS module (170), Based on the destination information and the current location of the electronic device (101), an intermediate destination for route guidance corresponding to the destination information is identified, Based on at least one second data from at least one sensor (180), the direction in which the electronic device (101) is facing is determined, An electronic device (101) configured to control the display module (160) to display an object corresponding to a range including a difference between a reference direction for route guidance from the current location of the electronic device (101) to the intermediate destination and a direction toward which the electronic device (101) is facing.

2. In paragraph 1, The above processor (120) controls the display module (160) to display an object corresponding to a range in which the difference is included, at least as a part of the operation, An electronic device (101) set to control the display module (160) to display a route guidance object for route guidance from the current location to the intermediate destination, together with an object corresponding to a range including the difference.

3. In any one of paragraphs 1 and 2, The above processor (120) controls the display module (160) to display an object corresponding to a range including the above difference at a point in time: It is confirmed that the other direction in which the electronic device (101) is directed at the above point in time and the other difference in the reference direction are included in a range different from the above range, An electronic device (101) further configured to control the display module (160) to display an object corresponding to the other range instead of an object corresponding to the other range, based on the other difference being included in the other range.

4. In any one of paragraphs 1 to 3, The above processor (120) controls the display module (160) to display an object corresponding to a range including the above difference at a point in time: It is confirmed that the other direction in which the electronic device (101) is directed at the above point in time and the other difference in the reference direction are included in the above range, An electronic device (101) further configured to control the display module (160) so that the expression of an object corresponding to the above range is maintained based on the above other difference being included in the above range.

5. In any one of paragraphs 1 to 4, The above processor (120): Identifying a plurality of ranges associated with the difference between the above reference direction and the direction in which the electronic device (101) is facing, An electronic device (101) further configured to determine a range in which the difference is included among the plurality of ranges.

6. In any one of paragraphs 1 to 5, The processor (120) is configured to, at least as part of the operation of determining the plurality of ranges associated with the difference between the reference direction and the direction in which the electronic device (101) is facing, An electronic device (101) configured to identify the plurality of ranges based on map information associated with the current location and / or the intermediate destination.

7. In any one of paragraphs 1 to 6, The above processor (120) is configured to, at least as part of the operation of checking the plurality of ranges based on the map information, An electronic device (101) set to check the existence of objects, the number of objects, and / or the plurality of ranges corresponding to the size of objects around the current location included in the map information.

8. In any one of paragraphs 1 to 7, The processor (120) is configured to, at least as part of the operation of determining the plurality of ranges associated with the difference between the reference direction and the direction in which the electronic device (101) is facing, An electronic device (101) configured to verify the plurality of ranges based on at least a portion of the at least one first data and the at least one second data.

9. In any one of paragraphs 1 to 8, The above processor (120) controls the display module (160) to display an object corresponding to a range including the above difference at a point in time: Check the above multiple ranges and other multiple ranges, An electronic device (101) further configured to control the display module (160) to display an object corresponding to a range in which the difference is included among the above-described multiple ranges.

10. In any one of paragraphs 1 to 9, An electronic device (101) in which the shape, size, and / or properties of an object corresponding to a range in which the difference is included among the plurality of ranges are at least partially different from the shape, size, and / or properties of an object corresponding to a range in which the difference is included among the other plurality of ranges.

11. A method of operating an electronic device (101) including at least one sensor (180), a GPS module (170), and a display module (160), An operation of determining the current location of the electronic device (101) based on at least one first data provided from the GPS module (170); An operation of identifying an intermediate destination for route guidance corresponding to the destination information based on destination information and the current location of the electronic device (101); An operation of determining a direction toward which the electronic device (101) is facing based on at least one second data from at least one sensor (180); and An operation of controlling the display module (160) to display an object corresponding to a range that includes a difference between a reference direction for route guidance from the current location of the electronic device (101) to the intermediate destination and the direction toward which the electronic device (101) is facing. A method of operating an electronic device (101) including:

12. In paragraph 11, The operation of controlling the display module (160) to express an object corresponding to the range including the above difference is as follows: An operating method of an electronic device (101) that controls the display module (160) to display a route guidance object for route guidance from the current location to the intermediate destination together with an object corresponding to a range including the difference.

13. In any one of paragraphs 11 to 12, At a point in time after controlling the display module (160) to display an object corresponding to the range in which the above difference is included: An operation for confirming that the other direction in which the electronic device (101) is directed at the above point in time and the other difference in the reference direction are included in a range different from the above range; and An operation of controlling the display module (160) to display an object corresponding to the other range instead of an object corresponding to the other range, based on the other difference being included in the other range. A method of operating an electronic device (101) further comprising:

14. In any one of paragraphs 11 to 13, At a point in time after controlling the display module (160) to display an object corresponding to the range in which the above difference is included: An operation for confirming that the other direction in which the electronic device (101) is directed at the above point in time and the other difference in the reference direction are included in the above range; and An operation of controlling the display module (160) so that the expression of an object corresponding to the above range is maintained based on the above other difference being included in the above range. A method of operating an electronic device (101) further comprising:

15. In any one of paragraphs 11 to 14, An operation of checking a plurality of ranges associated with the difference between the reference direction and the direction in which the electronic device (101) is facing; and An operation of checking the range that includes the difference among the above multiple ranges. A method of operating an electronic device (101) further comprising:

Images