Method and electronic device for providing navigation information

Abstract

An electronic device according to an embodiment disclosed in the present document may comprise: one or more sensors; a display; at least one processor; and a memory for storing instructions. The instructions may be executed by the at least one processor to cause the electronic device to: acquire current location and direction information by using the one or more sensors on the basis of identifying a destination from a user input; acquire surrounding data within a designated distance on the basis of the current location and the direction information; identify at least one object of interest included in a path to the destination from the surrounding data; acquire guidance information for providing guidance on the path to the destination on the basis of the at least one object of interest; and output the acquired guidance information on the display. In addition, various embodiments identified by the present document are also possible.

Description

Method for providing navigation information and electronic device thereof

[0001] The present disclosure relates to a method for providing navigation information and an electronic device thereof.

[0002] With the recent increase in the prevalence of various electronic devices, various services that operate through inter-device networks are being developed. Users can connect wearable devices, such as smartwatches, wireless earphones, and smart glasses, to mobile devices like smartphones and tablets. Wearable devices may include sensors to collect user-related information (e.g., location information, biometric information, or environmental information). The user-related information obtained from these sensors can be utilized to provide personalized services. For example, wearable devices can provide a navigation service that guides users on their way to a destination based on real-time location information collected by the user.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0004] According to an embodiment of the present disclosure, an electronic device may include one or more sensors, a display, at least one processor, and a memory storing instructions. The instructions, when executed by the at least one processor, may cause the electronic device to obtain current location and direction information using the one or more sensors based on identifying a destination from a user input. The instructions, when executed by the at least one processor, may cause the electronic device to obtain surrounding data within a specified distance based on the current location and the direction information. The instructions, when executed by the at least one processor, may cause the electronic device to determine at least one object of interest included in a path to the destination from the surrounding data. The instructions, when executed by the at least one processor, may cause the electronic device to obtain guide information for guiding a path to the destination based on the at least one object of interest. The instructions, when executed by the at least one processor, may cause the electronic device to output the obtained guide information on the display.

[0005] A method according to one embodiment of the present disclosure may include an operation of obtaining current location and direction information using one or more sensors included in an electronic device based on identifying a destination from a user input. The method may include an operation of obtaining surrounding data within a specified distance based on the current location and direction information. The method may include an operation of determining at least one object of interest included in a path to the destination from the surrounding data. The method may include an operation of obtaining guide information for guiding a path to the destination based on the at least one object of interest. The method may include an operation of outputting the obtained guide information on a display of the electronic device.

[0006] A computer-readable recording medium according to an embodiment of the present disclosure may include programs executable on a computer. The programs may perform an operation of acquiring current location and direction information using one or more sensors included in an electronic device based on identifying a destination from a user input. The programs may perform an operation of acquiring surrounding data within a specified distance based on the current location and direction information. The programs may perform an operation of determining at least one object of interest included in a path to the destination from the surrounding data. The programs may perform an operation of acquiring guide information for guiding a path to the destination based on the at least one object of interest. The programs may perform an operation of outputting the acquired guide information on a display of the electronic device.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0008] FIGS. 2A, 2B, and 2C are drawings illustrating a wearable device that can be worn by a user according to various embodiments.

[0009] FIG. 3 is a drawing illustrating a configuration of an electronic device according to one embodiment.

[0010] FIG. 4 is a drawing illustrating a function performed in an electronic device according to one embodiment.

[0011] FIG. 5 is a diagram illustrating a method of performing a function using a plurality of wearable devices according to one embodiment.

[0012] FIG. 6 is a diagram illustrating a method for providing a navigation service in an electronic device according to one embodiment.

[0013] FIG. 7 is a flowchart illustrating a method of operating an electronic device according to one embodiment.

[0014] FIG. 8 is a flowchart illustrating a method for providing a navigation service in an electronic device, according to one embodiment.

[0015] FIG. 9 is a diagram illustrating a method for dynamically providing guide information in response to a user's movement in an electronic device, according to one embodiment.

[0016] FIGS. 10A, 10B, and 10C are diagrams illustrating context-based information that may be provided together with a navigation service in an electronic device, according to one embodiment.

[0017] FIG. 11 is a drawing illustrating a method for providing guide information corresponding to a folded state of an electronic device, according to one embodiment.

[0018] FIG. 12 is a drawing illustrating a method of providing a guide message using a headset, according to one embodiment.

[0019] FIG. 13 is a drawing illustrating a method of providing guide information using smart glasses according to one embodiment.

[0020] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0021] Hereinafter, various embodiments disclosed in this document will be described with reference to the attached drawings. It should be understood that this is not intended to limit the various embodiments of the present disclosure to a specific form, but rather to encompass various modifications, equivalents, and / or alternatives of the present disclosure.

[0022] Navigation systems that provide route guidance to a destination based on a user's current location may provide unfamiliar, fixed guidance messages. For example, typical navigation systems may provide map-based directional information (e.g., east / west / south / north), direction guidance using a watch dial (e.g., 3 o'clock, 12 o'clock), and specific distance units (e.g., 10 m, 500 m). Consequently, users with limited directional sense or who need to quickly find their way while lost may have difficulty applying the guidance information provided by the navigation system to actual distances. Users of wearable devices such as smartwatches may experience even greater inconvenience in determining actual distances based on the location displayed on the map due to display size limitations.

[0023] In various embodiments of this document, when providing a navigation service using a wearable device, various embodiments can be provided to enable the user to find the way more intuitively by dynamically generating and providing guide information based on visual data (e.g., street view data) corresponding to the user's current location and direction of travel.

[0024] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary knowledge in the technical field to which this document pertains.

[0025] FIG. 1 is a diagram illustrating an electronic device within a network environment (100) according to one embodiment.

[0026] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0027] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0028] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0029] The number of processors (120) may be one or more. For example, the processor (120) may have a multi-core processor structure such as a dual core, quad core, or hexa core.

[0030] The processor (120) can control the operations of the electronic device (101) by executing instructions stored in the memory (130). For example, the processor (120) can correspond to a plurality of processors that collectively perform a plurality of operations by dividing them among the processors.

[0031] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0032] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0033] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0034] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0035] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0036] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0037] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0038] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0039] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0040] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0041] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0042] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0043] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0044] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0045] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0046] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0047] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent to a second surface (e.g., a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0048] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0049] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0050] FIG. 2a, FIG. 2b and FIG. 2c are drawings illustrating a wearable device that can be worn by a user (200) according to various embodiments.

[0051] Referring to FIG. 2A, a user (200) may wear various types of wearable devices on a part of the body or attach them to clothing. For example, in addition to the smartphone (210) that the user primarily uses, the user (200) may also own at least one of a smartwatch (220), a smart ring (230), wireless earphones (240) (or headset), smart glasses (250), or various other types of items. The above items can be manufactured in various forms, including a pendant type (261) that can be hung around the neck of a user (200), an accessory type (262) that can be attached to clothes worn by a user (200) (e.g., a brooch, a button), an accessory type (263) that can be attached to the body of a user (200) (e.g., a digital tattoo), a band type (264) that can be worn on the wrist of a user (200), a belt type (265) that can be worn around the waist of a user (200), or a shoe type (266) that can be worn on the feet of a user (200).

[0052] In one embodiment, the wearable device may be connected to a smartphone (210) or another wearable device registered to the smartphone (210) via short-range wireless communication, and may exchange and process various sensor data and control signals. The wearable device may be equipped with sensors for acquiring various data about the user (200) or the user's surroundings, and the data acquired from these sensors may be utilized to guide a route to a destination requested by the user (200).

[0053] Referring to FIG. 2B, the smart watch (220) can be divided into a front side that is exposed to the outside when worn and a back side that is in close contact with the wrist of the user (200). The front side of the smart watch (220) may include a camera (221), a microphone (222), a display (223), or an inertial sensor and a position measurement sensor (224). The back side of the smart watch (220) may include a sensor for measuring biometric information of the user (200), such as an electrode sensor (225), a photoplethysmogram (PPG) sensor (226), or a body temperature measurement sensor (227).

[0054] In one embodiment, the camera (221) may acquire images (or videos) of the user (200) or the user's surroundings, and measure data regarding the lighting environment around the user.

[0055] In one embodiment, the microphone (222) may acquire voice input from the user (200) or collect sounds generated around the user.

[0056] In one embodiment, the display (223) may display information to be provided to the user (200). For example, if the user (200) requests route guidance to a destination, the smartwatch (220) may execute a navigation application and display the navigation application's execution screen through the display (223).

[0057] In one embodiment, the inertial sensor (224) can detect the movement, posture, gait, or gesture of the user (200), and the position measurement sensor (224) can measure the current position or movement direction of the user (200). For example, the inertial sensor (224) can include at least one of an acceleration sensor, a gyro sensor, or a geomagnetic sensor, and the position measurement sensor (224) can include a global positioning system (GPS).

[0058] In one embodiment, the electrode sensor (225) can measure the body composition or electrocardiogram of the user (200), and the PPG sensor (226) can measure the heart rate and pulse of the user (200). The body temperature measurement sensor (227) can measure the skin surface temperature of the user (200).

[0059] Referring to FIG. 2c, the wireless earphones (240) can be functionally connected to a smartphone (210) or a smartwatch (220) to obtain a voice input from a user (200) or to output guide information for a destination requested by the user (200). The wireless earphones (240) can include a speaker (241), an infrared (IR) sensor (242), a microphone (243), an inertial sensor (244), or a touch sensor (245).

[0060] In one embodiment, the speaker (241) can output an acoustic signal or voice information to be provided to the user (200). For example, if the user (200) requests route guidance to a destination, the wireless earphone (240) can receive a voice message from a smartphone (210) or smartwatch (220) to guide the route to the destination and output it through the speaker (241).

[0061] In one embodiment, the IR sensor (242) can detect whether the wireless earphones (240) are being worn by the user (200).

[0062] In one embodiment, the microphone (243) can acquire a voice input from the user (200) or collect sounds generated around the user. According to various embodiments, the wireless earphone (240) can transmit the voice input of the user (200) acquired from the microphone (243) to a smartphone (210) or a smartwatch (220).

[0063] In one embodiment, the inertial sensor (244) may detect the movement, posture, gait, or gesture of the user (200). For example, the inertial sensor (244) may include at least one of an acceleration sensor, a gyro sensor, or a geomagnetic sensor.

[0064] In one embodiment, the touch sensor (245) can detect a touch input for controlling a function related to output while the user (200) is wearing the wireless earphones (240). For example, the wireless earphones (240) can perform a control such as play / stop / pause of an audio signal or adjust the volume of an audio signal being output based on the user's touch input detected by the touch sensor (245).

[0065] According to various embodiments, the wireless earphones (240) may further include a camera (not shown) for acquiring an image corresponding to the user's (200) gaze. The wireless earphones (240) may transmit the image acquired by the camera (not shown) to a smartphone (210) or a smartwatch (220).

[0066] FIG. 3 is a drawing illustrating the configuration of an electronic device (300) according to one embodiment.

[0067] Referring to FIG. 3, an electronic device (300) is a device that provides guide information for a destination based on visual data corresponding to a user's current location and direction of travel, and may include one or more sensors (310), a communication circuit (320), a display (330), at least one processor (340), and a memory (350). In FIG. 3, the electronic device (300) may correspond to the electronic device (101) illustrated in FIG. 1 or the smart watch (220) illustrated in FIG. 2B.

[0068] In one embodiment, one or more sensors (310) (e.g., sensor module (176) of FIG. 1) may collect / measure data related to a user or the user's surrounding environment. For example, one or more sensors (310) may include at least one of an acceleration sensor, a gyro sensor, or a geomagnetic sensor for collecting / measuring information about the user's movement, posture, or orientation. As another example, one or more sensors (310) may include a position measurement sensor (e.g., a GPS circuit) for measuring the user's current location and direction of movement.

[0069] In one embodiment, the communication circuit (320) (e.g., the communication module (190) of FIG. 1) may support a communication connection with another device. According to various embodiments, the communication circuit (320) may establish a communication connection with an electronic device located within a predetermined distance using short-range communication such as Bluetooth, Wi-Fi direct, or BLE (Bluetooth low energy), or may establish a communication connection with an external electronic device located outside a predetermined distance using long-range communication such as cellular or Wi-Fi, thereby exchanging data.

[0070] In one embodiment, the display (330) (e.g., the display module (160) of FIG. 1) may display information to be provided to the user. For example, when a navigation application is launched in response to a user's route guidance request, the display (330) may display an execution screen of the navigation application. As another example, the display (330) may display visual data (e.g., street view data) corresponding to the direction the user is facing from their current location, obtained using one or more sensors (310).

[0071] In one embodiment, the display (330) may be configured with at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED), a light emitting diode (LED), an active matrix organic LED (AMOLED), a flexible display, and a 3-dimensional display. In addition, some of these displays may be configured as transparent or light-transmitting so that the outside can be viewed through them. This may be configured in the form of a transparent display including a TOLED (transparent OLED).

[0072] In addition, the components described with reference to FIG. 1 may be appropriately applied to the electronic device (300). For example, the electronic device (300) may further include a microphone (e.g., input module (150) of FIG. 1) for obtaining a user's voice input (although not shown in FIG. 3), a speaker (e.g., sound output module (155) of FIG. 1) for outputting voice information corresponding to a user's request, or a camera (e.g., camera module (180) of FIG. 1) for obtaining an image of the user's surroundings or detecting the user's gaze.

[0073] In one embodiment, the memory (350) (e.g., the memory (130) of FIG. 1) may store instructions that, when executed, cause the electronic device (300) to perform various operations by at least one processor (340) (e.g., the processor (120) of FIG. 1). For example, the at least one processor (340) may control the electronic device (300) to perform operations for providing guide information for a destination in response to an input from a user wearing the wearable device.

[0074] In one embodiment, at least one processor (340) may obtain a user input requesting route guidance to a destination. The user input may be obtained using an input means such as a microphone (e.g., the input module (150) of FIG. 1) or a virtual keyboard provided through the display (330). For example, when the at least one processor (340) receives a voice input from a user requesting route guidance to a destination through the microphone, the at least one processor (340) may identify the destination from the voice input. In another example, when the at least one processor (340) receives a text input from a user requesting route guidance to a destination through the virtual keyboard provided through the display (330), the at least one processor (340) may extract and identify the destination from the text input. According to various embodiments, the destination may include at least one of a place name, a building name, a business name, address information, or a geographical location such as latitude / longitude. At least one processor (340) may identify a personalized location (e.g., home, office, school) of the user as the destination from the user input, and may recognize frequently visited locations or locations likely to be visited based on the user's visit history by associating the information of the destination with the information.

[0075] In one embodiment, at least one processor (340) may execute a navigation application to provide route guidance to the destination. According to various embodiments, at least one processor (340) may receive user input while the navigation application is running to identify the destination, or may automatically execute the navigation application in response to receiving the user input.

[0076] In one embodiment, at least one processor (340) may, upon identifying the destination from the user input, obtain information on the user's current location and direction using one or more sensors (310). For example, at least one processor (340) may obtain information on the user's current location using a GPS circuit. As another example, at least one processor (340) may obtain information on the direction in which the user is moving using a geomagnetic sensor.

[0077] In one embodiment, at least one processor (340) may obtain surrounding data within a specified distance based on the current location and direction information of the user. The surrounding data may include visual data (e.g., street view data) corresponding to a direction the user is facing from the current location of the user and point of interest (POI) data that can be easily identified within a specified distance radius based on the current location of the user. For example, at least one processor (340) may obtain the visual data and / or the POI data from an external server (e.g., server (108) of FIG. 1) providing a navigation service. As another example, at least one processor (340) may obtain the visual data and / or the POI data from an external device (e.g., electronic device (102) of FIG. 1 or smartphone (210) of FIG. 2A) connected to the electronic device (300) via short-range wireless communication. According to various embodiments, at least one processor (340) may utilize an image of the user's surroundings acquired using a camera (e.g., the camera module (180) of FIG. 1) or an image corresponding to the user's gaze acquired from an external device connected via a communication circuit (320) as the visual data.

[0078] In one embodiment, at least one processor (340) may determine at least one object of interest included in the path from the surrounding data to the destination. Here, the at least one object of interest may correspond to an object that can be easily identified in the user's field of view. For example, the at least one processor (340) may determine an object extracted from visual data (e.g., street view data) corresponding to a direction in which the user is facing from the user's current location as the at least one object of interest. In another example, the at least one processor (340) may identify an object included in the POI data from the visual data and determine the object as the at least one object of interest. In another example, the at least one processor (340) may detect gaze information of the user using one or more cameras (e.g., the camera module (180) of FIG. 1) and determine the at least one object of interest based on the detected gaze information. According to various embodiments, the at least one object of interest may be determined based on a pre-learned AI-generated model. In this case, at least one processor (340) can obtain at least one object of interest as an output parameter of an AI-generated model by inputting the user's current location and direction information and the route information to the destination as input parameters.

[0079] In one embodiment, at least one processor (340) may obtain guide information for guiding a route to the destination based on the at least one object of interest. For example, the at least one processor (340) may generate guide information for visually displaying a route to the destination using the at least one object of interest, or may obtain the guide information from an external device or external server connected via the communication circuit (320). The guide information may be generated based on a generative AI model. As another example, the at least one processor (340) may also generate a guide message describing the route to the destination using keywords associated with the at least one object of interest. The guide message may be generated based on a large language model (LLM).

[0080] LLM can be referred to as a language model comprised of an artificial neural network pre-trained on a massive amount of text data. Compared to conventional general language models, LLM can contain more than 10 times as many parameters (e.g., more than 100 billion parameters). LLM can utilize a transformer artificial neural network structure based on an attention mechanism. The attention mechanism is a technique that helps an artificial intelligence model focus on important parts of input data. The attention mechanism can be used to predict output data by predicting the degree to which at least a portion of time-series input data (e.g., input data such as voice or video, or input data of some layers of a neural network) contributes to the intermediate or final output of the neural network. The recurrent neural network (RNN) structure, which sequentially processes each element of a sequence, has poor prediction performance when there is information dependency between long time series distances, but the attention mechanism can consider information dependency between long time series distances by controlling the degree of weight concentration within the overall (or partial) context of the input data.

[0081] In one embodiment, at least one processor (340) may output the acquired guide information and / or the guide message. According to various embodiments, at least one processor (340) may display the visual data and / or information about the at least one object of interest on the display (330). For example, while providing map information including a route to the destination through the execution screen of the navigation application, the at least one processor (340) may display the visual data and / or the at least one object of interest overlapping the map information. At this time, the at least one processor (340) may display the at least one object of interest and at least one identifier (e.g., an arrow or a spot mark) indicating a direction toward the destination overlapping the map information and the visual data. According to various embodiments, at least one processor (340) may output the guide message through an audio output means such as a speaker (e.g., the audio output module (155) of FIG. 1), or may output the guide message through a speaker of an external device connected through a communication circuit (320).

[0082] In one embodiment, when at least one processor (340) detects movement of the user, the at least one processor (340) may dynamically change and provide the guide information and / or the guide message in response to the movement of the user. For example, in response to detecting the movement of the user, the at least one processor (340) may measure the changed current location and movement direction of the user using one or more sensors (310), and may acquire changed visual data (e.g., street view data) based on the changed current location and movement direction from the external server or the external device and display the changed visual data on the display (330). As another example, the at least one processor (340) may change and output the guide information for the destination and / or the corresponding guide message based on an object of interest identified from the changed visual data.

[0083] According to various embodiments, at least one processor (340) may provide additional information identified based on a situation related to the user or the destination, in addition to the route to the destination requested by the user. For example, at least one processor (340) may provide recommended information regarding a transportation method available to the user moving toward the destination or surrounding information suitable for the user's travel purpose (e.g., travel, business trip). As another example, at least one processor (340) may provide situational information based on an event (e.g., an event, an accident) that occurred at the destination or on the route to the destination and / or optimal route information considering the same.

[0084] FIG. 4 is a drawing illustrating a function performed in an electronic device (300) according to one embodiment.

[0085] Referring to FIG. 4, the electronic device (300) can perform functions of input (410), processing (420), or output (430). These functions can be controlled by at least one processor included in the electronic device (300) (e.g., the processor (120) of FIG. 1 or the processor (340) of FIG. 3).

[0086] In one embodiment, the electronic device (300) may acquire / collect location data (411), sensor data (412), voice data (413), or visual data (414) while performing the input (410) function. For example, the electronic device (300) may acquire location data (411) regarding the current location and the direction in which the device is moving based on a signal received from a global navigation satellite system (GNSS). The electronic device (300) may acquire sensor data (412) regarding the posture or movement state, or direction information of the electronic device (300) or a user wearing the electronic device (300) using one or more sensors (e.g., the sensor module (176) of FIG. 1 or the sensor (310) of FIG. 3). The one or more sensors may include at least one of an acceleration sensor, a gyro sensor, or a geomagnetic sensor. The location data (411) and the sensor data (412) may be updated according to a specified time cycle. The electronic device (300) can obtain voice data (413) including a user's voice input and sounds generated around the user through a microphone (e.g., the input module (150) of FIG. 1). The electronic device (300) can obtain visual data (414) including an image captured of the user or the user's surroundings using a camera (e.g., the camera module (180) of FIG. 1). According to various embodiments, the electronic device (300) can also obtain at least one of location data (411), sensor data (412), voice data (413), or visual data (414) related to the input (410) function from an external device connected to the electronic device (300) through wireless communication.

[0087] In one embodiment, the electronic device (300) may process / handle data for providing navigation information based on data acquired through the input (410) function while performing the processing (420) function. For example, the electronic device (300) may estimate context information of the user or the user's surroundings based on at least one of location data (411), sensor data (412), voice data (413), or visual data (414) through the context manager (421). The context manager (421) may identify a context (e.g., a place, a region, a city center) corresponding to the user's current location and moving direction based on the location data (411). If it is difficult to acquire location data (411) from GNSS, the context manager (421) may estimate the user's current location and moving direction using a PDR (pedestrian dead reckoning) algorithm based on sensor data (412), and determine context information corresponding thereto. For another example, the electronic device (300) can obtain navigation information for a destination requested by a user through the navigation manager (422). The navigation manager (422) can identify the destination included in the user's voice command based on voice data (413) and generate a route to the identified destination based on the user's current location. The navigation manager (422) can identify an event that occurred at the destination or on the route to the destination based on the context information and obtain optimal route information accordingly. For example, the navigation manager (422) can generate navigation information differently by considering the context of whether the user is walking or driving a vehicle. If the user is walking, the navigation manager (422) can generate navigation information that guides the user to reach the destination based on a walking route that a vehicle cannot enter.When the user is driving, the navigation manager (422) may generate navigation information including at least one of road lane information (e.g., 1 / 2 lanes, left / right turn lanes), speed limit information, facility / structure information, vehicle control information, or traffic condition information, based on a driving path that the vehicle can enter. In one embodiment, the electronic device (300) may obtain map information corresponding to the path to the destination through the map manager (424). The map manager (424) may obtain the map information including information about roads on which the user can travel from the current location to the destination, as well as information about buildings, streets, place names, or nearby POIs (points of interest) located on the path to the destination. The map manager (424) may also obtain street view data corresponding to the direction of travel from the user's current location as the map information, based on visual data (414). In one embodiment, the electronic device (300) may obtain personalized guide information for the user using the generation model (423). The generative model (423) may include a large multimodal model (LMM) learned based on language (e.g., natural language) and images. The generative model (423) may use the LMM to extract a partial image corresponding to a direction the user is looking at from a street view image corresponding to the user's current location based on navigation information for the destination obtained from the navigation manager (422) and map information obtained from the map manager (424), and may process the extracted image into information customized for the user by associating it with the navigation information and the map information.For example, when navigation information such as 'turn right in 50m ahead' is input, the generation model (423) can learn the navigation information and map information related thereto to generate map guidance (431) in the form of a map or street view image that the user can easily recognize from the current location. As another example, the generation model (423) can determine at least one identifiable object of interest on the route to the destination based on street view data corresponding to the user's current line of sight, and generate instruction guidance (432) for guiding the route to the destination using the at least one object of interest. The instruction guidance (432) can include an identifier indicating the at least one object of interest or route guidance to the destination on the street view data, and / or a guide message generated using a keyword related to the at least one object of interest. For example, the identifier can be displayed in the form of a spot mark emphasizing the at least one object of interest or the destination, or an arrow indicating the route to the destination. The above guide message may be output in the form of a message that guides a route to the destination by utilizing at least one object of interest identified at the user's current location (e.g., "Turn right after passing Restaurant A ahead" or "Turn right after passing Restaurant A on the right"). The instruction guidance (432) may be dynamically changed according to the user's position movement, update of posture or orientation information, or the user's feedback input (in response to route guidance).

[0088] According to various embodiments, when navigation information such as 'turn right in 50m ahead' is input, the generation model (423) may obtain map information corresponding to the current location from the map manager (424). According to some embodiments, the generation model (423) may additionally obtain an image corresponding to the current heading based on the sensor data (412) from the context manager (421). The generation model (423) may input the navigation information, the map information corresponding to the current location, and / or the image corresponding to the current heading into the LMM. When the generation model (423) detects a user command such as 'turn right in 50m ahead', the generation model (423) may perform processing to 'output a route guidance while viewing a map screen' based on the image of 'forward' identified from the user command. In this case, the generation model (423) can extract an identifiable object based on a location corresponding to a 'right turn' from the map information, and output a guide message such as "Turn right at Restaurant A ahead" along with a map image based on the extracted object. At this time, the name of the restaurant ahead can be obtained from an image obtained from the context manager (421), or can be obtained based on POI information obtained from the map manager (424) based on the current location. According to various embodiments, if the electronic device (300) cannot obtain information about Restaurant A or includes a foreign language that the user cannot recognize, the electronic device (300) can generate and output a message describing Restaurant A, such as "Turn right at the red sign building ahead." According to various embodiments, if the electronic device (300) detects that the user is looking in a different direction based on information obtained from the context manager (421), the electronic device (300) can additionally output a corrective message, such as "It's not that direction, it's to the right."According to various embodiments, when the electronic device (300) detects that the user maintains a location for a certain period of time and then resumes movement based on information obtained from the context manager (421), it may additionally output a message that can remind the user of the route, such as “There is a red sign on the right.”

[0089] In one embodiment, the electronic device (300) may output map guidance (431) and / or instruction guidance (432) obtained from the generation model (423) while performing the output (430) function. For example, the electronic device (300) may display the map guidance (431) and / or the instruction guidance (432) through a display (e.g., the display module (160) of FIG. 1 or the display (330) of FIG. 3), or may output an audio signal corresponding to the instruction guidance (432) through a speaker (e.g., the audio output module (155) of FIG. 1). For another example, the electronic device (300) may provide the map guidance (431) and / or the instruction guidance (432) via an external device (e.g., a smartphone (210), wireless earphones (240), or smart glasses (250) of FIG. 2A) connected via wireless communication.

[0090] According to various embodiments, the electronic device (300) may perform all of the input (410) function, the processing (420) function, and the output (430) function, or may perform only some of the functions in conjunction with an external device connected via wireless communication. For example, when the electronic device (300) recognizes a command from a user requesting route guidance to a destination, the electronic device (300) may perform all of the input (410) function, the processing (420) function, and the output (430) function on its own to generate and provide map guidance (431) and instruction guidance (432) for the destination. In another example, among the functions, the input (410) function and the output (430) function may be performed by the electronic device (300), and the processing (420) function may be performed by a smartphone (e.g., the electronic device (102) of FIG. 1 or the smartphone (210) of FIG. 2A) wirelessly connected to the electronic device (300). For another example, among the above functions, the input (410) function and the processing (420) function may be performed by the electronic device (300), and the output (430) function may be performed through wireless earphones or a headset (e.g., wireless earphones (240) of FIG. 2c) wirelessly connected to the electronic device (300).

[0091] FIG. 5 is a diagram illustrating a method of performing a function using a plurality of wearable devices according to one embodiment.

[0092] Referring to FIG. 5, a first device (510) may perform operations for providing navigation information in conjunction with a second device (520) connected via short-range wireless communication. Here, the first device (510) may correspond to a smart watch worn on a user's wrist (e.g., a smart watch (220) of FIG. 2b or an electronic device (300) of FIG. 3), and the second device (520) may correspond to a wireless earphone or headset worn on the user's head (ear) (e.g., a wireless earphone (240) of FIG. 2c).

[0093] In one embodiment, the first device (510) may include an application processor (AP) (511), a micro controller unit (MCU) (513), and a sensor (515). The second device (520) may include an MCU (521) and a sensor (523).

[0094] In one embodiment, the first device (510) and the second device (520) are connected to each other through a wireless communication circuit, and can exchange various data through an interface of an MCU (513) in the first device (510) and an interface of an MCU (521) in the second device (520). According to various embodiments, the first device (510) can synchronize data between the two devices through a connection management framework while the connection with the second device (520) is maintained, and can integrate and process the synchronized data. For example, the first device (510) can integrate and manage inertial sensor data acquired through a sensor (515) and inertial sensor data acquired from a sensor (523) of the second device (520). As another example, the first device (510) can determine in which device to activate a function that overlaps with the function of the second device (520). For example, the first device (510) may determine to activate the GPS function for measuring the user's current location in the first device (510) and to activate the camera function for acquiring an image corresponding to the user's gaze in the second device (520). In addition, the first device (510) may determine to activate the microphone function for recognizing the user's voice input or sounds occurring around the user in both devices, thereby integrating and processing voice signals acquired in both devices.

[0095] FIG. 6 is a diagram illustrating a method for providing a navigation service in an electronic device (300), according to one embodiment. According to various embodiments, the electronic device (300) may correspond to a smart watch worn on a user's wrist (e.g., the electronic device (101) of FIG. 1, the smart watch (220) illustrated in FIGS. 2A and 2B, or the electronic device (300) of FIG. 3). The electronic device (300) may include a display (600) for displaying an execution screen of a navigation application and / or information visually guiding a route to a destination requested by a user while providing a navigation service.

[0096] Referring to FIG. 6, the electronic device (300) can receive a user input (611) such as 'Give me directions to Gallery A'. The electronic device (300) can recognize a voice input corresponding to the user input (611) through a microphone (e.g., the input module (150) of FIG. 1 or the microphone (222) of FIG. 2B), or can recognize a text input corresponding to the user input (611) using a virtual keyboard provided through the display (600). While recognizing the user input (611), the electronic device (300) can display a first screen (610) on the display (600) indicating that it is receiving the user input (611). When the electronic device (300) receives the user input (611), it can identify a destination, which is a target of directions, from the user input (611). For example, the electronic device (300) can identify Gallery A as a destination from the user input (611).

[0097] In one embodiment, when the electronic device (300) identifies a destination from the user input (611), it may execute a navigation application to search for a route to the destination and display the execution screen of the navigation application on the display (600). According to various embodiments, the electronic device (300) may also identify the destination by receiving the user input (611) while the navigation application is running. When the navigation application is running, the electronic device (300) may display the user's current location and the route to the identified destination on a map and provide the information. At this time, the map may be displayed based on the user's moving direction or a direction corresponding to geomagnetic data acquired from a sensor of the electronic device (300).

[0098] In one embodiment, the electronic device (300) may obtain surrounding data based on the current location of the user and the direction in which the user is heading. The surrounding data may include street view data of an actual distance corresponding to the direction in which the user is heading based on the current location and POI (point of interest) data located within a specified distance radius based on the current location of the user. The electronic device (300) may obtain the street view data and / or the POI data from an external server providing a navigation service (e.g., the server (108) of FIG. 1) or an external device connected via short-range wireless communication (e.g., the electronic device (102) of FIG. 1 or the smartphone (210) of FIG. 2A). The electronic device (300) may identify at least one object of interest that can be easily identified at the current location of the user based on the street view data, the POI data, and the path to the identified destination. The at least one object of interest may be determined based on a generative AI model. For example, the electronic device (300) can display a second screen (620) including street view data corresponding to the current location and direction of the user on the display (600), and can confirm from the street view data that the object of interest, B Cafe, is located to the right front of the user. In this case, the electronic device (300) can generate and output a guide message (621) saying, "Turn right after passing B Cafe on the right." The guide message (621) can be generated based on an LLM (large language model) that generates a guide based on natural language, or an LMM (large multimodal model) that generates a guide based on natural language and images.The generated guide message (621) may be displayed through the display (600), or may be output as a TTS (text-to-speech) voice through a speaker of the electronic device (300) (e.g., the audio output module (155) of FIG. 1) or an external device (e.g., the wireless earphones (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) may display identifiers (622, 623) corresponding to 'B Cafe' and 'Right Turn' in the guide message (621) on the street view data of the second screen (620). As another example, the electronic device (300) may display a third screen (630) including street view data corresponding to the user's current location and heading direction on the display (600), and may confirm from the street view data that B Cafe, which is an object of interest, is located in front of the user's field of view. In this case, the electronic device (300) can generate and output a guide message (631) saying, “Go to the left road of the B cafe visible in front.” The guide message (631) is generated based on a large language model (LLM) and can be displayed through the display (600) or output as a TTS (text-to-speech) voice through a speaker of the electronic device (300) (e.g., an audio output module (155) of FIG. 1) or an external device (e.g., a wireless earphone (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) can display identifiers (632, 633) corresponding to “B cafe” and “left road” in the guide message (631) on the street view data of the third screen (630).

[0099] In one embodiment, when the electronic device (300) confirms that the user has reached the vicinity of the destination, the electronic device (300) may display a fourth screen (640) including street view data including the destination on the display (600) based on the user's current location. The electronic device (300) may confirm that the destination is located on the right front of the user from the street view data, and may generate and output a guide message (641) stating, "Gallery A is the building visible on the right, 10 m ahead." The guide message (641) may be generated based on a large language model (LLM), and may be displayed on the display (600), or output as a TTS (text-to-speech) voice through a speaker of the electronic device (300) (e.g., the audio output module (155) of FIG. 1) or an external device (e.g., the wireless earphones (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) may display identifiers (642, 643) corresponding to 'Gallery A' and '10m ahead' in the guide message (641) on the street view data of the fourth screen (640). According to various embodiments, when the electronic device (300) generates the guide message (641) based on a generative AI model, the electronic device (300) may generate / output the guide message (641) by distinguishing it into a format that describes the screen or a format that describes an actual object (e.g., a destination) depending on the posture of the user wearing the electronic device (300). For example, when the electronic device (300) detects a motion of the user raising his / her wrist through one or more sensors (e.g., the sensor module (176) of FIG. 1 or the sensor (310) of FIG. 3), the electronic device (300) may determine that the user is looking at the display (600) and generate and output a guide message in a format that describes the screen, such as "Gallery A is a building marked in red on the screen."For another example, if the wrist-raising motion is not detected, the electronic device (300) may determine that the user is not looking at the display (600) and may generate and output a guide message in a format that describes the destination, such as “The entrance to Gallery A is the building with the blue door ahead.”

[0100] FIG. 7 is a flowchart illustrating an operating method of an electronic device (300) according to an embodiment. According to an embodiment, the electronic device (300) is a device that provides guide information for a destination based on visual data corresponding to a user's current location and direction of travel, and may correspond to the electronic device (101) illustrated in FIG. 1 or the smart watch (220) illustrated in FIG. 2B. The operations of FIG. 7 may be performed by at least one processor included in the electronic device (300) (e.g., the processor (120) illustrated in FIG. 1 or the processor (340) illustrated in FIG. 3).

[0101] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0102] Referring to FIG. 7, according to one embodiment, in operation 710, the electronic device (300) may identify a destination, which is a route guidance target, from a user input requesting route guidance to the destination. The user input may be obtained by using an input means such as a microphone (e.g., the input module (150) of FIG. 1) or a virtual keyboard provided through the display (330). For example, if the electronic device (300) receives a voice input of a user requesting route guidance to the destination through the microphone in operation 710, the electronic device (300) may identify the destination from the voice input. As another example, if the electronic device (300) receives a text input of a user requesting route guidance to the destination through the virtual keyboard provided through the display (330) in operation 710, the electronic device (300) may extract and identify the destination from the text input. According to various embodiments, the destination may include at least one of a place name, a building name, a business name, address information, or a geographical location such as latitude / longitude. When the electronic device (300) identifies the user's personalized location (e.g., home, office, school) as the destination from the user input, it can recognize frequently visited locations or locations likely to be visited based on the user's visit history by associating them with information about the destination.

[0103] According to one embodiment, the electronic device (300) may execute a navigation application to search for a route to the destination. The electronic device (300) may identify the destination by receiving the user input while the navigation application is executed prior to operation 710, or may automatically execute the navigation application when the user input is received at operation 710.

[0104] According to one embodiment, in operation 720, the electronic device (300) may obtain information on the current location and direction of the user by using one or more sensors (e.g., the sensor module (176) of FIG. 1 or the sensor (310) of FIG. 3). For example, the electronic device (300) may obtain information on the current location of the user by using a GPS circuit. As another example, the electronic device (300) may obtain information on the direction in which the user is moving by using a geomagnetic sensor. According to various embodiments, the electronic device (300) may determine whether the user is moving by using at least one of a GPS circuit (or a global navigation satellite system (GNSS)), a geomagnetic sensor, an acceleration sensor (e.g., a pedometer), or a gyro sensor, and may estimate a direction in which the user is looking and / or a direction in which the user is likely to look in the current situation based on the determination. When the electronic device (300) detects that the user is moving while the navigation function is activated, the electronic device (300) can obtain heading information (information about the direction in which the user is moving based on the current location) through the GPS circuit. When the user stops moving and maintains the location at a certain point, the electronic device (300) can identify the current direction (orientation or azimuth) of the user using a compass including a geomagnetic sensor.

[0105] According to one embodiment, in operation 730, the electronic device (300) may acquire surrounding data within a specified distance based on the current location and direction information of the user. The surrounding data may include visual data (e.g., street view data) corresponding to a direction in which the user is facing from the current location of the user and POI (point of interest) data for an object that can be easily identified within a specified distance radius based on the current location of the user. The POI data may include at least one of absolute location information (e.g., latitude, longitude) of the object or classification attributes (e.g., business name, address, or industry classification) of the object. For example, the electronic device (300) may acquire the visual data and / or the POI data from an external server (e.g., server (108) of FIG. 1) that provides a navigation service. For another example, the electronic device (300) may obtain the visual data and / or the POI data from an external device (e.g., the electronic device (102) of FIG. 1 or the smartphone (210) of FIG. 2A) connected via short-range wireless communication. According to various embodiments, the electronic device (300) may also utilize an image of the user's surroundings obtained using a camera (e.g., the camera module (180) of FIG. 1) or an image corresponding to the user's gaze obtained from an external device connected via a communication circuit (320) as the visual data.

[0106] According to one embodiment, in operation 740, the electronic device (300) may determine at least one object of interest included in the path to the destination from the surrounding data. Here, the at least one object of interest may correspond to an object that can be easily identified in the user's field of view. For example, in operation 740, the electronic device (300) may determine an object extracted from visual data (e.g., street view data) corresponding to a direction in which the user is facing from the user's current location as the at least one object of interest. As another example, in operation 740, the electronic device (300) may identify an object included in the POI data from the visual data and determine the object as the at least one object of interest. As another example, in operation 740, the electronic device (300) may detect the user's gaze information using one or more cameras (e.g., the camera module (180) of FIG. 1) and determine the at least one object of interest based on the detected gaze information. According to various embodiments, the at least one object of interest may be determined based on a pre-trained AI-generated model. In this case, the electronic device (300) may acquire the at least one object of interest as an output parameter of the AI-generated model by inputting the user's current location and direction information, and the route information to the destination as input parameters.

[0107] According to one embodiment, in operation 750, the electronic device (300) may obtain guide information for guiding a path to the destination based on the at least one object of interest. For example, the electronic device (300) may generate guide information for visually displaying a path to the destination using the at least one object of interest, or may obtain the guide information from an external device or external server connected via the communication circuit (320). The guide information may be generated based on a generative AI model. As another example, the electronic device (300) may also generate a guide message describing a path to the destination using keywords associated with the at least one object of interest. The guide message may be generated based on a large language model (LLM).

[0108] According to one embodiment, in operation 750, the electronic device (300) may output the acquired guide information and / or the guide message. In operation 750, the electronic device (300) may display the visual data and / or information about the at least one object of interest on the display (330). For example, while providing map information including a route to the destination through the execution screen of the navigation application, the electronic device (300) may display the visual data and / or the at least one object of interest by overlapping the map information. The electronic device (300) may display the at least one object of interest and at least one identifier (e.g., an arrow or a spot mark) indicating a direction toward the destination by overlapping the map information and the visual data. In operation 750, the electronic device (300) may output the guide message through an audio output means such as a speaker (e.g., the audio output module (155) of FIG. 1), or may output the guide message through a speaker of an external device connected through a communication circuit (320).

[0109] According to various embodiments, when the electronic device (300) detects the movement of the user while providing the guide information and the guide message, the electronic device (300) may dynamically change and provide the guide information and the guide message in response to the movement of the user. For example, in response to detecting the movement of the user, the electronic device (300) may measure the changed current location and movement direction of the user using one or more sensors (310), and may acquire changed visual data (e.g., street view data) based on the changed current location and movement direction from the external server or the external device and display the changed visual data on the display (330). As another example, the electronic device (300) may change and output guide information for the destination and / or a corresponding guide message based on an object of interest identified from the changed visual data.

[0110] FIG. 8 is a flowchart illustrating a method for providing a navigation service in an electronic device (300), according to one embodiment. The operations of FIG. 8 may be understood as functions performed by at least one processor (e.g., the processor (120) of FIG. 1 or the processor (340) of FIG. 3) included in the electronic device (300).

[0111] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0112] Referring to FIG. 8, according to one embodiment, in operation 810, the electronic device (300) may identify a destination from a user input requesting route guidance. In operation 810, the electronic device (300) may identify the destination from a user's voice input received through a microphone (e.g., the input module (150) of FIG. 1), or may identify the destination from a user's text input received through a virtual keyboard provided through a display (e.g., the display module (160) of FIG. 1 or the display (330) of FIG. 3). According to various embodiments, when a personalized location of the user (e.g., home, office, school) is identified as the destination, the electronic device (300) may recognize a frequently visited location or a location likely to be moved to based on the user's visit history by associating it with information of the destination.

[0113] According to one embodiment, in operation 820, the electronic device (300) may execute a navigation application to search for a route to the destination based on the user's current location. According to various embodiments, the electronic device (300) may automatically execute the navigation application in response to receiving the user input requesting route guidance.

[0114] According to one embodiment, in operation 830, the electronic device (300) may determine whether the user's direction information is acquired from one or more sensors (e.g., the sensor module (176) of FIG. 1 or the sensor (310) of FIG. 3). If the direction information is not acquired (operation 830-No), the electronic device (300) may provide a guide message based on a map provided through the execution screen of the navigation application in operation 875. At this time, the guide message may be a general message that displays a route to reach the destination from the current location on the map without considering the user's direction information.

[0115] As a result of the above determination, if the direction information is acquired (operation 830-Yes), the electronic device (300) can determine whether surrounding data within a specified distance is acquired based on the user's current location and the direction information in operation 840. The surrounding data may include street view data corresponding to the direction the user is facing from the user's current location and data regarding a POI located within the specified distance radius based on the user's current location. The electronic device (300) can check whether the surrounding data is acquired from an external server connected via long-range wireless communication (e.g., server (108) of FIG. 1) or an external device connected via short-range wireless communication (e.g., electronic device (102) of FIG. 1 or smartphone (210) of FIG. 2A). As a result of the determination, if the surrounding data is not acquired (operation 840-No), the electronic device (300) can provide a guide message based on a map provided through the execution screen of the navigation application in operation 875. At this time, the guide message may be a general message that displays a route on a map to reach the destination from the current location without considering the user's surrounding data.

[0116] As a result of the above determination, if the surrounding data has been acquired (operation 840 - Yes), the electronic device (300) may determine whether information on at least one object of interest is acquired based on the surrounding data in operation 850. The at least one object of interest is an object that can be easily identified in the user's field of view, and may be determined based on the street view data and data about the POI. According to various embodiments, the electronic device (300) may acquire information on the at least one object of interest using a pre-learned AI-generated model. As a result of the above determination, if the information on the at least one object of interest has not been acquired (operation 850 - No), the electronic device (300) may provide a guide message based on a map provided through the execution screen of the navigation application in operation 875. In this case, the guide message may be a general message that displays a route for reaching the destination from the current location on a map without considering information on the at least one object of interest located around the user.

[0117] As a result of the above determination, if information on at least one object of interest has been obtained (operation 850-Yes), the electronic device (300) may generate a guide message describing a path to the destination using a keyword associated with the at least one object of interest in operation 860. Here, the guide message may be a personalized message for the user, which describes a path to reach the destination based on the object of interest identified from the street view data corresponding to the user's moving direction and the user's field of view.

[0118] According to one embodiment, in operation 870, the electronic device (300) may provide the generated guide message based on the street view data. For example, in operation 870, the electronic device (300) may display the street view data on the display (330) while overlaying the guide message on the street view data. As another example, while displaying the street view data on the display (330), the electronic device (300) may output a voice signal corresponding to the guide message through a speaker (e.g., the audio output module (155) of FIG. 1). In this case, the electronic device (300) may provide an identifier corresponding to an object of interest or a direction of movement included in the guide message by displaying it on the street view data.

[0119] FIG. 9 is a diagram illustrating a method for dynamically providing guide information in response to a user's movement in an electronic device (300), according to one embodiment. According to various embodiments, the electronic device (300) may correspond to a smart watch worn on a user's wrist (e.g., the electronic device (101) of FIG. 1, the smart watch (220) illustrated in FIGS. 2A and 2B, or the electronic device (300) of FIG. 3). The electronic device (300) may include a display (900) for displaying an execution screen of a navigation application and / or information visually guiding a route to a destination requested by a user while providing a navigation service.

[0120] Referring to FIG. 9, an electronic device (300) can obtain street view data corresponding to the direction in which the user is facing based on the current location and direction information of the user confirmed using one or more sensors (310), display the data on a display (900), and guide a route to a destination based on the street view data.

[0121] In one embodiment, the electronic device (300) may identify an object of interest and a direction toward the destination from the street view data while displaying the first screen (910) including the street view data. For example, the electronic device (300) may determine that the user is located in a park, which is the object of interest, and must move to the left front to reach the destination. In this case, the electronic device (300) may generate and output a guide message (911) such as, “Follow the path between the parks and go in the 10 o’clock direction.” The guide message (911) may be generated based on a large language model (LLM) and displayed through the display (900), or may be output as a TTS (test-to-speech) voice through a speaker of the electronic device (300) (e.g., the audio output module (155) of FIG. 1) or an external device wirelessly connected to the electronic device (300) (e.g., the wireless earphones (240) of FIGS. 2A and 2C). The electronic device (300) can display identifiers (912, 913) corresponding to the 'path between parks' and the '10 o'clock direction' in the guide message (911) on the street view data of the first screen (910). The electronic device (300) can add or modify an image of an arrow identifier (913) corresponding to the '10 o'clock direction' of the guide message (911) using a large vision model (LVM) or a large multimodal model (LMM) and display it on the street view data. According to various embodiments, the image of the arrow identifier (913) can be in the form of a single image or an animated image guiding a route.

[0122] In one embodiment, the electronic device (300) may dynamically change and provide the street view data and the guide message in response to the movement of the user's location. When the electronic device (300) detects that the user's location has moved from one or more sensors (310), the electronic device (300) may check the changed current location and movement direction according to the movement of the user, and display a second screen (920) including the changed street view data based on the changed current location and movement direction on the display (900). The electronic device (300) may identify an object of interest and a direction toward the destination based on the street view data of the second screen (920). For example, the electronic device (300) may determine that the user must move straight to reach the destination when entering a path between parks, which is an object of interest. In this case, the electronic device (300) may generate and output a guide message (921) that says, "Go straight for 100 m on the path between parks." The above guide message (921) is generated based on a large language model (LLM) and can be displayed through a display (900) or output as a text-to-speech (TTS) voice through a speaker of the electronic device (300) (e.g., an audio output module (155) of FIG. 1) or an external device (e.g., a wireless earphone (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) can display an identifier (922) corresponding to 'go straight' in the guide message (921) on the street view data of the second screen (920). The electronic device (300) can add or modify an image of an arrow identifier (922) corresponding to 'go straight' in the guide message (921) by using a large vision model (LVM) or a large multimodal model (LMM) and display it on the street view data.Depending on the various embodiments, the image of the arrow identifier (922) may be in the form of a single image or in the form of an animated image guiding a path.

[0123] In one embodiment, the electronic device (300) may acquire the user's location information and direction information from one or more sensors (310) at a specified time cycle and continuously update the user's current location and direction of movement. If the electronic device (300) detects that the user's current location and direction of movement have changed based on the updated information, the electronic device (300) may display a third screen (930) including changed street view data based on the changed current location and direction of movement on the display (900). The electronic device (300) may identify the destination based on the street view data of the third screen (930). For example, the electronic device (300) may confirm that the destination is in front of the user and may generate and output a guide message (931) stating, "The destination is 10 m ahead." The above guide message (931) is generated based on a large language model (LLM) and can be displayed through a display (900) or output as a TTS (text-to-speech) voice through a speaker of the electronic device (300) (e.g., an audio output module (155) of FIG. 1) or an external device (e.g., a wireless earphone (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) can display identifiers (932, 933) corresponding to '10 m ahead' and 'destination' in the guide message (931) on the street view data of the third screen (930). The electronic device (300) can add or modify an image of an arrow identifier (932) corresponding to '10 m ahead' of the guide message (931) by using a large vision model (LVM) or a large multimodal model (LMM) and display it on the street view data. Depending on the various embodiments, the image of the arrow identifier (932) may be in the form of a single image or in the form of an animated image guiding a path.

[0124] FIGS. 10A, 10B, and 10C are diagrams illustrating context-based information that may be provided together with a navigation service in an electronic device (300), according to one embodiment. According to various embodiments, the electronic device (300) may correspond to a smart watch worn on a user's wrist (e.g., the electronic device (101) of FIG. 1 , the smart watch (220) illustrated in FIGS. 2A and 2B , or the electronic device (300) of FIG. 3 ). The electronic device (300) may include a display (1000) for displaying an execution screen of a navigation application and / or information visually guiding a route to a destination requested by a user while providing a navigation service.

[0125] Referring to FIG. 10A, the electronic device (300) may provide recommendation information based on the user's situation while guiding a route to a destination based on street view data corresponding to the user's current location and direction of movement. For example, the electronic device (300) may recommend a means of transportation that can be used by a user walking toward the destination while displaying a first screen (1010) including the street view data on the display (1000). When the electronic device (300) identifies a direction toward the destination and a bus stop, which is an object of interest, from the street view data of the first screen (1010), the electronic device (300) may generate and output a guide message (1011) that says, "The destination is 700 m in the 11 o'clock direction. You can take bus number 142 at the bus stop on the right." The above guide message (1011) is generated based on a large language model (LLM) and can be displayed through a display (1000) or output as a TTS (text-to-speech) voice through a speaker of the electronic device (300) (e.g., an audio output module (155) of FIG. 1) or an external device (e.g., a wireless earphone (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) can display an identifier (1012) corresponding to '70 m in the 11 o'clock direction' and an identifier (1013) corresponding to 'bus stop' in the guide message (1011) on the street view data of the first screen (1010).

[0126] Referring to FIG. 10b, the electronic device (300) may provide recommended information suited to the user's travel purpose while guiding a route to a destination based on street view data corresponding to the user's current location and movement direction. For example, the electronic device (300) may recommend nearby attractions that a user who wishes to visit the destination for travel purposes can see while displaying a second screen (1020) including the street view data on the display (1000). When the electronic device (300) identifies the direction of the destination and the object of interest, St. Stephen's Cathedral, from the street view data of the second screen (1020), the electronic device (300) may generate and output a guide message (1021) that says, "The destination is 10 m ahead on the left. St. Stephen's Cathedral is 100 m ahead in the 12 o'clock direction." The above guide message (1021) is generated based on a large language model (LLM) and can be displayed through a display (1000) or output as a TTS (text-to-speech) voice through a speaker of the electronic device (300) (e.g., an audio output module (155) of FIG. 1) or an external device (e.g., a wireless earphone (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) can display an identifier (1022) corresponding to '10 m ahead to the left', an identifier (1023) corresponding to 'destination', and an identifier (1024) corresponding to 'St. Stephen's Cathedral' in the guide message (1021) on the street view data of the second screen (1020).

[0127] Referring to FIG. 10c, the electronic device (300) may provide recommended information while guiding a route to a destination based on street view data corresponding to the user's current location and direction of movement, taking into account the congestion level of the destination or the route to the destination. For example, the electronic device (300) may recommend an alternative route while displaying a third screen (1030) including the street view data on the display (1000), taking into account the congestion level due to an event occurring near the destination. If the electronic device (300) identifies an event (e.g., a marathon) occurring near the destination from the street view data of the third screen (1030), the electronic device (300) may generate and output a guide message (1031) saying, "The destination is 300m ahead. Gwanghwamun Square is currently congested due to the marathon, so please enter the alley on the right." The above guide message (1031) is generated based on a large language model (LLM) and can be displayed through a display (1000) or output as a TTS (text-to-speech) voice through a speaker of the electronic device (300) (e.g., an audio output module (155) of FIG. 1) or an external device (e.g., a wireless earphone (240) of FIGS. 2A and 2C) wirelessly connected to the electronic device (300). The electronic device (300) can display an identifier (1032) corresponding to 'Gwanghwamun Square' and an identifier (1033) corresponding to 'Right Alley' in the guide message (1031) on the street view data of the third screen (1030).

[0128] FIG. 11 is a diagram illustrating a method for providing guide information in response to a folded state of an electronic device (1100), according to one embodiment. In FIG. 11, the electronic device (1110) may be a foldable type terminal including a flexible display.

[0129] Referring to FIG. 11, the electronic device (1100) may provide different guidance information based on the folded state. For example, when the electronic device (1100) is in a folded state (1110), the electronic device (1100) may display brief information guiding the route to the destination on the cover display or output a voice message guiding the way to the destination through a speaker (e.g., the audio output module (155) of FIG. 1). As another example, when the electronic device (1100) is in an unfolded state (1120), the electronic device (1100) may guide the route to the destination using the execution screen of a navigation application.

[0130] According to various embodiments, the electronic device (1100) may provide different guide information depending on the direction in which the electronic device is gripped by the user. In one embodiment, if the electronic device (1100) detects that the electronic device is gripped in a direction parallel to the floor in an unfolded state (1120), the electronic device may provide guide information for the destination based on map information. In one embodiment, if the electronic device (1100) detects that the electronic device is gripped in a direction perpendicular to the floor in an unfolded state (1120), the electronic device may provide guide information for the destination based on street view data.

[0131] FIG. 12 is a drawing illustrating a method of providing a guide message using an audio output device according to one embodiment.

[0132] Referring to FIG. 12, an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (300) of FIG. 3) may output a guide message guiding a route to a destination using an audio output device connected via short-range wireless communication. For example, the audio output device may include a headset device (1200) or a wireless earphone device (1250).

[0133] In one embodiment, when the headset device (1200) receives a guide message guiding a route to a destination from the electronic device (300), the headset device (1200) may output the guide message through the left speaker (1210) and / or the right speaker (1220). In one embodiment, the headset device (1200) may adjust the volume of the left / right speakers (1210, 1220) in consideration of the direction in which the user should move toward the destination. For example, when guiding movement in the left direction, the headset device (1200) may output the guide message by adjusting the volume of the left speaker (1210) to be higher than that of the right speaker (1220). In another example, when guiding movement in the right direction, the headset device (1200) may output the guide message by adjusting the volume of the right speaker (1220) to be higher than that of the left speaker (1210).

[0134] In one embodiment, when the wireless earphone device (1250) receives a guide message guiding a route to a destination from the electronic device (300), the wireless earphone device (1250) may output the guide message through the left speaker (1260) and / or the right speaker (1270). In one embodiment, the wireless earphone device (1250) may adjust the volume of the left / right speakers (1260, 1270) in consideration of the direction in which the user should move toward the destination. When guiding movement in the left direction, the wireless earphone device (1250) may output the guide message by adjusting the volume of the left speaker (1260) to be higher than that of the right speaker (1270), and when guiding movement in the right direction, the wireless earphone device (1250) may output the guide message by adjusting the volume of the right speaker (1270) to be higher than that of the left speaker (1260).

[0135] In one embodiment, the headset device (1200) and the wireless earphone device (1250) may include a camera (1230). In this case, the headset device (1200) may intuitively recognize the direction in which the user's gaze is directed using the camera (1230) and provide a guide message customized to the user based on the recognized direction.

[0136] According to various embodiments, the camera (1230) may assist or replace the street view image in the process of guiding a route based on street view data. The electronic device (300) may guide a route to a destination by displaying an image acquired from the camera (1230) included in the audio output device on a display (e.g., the display module (160) of FIG. 1 or the display (330) of FIG. 3), or may search for street view data corresponding to an image acquired by the camera (1230) and display it on the display (330). The electronic device (300) may identify and provide a route based on an image acquired from the camera (1230) (e.g., a snapshot), or may guide a route based on a streaming video acquired through the camera (1230). In this case, the electronic device (300) may generate information for guiding a route based on an image output through the display (330) using a large multimodal model (LMM). For example, the electronic device (300) can output a message corresponding to each image frame (e.g., 'Go around the right cafe now', 'Yes, keep moving forward', 'Yes, that's the right place') based on the image frame (or scene) currently being output through the display (330) depending on the situation.

[0137] FIG. 13 is a drawing illustrating a method of providing guide information using smart glasses (1300), according to one embodiment.

[0138] Referring to FIG. 13, the smart glasses (1300) can provide guide information for guiding a path to a destination based on an image of an actual street that the user is viewing. The smart glasses (1300) can generate the guide information by identifying a direction toward the destination based on the image while displaying a screen (1310) including an image of an actual street based on the user's gaze direction. For example, if the smart glasses (1300) identify that the destination is in front of a user walking on a sidewalk block from the image on the screen (1310), the smart glasses (1300) can generate and output a guide message (1320) that says, "The destination is 480 meters ahead along the sidewalk block. Follow the arrow." The above guide message (1320) may be displayed by overlaying the image through the display of the smart glass (1300), or may be output through the speaker of the smart glass (1300) or an external device (e.g., wireless earphones (240) of FIGS. 2A and 2C) wirelessly connected to the smart glass (1300). The smart glass (1300) may display an identifier (1311) corresponding to the 'arrow' in the above guide message (1320) on the image of the screen (1310).

[0139] According to various embodiments, the smart glasses (1300) can dynamically change and output guide messages based on the user's gaze information acquired in real time. For example, if the user is looking at a car ahead, the smart glasses (1300) can generate and provide a guide message such as "Move in the direction of the car you are currently looking at" based on the object the user is looking at.

[0140] In one embodiment, an electronic device (e.g., electronic device (300)) includes one or more sensors (310), a display (330), at least one processor (340), and a memory (350) storing instructions, wherein the instructions are executed by the at least one processor (340) to cause the electronic device (300) to obtain current location and direction information using the one or more sensors (310) based on identifying a destination from a user input, obtain surrounding data within a specified distance based on the current location and the direction information, determine at least one object of interest included in a path to the destination from the surrounding data, obtain guide information for guiding a path to the destination based on the at least one object of interest, and output the obtained guide information on the display (330).

[0141] In one embodiment, the instructions may be executed by the at least one processor (340) to cause the electronic device (300) to obtain street view data corresponding to a direction in which the user is facing from the current location from an external server or an external device connected to the electronic device, and to display the obtained street view data on the display.

[0142] In one embodiment, the instructions may be executed by the at least one processor (340) to cause the electronic device (300) to extract the at least one object of interest identified from the street view data and generate a guide message corresponding to the guide information using a keyword associated with the at least one extracted object of interest.

[0143] In one embodiment, the guide message may be generated based on a large language model (LLM).

[0144] In one embodiment, the electronic device further includes a speaker, and the instructions, executed by the at least one processor (340), may cause the electronic device (300) to output the generated guide message through the speaker.

[0145] In one embodiment, the instructions, executed by the at least one processor (340), may cause the electronic device (300) to display on the street view data at least one identifier indicating the at least one object of interest and a direction toward the destination.

[0146] In one embodiment, the instructions may be executed by the at least one processor (340) to cause the electronic device (300) to, in response to detection of movement of the user, use the one or more sensors to determine a changed current location and direction of movement of the user, and to display changed street view data corresponding to the changed current location and direction of movement on the display (330).

[0147] In one embodiment, the electronic device further includes a communication circuit that supports wireless connection with at least one external device, and the instructions, executed by the at least one processor (340), may cause the electronic device (300) to output a voice message corresponding to the guide information through a speaker of the first external device when the electronic device (300) is connected to the first external device using the communication circuit.

[0148] In one embodiment, the electronic device further includes one or more cameras, and the instructions, executed by the at least one processor (340), may cause the electronic device (300) to detect gaze information of the user using the one or more cameras and identify the at least one object of interest based on the detected gaze information.

[0149] In one embodiment, the instructions may be executed by the at least one processor (340) to cause the electronic device (300) to display map information including a route to the destination on the display (330) based on the current location and the direction information, and to output the guide information by overlapping the map information.

[0150] According to one embodiment, a method may include an operation of obtaining current location and direction information using one or more sensors (310) included in an electronic device (300) based on identifying a destination from a user input, an operation of obtaining surrounding data within a specified distance based on the current location and the direction information, an operation of determining at least one object of interest included in a path to the destination from the surrounding data, an operation of obtaining guide information for guiding a path to the destination based on the at least one object of interest, and an operation of outputting the obtained guide information on a display (330) of the electronic device (300).

[0151] In one embodiment, the operation of acquiring the surrounding data may include an operation of acquiring street view data corresponding to a direction in which the user is facing from the current location from an external server or an external device connected to the electronic device (300), and an operation of displaying the acquired street view data on the display (330).

[0152] In one embodiment, the operation of determining at least one object of interest may include the operation of extracting the at least one object of interest identified from the street view data, and the operation of generating a guide message corresponding to the guide information using a keyword associated with the at least one extracted object of interest.

[0153] In one embodiment, the guide message may be generated based on a large language model (LLM).

[0154] In one embodiment, the method may further include an operation of outputting the generated guide message through a speaker of the electronic device (300).

[0155] In one embodiment, the act of outputting the street view data may further include the act of displaying on the street view data at least one identifier indicating the at least one object of interest and a direction toward the destination.

[0156] In one embodiment, the method may further include, in response to detection of movement of the user, an operation of determining a changed current location and direction of movement of the user using the one or more sensors (310), and an operation of displaying changed street view data corresponding to the changed current location and direction of movement on the display (330).

[0157] In one embodiment, the method may further include an operation of outputting a voice message corresponding to the guide information through a speaker of the first external device when the first external device is connected through a communication circuit of the electronic device (300).

[0158] In one embodiment, the method may further include an operation of detecting gaze information of the user using one or more cameras included in the electronic device (300), and an operation of identifying at least one object of interest based on the detected gaze information.

[0159] In one embodiment, the method may further include an operation of displaying map information including a route to the destination on the display (330) based on the current location and the direction information, and an operation of outputting the guide information overlapping with the map information.

[0160] In one embodiment, a computer-readable recording medium having recorded thereon programs executable on a computer may be caused by the computer to perform an operation of obtaining current location and direction information using one or more sensors (310) included in the electronic device (300) based on identifying a destination from a user input, an operation of obtaining surrounding data within a specified distance based on the current location and the direction information, an operation of determining at least one object of interest included in a path to the destination from the surrounding data, an operation of obtaining guide information for guiding a path to the destination based on the at least one object of interest, and an operation of outputting the obtained guide information on a display (330) of the electronic device (300).

[0161] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.

[0162] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0163] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0164] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0165] The term "module" as used herein may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0166] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0167] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0168] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (300), One or more sensors (310); display (330); At least one processor (340); and Executed by at least one processor (340), the electronic device (300): Based on identifying a destination from user input, current location and direction information is obtained using one or more sensors (310), Acquire surrounding data within a specified distance based on the current location and direction information, Determine at least one object of interest included in the path from the above surrounding data to the destination, Obtain guide information for guiding a path to the destination based on at least one object of interest; An electronic device comprising a memory (350) that stores instructions for outputting the acquired guide information on the display (330).

2. In claim 1, The above instructions are executed by the at least one processor (340), so that the electronic device (300) Obtaining street view data corresponding to the direction the user is facing from the current location from an external server or an external device connected to the electronic device, An electronic device that displays the acquired street view data on the display.

3. In claim 2, The above instructions are executed by the at least one processor (340), so that the electronic device (300) Extracting at least one object of interest identified from the street view data, An electronic device that generates a guide message corresponding to the guide information using a keyword associated with at least one object of interest extracted above.

4. In claim 3, The above guide message is an electronic device generated based on a large language model (LLM).

5. In claim 3, Including more speakers, The above instructions are executed by the at least one processor (340), so that the electronic device (300) An electronic device that outputs the generated guide message through the speaker.

6. In claim 3, The above instructions are executed by the at least one processor (340), so that the electronic device (300) An electronic device that displays at least one object of interest and at least one identifier indicating a direction toward the destination on the street view data.

7. In claim 2, The above instructions are executed by the at least one processor (340), so that the electronic device (300) In response to the detection of the user's movement, the changed current location and movement direction of the user are determined using the one or more sensors, An electronic device that displays changed street view data corresponding to the changed current location and movement direction on the display (330).

8. In claim 1, Further comprising a communication circuit that supports wireless connection with at least one external device, The above instructions are executed by the at least one processor (340), so that the electronic device (300) An electronic device that, when connected to a first external device using the above communication circuit, outputs a voice message corresponding to the guide information through a speaker of the first external device.

9. In claim 1, Including one or more cameras, The above instructions are executed by the at least one processor (340), so that the electronic device (300) Detecting the user's gaze information using one or more of the above cameras, An electronic device that identifies at least one object of interest based on the detected gaze information.

10. In claim 1, The above instructions are executed by the at least one processor (340), so that the electronic device (300) Based on the current location and direction information, map information including the route to the destination is displayed on the display (330), An electronic device that outputs the guide information by overlapping the above map information.

11. In the method, An operation of obtaining current location and direction information using one or more sensors (310) included in an electronic device (300) based on identifying a destination from a user input; An operation of acquiring surrounding data within a specified distance based on the current location and direction information; An operation of determining at least one object of interest included in a path from the surrounding data to the destination; An operation of obtaining guide information for guiding a path to the destination based on at least one object of interest; and A method including an operation of outputting the acquired guide information on the display (330).

12. In claim 11, The operation of acquiring the above peripheral data is: An operation of acquiring street view data corresponding to the direction the user is facing from the current location from an external server or an external device connected to the electronic device (300); and A method comprising an operation of displaying the acquired street view data on the display (330).

13. In claim 12, The operation of determining at least one object of interest is: An operation of extracting at least one object of interest identified from the street view data; and A method comprising an action of generating a guide message corresponding to the guide information using a keyword associated with at least one object of interest extracted above.

14. In claim 12, In response to detection of a user's movement, an operation of determining the user's changed current location and direction of movement using the one or more sensors; and A method further comprising an action of displaying changed street view data corresponding to the changed current location and movement direction on the display (330).

15. In claim 11, An operation of detecting the user's gaze information using one or more cameras included in the electronic device (300); and A method further comprising an operation of identifying at least one object of interest based on the detected gaze information.

Images