Electronic device and operating method thereof

By integrating camera modules and augmented reality technology on electronic devices, the problem of difficult navigation direction in traditional map applications is solved, and the detailed information of POI is displayed in the preview video is realized, which improves the user's navigation experience and information acquisition efficiency.

CN120467339APending Publication Date: 2025-08-12SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510563228.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2019-02-19
Filing Date
2020-02-17
Publication Date
2025-08-12

AI Technical Summary

Technical Problem

When navigation in traditional map applications, it is difficult for users to find directions through locations on the map, and only provides simple location information based on search terms, lacking further interactiveness and information display.

Method used

By integrating camera modules, processors and memory on electronic devices, obtaining location information and POI data, augmented reality technology is used to display the location and details of POI in the preview video captured, distinguishing focus from general POIs, and providing additional relevant information.

Benefits of technology

Improves the readability and information interactivity of users during navigation, and provides detailed POI information in preview videos through augmented reality technology, helping users to reach their destinations more easily and obtain relevant information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120467339A_ABST
    Figure CN120467339A_ABST
Patent Text Reader

Abstract

A method of displaying nearby points of interest (POI) using augmented reality and an electronic device thereof. The operation method of the electronic device comprises the following steps: acquiring a preview video; acquiring position information of the electronic device; acquiring information about at least one POI located nearby; selecting a focus POI among the at least one POI; determining first information to be provided to the user for the general POI; determining second information including more information than the first information to be provided to the user for the focus POI; determining a position of a preview video on a screen in which information about the at least one POI is to be displayed; and displaying the first information or the second information on the determined preview video position of the screen providing all or some of the at least one POI.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application with the application date of February 17, 2020, application number 202080028264.1, and invention name “Method and device for displaying surrounding information using augmented reality”. Technical Field

[0002] Various embodiments are directed to methods and apparatus for displaying nearby points of interest (POIs) using augmented reality. Background Art

[0003] As smartphones connect to the internet, data becomes freely available, allowing users to instantly access essential information. For example, users often use their smartphones to search for information about nearby restaurants or other related interests. In these situations, various map applications now include features that display the information users search for on a map.

[0004] In a map application, the user's current location and the searched location or place can be displayed together, and can be displayed with different icons depending on the attributes of the place to be searched. However, map applications are still limited to simply displaying the location searched based on the search term, so there is room for further improvement.

[0005] The above information is presented as background information only to assist in understanding the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above content may be used as prior art with respect to the present disclosure. Summary of the Invention

[0006] Technical Solution

[0007] Traditional map applications can help users navigate to a desired location by displaying the locations of nearby locations on a map. However, in order to reach a desired location only by the location on the map, it is inconvenient to look at the surrounding environment (such as roads, buildings, etc.) to find the direction.

[0008] One aspect of the present disclosure is to provide a method and apparatus for helping a user easily reach a desired location by notifying a direction of a current location reference and a camera preview screen and location information of a point of interest (POI) when searching for a nearby location.

[0009] Another aspect of the present disclosure provides a method and apparatus for allowing a user to check various information by providing information associated with a corresponding place, such as a coupon provided at the corresponding place in addition to a simple location of a POI.

[0010] Yet another aspect of the present disclosure provides a method and apparatus for increasing readability by showing information that is different from other information and can be more effectively used by a user.

[0011] The technical subject matter pursued by the present disclosure may not be limited to the above-mentioned technical subject matter, and other technical subject matter not mentioned may be clearly understood by those skilled in the art in the art of the present disclosure through the following description.

[0012] According to one aspect of the present disclosure, an electronic device includes: a communication module configured to communicate with an external device; a camera module configured to shoot a video; at least one processor configured to be operably connected to the communication module and the camera module; and at least one memory configured to be operably connected to the at least one processor, wherein the at least one memory stores instructions that, when executed, cause the at least one processor to: obtain a preview video shot by the camera module by controlling the camera module, obtain location information of the electronic device, obtain information about at least one point of interest (POI) located nearby based on the location information, and obtain information about at least one point of interest (POI) located nearby based on the location information. The method comprises the steps of: providing a first information display device for displaying information about at least one POI, selecting a focus POI from among the at least one POI, determining first information to be provided to a user for general POIs, the general POIs including the remaining POIs from the at least one POI except the selected focus POI, determining second information to be provided to the user for the focus POI, wherein the second information includes more information than the first information, determining a position on a screen at which the preview video is provided, wherein information about the at least one POI is displayed in the preview video, and displaying the first information or the second information to be provided at a position on the screen at which the determined preview video of all or some of the at least one POI is provided.

[0013] According to another aspect of the present disclosure, a method for operating an electronic device includes: obtaining a preview video captured by a camera module; obtaining location information of the electronic device; obtaining information about at least one POI located nearby based on the location information; selecting a focus POI among the at least one POI based on the information about the at least one POI; determining first information to be provided to a user for general POIs, the general POIs including the remaining POIs among the at least one POI except the selected focus POI; determining second information to be provided to the user for the focus POI including more information than the first information; determining a position on a screen providing the preview video, wherein information about the at least one POI will be displayed in the preview video, and displaying the first information or the second information to be provided at the position of the screen where the determined preview video of all or some of the at least one POI is provided.

[0014] According to another aspect of the present disclosure, a method for operating an electronic device includes: sending location information of the electronic device to a content provider (CP) server; obtaining information about at least one POI located nearby from the CP server; arranging the at least one POI according to the distance from the electronic device based on the location information of the electronic device; configuring the display position of each of the at least one POI based on the location of the electronic device and the shooting direction of a preview video of the electronic device; when the display position is a focus POI within a configured focus area, configuring information to be displayed related to the focus POI, and displaying a UI including the configured information at the configured display position on a screen displaying the preview video; and when the display position is a general POI outside the configured focus area, obtaining category information of the general POI, and displaying an icon corresponding to the category information at the configured display position on the screen displaying the preview video.

[0015] In addition to the method of obtaining information about a place through a fixed map image, the method and electronic device thereof according to various embodiments may provide location information to the user on a screen captured by the user, thereby providing location information that is easier to find.

[0016] The method and the electronic device thereof according to various embodiments may provide information related to a corresponding place in addition to a simple location, thereby allowing a user to check various information.

[0017] The method and the electronic device thereof according to various embodiments may display information that may be more effectively used by a user in a more detailed manner than other information, thereby increasing readability for the user.

[0018] Effects obtainable by the present disclosure are not limited to the above-mentioned effects, and those skilled in the art may clearly understand other effects not mentioned through the following description.

[0019] Before proceeding with the following detailed description, it may be helpful to set forth definitions of certain words and phrases used throughout this patent document: the terms "include" and "comprising," and their derivatives, mean including but not limited to; the term "or" is inclusive, meaning and / or; the phrases "associated with" and "associated therewith," and their derivatives, may mean including, being included within, interconnected with, containing, being contained within, connected to or connected with, coupled to or coupled with, communicable with, cooperating with, interwoven, juxtaposed, proximate to, bound to or bound with, having, having the property of, and the like; the term "controller" means any device, system, or portion thereof that controls at least one operation, such device being implemented in hardware, firmware, or software, or some combination of at least two thereof. It should be noted that the functionality associated with any particular controller may be centralized or distributed, local or remote.

[0020] In addition, the various functions described below can be implemented or supported by one or more computer programs, each of which is formed of computer-readable program code and embodied in a computer-readable medium. The terms "application" and "program" refer to one or more computer programs, software components, instruction sets, processes, functions, objects, classes, instances, related data, or parts thereof suitable for implementation in appropriate computer-readable program code. The phrase "computer-readable program code" includes any type of computer code, including source code, object code, and executable code. The phrase "computer-readable medium" includes any type of medium that can be accessed by a computer, such as read-only memory (ROM), random access memory (RAM), hard drive, compact disc (CD), digital video disc (DVD), or any other type of memory. "Non-transitory" computer-readable media does not include wired, wireless, optical, or other communication links that transmit temporary electrical signals or other signals. Non-transitory computer-readable media include media that can store data persistently and media that can store and then overwrite data, such as rewritable optical discs or erasable memory devices.

[0021] Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0023] Figure 1 is a block diagram illustrating an electronic device in a network environment according to various embodiments;

[0024] Figure 2 is a block diagram illustrating a camera module according to various embodiments;

[0025] Figure 3 is a diagram showing an example of a functional configuration of an electronic device according to various embodiments;

[0026] Figure 4 is a diagram illustrating an example of a focus area designated on a screen of an electronic device according to various embodiments;

[0027] Figure 5 is a diagram illustrating an example of displaying POI information on a display screen of an electronic device according to various embodiments;

[0028] Figure 6is a diagram illustrating an example of displaying detailed POI information on a display screen of an electronic device according to various embodiments;

[0029] Figure 7 is a diagram illustrating another example of displaying POI information on a display screen of an electronic device according to various embodiments;

[0030] Figure 8 is a flowchart illustrating an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen;

[0031] Figure 9 is a flowchart illustrating another example of an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen; and

[0032] Figure 10 is a flowchart illustrating an example of an operation of displaying surrounding information of an electronic device on a display screen in consideration of a POI group according to various embodiments.

[0033] Regarding the description of the drawings, the same or similar reference numerals may be used for the same or similar components. DETAILED DESCRIPTION

[0034] In this patent document, the following discussion Figures 1 to 10 The various embodiments used to describe the principles of the present disclosure are only by way of example and should not be interpreted in any way as limiting the scope of the present disclosure. Those skilled in the art will understand that the principles of the present disclosure can be implemented in any appropriately arranged system or device.

[0035] Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings.

[0036] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1, the electronic device 101 in the network environment 100 can communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 can communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented as embedded in the display device 160 (eg, a display).

[0037] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component of the electronic device 101 connected to the processor 120 (e.g., a hardware component or a software component), and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the commands or data stored in the volatile memory 132, and store the resulting data in the non-volatile memory 134. Depending on the embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent of or combined with the main processor 121. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a designated function. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of the main processor 121 .

[0038] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) among the components of the electronic device 101 (not the main processor 121), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) together with the main processor 121. Depending on the embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) that is functionally related to the auxiliary processor 123.

[0039] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0040] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0041] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0042] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0043] The display device 160 can visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. Depending on the embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit adapted to measure the strength of the force caused by the touch (e.g., a pressure sensor).

[0044] The audio module 170 can convert sound into an electrical signal, and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0045] The sensor module 176 can detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. Depending on the embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0046] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). Depending on the embodiment, the interface 177 may include, for example, a High-Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.

[0047] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. Depending on the embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0048] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0049] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

[0050] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0051] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0052] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. Depending on the embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0053] Antenna module 197 can transmit or receive signals or power to or from the outside of electronic device 101 (e.g., an external electronic device). Depending on the embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a PCB). Depending on the embodiment, antenna module 197 may include multiple antennas. In this case, at least one antenna suitable for the communication scheme used in a communication network (such as first network 198 or second network 199) may be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. Depending on the embodiment, additional components other than the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may also be formed as part of antenna module 197.

[0054] At least some of the above components can be connected to each other via an inter-peripheral communication scheme (e.g., a bus, general-purpose input output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0055] According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type than the electronic device 101. According to an embodiment, all or some operations to be executed on the electronic device 101 may be executed on one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or execute another function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial response to the request, either by further processing the result or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

[0056] Figure 2 FIG2 is a block diagram 200 illustrating a camera module 180 according to various embodiments. Figure 2 The camera module 180 may include a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (e.g., a buffer memory), or an image signal processor 260. The lens assembly 210 may collect light emitted from an object serving as an image capture target. The lens assembly 210 may include one or more lenses. Depending on the embodiment, the camera module 180 may include multiple lens assemblies 210. In this case, the camera module 180 may be, for example, a dual camera, a 360-degree camera, or a spherical camera. The multiple lens assemblies 210 may have the same lens properties (e.g., viewing angle, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have at least one other lens property that differs from the other lens assemblies. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens. The flash 220 may emit a light source for enhancing the light emitted from the object. The flash 220 may include one or more light-emitting diodes (e.g., red, green, and blue (RGB) LEDs, white LEDs, infrared LEDs, or ultraviolet LEDs) or a xenon lamp.

[0057] The image sensor 230 can acquire an image corresponding to the object by converting light transmitted from the object through the lens assembly 210 into an electrical signal. Depending on the embodiment, the image sensor 230 may include one image sensor selected from image sensors with different properties (e.g., an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors with the same properties, or a plurality of image sensors with different properties. Each image sensor included in the image sensor 230 may be implemented as, for example, a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

[0058] In response to movement of the camera module 180 or the electronic device 101 including the same, the image stabilizer 240 may move at least one lens included in the lens assembly 210 or the image sensor 230 in a specific direction, or may control it (e.g., adjust readout timing) to at least partially compensate for a negative effect (e.g., image shake) caused by the movement relative to the captured image. Depending on the embodiment, the image stabilizer 240 may be implemented as, for example, an optical image stabilizer, and may detect the above-mentioned movement using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module 180.

[0059] Memory 250 can at least temporarily store at least a portion of an image acquired by image sensor 230 for use in the next image processing task. For example, if image acquisition by a shutter is delayed, or if multiple images are acquired at high speed, the acquired original image (e.g., a high-resolution image) can be stored in memory 250, and a copy image corresponding to the original image (e.g., a low-resolution image) can be previewed via display device 160. Thereafter, if a specified condition (e.g., user input or system command) is met, at least a portion of the original image stored in memory 250 can be acquired or processed by, for example, image signal processor 260. Depending on the embodiment, memory 250 can be configured as at least a portion of memory 130, or can be configured as a separate memory that operates independently of memory 130.

[0060] The image signal processor 260 may perform image processing (e.g., depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening)) on images acquired by the image sensor 230 or stored in the memory 250. Additionally or alternatively, the image signal processor 260 may control at least one of the components included in the camera module 180 (e.g., image sensor 230) (e.g., exposure time control or readout timing control). Images processed by the image signal processor 260 may be stored again in the memory 250 for further processing, or may be transmitted to an external component of the camera module 180 (e.g., memory 130, display device 160, electronic device 102, electronic device 104, or server 108). Depending on the embodiment, the image signal processor 260 may be configured as at least a portion of the processor 120, or may be configured as a separate processor that operates independently of the processor 120. When configured as a separate processor, the image processed by the image signal processor 260 may be processed by the processor 120 as it is, or may be subjected to additional image processing, and then may be displayed by the display device 160 .

[0061] According to an embodiment, the electronic device 101 may include two or more camera modules 180, each module having different properties or functions. In this case, for example, at least one camera module 180 may be a wide-angle camera or a front-facing camera, and at least one other camera module may be a telephoto camera or a rear-facing camera.

[0062] The device or method for displaying surrounding information using augmented reality proposed in the present disclosure can obtain information about points of interest (POIs) scattered around the user relative to the current location when the user uses a camera to capture the surrounding environment, and can use augmented reality technology to show the acquired information together with a preview image or screen captured by the camera and displayed on the display.

[0063] The following will first define the basic terms required for the description.

[0064] Point of Interest: refers to a location that is useful to the user or that the user may be interested in. Hereinafter, it may be referred to as a POI.

[0065] Content Provider Server: It stores a list of all POIs and information about each POI, and can provide a list of POIs and related information around the user's location through a request based on the user's location. Hereinafter, it may be referred to as a Content Provider (CP) server.

[0066] POI related information: It includes information describing the POI that is useful to the user or can make the user more interested. It can include the relevant image, name (business name), location, category, address, telephone number, etc. of the POI, and in some cases may additionally include advertising or event related information. The POI related image may be an image that can represent the corresponding POI, and may include the business name or an image including representative products. The category may indicate the type of business to which the POI belongs. The category may be predetermined by the content provider, and it may be predetermined which category each POI belongs to. For example, the category of each POI may be determined for each business type (such as a cafe, restaurant, cinema, hotel, etc.), or may be further subdivided into Western restaurants, Korean restaurants, fast food restaurants, etc.

[0067] Figure 3 is a diagram illustrating an example of a functional configuration of an electronic device 300 according to various embodiments. Figure 3 Briefly illustrates a functional configuration that can be used to implement the method proposed in this disclosure. In an embodiment, Figure 3 The electronic device 300 may be Figure 1 electronic device 101.

[0068] refer to Figure 3 , the electronic device 300 may include a processor 310, a memory 320, a display 330, a sensor module 340, a communication module 360, and / or a GPS module 370. However, the electronic device 300 is not limited thereto. At least one of the above components may be omitted, or one or more other components may be added to the electronic device 300.

[0069] The camera module 350 can capture the vicinity of the current location. Specific components of the camera module 350 can be Figure 2 The camera module 180 is shown in FIG. The image or video captured by the camera module 350 can be displayed on the display 330.

[0070] The sensor module 340 may include at least one of a geomagnetic sensor, an acceleration sensor (e.g., an accelerometer), a gyroscopic sensor (e.g., a gyroscope), or a six-axis sensor. The sensor module 340 may detect a direction in which the camera module 350 of the electronic device 300 is photographing based on information obtained using the included sensors. The detected direction may be used by the processor 310 to select surrounding information to be displayed on the display 330. The sensor module 340 may correspond to Figure 1 sensor module 176 or a portion thereof.

[0071] The communication module 360 can communicate between the electronic device 300 and an external electronic device (eg, Figure 1The communication module 360 may establish a communication link with the server 108 and may perform communication via the established communication link. For example, the communication module 360 may use a communication method such as Bluetooth, BLE, Wi-Fi, NFC, or LTE to send control commands or data to other electronic devices and receive control commands or data from other electronic devices.

[0072] The GPS module 370 may generate location information obtained by detecting the current location of the electronic device 300. The GPS module 370 may receive signals from GPS satellites to generate information about the current location of the electronic device 300, for example, location information including latitude / longitude.

[0073] The communication module 360 can send information to or receive information from an external electronic device based on the control of the processor 310. For example, the communication module 360 can send location information generated by the GPS module 370 and direction information obtained by the sensor module 340 to an external electronic device (e.g., Figure 1 server 108), and can obtain surrounding information from external electronic devices.

[0074] The display 330 may display information to provide the information to the user. The display 330 may correspond to Figure 1 The display device 160. The display 330 may display a preview video and surrounding information captured by the camera module 350 of the electronic device 300 on a screen in the form of augmented reality (AR).

[0075] The processor 310 can control the overall operation of the electronic device 300. The processor 310 can be organically coupled to other components (e.g., the memory 320, the display 330, the sensor module 340, the camera module 350, the communication module 360, and the GPS module 370) to control the correct operation of the other components, can provide data to the other components, and can obtain and process data from the other components. The processor 310 can be implemented in software, can be implemented in hardware such as a chip, a circuit, etc., or can be implemented in a combination of software and hardware. The processor 310 can be one or a combination of multiple processors.

[0076] The memory 320 may refer to one or more memory groups. The memory 320 may execute instructions stored in the memory 320 based on signaling with the processor 310. The memory 320 may store data and / or commands received from other components (e.g., the processor 120, the sensor module 340, the communication module 360, and the display 330) or generated by other components.

[0077] According to various embodiments, when a user wishes to obtain information about surrounding information by starting to shoot or executing a related application, the processor 310 may use the GPS module 370 to obtain the current location information of the user or the electronic device 300, and may use the communication module 360 to send the obtained location information to an external electronic device (e.g., Figure 1 The processor 310 may receive point of interest (POI) information around the location of the user or electronic device 300 from an external electronic device. The processor 310 may use the received POI information to calculate and arrange the distance and direction to each POI based on the current location of the electronic device 300. Based on the arrangement results, the processor 310 may determine which POI to display on the screen and in which area of the screen to display the corresponding POI. The processor 310 may distinguish POIs into general POIs and focus POIs, display more detailed information about the focus POIs on the screen, and display general POIs using icons to provide information to the user. In addition, the focus POIs may be displayed in a designated focus area on the screen of the display 330. According to another embodiment, in addition to general POIs and focus POIs, the processor 310 may also distinguish advertising POIs. Advertising POIs may be POIs that include advertising or event information in the POI information at the request of an advertiser. Regarding advertising POIs, in addition to the information displayed via the general POIs or focus POIs, the processor 310 may also display advertising or event information on the screen.

[0078] According to various embodiments, the processor 310 may use the GPS module 370 to obtain the current location of the electronic device 300. The processor 310 may send a content provider (CP) server (e.g., Figure 1 The processor 310 may use the communication module 360 to send the current location of the electronic device 300 to the CP server to request POI list data within a predetermined distance from the current location of the electronic device 300. The CP server may store POI information to be provided to the user. According to an embodiment, the processor 310 may use the communication module 360 to send the current location of the electronic device 300 to the CP server to request POI list data from the CP server. In response to the sent location information, the processor 310 may receive POI list data from the CP server through the communication module 360. The information included in the POI list data received from the CP server may include latitude / longitude information indicating the location of each POI, name information, image information including a representative image, contact information, category information, and other text information.

[0079] According to various embodiments, the processor 310 may calculate the distance and direction of each POI relative to the current location of the electronic device 300 based on the location information of the POI list transmitted from the CP server, and may arrange the POIs in order of distance from the current location of the electronic device 300. According to an embodiment, the processor 310 may use the latitude / longitude included in the POI information received from the CP server to calculate the calculated distance, angle, etc. of the current location of the electronic device 300 as well as the latitude / longitude. The processor 310 may use the calculated results to arrange the relative position values between the electronic device 300 and the corresponding POI.

[0080] According to various embodiments, the processor 310 may display information about surrounding POIs and a preview screen of the results captured by the camera module 350 on the screen in the form of AI. However, due to factors such as the amount of surrounding information, the size of the display, and the viewing angle of the camera in the camera module 350, the locations for displaying multiple POIs may overlap, making it difficult to display all overlapping POIs on a single screen of the display 330. Therefore, the processor 310 may predict the locations where all POIs are to be displayed, taking into account factors such as the camera viewing angle, display size, and user interface (UI), and may generate a set of overlapping POIs. A POI group may refer to a cluster of POIs bound based on specific criteria. In particular, in cases where the distance between POIs is short, it may be difficult to distinguish and display multiple POIs on the screen due to the space limitations of the display 330 screen. Therefore, the processor 310 may group the multiple POIs into a single POI group to display the POI group. According to embodiments, the processor 310 may define a POI group by grouping POIs with similar values obtained using the distance between POIs, the direction of the POIs, and so on. The processor 310 may display a POI group based on a representative POI and may allow the user to access information of another POI included in the corresponding POI group by using the representative POI as an interface. The processor 310 may determine the representative POI based on information received from the CP server, or may determine the representative POI based on the user's usage habits and preferences. According to an embodiment, the processor 310 may determine the POI closest to the current location of the electronic device 300 among the POIs included in the POI group as the representative POI. According to another embodiment, the processor 310 may determine the POI with the highest grade as the representative POI based on the POI information received from the CP server. According to another embodiment, when the user prefers the restaurant category, the processor 310 may determine the POI included in the corresponding category as the representative POI. The processor 310 may determine the representative information and display position for displaying each POI group on the screen, wherein each POI group is generated based on predetermined criteria.

[0081] According to various embodiments, the processor 310 may display a preview video captured by the camera module 350 on the screen and may display the aforementioned POI groups on the screen in the form of an AI above the displayed preview video. To display each POI group on the screen, the processor 310 may use the sensor module 340 to obtain the direction in which the electronic device 300's camera or camera module 350 is shooting in real time, and may display information about each POI group taking into account the position and direction of each POI group and the camera's viewing angle. In this case, the information displayed on the display 330 screen may represent each POI group, and an additional user interface may be used to confirm information about other overlapping POIs. For example, the processor 310 may display a UI related to a representative POI on the screen, and the corresponding UI may serve as an interface for the user to obtain information about other POIs included in the same POI group. According to embodiments, when a left / right scrolling operation by the user is detected, the processor 310 may display information about other POIs included in the same POI group on the display 330 screen.

[0082] According to various embodiments, the processor 310 may display POI information of the direction in which the camera module 350 is photographing on the screen together with the video captured by the camera module 350, thereby providing them to the user at the same time. Therefore, in response to the direction of the camera module 350 being changed as the electronic device 300 is rotated to the left or right of the user, the processor 310 may confirm the POI corresponding to the direction to display it on the screen.

[0083] As described above, when processor 310 displays surrounding information on the screen of display 330, there may be a trade-off between the UI area for displaying each POI group and the amount of data to be provided. To provide a large amount of data to the user, the UI area may be increased, while when the UI area is reduced, limited information may be provided. Therefore, in the present disclosure, a focus POI may be defined so that more detailed information about a POI group determined to be important to the user can be provided in the focus area.

[0084] Figure 4 is a diagram 400 illustrating an example of a focus area 410 designated on a screen of an electronic device 300 according to various embodiments.

[0085] According to various embodiments, the processor 310 may designate a partial area of the screen of the display 330 as the focus area 410. According to an embodiment, referring to Figure 4 ,like Figure 4As shown in the dotted box, the lower center portion of the screen of the display 330 can be designated as the focus area 410. The processor 310 can determine the focus POI or focus POI group to be displayed in the focus area 410 by using the position of the electronic device 300, the shooting direction of the camera module 350, the distance and angle of the POI, etc. In response to a change in the position and / or shooting direction of the electronic device 300 through user manipulation, the focus POI or focus POI group to be displayed in the focus area can be changed. The processor 310 can cause general POIs or POI groups that cannot be displayed in the focus area to provide minimal information using simple UIs 421 to 427, and can cause the focus POI group that can be displayed in the focus area to provide more information to the user through the expanded UI area 430.

[0086] According to an embodiment, the processor 310 may display a general POI or general POI group using icons 421, 423, 425, and 427 indicating the category of the corresponding POI or POI group. In an embodiment, icon 421 may be an icon obtained by shaping a knife and fork to represent a Western restaurant and indicate the Western restaurant category, icon 425 may be an icon obtained by shaping a shared projector and indicate the movie theater category, and icon 427 may be an icon obtained by shaping a coffee cup and indicate the cafe category. According to another embodiment, the processor 310 may display a UI that includes an image, name, etc. of the corresponding POI or POI group for the focus POI or focus POI group. As a result, a UI 430 including more information than the general POI or general POI group may be displayed on the screen of the display 330 for the focus POI or focus POI group, and the displayed UI 430 may be provided to the user. When displaying the POI group on the screen of the display 330 , the processor 310 may display icons corresponding to categories of representative POIs regarding the general POI group and may display images, names, etc. of representative POIs of the corresponding POI group regarding the focus POI group.

[0087] According to various embodiments, the processor 310 may separate an advertising POI to display advertisements or event information in addition to icons for general POIs, or may allow advertisements or event information to be included in the UI of the focus POI to display the corresponding information. Furthermore, when an advertising POI is included in a POI group, the advertising POI may be determined as a representative POI in priority over other POIs.

[0088] According to various embodiments, the processor 310 may convert a focus POI into a general POI, and vice versa, by changing the position and / or shooting direction of the electronic device 300. To display such changes on the screen, the processor 310 may gradually change the UI from a UI representing the focus POI to a UI representing the general POI, or vice versa.

[0089] Figure 5 is a diagram 500 illustrating an example of displaying POI information on the screen of the display 330 of the electronic device 300 according to various embodiments.

[0090] Figure 6 is a diagram 600 illustrating an example of displaying detailed POI information on the screen of the display 330 of the electronic device 300 according to various embodiments.

[0091] Referring to the embodiment Figure 5 , the processor 310 may display a UI including POI information and a preview video 501 captured by the camera module 350 on the screen of the display 330. UIs 531 and 532 may include information about the focus POI, and the processor 310 may display information such as a representative image, name, distance, star rating, and rating associated with the POI. In particular, UIs 531 and 532 may be displayed in the focus area 510 of the screen of the display 330. On the other hand, UIs 521, 523, and 525 may display information of general POIs, and the processor 310 may display corresponding information using icons indicating the category of the corresponding POI, and the icons may be different icons for each category. According to an embodiment, an advertising POI may be displayed on the screen, and in the case of an advertising POI, advertising information and / or event information may be included in the information displayed on the screen.

[0092] When the user touches the UI displayed on the screen of the display 330, no matter whether the POI is a general POI, a focus POI or an advertisement POI, as shown in FIG. Figure 6As shown, processor 310 may display UI 610 on the screen, which includes detailed information related to the corresponding POI of the touched UI. UI 610 can display various information related to the POI received from the CP server to the user, and the detailed information displayed on UI 610 can be connected to separate applications via hyperlinks, etc. to provide additional services. For example, UI 610 can display a representative image, name, star rating, rating, distance, address, contact, etc., and when a contact displayed on UI 610 is pressed, a caller application (Call) can be executed to provide a phone call service. When the user touches a representative image or name, an internet application can be executed to display the website of the corresponding POI. When the user touches an address or "Get Directions," services and map-related applications can be provided to provide detailed guidance to the corresponding location. In addition, if the POI touched by the user is a POI group in which multiple POIs are grouped together rather than a single POI, processor 310 may display a separate UI 620 on the screen of display 330 to indicate that the separate UI 620 is a POI group and provide the user with information related to the number of POIs included in the POI group. In this case, the processor 310 may provide information of another POI other than the currently displayed POI on the screen of the display 330 in response to a left / right scan operation of the user.

[0093] Figure 7 is a diagram illustrating another example of displaying POI information on the screen of the display 330 of the electronic device 300 according to various embodiments.

[0094] refer to Figure 7 , in the case where the user uses an application that implements the method of the present disclosure, the processor 310 may display POI information and a preview taken by the camera module 350 on the screen of the display 330, and in the case of general POIs, the POI information may be displayed using icons 721, 723, 725, 727 indicating the category of each POI. According to an embodiment, icon 721 and icon 727 may be used to indicate that the corresponding POI is a restaurant category, and icon 725 may be used to indicate that the corresponding POI is a category of places where meetings can be held. According to an embodiment, the processor 310 may change the size of the icon according to the distance from the current location of the electronic device 300, so that a close POI may be displayed using icon 727 having a relatively large size, and a distant POI may be displayed using icon 723 having a relatively small size. According to an embodiment, the processor 310 may provide icons that reflect user preferences. The processor 310 may use a heart shape as shown in icon 727 to display a POI with a high user preference. For a specific icon, when there is a user operation such as a touch, the icon 727 may be displayed as shown in FIG. Figure 6Detailed information of the POI corresponding to the icon is provided as shown in . In the case of a focus POI, the processor 310 may display UIs 731 and 733 providing additional information such as the name, star rating and rating of the POI and a corresponding image on the screen of the display 330. Even in the case of a focus POI, when the distance from the electronic device 300 is short, the processor 310 may display the focus POI using a relatively large UI 731, and when the distance therefrom is large, the processor 310 may display the focus POI using a relatively small UI 733. According to another embodiment, the processor may display a POI having a relatively long distance therefrom as being located at the lower part of the screen, and may display a POI having a relatively long distance therefrom as being located at the upper part of the screen. According to an embodiment, the processor 310 may provide a UI reflecting user preferences, and may display POIs having high user preferences using a heart shape as shown in UI 731. Furthermore, in the case of an advertising POI, processor 310 may display a UI (not shown) on the screen of display 330 that provides information such as the POI's name, star rating, and rating, as well as a corresponding image, and also information such as advertising information or event information. Depending on the embodiment, the advertising POI may be displayed more prominently than the general POIs and the focus POIs, allowing the user to more clearly understand the advertising POI. Depending on the embodiment, the advertising POI may be included in the general POIs or in the focus POIs.

[0095] According to various embodiments, the processor 310 may configure a specific area of the preview screen generated by the camera module 350 as a focus area, and may configure a POI existing in the focus area as a focus POI. When the processor 310 compares the location, direction information, road conditions, etc. between the electronic device 300 and the POI, the processor 310 may configure a location that is easier for the user to reach as the focus area, and may configure a POI existing in the corresponding focus area as the focus POI, thereby providing relatively rich information.

[0096] According to various embodiments, processor 310 may select focus POIs based on various criteria. In one embodiment, as described above, processor 310 may select all POIs within an easily accessible focus area as focus POIs. In another embodiment, processor 310 may select focus POIs based on the direction in which camera module 350 captures the image, the camera's viewing angle, the distance between the current location of electronic device 300 and the POI, and so on. Thus, the actual location may be included in the preview screen, determined based on the direction captured by camera module 350 and the viewing angle between surrounding POIs, so that POIs within a predetermined distance may be selected as focus POIs. In another embodiment, processor 310 may select focus POIs that the user has previously visited or about which the user has previously searched for information as focus POIs. In another embodiment, processor 310 may select focus POIs based on the user's past usage history, behavior, and so on. In another embodiment, processor 310 may select focus POIs based on user preferences. For example, if a restaurant is the user's highest preference, processor 310 may select restaurant-related POIs as focus POIs. In another embodiment, the processor 310 may select the focus POI based on a combination of the above selection conditions.

[0097] According to various embodiments, for POIs included in the focus POI, the processor 310 may change the level of information provided for each POI based on past usage history, behavior, and the like.

[0098] According to various embodiments, when the user changes the position of the electronic device 300, the processor 310 is used to newly change the distance and angle to all POIs, and accordingly, the selection of the focus POI can be updated, and the POI group can be added, deleted, or changed. In addition, even when the user changes the direction in which the camera module 350 is shooting, the processor 310 may need to update the selection of the focus POI. According to an embodiment, when the direction in which the camera module 350 is shooting is changed, the processor 310 may display the focus POI included in the preview video currently shot and displayed by the camera module 350 on the screen of the display 330 among the previously selected focus POIs, without selecting a new focus POI.

[0099] According to various embodiments, the processor 310 may newly select a focus POI by receiving new POI information from the CP server according to a degree of change in the location of the electronic device 300 , and may display the selected focus POI on the screen of the display 330 .

[0100] According to the present disclosure, through the above-mentioned operation of the processor 310, location information can be presented on the video taken by the user, instead of providing information about the place through a fixed map image, making it easier to find location information, and, in addition to the simple location, various information related to the corresponding place can also be provided to the user.

[0101] According to various embodiments, an electronic device (e.g., Figure 1 electronic device 101 or Figure 3 The electronic device 300 may include: a communication module configured to perform communication with an external device; a camera module configured to capture a video; at least one processor configured to be operably connected to the communication module and the camera module; and at least one memory configured to be operably connected to the at least one processor, wherein the at least one memory includes instructions that, when executed, cause the at least one processor to obtain a preview video captured by the camera module by controlling the camera module, obtain location information of the electronic device, obtain information about at least one point of interest (POI) located nearby based on the location information, select a focus POI from among the at least one POI based on the information about the at least one POI, determine first information to be provided to a user for general POIs, the general POIs including the remaining POIs from the at least one POI except the selected focus POI, determine second information to be provided to the user for the focus POI, wherein the second information includes more information than the first information, determine a position at which to provide a preview video on a screen, wherein information about the at least one POI is to be displayed in the preview video, and display the first information or the second information at the position at which the preview video of all or some of the at least one POI is provided on the screen.

[0102] According to various embodiments, the instructions may cause the at least one processor to select a POI including advertisement and / or event information in the information about the at least one POI as an advertising POI among the at least one POI, determine third information of the advertising POI to be provided to the user, wherein the third information includes advertisement and / or event information, and display the third information at a position on the screen where the preview video determined for the advertising POI is provided.

[0103] According to various embodiments, the instructions may cause the at least one processor to select some POIs to be displayed on the screen providing the preview video from among the at least one POI based on the direction in which the camera module shoots the preview video and the viewing angle of the camera module, and display the first information or the second information at a position where the determined preview video of each of the selected POIs is provided on the screen.

[0104] According to various embodiments, the instructions may cause the at least one processor to configure a condition corresponding to the focus POI and select a POI in which information about the at least one POI satisfies the condition corresponding to the focus POI as the focus POI.

[0105] According to various embodiments, the instructions may enable the at least one processor to configure a partial area in the preview video as a focus area, and configure a POI whose actual location is included in the focus area as a condition corresponding to the focus POI.

[0106] According to various embodiments, the instructions may cause the at least one processor to determine the distance between the electronic device and each POI as a condition corresponding to a focus POI based on the location information of the electronic device and the location information of each POI included in the information about the at least one POI, and to configure a POI in which the distance between the electronic device and the POI is within a predetermined value based on the distance determined between the electronic device and each POI.

[0107] According to various embodiments, the instructions may cause the at least one processor to configure a POI with high preference as a condition corresponding to the focus POI based on user preferences, the user preferences being configured based on user behavior, the POI with high preference including a POI that the user has previously visited or a POI about which the user has previously searched for information.

[0108] According to various embodiments, the instructions may cause the at least one processor to designate a portion of the screen where the preview video is provided as a focus area, and display the second information for a focus POI within the focus area.

[0109] According to various embodiments, the instructions may cause the at least one processor to configure POIs within a predetermined distance from each other into a POI group based on location information of each POI included in the information about the at least one POI or a position on a screen on which the information about the at least one POI is to be displayed, select a representative POI from among the POIs in the POI group, and display to provide information about the representative POI to a position on the screen representing the representative POI of the POI group.

[0110] According to various embodiments, the instructions may cause the at least one processor to determine the first information as a category of the POI, determine the second information as including at least one of a POI-related image, a name, and a distance from the current location of the electronic device, display an icon corresponding to the category to provide the first information, and display a user interface (UI) including the second information to provide the second information.

[0111] Hereinafter, a method of providing surrounding information on a camera preview video in the form of augmented reality in the electronic device 300 will be described.

[0112] Figure 8 800 is a flowchart illustrating an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen. Figure 8 The operation object of the flowchart 800 shown in FIG can be understood as an electronic device (eg, Figure 1 electronic device 101 or Figure 3 electronic device 300) or a processor of the electronic device (e.g., Figure 1 Processor 120 or Figure 3 processor 310).

[0113] According to various embodiments, in operation 801, the electronic device 101 or 300 may obtain surrounding POI information. In order to obtain surrounding POI information, when the user starts shooting with the camera module 350 or obtains information about the surrounding location by executing a related application, the electronic device 101 or 300 may use the GPS module 370 to obtain the current location information of the electronic device 101 or 300. The current location may be displayed in latitude and longitude. The electronic device 101 or 300 may obtain surrounding POI information based on its current location. In an embodiment, the electronic device 101 or 300 may select a POI within a predetermined distance from the current location of the electronic device 101 or 103 from among the POIs stored in the memory 130 or 320 through an application, thereby obtaining surrounding POI information. According to another embodiment, the electronic device 101 or 300 may send its current location to a CP server (e.g., Figure 1 The CP server 108 may be connected to the CP server 101 and may receive surrounding POI information extracted based on the current location from the CP server, thereby acquiring surrounding POI information. In this case, the CP server may provide information about POIs within a predetermined distance from the current location of the electronic devices 101 and 300. The POI information may include latitude and longitude information indicating the location of each POI, a name, image information including a representative image, contact information, category information, other text information, and the like.

[0114] According to various embodiments, in operation 803, the electronic device 101 or 300 may select a focus POI based on the acquired surrounding POI information. In addition, the electronic device 101 or 300 may also select an advertising POI. The focus POI may be a POI that is determined to be of greater interest to the user than a general POI. An advertising POI may be a POI that contains advertisements and / or event information. According to one embodiment, the electronic device 101 or 300 may select a POI that contains advertisements and / or event information as an advertising POI based on the acquired POI information. The advertising POI may be selected to be distinguished from the general POI or focus POI, but may be a general POI or a focus POI and an advertising POI.

[0115] According to various embodiments, the electronic device 101 or 300 may select a focus POI based on various criteria. According to an embodiment, the electronic device 101 or 300 may configure a focus area near a place that is easily accessible to the user, and may select all POIs in the focus area as focus POIs. In another embodiment, the electronic device 101 or 300 may select a focus POI based on the direction in which the camera module 350 is shooting, the distance to the POI, the angle of view of the camera, etc. In another embodiment, the electronic device 101 or 300 may select a POI that the user has previously visited or a POI for which the user has previously searched for information as a focus POI. According to another embodiment, the electronic device 101 or 300 may select a focus POI based on the user's past usage history, behavior, etc. According to another embodiment, the electronic device 101 or 300 may select a focus POI based on the user's preset preferences. For example, if a restaurant has the user's highest preference, the electronic device 101 or 300 may select a restaurant-related POI as the focus POI. In another embodiment, the electronic device 101 or 300 may select the focus POI based on a combination of the above selection conditions.

[0116] According to various embodiments, the electronic device 101 or 300 may arrange the surrounding POIs obtained for selecting the focus POI according to the above conditions. In one embodiment, when selecting the focus POI based on distance, the distance between the current location of the electronic device 101 or 300 and each POI may be obtained based on the location information of the surrounding POIs, the surrounding POIs may be arranged according to the distance, and the surrounding POIs within a predetermined distance may be selected as the focus POI.

[0117] According to various embodiments, when the location of the electronic device 101 or 300 changes, the electronic device 101 or 300 may select a new focus POI. According to embodiments, when the location of the electronic device 101 or 300 changes, the distance and angle to each POI may be newly calculated and acquired. Therefore, since the POI corresponding to the focus POI may change, a new POI corresponding to the focus POI may be selected.

[0118] According to various embodiments, when the shooting direction of the electronic device 101 or 300 is changed, a new focus POI may be selected. When the shooting direction of the electronic device 101 or 300 is changed, the POI displayed on the preview screen by shooting may be changed. Therefore, a new focus POI may be selected from the POIs included in the current preview screen. When the shooting direction of the electronic device 101 or 300 is changed, a specific POI may be changed from a focus POI to a general POI, or from a general POI to a focus POI.

[0119] According to various embodiments, in operation 805, the electronic device 101 or 300 may configure the display (eg, Figure 1 Display device 160 or Figure 3 The display position and information of each POI displayed on the screen of the display 330 of the electronic device 101 or 300. In an embodiment, the display position of each POI may be a position corresponding to the actual position in the preview video captured by the camera module 350 and displayed on the screen. According to another embodiment, a partial area of the screen on which the preview video is displayed may be configured as a focus area, the focus POI may be displayed in the focus area, and general POIs may be displayed outside the focus area. In addition, the electronic device 101 or 300 may configure the display position to be closer to the bottom of the screen for POIs close to the current position of the electronic device 101 or 300, and may configure the display position to be biased towards the top of the screen for POIs far from the current position of the electronic device 101 or 300.

[0120] According to various embodiments, the electronic device 101 or 300 may be configured to provide different information for general POIs and focus POIs. According to an embodiment, the electronic device 101 or 300 may use the category of the corresponding POI to configure the information provided for the general POI. On the other hand, the electronic device 101 or 300 may be configured to provide more information for the focus POI compared to the general POI. According to an embodiment, the electronic device 101 or 300 may configure the focus POI to provide information of at least one of related images, names, distances, stars, and ratings. In addition, according to another embodiment, the electronic device 101 or 300 may configure the information provided for each focus POI differently based on past usage history, behavior, etc., even for the focus POI.

[0121] According to various embodiments, the display positions of multiple POIs may overlap due to conditions such as the amount of surrounding POI information, the size of the display screen, the camera's viewing angle, etc., making it difficult to display all overlapping POIs simultaneously on a single screen. Therefore, the electronic device 101 or 300 may configure the display positions of all surrounding POIs as described above, taking into account conditions such as the camera's viewing angle, the size of the display, and the user interface (UI), and may group POIs whose display positions overlap to generate a POI group. A POI group may refer to a cluster of POIs bound by specific criteria. In particular, in cases where the distance between POIs is short, it may be difficult to distinguish and display multiple POIs on the screen due to space limitations on the display screen. Therefore, the electronic device 101 or 300 may group multiple POIs into a single POI group to display the POI group. According to embodiments, the electronic device 101 or 300 may define a POI group by grouping POIs with similar values obtained using the distance, angle, etc. between the POIs into a POI group. The electronic device 101 or 300 can configure the display position of a POI group based on a representative POI and allow the user to access information about other POIs included in the POI group using the representative POI as an interface. The electronic device 101 or 300 can determine the representative POI based on the POI information acquired in operation 801, or can determine the representative POI based on the user's usage habits, preferences, etc. In one embodiment, the electronic device 101 or 300 can determine the POI closest to the current location of the electronic device 300 as the representative POI among the POIs included in the POI group. In another embodiment, the electronic device 101 or 300 can determine the POI with the highest rating as the representative POI based on the acquired surrounding POI information. In another embodiment, if the user prefers the restaurant category, the electronic device 101 or 300 can determine the POIs included in that category as the representative POI. The electronic device 101 or 300 can configure representative information for each POI group generated based on predetermined criteria and the display position for displaying each POI group on the screen as the representative POI information and display position.

[0122] According to various embodiments, in operation 807, the electronic device 101 or 300 may display POI information on the screen along with a preview video captured by the camera module 350. According to an embodiment, the electronic device 101 or 300 may display the display location and information of each POI or POI group configured in operation 805 on the preview video. According to an embodiment, in the case of a general POI, the electronic device 101 or 300 may display the POI information by displaying an icon corresponding to the category of the POI at the display location determined in operation 805. In addition, in the case of a focus POI, the electronic device 101 or 300 may display a UI including the information configured at the display location determined in operation 805 (e.g., at least one of an image, name, location, star rating, and rating). According to another embodiment, in the case of a general POI group, the electronic device 101 or 300 may display an icon corresponding to the category of the representative POI at the display location determined for the representative POI in operation 805. Furthermore, in the case of a focus POI group, the electronic device 101 or 330 may display a UI including information configured for the representative POI at the display location determined for the representative POI in operation 805. In the case of a focus POI or a focus POI group, the display location may be within the focus area of the screen. Furthermore, in the case of an advertising POI, the electronic device 101 or 330 may display a UI including information configured at the display location determined in operation 805. The configuration information for the advertising POI may necessarily include advertisement and / or event information.

[0123] According to various embodiments, the electronic device 101 or 300 may display a UI including information related to a representative POI on the screen, and may provide information of other POIs included in the same POI group through an additional interface with the user. According to an embodiment, when the electronic device 101 or 300 detects a left / right scroll operation of the user, the electronic device 101 or 300 may display information of other POIs in the same POI group on the screen of the display 330.

[0124] According to various embodiments, the electronic device 101 or 300 may configure the size of the UI displayed for each POI or POI group differently. According to an embodiment, the electronic device 101 or 300 may change the size of the icon or UI according to the distance from the current location of the electronic device 101 or 300, and the electronic device 101 or 300 may display the corresponding information. The electronic device 101 or 300 may use a relatively large icon or UI to display nearby POIs, and may use a relatively small icon or UI to display distant POIs.

[0125] According to various embodiments, the electronic device 101 or 300 may gradually change the UI to indicate that the POI has changed from a general POI to a focus POI or vice versa according to the change in the shooting direction. In one embodiment, when a change occurs from a general POI to a focus POI, the icon may change to a UI including information about the corresponding POI while gradually expanding. In another embodiment, when a change occurs from a focus POI to a general POI, the UI including information about the corresponding POI may eventually change to an icon while gradually shrinking.

[0126] Figure 9 is a flowchart 900 illustrating another example of an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen. Figure 9 The operation object of the flowchart 900 shown can be understood as an electronic device (for example, Figure 1 electronic device 101 or Figure 3 electronic device 300) or a processor of the electronic device (e.g., Figure 1 Processor 120 or Figure 3 processor 310).

[0127] According to various embodiments, in operation 901, the electronic device may send its current location to a CP server (eg, Figure 1 When a user wishes to obtain information about a nearby location by starting to shoot or driving an application provided in the electronic device, the electronic device may use a GPS module (e.g., Figure 3 The GPS module 370) obtains its current location and can send the obtained current location to the CP server.

[0128] According to various embodiments, in operation 903, the electronic device may receive surrounding POI information from a CP server. The surrounding POIs may refer to POIs within a predetermined distance from the current location of the electronic device. In one embodiment, the predetermined distance may be configured in the CP server. In another embodiment, the predetermined distance may be configured in the electronic device. When transmitting the current location to the CP server, the electronic device may also transmit the pre-configured predetermined distance. In this case, the predetermined distance may be configured by receiving user input.

[0129] According to various embodiments, the surrounding POIs received from the CP server may be arranged based on the current location of the electronic device in operation 905. The electronic device may obtain the distance and direction of each POI based on the location information of the POI list received from the CP server relative to the current location of the electronic device, and may arrange the POIs in order of distance.

[0130] According to various embodiments, in operation 907, the electronic device may configure the display position of each POI based on the current location of the electronic device, the direction in which the preview video was taken, and the distance and direction of each POI acquired. In an embodiment, the electronic device may configure the display position of POIs whose actual locations are included in the preview video. The electronic device may not configure the display position of some POIs whose actual locations are not included in the preview video by comparing the direction in which the preview video was taken with the acquired direction of the POI.

[0131] According to various embodiments, in operation 909 , the electronic device may determine whether the display location of each POI is within the focus area.

[0132] According to an embodiment, the focus area may be arbitrarily designated by the electronic device, or may be designated based on user input. Figure 4 In an embodiment, the lower center portion of the screen can be designated as a focus area. The electronic device can distinguish POIs into focus POIs and general POIs. In addition, advertising POIs can be distinguished. A focus POI can be a POI that the user determines to be more interesting than a general POI. An advertising POI can be a POI that includes advertisements and / or event information. Therefore, the electronic device can select a POI that includes advertisements and / or event information as an advertising POI. Various conditions for selecting a focus POI can be provided. The focus POI can be configured with a display position within a designated focus area of the screen.

[0133] According to various embodiments, if the display location of the POI is within the focus area determined in operation 909, then in operation 911, information related to the corresponding POI may be configured to be displayed. In one embodiment, the corresponding POI may be configured to display at least one of an image, distance, name, star rating, and rating related to the POI, but is not limited thereto. If the corresponding POI includes advertisements and / or event information (i.e., an advertising POI), the advertisements and / or event information may be configured as the information to be displayed. In operation 913, a UI including the information configured to be displayed in operation 911 may be displayed at the display location determined in operation 907 on a preview screen captured by the camera.

[0134] According to various embodiments, if the display position of the POI is outside the focus area based on the determination in operation 909, the category of the POI may be acquired in operation 915, and in operation 917, an icon corresponding to the category of the POI acquired in operation 915 may be displayed at the display position determined in operation 907 on the preview screen captured by the camera.

[0135] When displaying the POI information of the electronic device through the above operations 911 to 917, the electronic device should consider the camera (eg, Figure 3 , the camera module 350) and the viewing angle of the camera currently shooting. In an embodiment, in operation 905, the direction of each POI can be indicated by an absolute heading. With respect to the current position of the electronic device, the direction of the POI existing on the due north side can be configured to 0 degrees, the direction of the POI on the due east side can be configured to 90 degrees, the direction of the POI on the due south side can be configured to 180 degrees, and the direction of the POI on the due west side can be configured to 270 degrees. In addition, if the shooting direction of the camera is on the due south side and the viewing angle of the camera is 60 degrees, POIs whose directions are between 150 degrees and 210 degrees can be located and displayed in the preview video shot by the camera. Since other POI directions are outside the preview video, POIs with other POI directions may not be displayed on the screen.

[0136] Figure 10 is a flowchart 1000 illustrating an example of an operation of displaying surrounding information of an electronic device on a display screen in consideration of a POI group according to various embodiments. Figure 10 The operation object of the flowchart 1000 shown in FIG can be understood as an electronic device (eg, Figure 1 electronic device 101 or Figure 3 electronic device 300) or a processor of the electronic device (e.g., Figure 1 Processor 120 or Figure 3 processor 310).

[0137] exist Figure 10 In the flowchart of FIG. 1 , operations 901 to 917 can be performed with Figure 9 The flowchart of is described in the same manner, but after operation 907, an operation of generating a POI group may be added.

[0138] A POI group may refer to a cluster of POIs bound by specific criteria. In an embodiment, among the POIs belonging to the focus POI, POIs having almost the same display position on the screen may be configured as a POI group. In particular, in a case where the distance between POIs is short, it may be difficult to distinguish and display many POIs on the screen due to screen space limitations, so many POIs may be grouped into a single POI group to display the POI group. In an embodiment, POIs with similar values may be clustered into POI groups using the distance and direction between the POIs. When displaying the POI group according to operations 911 to 917, the POI group may be displayed on the screen based on representative POIs.

[0139] According to various embodiments, in operation 1001, the electronic device may determine whether a POI group can be generated. In one embodiment, this determination may be made by configuring POI group generation conditions and determining whether there are POIs that meet the conditions. For example, POIs within a 2-meter distance may be generated as a POI group. In another embodiment, POIs within the same building may be generated as a POI group.

[0140] If the POI group cannot be generated, operation 909 may be immediately performed. If the POI group can be generated, then in operation 1003 , the POI group may be generated by grouping POIs that meet the above conditions.

[0141] According to various embodiments, in operation 1005, a representative POI may be selected for each POI group. The representative POI may be determined based on each piece of POI information included in the POI group or based on the user's usage habits and preferences. According to one embodiment, the electronic device may select the POI closest to its current location as the representative POI. According to another embodiment, the electronic device may configure the POI with the highest rating among the POIs in the most preferred category as the representative POI.

[0142] Furthermore, operations 909 to 917 may be performed based on information of a representative POI of the POI group.

[0143] According to various embodiments, Figure 10 In operation 909 , the electronic device may determine whether the display position of the representative POI of each POI group is within the focus area.

[0144] According to various embodiments, if the display location of the representative POI of the POI group is within the focus area based on the determination in operation 909, information related to the representative POI may be configured to be displayed in operation 911. In one embodiment, at least one of an image, distance, name, star rating, and rating associated with the representative POI may be configured as the information to be displayed, but is not limited thereto. In operation 913, a UI including the information to be displayed regarding the representative POI configured in operation 911 may be displayed at the display location of the representative POI determined in operation 907 on a preview screen captured by the camera.

[0145] According to various embodiments, if the display position of the representative POI is outside the focus area based on the determination in operation 909, the category of the corresponding representative POI may be acquired in operation 915, and in operation 917, an icon corresponding to the category of the POI acquired in operation 915 is located at the display position of the representative POI determined in operation 907 on the preview screen captured by the camera.

[0146] According to various embodiments of the present disclosure, by using the above-described method or an application for implementing the above-described method, location information can be provided to make it easier to find the location information by displaying the location information on a screen captured by the user. In addition, according to this method, by providing information related to the corresponding location in addition to the simple location, when the user wants to select one of various locations, additional information for selection can be provided.

[0147] According to various embodiments, an electronic device (e.g., Figure 1 electronic device 101 or Figure 3 The operation method of the electronic device 300 may include: obtaining a signal from a camera module (eg, Figure 3 The invention also provides a method for providing a preview video captured by a camera module 350 of the electronic device; obtaining location information of the electronic device; obtaining information about at least one POI located nearby based on the location information; selecting a focus POI among the at least one POI based on the information about the at least one POI; determining first information to be provided to the user for general POIs, the general POIs including the remaining POIs in the at least one POI except the selected focus POI; determining second information to be provided to the user for the focus POI including more information than the first information; determining a position on a screen providing a preview video, wherein the information about the at least one POI is to be displayed in the preview video; and displaying to provide the first information or the second information at the position of the screen providing the determined preview video of all or some of the at least one POI.

[0148] According to various embodiments, the method may further include: selecting a POI including advertisement and / or event information in information about at least one POI as an advertising POI among at least one POI; determining third information to be provided to the user for the advertising POI, wherein the third information includes the advertisement and / or event information; and displaying the third information at a position on the screen where the determined preview video is provided for the advertising POI.

[0149] According to various embodiments, displaying to provide the first information or the second information may include: selecting some POIs to be displayed on the screen providing the preview video from among at least one POI based on the direction in which the camera module shoots the preview video and the viewing angle of the camera module; and displaying to provide the first information or the second information at a position of the screen providing the determined preview video for each of the selected POIs.

[0150] According to various embodiments, selecting the focus POI among the at least one POI may include: configuring a partial area in the preview video as the focus area; and configuring a POI whose actual location is included in the focus area as the focus POI.

[0151] According to various embodiments, selecting a focus POI among at least one POI may include: determining a distance between the electronic device and each POI based on location information of the electronic device and location information of each POI included in the information about the at least one POI; and selecting a POI in which the distance between the electronic device and the POI is within a predetermined value as the focus POI based on the determined distance between the electronic device and each POI.

[0152] According to various embodiments, determining a position on the screen may include: designating a portion of the screen where a preview video is provided as a focus area; and determining a position within the designated focus area using a position on the screen where a preview video is provided where information about a focus POI will be displayed.

[0153] According to various embodiments, the method may further include: configuring POIs within a predetermined distance from each other as a POI group based on position information of each POI included in the information about the at least one POI or a position on a screen where the information about the at least one POI is to be displayed; and selecting a representative POI among the POIs in the POI group, wherein displaying to provide the first information or the second information includes displaying to provide the information about the representative POI to a position on the screen where the determined preview video of the representative POI representing the POI group is provided.

[0154] According to various embodiments, the first information may be a category of the POI, and the second information may include at least one of an image, a name, and a distance from the current location of the electronic device related to the POI, and displaying to provide the first information or the second information may include displaying an icon corresponding to the category as a display for providing the first information; and displaying a UI including the second information as a display for providing the second information.

[0155] According to various embodiments, an electronic device (e.g., Figure 1 electronic device 101 or Figure 3 The operation method of the electronic device 300 may include: sending a request to a CP server (eg, Figure 1the server 108) sends the location information of the electronic device; obtains information about at least one POI located nearby from the CP server; arranges at least one POI according to the distance from the electronic device based on the location information of the electronic device; configures the display position of each POI in the at least one POI based on the location of the electronic device and the preview video shooting direction of the electronic device; when the display position is a focus POI within a configured focus area, configures information to be displayed related to the focus POI, and displays a UI including the configured information at the configured display position on the screen displaying the preview video; and when the display position is a general POI outside the configured focus area, obtains category information of the general POI, and displays an icon corresponding to the category information at the configured display position on the screen displaying the preview video.

[0156] According to various embodiments, the method may further include: determining whether a POI group including at least one POI displayed as one display on the preview video screen can be generated; and when the POI group can be generated, generating the POI group and selecting a representative POI of each POI group, wherein displaying the UI including the configured information includes displaying the UI including the configuration information of the representative POI at the configured display position of the representative POI on the screen displaying the preview video, and displaying the icon corresponding to the category includes displaying the icon corresponding to the category of the representative POI at the configured display position of the representative POI on the screen displaying the preview video.

[0157] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those described above.

[0158] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but rather include various changes, equivalents or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding phrase in the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish corresponding components from another component, and do not limit the components in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., a second element)”, “combined to another element (e.g., a second element)”, “connected with another element (e.g., a second element)”, or “connected to another element (e.g., a second element)”, when the term “operably” or “communicatively” is used or when the term “operably” or “communicatively” is not used, it means that the element can be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0159] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or the smallest unit or portion of the single integrated component. For example, depending on an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0160] The various embodiments described herein can be implemented as software (e.g., program 140) comprising one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) can call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to be operable to perform at least one function according to the called at least one instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium can be provided in the form of a non-transitory storage medium. The term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0161] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store). TM ) The computer program product may be published online (e.g., downloaded or uploaded) or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smartphones). If published online, at least part of the computer program product may be temporarily generated or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0162] According to various embodiments, each component (for example, module or program) in the above-mentioned components may include a single entity or multiple entities. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (for example, module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to various embodiments, the operations performed by module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0163] Although the present disclosure has been described with various embodiments, various changes and modifications may be suggested to one skilled in the art. The present disclosure is intended to encompass such changes and modifications as fall within the scope of the appended claims.

Claims

1. An electronic device comprising: a camera configured to capture still images and video; one or more processors, including processing circuitry; and a memory storing instructions that, when executed individually and / or collectively by one or more processors, cause the electronic device to: identifying one or more points of interest (POIs) in the preview video captured by the camera, identifying a focus POI included in a focus area and general POIs among one or more POIs other than the focus POI, the focus area being a partial area of the preview image, identifying a location where a user interface (UI) associated with the focus POI is displayed on the preview image, Displays a preview image and information related to the focused POI.

2. The electronic device according to claim 1, wherein When the instructions are executed individually and / or collectively by one or more processors, the electronic device: identifying a distance between the electronic device and each of the one or more POIs based on the location information of the electronic device and the location information of each of the one or more POIs, and Based on a distance between the electronic device and each of the one or more POIs being within a predetermined value, a focus POI is identified.

3. The electronic device according to claim 1, wherein: When the instructions are executed individually and / or collectively by one or more processors, the electronic device: A focus POI is identified based on preferences of a user of the electronic device.

4. The electronic device according to claim 3, wherein: When the instructions are executed individually and / or collectively by one or more processors, the electronic device: The user's preferences are identified based on one or more of the user's access history, the user's search history, or preset preferences determined by the user.

5. The electronic device according to claim 4, wherein: When the instructions are executed individually and / or collectively by one or more processors, the electronic device: Displays information related to the focus POI based on the user's preferences.

6. The electronic device according to claim 1, wherein When the instructions are executed individually and / or collectively by one or more processors, the electronic device: re-identifying the focus POI as a general POI based on a change in the direction in which the camera captures the preview video and the camera's field of view, and A UI related to the general POI is displayed.

7. The electronic device according to claim 6, wherein: When the instructions are executed individually and / or collectively by one or more processors, the electronic device: The UI related to the general POI is displayed by changing the UI related to the displayed focus POI to the UI related to the general POI.

8. The electronic device according to claim 1, wherein: When the instructions are executed individually and / or collectively by one or more processors, the electronic device: Based on the direction in which the camera captured the preview video and the camera's field of view, one or more nearby POIs are identified.

9. A method for operating an electronic device, comprising: identifying one or more points of interest (POIs) in a preview video captured by a camera; identifying a focus POI included in a focus area and general POIs among one or more POIs other than the focus POI, the focus area being a partial area of the preview image; identifying a location where a user interface (UI) associated with the focus POI is displayed on the preview image; as well as Displays a preview image and information related to the focused POI.

10. The method for operating an electronic device according to claim 9, wherein: Identifying the focus POI includes: identifying a distance between the electronic device and each of the one or more POIs based on the location information of the electronic device and the location information of each of the one or more POIs, and Based on a distance between the electronic device and each of the one or more POIs being within a predetermined value, a focus POI is identified.

11. The method for operating an electronic device according to claim 9, wherein: Identifying focus POIs includes: A focus POI is identified based on preferences of a user of the electronic device.

12. The method for operating an electronic device according to claim 11, wherein: Identifying focus POIs includes: The user's preferences are identified based on one or more of the user's access history, the user's search history, or preset preferences determined by the user.

13. The method for operating an electronic device according to claim 12, wherein: The information displayed about the focus POI includes: Displays information related to the focus POI based on the user's preferences.

14. The method for operating an electronic device according to claim 9, wherein: The operation method includes: re-identifying the focus POI as a general POI based on a change in the direction in which the camera captures the preview video and the camera's field of view, and A UI related to the general POI is displayed.

15. The method for operating an electronic device according to claim 14, wherein: The UI related to general POIs includes: The UI related to the general POI is displayed by changing the UI related to the displayed focus POI to the UI related to the general POI.