Method and apparatus for displaying surrounding information using augmented reality

By providing the current position direction and POI information on the camera preview screen in the map application, it solves the problem that traditional map applications have difficulty finding direction by viewing the surrounding environment, and displays detailed information through augmented reality technology, improving the user experience.

CN113692604BActive Publication Date: 2025-05-23SAMSUNG ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202080028264.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-02-19
Filing Date
2020-02-17
Publication Date
2025-05-23
Estimated Expiration
2040-02-17

AI Technical Summary

Technical Problem

When traditional map applications help users navigate to their desired locations, they find directions by viewing their surroundings, and only provide simple location information, lacking detailed relevant information.

Method used

By providing the direction of the current position reference and the Point of Interest (POI) location information on the camera preview screen when searching for nearby locations, it helps users to get to their desired locations more easily. At the same time, users are allowed to check various detailed information by providing information associated with corresponding locations and displaying this information through augmented reality technology.

Benefits of technology

Improves the ease of users finding directions during navigation and provides detailed information associated with nearby locations, enhancing user experience and information readability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113692604B_ABST
    Figure CN113692604B_ABST
Patent Text Reader

Abstract

A method for displaying nearby points of interest (POI) using augmented reality and an electronic device thereof. A method for operating an electronic device, comprising: obtaining a preview video; obtaining location information of the electronic device; obtaining information about at least one POI located nearby; selecting a focus POI among the at least one POI; determining first information to be provided to a user for a general POI; determining second information including more information than the first information to be provided to the user for the focus POI; determining a position on a screen where a preview video about the at least one POI is to be displayed; and displaying the first information or the second information at the position of the screen where the determined preview video of all or some of the at least one POI is provided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Various embodiments are directed to methods and apparatus for displaying nearby points of interest (POIs) using augmented reality. Background Art

[0002] As smartphones interact with the Internet, data becomes freely available and users tend to obtain necessary information immediately. For example, users often search for information about nearby restaurants or interest-related information by using smartphones. In this case, various map applications are used to include a function of displaying the information searched by the user on a map.

[0003] In a map application, the user's current location and the searched location or place can be displayed together and can be displayed by different icons depending on the attributes of the place to be searched. However, map applications are still limited to simply displaying the location searched based on the search term, so there is room for further improvement.

[0004] The above information is presented as background information only to assist in understanding the present disclosure. No determination has been made and no assertion has been made as to whether any of the above content may be used as prior art for the present disclosure. Summary of the invention

[0005] Technical Solution

[0006] Traditional map applications can help users navigate to a desired location by displaying the locations of nearby locations on a map. However, in order to reach a desired location only by the location on the map, it is inconvenient to check the surrounding environment (such as roads, buildings, etc.) to find the direction.

[0007] An aspect of the present disclosure provides a method and apparatus for helping a user to easily reach a desired location by notifying a direction of a current location reference and a camera preview screen and location information of a point of interest (POI) when searching for a nearby location.

[0008] Another aspect of the present disclosure provides a method and apparatus for allowing a user to check various information by providing information associated with a corresponding place, such as a coupon provided at the corresponding place in addition to a simple location of a POI.

[0009] Yet another aspect of the present disclosure provides a method and apparatus for increasing readability by showing information that is different from other information and can be more effectively used by a user.

[0010] The technical subject matter pursued by the present disclosure may not be limited to the above-mentioned technical subject matter, and other technical subject matter not mentioned may be clearly understood by those skilled in the art in the field of the present disclosure through the following description.

[0011] According to one aspect of the present disclosure, an electronic device includes: a communication module configured to perform communication with an external device; a camera module configured to shoot a video; at least one processor configured to be operably connected to the communication module and the camera module; and at least one memory configured to be operably connected to the at least one processor, wherein the at least one memory stores instructions that, when executed, are used to cause the at least one processor to: obtain a preview video shot by the camera module by controlling the camera module, obtain location information of the electronic device, obtain information about at least one point of interest (POI) located nearby based on the location information, and obtain information about at least one point of interest (POI) located nearby based on the location information. The method comprises the steps of: providing information of at least one POI of a certain type, selecting a focus POI from among the at least one POI, determining first information to be provided to the user for general POIs, the general POIs including the remaining POIs from among the at least one POI except the selected focus POI, determining second information to be provided to the user for the focus POI, wherein the second information includes more information than the first information, determining a position on a screen at which the preview video is provided, wherein information about the at least one POI will be displayed in the preview video, and displaying the first information or the second information to be provided at a position on the screen at which the determined preview video of all or some of the at least one POI is provided.

[0012] According to another aspect of the present disclosure, a method for operating an electronic device includes: obtaining a preview video captured by a camera module; obtaining location information of the electronic device; obtaining information about at least one POI located nearby based on the location information; selecting a focus POI among the at least one POI based on the information about the at least one POI; determining first information to be provided to a user for general POIs, the general POIs including the remaining POIs among the at least one POI except the selected focus POI; determining second information to be provided to the user for the focus POI including more information than the first information; determining a position on a screen providing the preview video, wherein information about the at least one POI will be displayed in the preview video, and displaying the first information or the second information to be provided at a position on the screen of the determined preview video providing all or some of the at least one POI.

[0013] According to another aspect of the present disclosure, a method for operating an electronic device includes: sending location information of the electronic device to a content provider (CP) server; obtaining information about at least one POI located nearby from the CP server; arranging the at least one POI according to the distance from the electronic device based on the location information of the electronic device; configuring the display position of each of the at least one POI based on the location of the electronic device and the shooting direction of a preview video of the electronic device; when the display position is a focus POI within a configured focus area, configuring information to be displayed related to the focus POI, and displaying a UI including the configured information at the configured display position on a screen displaying the preview video; and when the display position is a general POI outside the configured focus area, obtaining category information of the general POI, and displaying an icon corresponding to the category information at the configured display position on the screen displaying the preview video.

[0014] In addition to the method of obtaining information about a place through a fixed map image, the method and the electronic device thereof according to various embodiments may provide the user with location information on a screen captured by the user, thereby providing location information that is easier to find.

[0015] The method and the electronic device thereof according to various embodiments may provide information related to a corresponding place in addition to a simple location, thereby allowing a user to check various information.

[0016] The method and the electronic device thereof according to various embodiments may display information that may be more effectively used by a user in a more detailed manner than other information, thereby increasing readability for the user.

[0017] Effects obtainable by the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those skilled in the art through the following description.

[0018] Before proceeding to the following detailed description, it may be helpful to set forth definitions of certain words and phrases used throughout this patent document: the terms "include" and "comprising" and their derivatives, mean including but not limited to; the term "or" is inclusive, meaning and / or; the phrases "associated with" and "associated with" and their derivatives may mean including, included, interconnected with, containing, contained within, connected to or connected to, coupled to or coupled with, communicable with, cooperating with, intertwined, juxtaposed, proximate to, bound to or bound with, having, having the property of, etc.; the term "controller" means any device, system, or part thereof that controls at least one operation, such device may be implemented in hardware, firmware, or software, or some combination of at least two thereof. It should be noted that the functionality associated with any particular controller may be centralized or distributed, local or remote.

[0019] In addition, the various functions described below may be implemented or supported by one or more computer programs, each of which is formed by a computer-readable program code and embodied in a computer-readable medium. The terms "application" and "program" refer to one or more computer programs, software components, instruction sets, processes, functions, objects, classes, instances, related data or parts thereof suitable for implementation in appropriate computer-readable program codes. The phrase "computer-readable program code" includes any type of computer code, including source code, object code and executable code. The phrase "computer-readable medium" includes any type of medium that can be accessed by a computer, such as a read-only memory (ROM), a random access memory (RAM), a hard drive, a compact disk (CD), a digital video disk (DVD) or any other type of memory. "Non-transitory" computer-readable media does not include wired, wireless, optical or other communication links that transmit temporary electrical signals or other signals. Non-transitory computer-readable media include media that can store data sustainably and media that can store and then overwrite data, such as rewritable optical disks or erasable memory devices.

[0020] Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions apply to prior, as well as future uses of such defined words and phrases. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0022] Figure 1 is a block diagram illustrating an electronic device in a network environment according to various embodiments;

[0023] Figure 2 is a block diagram illustrating a camera module according to various embodiments;

[0024] Figure 3 is a diagram showing an example of a functional configuration of an electronic device according to various embodiments;

[0025] Figure 4 is a diagram showing an example of a focus area designated on a screen of an electronic device according to various embodiments;

[0026] Figure 5 is a diagram showing an example of displaying POI information on a display screen of an electronic device according to various embodiments;

[0027] Figure 6is a diagram showing an example of displaying detailed POI information on a display screen of an electronic device according to various embodiments;

[0028] Figure 7 is a diagram showing another example of displaying POI information on a display screen of an electronic device according to various embodiments;

[0029] Figure 8 is a flowchart illustrating an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen;

[0030] Fig. 9 is a flowchart showing another example of an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen; and

[0031] Fig.10 is a flowchart illustrating an example of an operation of displaying surrounding information of an electronic device on a display screen in consideration of a POI group according to various embodiments.

[0032] Regarding the description of the drawings, the same or similar reference numerals may be used for the same or similar components. DETAILED DESCRIPTION

[0033] In this patent document, the following discussion Figures 1 to 10 The various embodiments used to describe the principles of the present disclosure are only by way of example and should not be interpreted in any way as limiting the scope of the present disclosure. It will be understood by those skilled in the art that the principles of the present disclosure can be implemented in any appropriately arranged system or device.

[0034] Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings.

[0035] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1, the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit.For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).

[0036] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 , or as part of the main processor 121 .

[0037] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 (not the main processor 121), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123.

[0038] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0039] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0040] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0041] The sound output device 155 can output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as a part of the speaker.

[0042] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of a force caused by a touch.

[0043] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0044] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0045] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0046] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0047] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0048] The camera module 180 may capture still images or moving images. According to embodiments, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0049] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0050] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0051] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0052] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module 197.

[0053] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, general purpose input output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0054] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute the requested at least part of the function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

[0055] Figure 2 2 is a block diagram showing a camera module 180 according to various embodiments. Figure 2 , the camera module 180 may include a lens assembly 210, a flash 220, an image sensor 230, an image stabilizer 240, a memory 250 (e.g., a buffer memory), or an image signal processor 260. The lens assembly 210 may collect light emitted from an object as an image capture target. The lens assembly 210 may include one or more lenses. According to an embodiment, the camera module 180 may include a plurality of lens assemblies 210. In this case, the camera module 180 may be, for example, a dual camera, a 360-degree camera, or a spherical camera. The plurality of lens assemblies 210 may have the same lens properties (e.g., viewing angle, focal length, auto focus, f-number, or optical zoom), or at least one lens assembly may have at least one other lens property different from other lens assemblies. The lens assembly 210 may include, for example, a wide-angle lens or a telephoto lens. The flash 220 may emit a light source for enhancing light emitted from an object. The flash 220 may include one or more light emitting diodes (e.g., red, green, and blue (RGB) LEDs, white LEDs, infrared LEDs, or ultraviolet LEDs) or xenon lamps.

[0056] The image sensor 230 may acquire an image corresponding to an object by converting light transmitted from the object through the lens assembly 210 into an electrical signal. According to an embodiment, the image sensor 230 may include one image sensor selected from image sensors having different properties (e.g., an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor), a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor 230 may be implemented as, for example, a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

[0057] In response to the movement of the camera module 180 or the electronic device 101 including the same, the image stabilizer 240 may move at least one lens included in the lens assembly 210 or the image sensor 230 in a specific direction, or may control it (e.g., adjust the readout timing) so as to at least partially compensate for the negative effect (e.g., image shake) caused by the movement relative to the captured image. According to an embodiment, the image stabilizer 240 may be implemented as, for example, an optical image stabilizer, and the above-mentioned movement may be detected using a gyro sensor (not shown) or an acceleration sensor (not shown) arranged inside or outside the camera module 180.

[0058] The memory 250 may at least temporarily store at least a portion of the image acquired by the image sensor 230 for the next image processing task. For example, if image acquisition according to the shutter is delayed, or if a plurality of images are acquired at a high speed, the acquired original image (e.g., a high-resolution image) may be stored in the memory 250, and a copy image (e.g., a low-resolution image) corresponding to the original image may be previewed through the display device 160. Thereafter, if a specified condition (e.g., a user input or a system command) is satisfied, at least a portion of the original image stored in the memory 250 may be acquired or processed by, for example, the image signal processor 260. According to an embodiment, the memory 250 may be configured as at least a portion of the memory 130, or may be configured as a separate memory that operates independently of the memory 130.

[0059] The image signal processor 260 may perform image processing (e.g., depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesis, or image compensation {e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening}) on an image acquired through the image sensor 230 or an image stored in the memory 250. Additionally or alternatively, the image signal processor 260 may perform control (e.g., exposure time control or readout timing control) on at least one of the components included in the camera module 180 (e.g., the image sensor 230). The image processed by the image signal processor 260 may be stored again in the memory 250 for further processing, or may be transmitted to an external component of the camera module 180 (e.g., the memory 130, the display device 160, the electronic device 102, the electronic device 104, or the server 108). According to an embodiment, the image signal processor 260 may be configured as at least a part of the processor 120, or may be configured as a separate processor that operates independently of the processor 120. When configured as a separate processor, the image processed by the image signal processor 260 may be processed by the processor 120 as it is, or may be subjected to additional image processing, and may then be displayed by the display device 160 .

[0060] According to an embodiment, the electronic device 101 may include two or more camera modules 180, each module having different properties or functions. In this case, for example, at least one camera module 180 may be a wide-angle camera or a front camera, and at least one other camera module may be a telephoto camera or a rear camera.

[0061] The device or method for displaying surrounding information using augmented reality proposed in the present disclosure can obtain information about points of interest (POI) scattered around the user relative to the current location when the user uses a camera to capture the surrounding environment, and can use augmented reality technology to show the acquired information together with a preview image or screen captured by the camera and displayed on the display.

[0062] The following will first define the basic terms required for the description.

[0063] Point of interest: refers to a location that is useful to the user or that the user may be interested in. Hereinafter, it may be referred to as a POI.

[0064] Content Provider Server: It stores a list of all POIs and information about each POI, and can provide a list of POIs and related information around the user's location through a request based on the user's location. Hereinafter, it may be referred to as a Content Provider (CP) server.

[0065] POI related information: It includes information describing the POI that is useful to the user or can make the user more interested. It may include relevant images, names (business names), locations, categories, addresses, telephone numbers, etc. of the POI, and in some cases may additionally include advertising or event related information. The POI related image may be an image that can represent the corresponding POI, and may include a business name or an image including representative products. The category may indicate the type of business to which the POI belongs. The category may be predetermined by the content provider, and it may be predetermined which category each POI belongs to. For example, the category of each POI may be determined for each business type (such as a cafe, restaurant, cinema, hotel, etc.), or may be further subdivided into Western restaurants, Korean restaurants, fast food restaurants, etc.

[0066] Figure 3 is a diagram showing an example of a functional configuration of an electronic device 300 according to various embodiments. Figure 3 Briefly shows the functional configuration that can be used to implement the method proposed in this disclosure. In an embodiment, Figure 3 The electronic device 300 may be Figure 1 An electronic device 101.

[0067] refer to Figure 3 , the electronic device 300 may include a processor 310, a memory 320, a display 330, a sensor module 340, a communication module 360 ​​and / or a GPS module 370. However, the electronic device 300 is not limited thereto. At least one of the above components may be omitted, or one or more other components may be added to the electronic device 300.

[0068] The camera module 350 can capture the vicinity of the current location. Specific components of the camera module 350 can be Figure 2 The camera module 180 shown in FIG. The image or video captured by the camera module 350 can be displayed on the display 330.

[0069] The sensor module 340 may include at least one of a geomagnetic sensor, an acceleration sensor (e.g., an accelerometer), a gyroscopic sensor (e.g., a gyro), or a six-axis sensor. The sensor module 340 may detect a direction in which the camera module 350 of the electronic device 300 is photographing based on information obtained using the included sensors. The detected direction may be used by the processor 310 to select surrounding information to be displayed on the display 330. The sensor module 340 may correspond to Figure 1 sensor module 176 or a portion thereof.

[0070] The communication module 360 ​​can be used between the electronic device 300 and an external electronic device (eg, Figure 1The communication module 360 ​​can establish a communication link between the server 108 and the electronic device, and can perform communication through the established communication link. For example, the communication module 360 ​​can use a communication method such as Bluetooth, BLE, Wi-Fi, NFC or LTE to send control commands or data to other electronic devices and receive control commands or data from other electronic devices.

[0071] The GPS module 370 may generate location information obtained by detecting the current location of the electronic device 300. The GPS module 370 may receive a signal from a GPS satellite to generate information about the current location of the electronic device 300, for example, location information including latitude / longitude.

[0072] The communication module 360 ​​may send information to or receive information from an external electronic device based on the control of the processor 310. For example, the communication module 360 ​​may send location information generated by the GPS module 370 and direction information obtained by the sensor module 340 to an external electronic device (e.g., Figure 1 server 108), and can obtain surrounding information from external electronic devices.

[0073] The display 330 may display information to provide the information to the user. The display 330 may correspond to Figure 1 The display device 160 of the electronic device 300. The display 330 may display a preview video and surrounding information photographed by the camera module 350 of the electronic device 300 on the screen in the form of augmented reality (AR).

[0074] The processor 310 can control the overall operation of the electronic device 300. The processor 310 can be organically coupled to other components (e.g., the memory 320, the display 330, the sensor module 340, the camera module 350, the communication module 360, and the GPS module 370) to control the correct operation of the other components, can provide data for the other components, and can obtain and process data from the other components. The processor 310 can be implemented in software, can be implemented in hardware such as a chip, a circuit, etc., or can be implemented in a collection of software and hardware. The processor 310 can be one or a collection of multiple processors.

[0075] The memory 320 may refer to one or more memory groups. The memory 320 may execute instructions stored in the memory 320 based on signaling with the processor 310. The memory 320 may store data and / or commands received from other components (e.g., the processor 120, the sensor module 340, the communication module 360, and the display 330) or generated by other components.

[0076] According to various embodiments, when a user wishes to obtain information about surrounding information by starting to shoot or executing a related application, the processor 310 may use the GPS module 370 to obtain current location information of the user or the electronic device 300, and may use the communication module 360 ​​to send the obtained location information to an external electronic device (e.g., Figure 1 The processor 310 may receive point of interest (POI) information around the location of the user or the electronic device 300 from an external electronic device. The processor 310 may use the received POI information to calculate and arrange the distance and direction to each POI based on the current location of the electronic device 300. The processor 310 may determine which POI is to be displayed on the screen and in which area of ​​the screen the corresponding POI is to be displayed based on the result of the arrangement. The processor 310 may distinguish the POIs into general POIs and focus POIs, may display more detailed information about the focus POI on the screen, and may display the general POI using icons to provide information to the user. In addition, the focus POI may be displayed in a focus area specified on the screen of the display 330. According to another embodiment, in addition to the general POI and the focus POI, the processor 310 may also distinguish between advertising POIs. Advertising POIs may be POIs that include advertising or event information in the POI information at the request of an advertiser. Regarding advertising POIs, in addition to the information displayed by the general POI or the focus POI, the processor 310 may also display advertising or event information on the screen.

[0077] According to various embodiments, the processor 310 may use the GPS module 370 to obtain the current location of the electronic device 300. The processor 310 may send a content provider (CP) server (e.g., Figure 1 The processor 310 may use the communication module 360 ​​to send the current location of the electronic device 300 to the CP server to request POI list data within a predetermined distance from the current location of the electronic device 300. The CP server may store POI information to be provided to the user. According to an embodiment, the processor 310 may use the communication module 360 ​​to send the current location of the electronic device 300 to the CP server to request POI list data from the CP server. In response to the sent location information, the processor 310 may receive POI list data from the CP server through the communication module 360. The information included in the POI list data received from the CP server may include latitude / longitude information indicating the location of each POI, name information, image information including a representative image, contact information, category information, and other text information.

[0078] According to various embodiments, the processor 310 may calculate the distance and direction of each POI relative to the current location of the electronic device 300 based on the location information of the POI list transmitted from the CP server, and may arrange the POIs in the order of the distance from the current location of the electronic device 300. According to an embodiment, the processor 310 may use the latitude / longitude included in the POI information received from the CP server to calculate the calculated distance, angle, etc. and the latitude / longitude of the current location of the electronic device 300. The processor 310 may use the calculated result to arrange the relative position value between the electronic device 300 and the corresponding POI.

[0079] According to various embodiments, the processor 310 may display information about surrounding POIs and a preview screen as a result of being photographed by the camera module 350 on the screen in the form of AI. However, due to conditions such as the amount of surrounding information, the size of the display, the viewing angle of the camera in the camera module 350, the positions for displaying multiple POIs may overlap, making it difficult to display all overlapping POIs on one screen of the display 330, so the processor 310 may consider conditions such as the camera viewing angle, the display size, the user interface (UI), etc., predict the position where all POIs are to be displayed, and may generate a set of overlapping POIs. The POI group may refer to a cluster of POIs bound based on a specific standard. In particular, in the case where the distance between POIs is short, it is difficult to distinguish and display multiple POIs on the screen due to the space limitation of the screen of the display 330, so the processor 310 may group multiple POIs into a single POI group to display the POI group. According to an embodiment, the processor 310 may define a POI group by grouping POIs having similar numerical values ​​obtained using the distance between POIs, the direction of the POI, etc. into the POI group. The processor 310 may display a POI group based on one representative POI, and may allow the user to access information of another POI included in the corresponding POI group by using the representative POI as an interface. The processor 310 may determine the representative POI based on information received from the CP server, or may determine the representative POI based on the user's usage habits and preferences. According to an embodiment, the processor 310 may determine the POI closest to the current location of the electronic device 300 among the POIs included in the POI group as a representative POI. According to another embodiment, the processor 310 may determine the POI with the highest grade as a representative POI based on the POI information received from the CP server. According to another embodiment, when the user prefers a restaurant category, the processor 310 may determine the POI included in the corresponding category as a representative POI. The processor 310 may determine representative information and display positions for displaying each POI group on the screen, wherein each POI group is generated based on a predetermined standard.

[0080] According to various embodiments, the processor 310 may display a preview video shot by the camera module 350 on the screen, and may display the above-mentioned various POI groups on the screen in the form of AI above the displayed preview video. In order to display each POI group on the screen, the processor 310 may use the sensor module 340 to obtain the direction in which the camera or camera module 350 of the electronic device 300 shoots in real time, and may display the information of the POI group in consideration of the position and direction of each POI group and the viewing angle of the camera. In this case, the information displayed on the screen of the display 330 may be information representing each POI group, and the information of another overlapping POI may be confirmed using an additional interface with the user. For example, the processor 310 may display a UI related to a representative POI on the screen, and the corresponding UI may be used as an interface so that the user obtains information of another POI included in the same POI group. According to an embodiment, when a left / right scrolling operation of a user is detected, the processor 310 may display information of other POIs included in the same POI group on the screen of the display 330.

[0081] According to various embodiments, the processor 310 may display the POI information of the direction in which the camera module 350 is photographed on the screen together with the video photographed by the camera module 350, thereby providing them to the user at the same time. Therefore, in response to the direction of the camera module 350 being changed as the electronic device 300 is rotated to the left or right of the user, the processor 310 may confirm the POI corresponding to the direction to display it on the screen.

[0082] As described above, when the processor 310 displays surrounding information on the screen of the display 330, there may be a trade-off relationship between the UI area for displaying each POI group and the amount of data to be provided. In order to provide a large amount of data to the user, the UI area may be increased, and when the UI area is reduced, limited information may be provided. Therefore, in the present disclosure, a focus POI may be defined so that more detailed information about a POI group determined to be important to the user may be provided in the focus area.

[0083] Figure 4 is a diagram 400 illustrating an example of a focus area 410 designated on a screen of an electronic device 300 according to various embodiments.

[0084] According to various embodiments, the processor 310 may designate a partial area of ​​the screen of the display 330 as the focus area 410. According to an embodiment, referring to Figure 4 ,like Figure 4As shown in the dotted frame of , the lower center portion of the screen of the display 330 may be designated as the focus area 410. The processor 310 may determine a focus POI or a focus POI group to be displayed in the focus area 410 by using the position of the electronic device 300, the shooting direction of the camera module 350, the distance and angle of the POI, etc. In response to a change in the position and / or shooting direction of the electronic device 300 by a user's manipulation, the focus POI or the focus POI group to be displayed in the focus area may be changed. The processor 310 may cause a general POI or a POI group that cannot be displayed in the focus area to provide minimum information using simple UIs 421 to 427, and may cause a focus POI group that can be displayed in the focus area to provide more information to the user through an extended UI area 430.

[0085] According to an embodiment, the processor 310 may display a general POI or a general POI group using icons 421, 423, 425, and 427 indicating the category of the corresponding POI or POI group. In an embodiment, the icon 421 may be an icon obtained by shaping a knife and fork to represent a western restaurant and indicates the western restaurant category, the icon 425 may be an icon obtained by sharing a projector and indicates the cinema category, and the icon 427 may be an icon obtained by shaping a coffee cup and indicates the cafe category. According to another embodiment, the processor 310 may display a UI including an image, a name, etc. of the corresponding POI or POI group about the focus POI or the focus POI group. As a result, with respect to the focus POI or the focus POI group, a UI 430 including more information than the information of the general POI or the general POI group may be displayed on the screen of the display 330, and the displayed UI 430 may be provided to the user. When displaying the POI group on the screen of the display 330 , the processor 310 may display icons corresponding to categories of representative POIs with respect to the general POI group, and may display images, names, etc. of representative POIs of corresponding POI groups with respect to the focus POI group.

[0086] According to various embodiments, the processor 310 may separate the advertising POI to display the advertisement or event information in addition to the icon of the general POI, or may allow the advertisement or event information to be additionally included in the UI of the focus POI to display the corresponding information. In addition, when the advertising POI is included in the POI group, the advertising POI may be determined as a representative POI in priority to other POIs.

[0087] According to various embodiments, the processor 310 may convert the focus POI to a general POI, and convert the general POI to a focus POI by changing the position and / or shooting direction of the electronic device 300. In order to display such a change on the screen, the processor 310 may gradually change the UI from a UI representing the focus POI to a UI representing the general POI, or vice versa, may gradually change the UI from a UI representing the general POI to a UI representing the focus POI.

[0088] Figure 5 500 is a diagram illustrating an example of displaying POI information on the screen of the display 330 of the electronic device 300 according to various embodiments.

[0089] Figure 6 600 is a diagram illustrating an example of displaying detailed POI information on the screen of the display 330 of the electronic device 300 according to various embodiments.

[0090] Referring to the embodiment Figure 5 , the processor 310 may display a UI including POI information and a preview video 501 captured by the camera module 350 on the screen of the display 330. UIs 531 and 532 may include information about the focus POI, and the processor 310 may display information such as a representative image, name, distance, star rating, and rating associated with the POI. In particular, UIs 531 and 532 may be displayed in a focus area 510 of the screen of the display 330. On the other hand, UIs 521, 523, and 525 may display information of general POIs, and the processor 310 may display corresponding information using icons indicating categories of corresponding POIs, and the icons may be different icons for each category. According to an embodiment, an advertising POI may be displayed on the screen, and in the case of an advertising POI, advertising information and / or event information may be included in the information displayed on the screen.

[0091] When the user touches the UI displayed on the screen of the display 330, regardless of whether the POI is a general POI, a focus POI, or an advertisement POI, as shown in FIG. Figure 6As shown, the processor 310 can display a UI 610 on the screen, which includes detailed information related to the corresponding POI of the touched UI. The UI 610 can display various information related to the POI received from the CP server to the user, and the detailed information displayed on the UI 610 can be connected to a separate application through a hyperlink, etc. to provide additional services. For example, the UI 610 can display a representative image, name, star, rating, distance, address, contact, etc., and when the contact displayed on the UI 610 is pressed, a caller application (call) can be executed to provide a phone call service. When the user touches the representative image or name, an Internet application can be executed to display the website of the corresponding POI. When the user touches the address or "get directions", a service and a map-related application can be provided to provide a detailed guide to the corresponding place. In addition, when the POI touched by the user is a POI group in which multiple POIs are grouped instead of a single POI, the processor 310 can display a separate UI 620 on the screen of the display 330 to indicate that the separate UI 620 is a POI group, and provide the user with information related to the number of POIs included in the POI group. In this case, the processor 310 may provide information of another POI other than the currently displayed POI on the screen of the display 330 in response to a left / right scanning operation of the user.

[0092] Figure 7 is a diagram illustrating another example of displaying POI information on the screen of the display 330 of the electronic device 300 according to various embodiments.

[0093] refer to Figure 7 In the case where a user uses an application implementing the method of the present disclosure, the processor 310 may display POI information and a preview taken by the camera module 350 on the screen of the display 330, and in the case of a general POI, the POI information may be displayed using icons 721, 723, 725, 727 indicating the category of each POI. According to an embodiment, icon 721 and icon 727 may be used to indicate that the corresponding POI is a restaurant category, and icon 725 may be used to indicate that the corresponding POI is a category of a place where a meeting can be held. According to an embodiment, the processor 310 may change the size of the icon according to the distance from the current location of the electronic device 300, so that a nearby POI may be displayed using an icon 727 having a relatively large size, and a distant POI may be displayed using an icon 723 having a relatively small size. According to an embodiment, the processor 310 may provide icons that reflect user preferences. The processor 310 may use a heart shape as shown in icon 727 to display a POI with a high user preference. For a specific icon, when there is a user operation such as a touch, the icon 721 may be displayed as shown in FIG. Figure 6Detailed information of the POI corresponding to the icon is provided as shown in . In the case of a focus POI, the processor 310 may display UIs 731 and 733 providing additional information such as the name, star rating, and rating of the POI and a corresponding image on the screen of the display 330. Even in the case of a focus POI, when the distance to the electronic device 300 is short, the processor 310 may display the focus POI using a relatively large UI 731, and when the distance therefrom is large, the processor 310 may display the focus POI using a relatively small UI 733. According to another embodiment, the processor may display a POI having a relatively long distance therefrom as being located at the lower part of the screen, and may display a POI having a relatively long distance therefrom as being located at the upper part of the screen. According to an embodiment, the processor 310 may provide a UI reflecting user preferences, and may display a POI having a high user preference using a heart shape as shown in UI 731. In addition, in the case of an advertising POI, the processor 310 may display a UI (not shown) on the screen of the display 330, which provides information such as advertising information or event information in addition to information such as the name, star rating, rating, etc. of the POI and a corresponding image. According to an embodiment, the advertising POI may be displayed more prominently than the general POI and the focus POI so that the user can understand the advertising POI more clearly. According to an embodiment, the advertising POI may be included in the general POI, or may be included in the focus POI.

[0094] According to various embodiments, the processor 310 may configure a specific area of ​​the preview screen generated by the camera module 350 as a focus area, and may configure a POI existing in the focus area as a focus POI. When the processor 310 compares the location, direction information, road conditions, road conditions, etc. between the electronic device 300 and the POI, the processor 310 may configure a location that is easier for the user to reach as a focus area, and may configure a POI existing in the corresponding focus area as a focus POI, thereby providing relatively rich information.

[0095] According to various embodiments, the processor 310 may select a focus POI based on various criteria. According to an embodiment, as described above, the processor 310 may select all POIs within a focus area that is easily accessible as the focus POI. In another embodiment, the processor 310 may select a focus POI based on the direction in which the camera module 350 shoots, the viewing angle of the camera, the distance between the current position of the electronic device 300 and the POI, etc. Therefore, the actual position may be included in the preview screen determined based on the direction shot by the camera module 350 and the viewing angle between the surrounding POIs, so that a POI with a distance within a predetermined value may be selected as the focus POI. According to another embodiment, the processor 310 may select a POI that the user has previously visited or a POI for which the user has previously searched for information as the focus POI. In another embodiment, the processor 310 may select a focus POI based on the user's past usage history, behavior, etc. In another embodiment, the processor 310 may select a focus POI based on preferences preset by the user. For example, in the case where a restaurant has the highest preference of the user, the processor 310 may select a restaurant-related POI as the focus POI. In another embodiment, the processor 310 may select the focus POI based on a combination of the above selection conditions.

[0096] According to various embodiments, for POIs included in the focus POI, the processor 310 may change the level of information provided for each POI based on past usage history, behavior, and the like.

[0097] According to various embodiments, when the user changes the position of the electronic device 300, the processor 310 is used to newly change the distance and angle to all POIs, and the selection of the focus POI can be updated accordingly, and the POI group can be added, deleted or changed. In addition, even when the user changes the direction in which the camera module 350 shoots, the processor 310 may need to update the selection of the focus POI. According to an embodiment, when the direction in which the camera module 350 shoots is changed, the processor 310 can display the focus POI included in the preview video currently shot and displayed by the camera module 350 among the previously selected focus POIs on the screen of the display 330 without selecting a new focus POI.

[0098] According to various embodiments, the processor 310 may newly select a focus POI by receiving new POI information from the CP server according to the degree of change in the location of the electronic device 300 , and may display the selected focus POI on the screen of the display 330 .

[0099] According to the present disclosure, through the above-mentioned operation of the processor 310, location information can be presented on the video taken by the user, instead of providing information about the place through a fixed map image, making it easier to find the location information, and, in addition to the simple location, various information related to the corresponding place can also be provided to the user.

[0100] According to various embodiments, an electronic device (e.g., Figure 1 The electronic device 101 or Figure 3 The electronic device 300 may include: a communication module configured to perform communication with an external device; a camera module configured to shoot a video; at least one processor configured to be operably connected to the communication module and the camera module; and at least one memory configured to be operably connected to the at least one processor, wherein the at least one memory instruction, when executed, is used to cause the at least one processor to obtain a preview video shot by the camera module by controlling the camera module, obtain location information of the electronic device, obtain information about at least one point of interest (POI) located nearby based on the location information, select a focus POI among the at least one POI based on the information about the at least one POI, determine first information to be provided to a user for general POIs, the general POIs including the remaining POIs among the at least one POI except the selected focus POI, determine second information to be provided to the user for the focus POI, wherein the second information includes more information than the first information, determine a position to provide a preview video on a screen, wherein information about the at least one POI is to be displayed in the preview video, and display the first information or the second information at the position of the determined preview video to provide all or some of the at least one POI on the screen.

[0101] According to various embodiments, the instructions may cause the at least one processor to select a POI among the at least one POI that includes advertising and / or event information in the information about the at least one POI as an advertising POI, determine third information of the advertising POI to be provided to the user, wherein the third information includes advertising and / or event information, and display the third information at a position on the screen where a preview video determined for the advertising POI is provided.

[0102] According to various embodiments, the instructions may cause the at least one processor to select some POIs to be displayed on the screen providing the preview video from among the at least one POI based on the direction in which the camera module shoots the preview video and the viewing angle of the camera module, and display the first information or the second information at the position of the determined preview video for each of the selected POIs provided on the screen.

[0103] According to various embodiments, the instructions may cause the at least one processor to configure a condition corresponding to the focus POI, and select a POI in which the information about the at least one POI satisfies the condition corresponding to the focus POI as the focus POI.

[0104] According to various embodiments, the instructions may enable the at least one processor to configure a partial area in the preview video as a focus area, and configure a POI whose actual position is included in the focus area as a condition corresponding to the focus POI.

[0105] According to various embodiments, the instructions may cause the at least one processor to determine the distance between the electronic device and each POI as a condition corresponding to the focus POI based on the location information of the electronic device and the location information of each POI included in the information about the at least one POI, and to configure a POI in which the distance between the electronic device and the POI is within a predetermined value based on the distance determined between the electronic device and each POI.

[0106] According to various embodiments, the instructions may cause the at least one processor to configure a POI with a high preference as a condition corresponding to the focus POI based on user preferences, wherein the user preferences are configured based on user behavior, and the POI with a high preference includes a POI that the user has previously visited or a POI about which the user has previously searched for information.

[0107] According to various embodiments, the instructions may cause the at least one processor to designate a portion of the screen where the preview video is provided as a focus area, and display the portion to provide second information for a focus POI within the focus area.

[0108] According to various embodiments, the instructions may cause the at least one processor to configure POIs within a predetermined distance from each other into a POI group based on location information of each POI included in the information about the at least one POI or a position on a screen on which the information about the at least one POI is to be displayed, select a representative POI from among the POIs in the POI group, and display to provide information about the representative POI to a position on the screen representing the representative POI of the POI group.

[0109] According to various embodiments, the instructions may cause the at least one processor to determine the first information as a category of the POI, determine the second information as including at least one of a POI-related image, a name, and a distance from the current location of the electronic device, display an icon corresponding to the category to provide the first information, and display a user interface (UI) including the second information to provide the second information.

[0110] Hereinafter, a method of providing surrounding information on a camera preview video in the form of augmented reality in the electronic device 300 will be described.

[0111] Figure 8 800 is a flowchart illustrating an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen. Figure 8 The operation object of the flowchart 800 shown in FIG. 8 can be understood as an electronic device (eg, Figure 1 The electronic device 101 or Figure 3 electronic device 300) or a processor of the electronic device (e.g., Figure 1 The processor 120 or Figure 3 processor 310).

[0112] According to various embodiments, in operation 801, the electronic device 101 or 300 may obtain surrounding POI information. In order to obtain surrounding POI information, when the user starts shooting with the camera module 350 or obtains information about the surrounding location by executing a related application, the electronic device 101 or 300 may use the GPS module 370 to obtain the current location information of the electronic device 101 or 300. The current location may be displayed in latitude and longitude. The electronic device 101 or 300 may obtain surrounding POI information based on its current location. In an embodiment, the electronic device 101 or 300 may select a POI within a predetermined distance from the current location of the electronic device 101 or 103 from among the POIs stored in the memory 130 or 320 through an application, thereby obtaining surrounding POI information. According to another embodiment, the electronic device 101 or 300 may send its current location to a CP server (e.g., Figure 1 The CP server 108 of the electronic device 101 and 300 may receive surrounding POI information extracted based on the current location from the CP server, thereby acquiring surrounding POI information. In this case, the CP server may provide information of POIs within a predetermined distance from the current location of the electronic device 101 and 300. The POI information may include latitude and longitude information indicating the location of each POI, a name, image information including a representative image, contact information, category information, other text information, etc.

[0113] According to various embodiments, in operation 803, the electronic device 101 or 300 may select a focus POI based on the acquired surrounding POI information. In addition, the electronic device 101 or 300 may also select an advertising POI. The focus POI may be a POI that is determined to be of greater interest to the user than a general POI. An advertising POI may be a POI that contains advertisements and / or event information. According to one embodiment, the electronic device 101 or 300 may select a POI that contains advertisements and / or event information as an advertising POI based on the acquired POI information. An advertising POI may be selected to be distinguished from a general POI or a focus POI, but may be a general POI or a focus POI and an advertising POI.

[0114] According to various embodiments, the electronic device 101 or 300 may select a focus POI based on various criteria. According to an embodiment, the electronic device 101 or 300 may configure a focus area near a place that is easily accessible to the user, and may select all POIs in the focus area as focus POIs. In another embodiment, the electronic device 101 or 300 may select a focus POI based on the direction in which the camera module 350 shoots, the distance to the POI, the viewing angle of the camera, etc. In another embodiment, the electronic device 101 or 300 may select a POI that the user has previously visited or a POI for which the user has previously searched for information as a focus POI. According to another embodiment, the electronic device 101 or 300 may select a focus POI based on the user's past usage history, behavior, etc. According to another embodiment, the electronic device 101 or 300 may select a focus POI based on a user's preset preferences. For example, in the case where a restaurant has the user's highest preference, the electronic device 101 or 300 may select a restaurant-related POI as a focus POI. In another embodiment, the electronic device 101 or 300 may select the focus POI based on a combination of the above selection conditions.

[0115] According to various embodiments, the electronic device 101 or 300 can arrange the surrounding POIs obtained for selecting the focus POI according to the above conditions. In one embodiment, when the focus POI is selected according to the distance, the distance between the current position of the electronic device 101 or 300 and each POI can be obtained based on the position information of the surrounding POIs, the surrounding POIs can be arranged according to the distance, and the surrounding POIs within a predetermined distance can be selected as the focus POI.

[0116] According to various embodiments, when the position of the electronic device 101 or 300 changes, the electronic device 101 or 300 may newly select a focus POI. According to an embodiment, when the position of the electronic device 101 or 300 changes, the distance and angle to each POI may be newly calculated and acquired. Therefore, since the POI corresponding to the focus POI may be changed, the POI corresponding to the focus POI may be newly selected.

[0117] According to various embodiments, when the shooting direction of the electronic device 101 or 300 is changed, a focus POI may be newly selected. When the shooting direction of the electronic device 101 or 300 is changed, the POI displayed on the preview screen by shooting may be changed. Therefore, a focus POI may be newly selected among the POIs included in the current preview screen. When the shooting direction of the electronic device 101 or 300 is changed, a specific POI may be changed from a focus POI to a general POI, or from a general POI to a focus POI.

[0118] According to various embodiments, in operation 805, the electronic device 101 or 300 may configure the display (eg, Figure 1 The display device 160 or Figure 3 The display position and information of each POI displayed on the screen of the display 330 of the electronic device 101 or 300. In an embodiment, the display position of each POI may be a position corresponding to the actual position in the preview video captured by the camera module 350 and displayed on the screen. According to another embodiment, a partial area of ​​the screen on which the preview video is displayed may be configured as a focus area, a focus POI may be displayed in the focus area, and a general POI may be displayed outside the focus area. In addition, the electronic device 101 or 300 may configure the display position to be closer to the bottom of the screen for a POI close to the current position of the electronic device 101 or 300, and may configure the display position to be biased towards the top of the screen for a POI far from the current position of the electronic device 101 or 300.

[0119] According to various embodiments, the electronic device 101 or 300 may be configured to provide different information for general POIs and focus POIs. According to an embodiment, the electronic device 101 or 300 may use the category of the corresponding POI to configure the information provided for the general POI. On the other hand, compared with the general POI, the electronic device 101 or 300 may be configured to provide more information for the focus POI. According to an embodiment, the electronic device 101 or 300 may configure the focus POI to provide information of at least one of the related image, name, distance, star and rating. In addition, according to another embodiment, the electronic device 101 or 300 may configure the information provided for each focus POI differently based on past usage history, behavior, etc., even for the focus POI.

[0120] According to various embodiments, the display positions of multiple POIs may overlap due to conditions such as the amount of surrounding POI information, the size of the display screen, the viewing angle of the camera, etc., making it difficult to display all overlapping POIs on one screen at the same time. Therefore, the electronic device 101 or 300 may consider conditions such as the viewing angle of the camera, the size of the display, the user interface (UI), etc., configure the display positions of all surrounding POIs as described above, and may group POIs whose display positions overlap to generate a POI group. A POI group may refer to a POI cluster bound by a specific standard. In particular, in the case where the distance between POIs is short, it is difficult to distinguish and display multiple POIs on the screen due to the space limitation of the screen of the display, so the electronic device 101 or 300 may group multiple POIs into a single POI group to display the POI group. According to an embodiment, the electronic device 101 or 300 may define a POI group by grouping POIs having similar numerical values ​​obtained using the distance, angle, etc. between POIs into a POI group. The electronic device 101 or 300 may configure the display position of the POI group based on a representative POI, and may allow the user to access the information of other POIs included in the POI group by using the representative POI as an interface. The electronic device 101 or 300 may determine the representative POI based on the POI information acquired in operation 801, or may determine the representative POI based on the user's usage habits, preferences, etc. According to an embodiment, the electronic device 101 or 300 may determine the POI closest to the current position of the electronic device 300 as the representative POI among the POIs included in the POI group. According to another embodiment, the electronic device 101 or 300 may determine the POI with the highest rating as the representative POI based on the acquired surrounding POI information. In another embodiment, when the user prefers the restaurant category, the electronic device 101 or 300 may determine the POI included in the category as the representative POI. The electronic device 101 or 300 may configure the representative information of each POI group generated based on a predetermined standard and the display position for displaying each POI group on the screen as the information and display position of the representative POI.

[0121] According to various embodiments, in operation 807, the electronic device 101 or 300 may display the POI information and the preview video shot by the camera module 350 on the screen. According to an embodiment, the electronic device 101 or 300 may display the display position and information of each POI or POI group configured in operation 805 on the preview video together. According to an embodiment, in the case of a general POI, the electronic device 101 or 300 may display the POI information by displaying an icon corresponding to the category of the POI at the display position determined in operation 805. In addition, in the case of a focus POI, the electronic device 101 or 300 may display a UI including the information configured at the display position determined in operation 805 (e.g., at least one of an image, a name, a location, a star, and a rating). According to another embodiment, in the case of a general POI group, the electronic device 101 or 300 may display an icon corresponding to the category of the representative POI at the display position determined for the representative POI in operation 805. In addition, in the case of a focus POI group, the electronic device 101 or 330 may display a UI including information configured for the representative POI at the display position determined for the representative POI in operation 805. In the case of a focus POI or a focus POI group, the display position may be within the focus area of ​​the screen. In addition, in the case of an advertising POI, the electronic device 101 or 300 may display a UI including information configured at the display position determined in operation 805. The configuration information of the advertising POI may necessarily include advertisement and / or event information.

[0122] According to various embodiments, the electronic device 101 or 300 may display a UI including information related to a representative POI on the screen, and may provide information of other POIs included in the same POI group through an additional interface with the user. According to an embodiment, when the electronic device 101 or 300 detects a left / right scroll operation of the user, the electronic device 101 or 300 may display information of other POIs in the same POI group on the screen of the display 330.

[0123] According to various embodiments, the electronic device 101 or 300 may configure the size of the UI displayed for each POI or POI group differently. According to an embodiment, the electronic device 101 or 300 may change the size of the icon or UI according to the distance from the current location of the electronic device 101 or 300, and the electronic device 101 or 300 may display the corresponding information. The electronic device 101 or 300 may display a nearby POI using an icon or UI having a relatively large size, and may display a distant POI using an icon or UI having a relatively small size.

[0124] According to various embodiments, the electronic device 101 or 300 may gradually change the UI to indicate that the POI is changed from a general POI to a focus POI or from a focus POI to a general POI according to a change in the shooting direction. In an embodiment, when a change occurs from a general POI to a focus POI, the icon may be changed to a UI including information of the corresponding POI while gradually expanding. In another embodiment, when a change occurs from a focus POI to a general POI, the UI including information of the corresponding POI may eventually be changed to an icon while gradually shrinking.

[0125] Fig. 9 is a flowchart 900 illustrating another example of an operation of displaying surrounding information of an electronic device according to various embodiments on a display screen. Fig. 9 The operation object of the flowchart 900 shown can be understood as an electronic device (for example, Figure 1 The electronic device 101 or Figure 3 electronic device 300) or a processor of the electronic device (e.g., Figure 1 The processor 120 or Figure 3 processor 310).

[0126] According to various embodiments, in operation 901, the electronic device may send its current location to a CP server (eg, Figure 1 When a user wishes to obtain information about a nearby location by starting to shoot or driving an application provided in the electronic device, the electronic device may use a GPS module (e.g., Figure 3 The GPS module 370) obtains its current location and can send the obtained current location to the CP server.

[0127] According to various embodiments, in operation 903, the electronic device may receive surrounding POI information from the CP server. The surrounding POI may refer to a POI within a predetermined distance from the current location of the electronic device. In an embodiment, the predetermined distance may be configured in the CP server. In another embodiment, the predetermined distance may be configured in the electronic device. When sending the current location to the CP server, the electronic device may also send a pre-configured predetermined distance. In this case, the predetermined distance may be configured by receiving input from the user.

[0128] According to various embodiments, the surrounding POIs received from the CP server may be arranged based on the current location of the electronic device in operation 905. The electronic device may acquire the distance and direction of each POI based on the location information of the POI list relative to the current location of the electronic device received from the CP server, and may arrange the POIs in order of distance.

[0129] According to various embodiments, in operation 907, the electronic device may configure the display position of each POI based on the current position of the electronic device, the direction in which the preview video is shot, and the distance and direction of each POI acquired. In an embodiment, the electronic device may configure the display position of the POI whose actual position is included in the preview video. The electronic device may not configure the display position of some POIs whose actual positions are not included in the preview video in the preview video by comparing the direction in which the preview video is shot and the acquisition direction of the POI.

[0130] According to various embodiments, in operation 909 , the electronic device may determine whether the display position of each POI is within the focus area.

[0131] According to an embodiment, the focus area may be arbitrarily designated by the electronic device, or may be designated based on user input. Figure 4 In an embodiment of the present invention, the lower center portion of the screen may be designated as a focus area. The electronic device may distinguish POIs into focus POIs and general POIs. In addition, advertising POIs may be distinguished. A focus POI may be a POI that a user determines to be more interesting than a general POI. An advertising POI may be a POI that includes advertisements and / or event information. Therefore, the electronic device may select a POI that includes advertisements and / or event information as an advertising POI. Various conditions may be provided for selecting a focus POI. A focus POI may be configured with a display position within a designated focus area of ​​the screen.

[0132] According to various embodiments, if the display position of the POI is within the focus area determined based on operation 909, in operation 911, information related to the corresponding POI to be displayed may be configured. In one embodiment, the corresponding POI may be configured to display information for at least one of a POI-related image, distance, name, star rating, and rating, but is not limited thereto. If the corresponding POI includes advertisement and / or event information (i.e., an advertising POI), the advertisement and / or event information may be configured as information to be displayed. In operation 913, a UI including the information to be displayed configured in operation 911 may be displayed at the display position determined in operation 907 on a preview screen captured by a camera.

[0133] According to various embodiments, if the display position of the POI is outside the focus area based on the determination in operation 909, then in operation 915, the category of the POI can be acquired, and in operation 917, an icon corresponding to the category of the POI acquired in operation 915 can be displayed at the display position determined in operation 907 on the preview screen captured by the camera.

[0134] When displaying the POI information of the electronic device through the above operations 911 to 917, the electronic device should consider the camera (eg, Figure 3 The camera module 350 of the electronic device) and the viewing angle of the camera currently photographed. In an embodiment, in operation 905, the direction of each POI can be indicated with an absolute orientation. With respect to the current position of the electronic device, the direction of the POI existing on the due north side can be configured to 0 degrees, the direction of the POI on the due east side can be configured to 90 degrees, the direction of the POI on the due south side can be configured to 180 degrees, and the direction of the POI on the due west side can be configured to 270 degrees. In addition, if the shooting direction of the camera is on the due south side and the viewing angle of the camera is 60 degrees, the POI whose direction is between 150 degrees and 210 degrees can be located and displayed in the preview video taken by the camera. Since other POI directions are outside the preview video, POIs with other POI directions may not be displayed on the screen.

[0135] Fig.10 1000 is a flowchart illustrating an example of an operation of displaying surrounding information of an electronic device on a display screen in consideration of a POI group according to various embodiments. Fig.10 The operation object of the flowchart 1000 shown in FIG. 1 can be understood as an electronic device (eg, Figure 1 The electronic device 101 or Figure 3 electronic device 300) or a processor of the electronic device (e.g., Figure 1 The processor 120 or Figure 3 processor 310).

[0136] exist Fig.10 In the flowchart of FIG. 1 , operations 901 to 917 can be performed with Fig. 9 The flowchart of is described in the same manner, but after operation 907, an operation of generating a POI group may be added.

[0137] A POI group may refer to a cluster of POIs bound by a specific standard. In an embodiment, among the POIs belonging to the focus POI, POIs having almost the same display position on the screen may be configured as a POI group. In particular, in a case where the distance between POIs is short, since it is difficult to distinguish and display many POIs on the screen due to screen space limitations, many POIs may be grouped into a single POI group to display the POI group. In an embodiment, POIs with similar values ​​may be clustered into POI groups using the distance and direction between the POIs. When a POI group is displayed according to operations 911 to 917, the POI group may be displayed on the screen based on a representative POI.

[0138] According to various embodiments, in operation 1001, the electronic device may determine whether a POI group may be generated. In one embodiment, it may be determined whether a POI group may be generated by configuring a POI group generation condition and determining whether there are POIs that meet the generation condition. For example, POIs within a distance of 2 m between POIs may be generated as a POI group. In another embodiment, POIs in the same building may be generated as a POI group.

[0139] If the POI group cannot be generated, operation 909 may be performed immediately. If the POI group can be generated, in operation 1003, the POI group may be generated by grouping POIs that meet the above conditions.

[0140] According to various embodiments, in operation 1005, a representative POI of each POI group may be selected. The representative POI may be determined based on each piece of POI information included in the POI group or based on the user's usage habits and preferences. According to an embodiment, the electronic device may select the POI closest to its current location as the representative POI. According to another embodiment, the electronic device may configure the POI with the highest rating among the POIs of the category with the highest preference as the representative POI.

[0141] Furthermore, operations 909 to 917 may be performed based on information of a representative POI of the POI group.

[0142] According to various embodiments, Fig.10 In operation 909 , the electronic device may determine whether a display position of a representative POI of each POI group is within the focus area.

[0143] According to various embodiments, if the display position of the representative POI of the POI group is within the focus area based on the determination of operation 909, information related to the representative POI to be displayed may be configured in operation 911. In an embodiment, at least one of a representative POI-related image, a distance, a name, a star, and a rating may be configured as the information to be displayed, but is not limited thereto. In operation 913, a UI including information to be displayed about the representative POI configured in operation 911 may be displayed at the display position of the representative POI determined in operation 907 on a preview screen captured by a camera.

[0144] According to various embodiments, if the display position of the representative POI is outside the focus area based on the determination in operation 909, the category of the corresponding representative POI may be acquired in operation 915, and in operation 917, an icon corresponding to the category of the POI acquired in operation 915 is located at the display position of the representative POI determined in operation 907 on the preview screen captured by the camera.

[0145] According to various embodiments of the present disclosure, by using the above method or an application for implementing the above method, location information can be provided so that the location information can be found more easily by displaying the location information on a screen captured by a user. In addition, according to the method, by providing information related to the corresponding location in addition to the simple location, when the user wants to select one of the various locations, additional information for selection can be provided.

[0146] According to various embodiments, an electronic device (e.g., Figure 1 The electronic device 101 or Figure 3 The operation method of the electronic device 300 may include: obtaining a signal received by a camera module (eg, Figure 3 The invention relates to a method for providing a preview video captured by a camera module 350 of the electronic device; obtaining location information of the electronic device; obtaining information about at least one POI located nearby based on the location information; selecting a focus POI among the at least one POI based on the information about the at least one POI; determining first information to be provided to a user for general POIs, the general POIs including the remaining POIs among the at least one POI except the selected focus POI; determining second information to be provided to the user for the focus POI including more information than the first information; determining a position on a screen providing a preview video, wherein information about the at least one POI is to be displayed in the preview video; and displaying to provide the first information or the second information at the position of the screen providing the determined preview video of all or some of the at least one POI.

[0147] According to various embodiments, the method may further include: selecting a POI among at least one POI, in which information about at least one POI includes advertisement and / or event information, as an advertising POI; determining third information to be provided to the user for the advertising POI, wherein the third information is the advertisement and / or event information; and displaying the third information at a position on the screen where the determined preview video is provided for the advertising POI.

[0148] According to various embodiments, displaying to provide the first information or the second information may include: selecting some POIs to be displayed on the screen providing the preview video from among at least one POI based on the direction in which the camera module shoots the preview video and the viewing angle of the camera module; and displaying to provide the first information or the second information at the position of the screen providing the determined preview video of each of the selected POIs.

[0149] According to various embodiments, selecting the focus POI among the at least one POI may include: configuring a partial area in the preview video as the focus area; and configuring a POI whose actual location is included in the focus area as the focus POI.

[0150] According to various embodiments, selecting a focus POI among at least one POI may include: determining a distance between the electronic device and each POI based on location information of the electronic device and location information of each POI included in information about the at least one POI; and based on the determined distance between the electronic device and each POI, selecting a POI in which the distance between the electronic device and the POI is within a predetermined value as the focus POI.

[0151] According to various embodiments, determining a position on the screen may include: designating a portion of the screen where a preview video is provided as a focus area; and determining a position within the designated focus area using a position on the screen where a preview video is provided where information about a focus POI will be displayed.

[0152] According to various embodiments, the method may further include: configuring POIs within a predetermined distance from each other as a POI group based on position information of each POI included in the information about the at least one POI or a position on a screen where the information about the at least one POI is to be displayed; and selecting a representative POI among the POIs in the POI group, wherein displaying to provide the first information or the second information includes displaying to provide the information about the representative POI to a position on the screen where a determined preview video of the representative POI representing the POI group is provided.

[0153] According to various embodiments, the first information may be a category of the POI, and the second information may include at least one of an image, a name, and a distance from the current location of the electronic device related to the POI, and displaying to provide the first information or the second information may include displaying an icon corresponding to the category as a display for providing the first information; and displaying a UI including the second information as a display for providing the second information.

[0154] According to various embodiments, an electronic device (e.g., Figure 1 The electronic device 101 or Figure 3 The operation method of the electronic device 300 may include: sending a signal to a CP server (eg, Figure 1The method comprises the steps of: sending the location information of the electronic device to a server 108); acquiring information about at least one POI located nearby from the CP server; arranging at least one POI according to the distance from the electronic device based on the location information of the electronic device; configuring the display position of each POI in at least one POI based on the location of the electronic device and the shooting direction of a preview video of the electronic device; when the display position is a focus POI within a configured focus area, configuring information to be displayed related to the focus POI, and displaying a UI including the configured information at the configured display position on a screen displaying a preview video; and when the display position is a general POI outside the configured focus area, acquiring category information of the general POI, and displaying an icon corresponding to the category information at the configured display position on a screen displaying a preview video.

[0155] According to various embodiments, the method may further include: determining whether a POI group including at least one POI displayed as one on a preview video screen can be generated; and when the POI group can be generated, generating the POI group and selecting a representative POI of each POI group, wherein displaying a UI including configured information includes displaying a UI including configuration information of the representative POI at a configured display position of the representative POI on the screen displaying the preview video, and displaying icons corresponding to categories includes displaying icons corresponding to categories of the representative POI at a configured display position of the representative POI on the screen displaying the preview video.

[0156] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0157] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0158] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0159] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.

[0160] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) The computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0161] According to various embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to various embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0162] Although the present disclosure has been described with various embodiments, various changes and modifications may be suggested to one skilled in the art. The present disclosure is intended to encompass such changes and modifications as fall within the scope of the appended claims.

Claims

1. An electronic device, include: a communication module configured to perform communication with an external device; a camera module configured to capture still images and video; at least one processor configured to be operably connected to the communication module and the camera module; and at least one memory configured to be operably connected to the at least one processor, The at least one memory stores instructions, which, when executed, are used to cause the at least one processor to: acquiring a preview video shot by the camera module by controlling the camera module, obtaining location information of the electronic device, acquiring information about at least one point of interest (POI) located nearby based on the location information, selecting a focus POI among the at least one POI based on the information about the at least one POI, determining first information to be provided to the user for general POIs among the at least one POI, the general POIs including remaining POIs except the selected focus POI, determining second information to be provided to the user for the focus POI, wherein the second information contains more information than the first information, determining a position on the screen at which to display a preview video in which information about the at least one POI is provided, and displaying the first information or the second information at a determined position on the screen where a determined preview video of all or some of the at least one POI is provided, The instructions further cause the at least one processor to: configuring POIs whose distances are within a predetermined distance from each other as a POI group based on position information of each POI included in the information about the at least one POI or a position on a screen on which the information about the at least one POI will be displayed; selecting a representative POI among the POIs within the POI group based on the information about the at least one POI or a user preference; and Information about the representative POI is displayed on a screen at a position of the representative POI representing the POI group.

2. The electronic device according to claim 1, in, The instructions further cause the at least one processor to: selecting, from among the at least one POI, a POI including advertisement and / or event information in information about the at least one POI as an advertising POI; Determining third information to be provided to the user for the advertisement POI, wherein the third information includes the advertisement and / or event information; and The third information is displayed at a position on the screen where the determined preview video is provided for the advertising POI.

3. The electronic device according to claim 1, in, The instructions further cause the at least one processor to: selecting some POIs to be displayed on a screen providing the preview video among the at least one POI based on a direction in which the camera module photographs the preview video and a viewing angle of the camera module; and The first information or the second information is displayed at a position of a screen providing the determined preview video of each of the selected some POIs.

4. The electronic device as claimed in claim 1, in, The instructions further cause the at least one processor to: configuring conditions corresponding to the focus POI; and A POI in which the information about the at least one POI satisfies a condition corresponding to the focus POI is selected as the focus POI.

5. The electronic device as claimed in claim 4, in, The instructions further cause the at least one processor to: configuring a partial area in the preview video as a focus area; and A POI whose actual position is included in the focus area is configured as the condition corresponding to the focus POI.

6. The electronic device as claimed in claim 4, in, The instructions further cause the at least one processor to: determining a distance between the electronic device and each POI as the condition corresponding to the focus POI based on the location information of the electronic device and location information of each POI included in the information about the at least one POI; and POIs are configured in which a distance between the electronic device and the POI is within a predetermined value based on a distance determined between the electronic device and each POI.

7. The electronic device as claimed in claim 4, in, The instructions further cause the at least one processor to configure a POI with high preference as the condition corresponding to the focus POI based on user preferences configured according to user behavior, the POI with high preference including a POI that the user has previously visited or a POI for which the user has previously searched for information.

8. The electronic device as claimed in claim 1, in, The instructions further cause the at least one processor to: designating a portion of the screen where the preview video is provided as a focus area; and The second information for the focus POI is displayed to be provided within the focus area.

9. The electronic device as claimed in claim 1, in, The instructions further cause the at least one processor to: Determining that the first information is the category of the POI; determining that the second information includes at least one of an image, a name, or a distance from a current location of the electronic device related to the POI; displaying an icon corresponding to the category to provide the first information; as well as A user interface (UI) including the second information is displayed to provide the second information.

10. A method for operating an electronic device, include: Get the preview video shot by the camera module; Acquiring location information of the electronic device; acquiring information about at least one POI located nearby based on the location information; selecting a focus POI among the at least one POI based on the information about the at least one POI; Determining first information to be provided to the user for general POIs among the at least one POI, the general POIs including remaining POIs except the selected focus POI; determining second information including more information than the first information to be provided to the user for the focus POI; determining a location on a screen at which to display a preview video, wherein information about the at least one POI is provided in the preview video; as well as displaying the first information or the second information at a determined position of a screen providing a determined preview video of all or some of the at least one POI, The operation method further includes: configuring POIs whose distances are within a predetermined distance from each other as a POI group based on position information of each POI included in the information about the at least one POI or a position on a screen on which the information about the at least one POI will be displayed; selecting a representative POI among the POIs within the POI group based on the information about the at least one POI or a user preference; and Information about the representative POI is displayed on a screen at a position of the representative POI representing the POI group.

11. The operating method according to claim 10, further comprising: include: selecting, from among the at least one POI, a POI including advertisement and / or event information in information about the at least one POI as an advertising POI; Determining third information to be provided to the user for the advertisement POI, wherein the third information includes the advertisement and / or event information; as well as The third information is displayed at a location on the screen where the determined preview video is provided for the advertising POI.

12. The operating method according to claim 10, in, Displaying to provide the first information or the second information includes: selecting some POIs to be displayed on a screen providing the preview video among the at least one POI based on a direction in which the camera module shoots the preview video and a viewing angle of the camera module; and The first information or the second information is displayed at a position of a screen providing the determined preview video of each of the selected some POIs.

13. A method for operating an electronic device comprising a screen, include: Sending the location information of the electronic device to a content provider (CP) server; acquiring information about at least one POI located nearby from the CP server; arranging the at least one POI according to a distance from the electronic device based on the location information of the electronic device; configuring a display position of each POI in the at least one POI based on the position of the electronic device and a preview video shooting direction of the electronic device; When the display position is a focus POI within the configured focus area, configuring information to be displayed related to the focus POI, and displaying a UI including the configured information at the configured display position on the screen displaying the preview video; When the display position is a general POI outside the configured focus area, acquiring category information of the general POI, and displaying an icon corresponding to the category information at the configured display position on the screen displaying the preview video, determining whether a POI group including at least one POI displayed as a display on the preview video can be generated; as well as When it is determined that the POI group can be generated, generating the POI group; as well as A representative POI of each POI group is selected based on the information about the at least one POI or a user preference.

Citation Information

Patent Citations

  • Apparatus and method for providing real estate augmented reality services

    KR101921743B1

  • Terminal to provide augmented reality

    US20120223966A1