Method and apparatus for providing augmented content through augmented reality view based on preset unit space

Abstract

Provided are a method and apparatus for providing augmented content through an augmented reality view based on a predetermined unit space.SOLUTION: One or more example embodiments also provide a method of providing augmented content, the method including determining whether a user terminal is located in a preset unit space based on a location of the user terminal, and augmenting and displaying content associated with the unit space in an image captured by a camera through an augmentedreality (AR) view in response to the user terminal being determined to be located in the unit space.SELECTED DRAWING: Figure 1a

Description

[Technical Field]

[0001] The following description relates to a method and apparatus for extending and providing content (content or content items) to an image using an augmented reality view, and more particularly to a method and apparatus for extending and providing content associated with a predetermined unit space to an augmented reality view image based on the predetermined unit space. [Background technology]

[0002] Augmented reality (AR) is a technology that integrates computer-generated virtual objects and information into the real world. AR is a technology that displays virtual content in an augmented real-world environment, allowing users to view augmented content in response to the real-world environment using electronic devices.

[0003] In a user terminal, which is a user's electronic device, content related to objects present within a certain distance or radius based on the location of the user terminal is augmented and provided to the user terminal's image. If augmented content is provided based on the physical distance from the user terminal, unnecessary content may be augmented, increasing the cognitive load on the user and the load on the user terminal. Furthermore, inappropriate content that does not match the service desired by the user may be augmented to the user terminal.

[0004] As an example of technology related to various services that utilize augmented reality technology, Korean Patent Publication No. 10-2014-0065963 (published on May 30, 2014) discloses an augmented reality navigator that displays an image of the driving route captured by a camera installed in a vehicle on a display, and maps virtual display information that guides the driving route onto the image displayed on the display.

[0005] The above description is merely intended to aid in the understanding of the present invention and may include material that does not form part of the prior art, or that the prior art may suggest to one skilled in the art. Summary of the Invention [Problem to be solved by the invention]

[0006] Provided is a method for providing extended content that is extended to an image by an AR view including an image captured by a camera of a user terminal, and that, when the user terminal is located in a preset unit space, allows only content associated with the unit space to be extended to the image and provided.

[0007] Provided is a method for determining whether a user terminal is located in a preset unit space, and if the user terminal is located in the preset unit space, changing application settings to provide an AR view based on attributes of the unit space (e.g., indoors or outdoors).

[0008] The present invention provides a method for filtering content to be expanded and displayed in an AR view by determining whether a user terminal enters or exits a preset unit space, and for changing the display of the unit space that the user terminal enters or exits in a map view provided together with the AR view. [Means for solving the problem]

[0009] According to one aspect, an augmented content providing method executed by a computer system that is a server or a user terminal includes a step of determining whether the user terminal is located in a predetermined unit space based on the position of the user terminal, and a step of extending and displaying at least one content associated with the unit space into an image using an augmented reality (AR) view including an image captured by a camera of the user terminal when it is determined that the user terminal is located in the unit space.

[0010] The unit space may be independent of the position of the user terminal or the distance from the user terminal, and may be predefined as at least a portion of a space in which the user terminal moves, and the content may be mapped to at least one object within the unit space.

[0011] The unit space may be defined as a layer on a map for the space, corresponding to a service target area in which a service including the content is provided within the space, and the content may be associated with the layer.

[0012] The unit space is predefined as at least a portion of a three-dimensional space within the space, and the determining step may determine whether the user terminal is located in the unit space, which is the three-dimensional space, based on the position of the user terminal, including the height of the user terminal.

[0013] A plurality of unit spaces including the unit space may be defined in the space in which the user terminal moves, and in the displaying step, content associated with other unit spaces adjacent to the unit space, content associated with other unit spaces existing within a predetermined radius from the position of the user terminal, or content associated with objects other than the unit space existing within a predetermined radius from the position of the user terminal may not be extended and displayed in the image, but only at least one content associated with the unit space in which it is determined that the user terminal is located may be extended and displayed in the image.

[0014] The determining step may include a step of determining that the user terminal has entered the unit space, and the displaying step may include extending and displaying the content filtered as content associated with the unit space when the user terminal has entered the unit space in the image, and the extended content providing method may further include a step of determining whether the user terminal has departed from the unit space based on a position of the user terminal.

[0015] The step of determining whether the user terminal has entered the unit space may determine that the user terminal has entered the unit space if coordinates corresponding to the position of the user terminal are included within the unit space, and the step of determining whether the user terminal has departed from the unit space may determine that the user terminal has departed from the unit space if coordinates corresponding to the position of the user terminal are not included within the unit space.

[0016] The method for providing extended content, wherein the step of determining whether the user terminal has entered the unit space determines that the user terminal has entered the unit space if it is determined that the user terminal has passed a first node predefined in association with the unit space based on the location of the user terminal, and the step of determining whether the user terminal has departed from the unit space determines that the user terminal has departed from the unit space if it is determined that the user terminal has passed a second node predefined in association with the unit space based on the location of the user terminal.

[0017] The method for providing extended content may further include, when it is determined that the user terminal has deviated from the unit space and moved to another unit space among the plurality of unit spaces, stopping the content from being extended and displayed on the image, and extending and displaying at least one other content associated with the other unit space on the image.

[0018] The enhanced content providing method may further include changing settings of an application installed on the user terminal to display the AR view when it is determined that the user terminal is located in the unit space, and the application settings may include at least one of changing display settings of the content, changing display settings of a user interface associated with the AR view, and changing display settings of a map associated with the AR view.

[0019] The step of changing the application settings may include changing the application settings to display the content relatively larger and the scale of the map relatively smaller if the unit space determined to be where the user terminal is located is an outdoor space, and changing the application settings to display the content relatively smaller and the scale of the map relatively larger if the unit space determined to be where the user terminal is located is an indoor space.

[0020] The unit space may be associated with a plurality of contents, and the displaying step may include, when it is determined that the user terminal is located in the unit space, extending and displaying, based on the position of the user terminal, content among the plurality of contents that is mapped to an object located within a predetermined distance from the position of the user terminal or within a predetermined radius from the position of the user terminal, in the image.

[0021] The augmented content providing method may further include a step of displaying a map view including a map matched to the image together with the AR view, and the map displayed as the map view may include the location of the user terminal, the unit space, and the content or an object to which the content is mapped.

[0022] The displaying of the map view may include displaying an area of ​​the map corresponding to the unit space in which it is determined that the user terminal is located so as to be visually separated from the remaining area.

[0023] The displaying of the map view may include displaying a boundary between the area corresponding to the unit space and the remaining area in three dimensions, and highlighting the area corresponding to the unit space compared to the remaining area.

[0024] In the space in which the user terminal moves, a plurality of unit spaces are defined, including a first unit space and a second unit space at least partially contained in the first unit space, and the unit space may be the first unit space or the second unit space.

[0025] The second unit space is a sub-unit space of the first unit space, and when the unit space is the second unit space, the displaying step may include extending and displaying at least one content associated with the second unit space and at least one content associated with the first unit space in the image when it is determined that the user terminal is located in the second unit space.

[0026] In another aspect, a computer system for realizing a user terminal or a server includes at least one processor configured to execute computer-readable instructions contained in a memory, wherein the at least one processor determines whether the user terminal is located in a predetermined unit space based on the position of the user terminal, and when it is determined that the user terminal is located in the unit space, the computer system extends and displays at least one content associated with the unit section into the image using an AR (Augmented Reality) view including an image captured by a camera of the user terminal. [Effects of the Invention]

[0027] By pre-setting a unit space as a layer on a map corresponding to a service target area and filtering content related to the unit space and providing it as an AR view when a user device is located in the pre-set unit space, unnecessary display of augmented content can be prevented compared to providing augmented content based on the physical distance from the user device, thereby reducing the cognitive load on the user and the load on the user device.

[0028] Since only the content of the service provided by this unit space can be provided to the user terminal as extended content related to the unit space into which the user terminal has entered, meaningful content can be provided to the user.

[0029] The application settings for providing an AR view can be appropriately changed depending on the attributes of the pre-defined unit space in which the user terminal is located (e.g., indoors or outdoors), so that the display of the map view for this unit space can be dynamically changed in relation to the unit space into which the user terminal enters. [Brief explanation of the drawings]

[0030] [Figure 1a] 10A and 10B are diagrams illustrating an extended content providing method for extending and displaying content in an AR view image based on a preset unit space according to an embodiment. [Figure 1b] FIG. 1b shows a detailed view of the map on the screen of the user terminal of FIG. 1a; [Figure 2] 1 illustrates a computer system and server for implementing an enhanced content delivery method in one embodiment. [Figure 3] 10 is a flowchart illustrating an extended content providing method for extending and displaying content in an AR view image based on a preset unit space according to an embodiment. [Figure 4] 10 is a flowchart illustrating a method for changing the display of content in an AR view and / or application settings by determining whether a user terminal has deviated from a unit space, in one example. [Figure 5] 1 is a flowchart illustrating a method for displaying a map view in one example. [Figure 6] FIG. 10 is a diagram illustrating a method for setting a unit space and mapping content to the unit space in an example. [Figure 7] FIG. 10 illustrates a method for setting unit spaces having overlapping and / or hierarchical relationships in one example. [Figure 8] FIG. 10 is a diagram illustrating a method for determining whether a unit space has been entered based on a preset node in one example. [Figure 9] FIG. 10 illustrates a method for providing enhanced content in accordance with the movement of a user terminal within a unit space in one example. [Figure 10] FIG. 10 is a diagram illustrating a method for changing settings of an application installed on a user terminal according to attributes of a unit space in an example. [Figure 11] FIG. 1 illustrates a method for displaying a map of a space in which a user terminal moves, in one example. [Figure 12a] FIG. 10 is a diagram illustrating a method for providing an AR view and a map view on a user terminal by the user terminal entering a unit space in one example. [Figure 12b] 12b shows a detailed view of the map on the screen of the user terminal of FIG. 12a; [Figure 13a] 1 is a diagram illustrating a method for defining a unit space corresponding to a semantic range for providing extended content for a space, according to an example. [Figure 13b] 10 is a diagram illustrating a method for defining a unit space corresponding to a semantic range for providing extended content for a space in one example. DETAILED DESCRIPTION OF THE INVENTION

[0031] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings.

[0032] The embodiment relates to an extended content providing method for providing a location-based AR service by extending and displaying content of a service desired by a user in an AR view image using an AR view displayed on a user terminal 100. In the following detailed description, the content extended and displayed in an image will be referred to as "extended content."

[0033] In embodiments, a "space" associated with providing augmented content may refer to an indoor space and / or an outdoor space. In other words, the spaces and unit spaces described below may be defined as spaces that include indoor locations or outdoor locations, or may be defined as composite spaces that combine indoor and outdoor spaces.

[0034] In the following detailed description, for convenience of explanation, the location of the user who carries the user terminal 100 will be described as the location of the user terminal 100. Also, for convenience of explanation, the terms "user" and "user terminal 100" carried by the user will be used interchangeably.

[0035] In the detailed description below, "extending" content and / or information (e.g., indicators, etc.) onto a video may, in some embodiments, be interpreted as encompassing the display of content and / or information superimposed on the video / screen of the AR view.

[0036] FIG. 1a is a diagram illustrating a method for providing extended content in an AR view image based on a preset unit space in one embodiment, and FIG. 1b is a diagram illustrating in detail a map view on the screen of the user terminal of FIG. 1a.

[0037] As shown in the figure, a user terminal 100 such as a smartphone can capture images of its surroundings using a camera, and an AR view 10 containing the images captured by the camera can augment and display content 30 mapped to objects present in the space.

[0038] In an embodiment, based on the position of the user terminal 100, it may be determined whether the user terminal 100 is located within a preset unit space, and if it is determined that the user terminal 100 is located within the preset unit space, the content 30 associated with that unit space may be extended and displayed in the image of the AR view 10.

[0039] The "predetermined unit space" may be set in advance by the server 200. The server 200 (for example, a content providing server) may set at least a partial area of ​​the space 5 in which the user terminal 100 moves or a divided partial area of ​​the space 5 as the unit space. Such a unit space may be defined independently of the position of the user terminal 100 or the distance from the user terminal 100.

[0040] The space 5 may be an indoor space, an outdoor space, or a composite space including both indoor and outdoor spaces. The space 5 may be a service target area for providing services including content. Each unit space may be defined as a layer for such a space 5. A layer for the space 5 may be a layer on a map for the space 5.

[0041] As an example, as shown in the figure, unit spaces 1 to 4 may be defined in space 5.

[0042] The server 200 may associate at least one piece of content with each unit space. At least one object may be placed in the unit space, and the server 200 may associate the content with the unit space by mapping the content to the at least one object in the unit space. That is, the content may be associated with a layer corresponding to the unit space.

[0043] In the example shown in the figure, the user terminal 100 may display content 30 of object A by extending it into the video using the AR view 10, as a result of determining that the user terminal 100 is located in unit space 3. The content 30 may be associated with a preset unit space 3 and may be mapped to object A among the objects arranged in the unit space 3. In this way, in the embodiment, the content 30 associated with the unit space 3 in which it is determined that the user terminal 100 is located may be provided to the user terminal 100 as extended content.

[0044] In this case, the AR view 10 of the user terminal 100 displays the content 30 associated with unit space 3, but may not display content associated with other unit spaces (e.g., unit space 1 or unit space 4) that are physically close to the location of the user terminal 100 but where the user terminal 100 is not located, or content mapped to objects (e.g., objects X, Y, and Z) that are not within unit space 3. In other words, the content associated with unit space 1 or unit space 4 or the content mapped to objects X, Y, and Z does not need to be provided to the user terminal 100 located in unit space 3, which is separated by a wall within space 5.

[0045] In the embodiment, it is possible to prevent the display of unnecessary augmented content as described above by filtering only content related to the unit space 3 in which the user terminal 100 is located and displaying it as the AR view 10. This reduces the cognitive load on the user and the load on the user terminal.

[0046] The content 30 provides information about the object to which the content 30 is mapped. For example, the content 30 may include text, two-dimensional or three-dimensional images, and other multimedia content as information about the object. The content 30 may include an icon indicating the type or kind of object to which the content 30 is mapped.

[0047] As an example, if space 5 is a museum and unit spaces 1 to 4 correspond to exhibition rooms in the museum, the objects may correspond to items (exhibits, exhibits, relics, etc.) in the exhibition rooms, and content 30 may include information describing the item corresponding to object A. In the example shown in the figure, only content 30 mapped to object A is displayed in AR view 10, but at least one piece of content mapped to other objects (objects B to E) arranged in unit space 3 may also be displayed in AR view 10.

[0048] Along with the AR view 10, a map view 20 including a map mapped onto the image of the AR view 10 may be further displayed on the screen of the user terminal 100. The map view 20 may include a current location 50 of the user terminal 100. The map view 20 may include a 2D map or a 3D map. The map view 20 may include a unit space in which the user terminal 100 moves, content provided to the user terminal 100, or an object to which the content is mapped. Meanwhile, as shown in the figure, in the map view 20, an area corresponding to the unit space in which the user terminal 100 is located may be displayed so as to be visually separated from the remaining area.

[0049] The user terminal 100 may communicate with the server 200 to display the augmented content using the AR view 10 and the map view 20. The server 200 may provide the user terminal 100 with content 30 associated with the unit space in which the user terminal 100 is located in response to movement of the user terminal 100, and may provide the user terminal 100 with map information for displaying the map view 20 in response to movement of the user terminal 100.

[0050] As described above, the server 200 may be a server that defines and manages unit spaces for the space 5 and manages the registration, modification, deletion, etc. of content associated with each unit space. The server 200 may also be a map server that provides digital maps (3D maps and / or 2D maps).

[0051] A more specific method for setting the unit space by the server 200 and a specific method for determining whether the user terminal 100 has entered the unit space and providing the extended content to the user terminal 100 will be described in more detail with reference to Figures 2 to 13.

[0052] FIG. 2 illustrates a computer system and server that executes the enhanced content delivery method in one embodiment.

[0053] 1a and 1b may be realized by the computer system 100 shown in the figure. For example, a computer program for realizing the method of the embodiment may be installed and executed in the computer system 100, and such computer system 100 may perform the enhanced content providing method according to the embodiment under the control of the executed computer program.

[0054] The method for providing augmented content according to the embodiment may be executed through a PC-based program or a dedicated application for a mobile terminal. For example, the method for providing augmented content according to the embodiment may be implemented in the form of an independently operating program, or may be implemented in the form of an in-app for a specific application so as to be operable on the specific application. Such a specific application may be installed on the computer system 100 and may execute the method for providing augmented content according to the embodiment by providing the augmented content 30 through the AR view 10.

[0055] The computer system 100 is an electronic device corresponding to the above-described user terminal 100, and may be a smartphone or similar device capable of installing and executing an application or program, as shown in Figures 1a and 1b. The computer system 100 may also be a personal computer (PC), a laptop computer, a tablet, an Internet of Things (IoT) device, a wearable computer, or the like.

[0056] As shown, computer system 100 may include memory 110, processor 120, communication interface 130, and input / output interface 140 as components for performing the augmented content provision method.

[0057] Memory 110 is a computer-readable recording medium and may include random access memory (RAM), read-only memory (ROM), and a persistent mass storage device such as a disk drive. Here, a persistent mass storage device such as a ROM or a disk drive may be included in computer system 100 as a separate persistent storage device distinct from memory 110. Memory 110 may also store an operating system and at least one program code. Such software components may be loaded into memory 110 from a computer-readable recording medium separate from memory 110. Such separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, or a memory card. In other embodiments, software components may be loaded into memory 110 through communication interface 130, which is not a computer-readable recording medium. For example, software components may be loaded into memory 110 of computer system 100 based on a computer program installed by a file received over network 160.

[0058] Processor 120 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to processor 120 by memory 110 or by communication interface 130. For example, processor 120 may be configured to execute instructions received according to program code stored in a storage device such as memory 110.

[0059] That is, the processor 120 may manage the components of the computer system 100 and may execute programs or applications used by the computer system 100. For example, the processor 120 may be configured to execute an application for performing the augmented content providing method of the embodiment and process data received from the server 200 to provide the augmented content 30 via the AR view 10. The processor 120 may also process calculations required for executing the program or application and processing data, and may be at least one processor of the computer system 100 or at least one core within a processor.

[0060] The communication interface 130 may provide a function for the computer system 100 to communicate with other computer systems (not shown) via the network 160. For example, requests, instructions, data, files, etc. generated by the processor 120 of the computer system 100 in accordance with program code stored in a storage device such as the memory 110 may be transmitted to the computer system via the network 160 under the control of the communication interface 130. Conversely, signals, instructions, data, files, etc. from other computer systems may be received by the computer system 100 via the communication interface 130 of the computer system 100 via the network 160. The signals, instructions, data, etc. received via the communication interface 130 may be transmitted to the processor 120 or the memory 110, and files, etc. may be recorded on a storage device (such as the persistent storage device described above) that the computer system 100 may further include. The communication interface 130 may be a hardware module such as a network interface card, a network interface chip, or a networking interface port of the computer system 100, or a software module such as a network device driver or a networking program.

[0061] The input / output interface 140 may be a means for interfacing with the input / output device 150. For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display or speaker. As another example, the input / output interface 140 may be a means for interfacing with a device that integrates input and output functions into one, such as a touch screen. The input / output device 150 may be configured as a single device together with the computer device 100.

[0062] Also, in other embodiments, the computer system 100 may include more components than those shown in FIG. 2 . However, it is not necessary to explicitly illustrate most of the conventional components. For example, the computer system 100 may be implemented to include at least some of the input / output devices connected to the input / output interface 140 described above, or may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, a database, etc. As a more specific example, if the computer system 100 is implemented in the form of a mobile device such as a smartphone, the computer system 100 may further include various components typically included in a mobile device, such as a camera, an acceleration sensor, a gyro sensor, various physical buttons, buttons using a touch panel, input / output ports, and a vibrator for vibration. For example, the computer system 100 corresponding to the user terminal 100 may include a camera that captures the surroundings to execute the AR view 10. The computer system 100 may display an image captured by the camera as the AR view 10 and may display content 30 by extending the image of the AR view 10. For example, the computer system 100 may determine whether the computer system 100 is located in a preset unit space through positioning, and if the computer system 100 is located in the preset unit space, may display content 30 associated with the unit space by extending the image of the AR view 10. However, the actual operation of determining whether the computer system 100 is located in the preset unit space may be performed by the server 200, rather than the computer system 100.

[0063] Server 200 may be an electronic device that communicates with computer system 100, provides (augmented) content to computer system 100, and manages the augmented content. Server 200 is a device that manages (registers, modifies, deletes, stores, maintains, etc.) content and unit spaces associated with the content provided to computer system 100, and may include a database or communicate with such a database. Server 200 may also be or include a map server that provides digital maps (3D maps and / or 2D maps).

[0064] The server 200 may include at least one computer system. The computer system included in the server 200 includes a configuration similar to that of the computer system 100 described above, and therefore a duplicated description thereof will be omitted.

[0065] In an embodiment, the user terminal 100, which is a computer system 100, may communicate with the server 200 to provide the augmented content 30 through the AR view 10, and may augment and display the content 30 in a video through the AR view 10 based on data and / or information provided by the server 200. In this case, the server 200 may receive the location of the user terminal 100, determine whether the user terminal 100 is located within a unit space based on the received location, and, if the user terminal 100 is located within the unit space, provide the user terminal 100 with content associated with this unit space.

[0066] In the detailed description below, for convenience of explanation, the embodiment will be described focusing on the computer system 100 corresponding to the user terminal 100, but the description of communication with the server 200 and the operation on the server 200 side may be simplified or omitted.

[0067] Furthermore, in the following detailed description, for convenience of explanation, operations (steps) performed by the computer system 100 (or the components of the server 200 (e.g., a processor, etc.)) will be described as being performed by the computer system 100 (or the server 200).

[0068] The above description of the technical features given with reference to FIG. 1 can also be applied to FIG. 2, so duplicated description will be omitted.

[0069] FIG. 3 is a flowchart illustrating a method for providing augmented content, in which content is augmented and displayed on an AR view image based on a preset unit space, according to an embodiment.

[0070] An enhanced content providing method executed by a computer system 100 will be described with reference to FIG. 3. The computer system 100 may be the user terminal 100 described with reference to FIG. 1, and in the following detailed description, the embodiment will be described using the term user terminal 100 instead of computer system 100. Furthermore, steps 310 to 320 described below and at least some of the steps described with reference to FIGS. 4 and 5 may be configured to be executed by a server 200 instead of the user terminal 100. Execution of each step will be described below with a focus on the user terminal 100, but redundant description of the server 200 may be omitted.

[0071] In step 310, the user terminal 100 or the server 200 may determine whether the user terminal 100 is located in a preset unit space based on the location of the user terminal 100. The user terminal 100 may determine the location of the user terminal 100 by a method based on at least one of GPS, a Visual Positioning System (VPS), and a Wi-Fi Positioning System (WPS), for example, and may determine whether the user terminal 100 is located in the preset unit space based on the determined location. Alternatively, the server 200 may receive the determined location of the user terminal 100 and determine whether the received location is located in the preset unit space.

[0072] Alternatively, whether the user terminal 100 is located in a preset unit space may be determined based on communication between the user terminal 100 and a communication module (e.g., a short-range communication module, an AP (Access Point), a beacon, etc.) present in the unit space. As an example, the position of the user terminal 100 may be determined by the strength of communication (i.e., signal strength) between the user terminal 100 and at least one of the communication modules or by positioning (triangulation, etc.) based on the communication, and whether the user terminal 100 is located in the unit space may be determined.

[0073] As shown in step 312, the user terminal 100 or the server 200 may determine whether the user terminal 100 has entered the unit space in order to determine whether the user terminal 100 is located within the unit space. A specific method for determining whether the user terminal 100 has entered the unit space or whether the user terminal 100 has departed from the unit space will be described in more detail with reference to FIGS. 4 and 8.

[0074] In step 320, the user terminal 100 or the server 200 may determine that the user terminal 100 is located in the unit space and thereby augment and display at least one content 30 associated with the unit space using the AR view 10 including an image captured by a camera of the user terminal 100. For example, the user terminal 100 may receive the content 30 or information / data for displaying the content 30 from the server 200, and thereby display the content 30 by augmenting it into an image. The server 200 may determine that the user terminal 100 is located in the unit space and thereby control the user terminal 100 to augment and display the content 30 associated with the unit space using the AR view 10.

[0075] Alternatively / additionally, in step 320, the user terminal 100 or the server 200 may change the settings of an application installed on the user terminal 100 in order to display the AR view 10, based on the determination that the user terminal 100 is located in the unit space. For example, the server 200 may control the user terminal 100 to change the settings of an application installed on the user terminal 100.

[0076] The application settings that are changed in this manner may include at least one of changing the display settings of the content 30 that is displayed augmented by the video, changing the display settings of a user interface associated with the AR view 10, and changing the display settings of a map associated with the AR view 10 (e.g., the map in the map view 20).

[0077] A more specific method for changing application settings will be described in more detail with reference to FIG.

[0078] Hereinafter, a method for setting or defining a unit space for a space in which the user terminal 100 moves and associating content with the unit space will be described in more detail with reference to FIGS. 6, 7, and 13. FIG.

[0079] In this regard, FIG. 6 is a diagram illustrating a method for setting a unit space and mapping content to the unit space in one example.

[0080] The server 200 may define a unit space for the space 600 in which the user terminal 100 moves, independently of the position of the user terminal 100 or the distance from the user terminal 100. Such a unit space may be defined in advance as at least a part of the space 600 prior to providing the extended content to the user terminal 100. The unit space may be an indoor space as in the example shown in the figure. However, depending on the embodiment, the unit space may be an outdoor space or a composite space that combines an indoor space and an outdoor space.

[0081] The server 200 may define, for example, a service target area for providing a service as a unit space, as each divided area of ​​the space 600. In this case, the unit space may be a layer defined on the space 600 showing a map. In other words, each unit space defined on the space 600 may be a layer.

[0082] Each layer (unit space) may be assigned a name or an identifier. For example, as shown in the figure, for a museum space 600, layers corresponding to each exhibition room may be defined as unit spaces, and each unit space may be assigned the name (or exhibition room number) of the corresponding exhibition room. The name or identifier assigned to the unit space may be displayed as augmented content in the AR view 10 when the user terminal 100 enters the corresponding exhibition room. This can improve the service experience when the user enters the unit space.

[0083] The server 200 may associate at least one piece of content with each unit space. For example, the server 200 may associate the content with the unit space by mapping the content to an object located in the unit space. Thus, the content becomes associated with the layer corresponding to the unit space.

[0084] In this way, the unit space set by the server 200 may correspond to a semantic range for providing the extended content corresponding to the service to the user terminal 100.

[0085] In relation to this, FIGS. 13a and 13b are diagrams illustrating a method for defining a unit space corresponding to a semantic range for providing extended content for a space, according to an example.

[0086] As shown in FIG. 13a, a route traveled by the user terminal 100 may be mapped according to a map (or drawing) corresponding to the space 600. Such a route may include a plurality of nodes and links connecting the nodes. Based on such a mapped route, the server 200 may set a service target area within the space 600 where a specific service is provided as a unit space. For example, as shown in FIG. 13b, in the space 600 that is a museum, each exhibition room of the museum, such as the Prehistoric Ancient Room, the Paleolithic Room, the Bronze Age Room, the Ancient Korean Room, and the Neolithic Room, may be set as a unit space based on the mapped route. Each exhibition room set as such a unit space may become a semantic range for providing extended content of a service appropriate for the space.

[0087] As described above, the unit space may be defined based on a map of the space 600 for which the service is provided, or may be defined by geodata based on coordinates. The server 200 may generate and store geodata that defines and divides such unit space.

[0088] The geodata representing the unit space may include two-dimensional coordinates (i.e., x and y coordinates as planar coordinates or a range of coordinate values). The unit space may be composed of a figure formed on a two-dimensional plane. The figure may include a polygon. Whether the user terminal 100 is located in the unit space may be determined by comparing the two-dimensional position of the user terminal 100 with the geodata of the unit space.

[0089] Furthermore, the unit space may be defined as at least a portion of a three-dimensional space within the space 600. In this case, the geodata indicating the unit space may include three-dimensional coordinates (i.e., x, y, z coordinates or a range of coordinate values). When the geodata indicating the unit space includes height information such as a z coordinate, the unit space of the space 600 may indicate a space on a specific floor. In other words, the unit space may be divided by vertical height (e.g., floor). The unit space may be composed of a three-dimensional figure composed of a three-dimensional space.

[0090] In the above-mentioned step 310, the user terminal 100 or the server 200 may determine whether the user terminal is located in a unit space, which is a three-dimensional space, based on the position of the user terminal including the height of the user terminal 100. In other words, whether the user terminal 100 is located in the unit space may be determined by comparing the three-dimensional position of the user terminal 100 with the geodata of the unit space, which is the three-dimensional space of the terminal.

[0091] On the other hand, the unit spaces defined for the space 600 may be defined to overlap each other or have a hierarchical relationship.

[0092] In this regard, FIG. 7 is a diagram illustrating a method for setting unit spaces having overlapping and / or hierarchical relationships in one example.

[0093] The space 700 shown in the figure may be a space in which the user terminal 100 moves, and may correspond to a service providing area for providing services.

[0094] In the space 700, a plurality of unit spaces 710 to 730 may be defined, including a first unit space 710 and a second unit space 720 at least a part of which is included in the first unit space 710.

[0095] The second unit space 720 may be a space that partially overlaps with the first unit space 710, or may be a space that is completely contained within the first unit space 710, as shown in the figure. Meanwhile, the third unit space 730 may be a space that partially overlaps with the first unit space 710 and / or the second unit space 720, or may be a space that is completely contained within the first unit space 710 and the second unit space 720, as shown in the figure.

[0096] In the example shown in the figure, the second unit space 720 may be a sub-unit space of the first unit space 710. On the other hand, the third unit space 730 may be a sub-unit space of the first unit space 710 and the second unit space 720.

[0097] In this way, the server 200 may define layers corresponding to unit spaces that overlap each other for the space 700, or may define layers corresponding to unit spaces that have a hierarchical relationship with each other. As the unit spaces have a hierarchical relationship with each other, the contents associated with the unit spaces may also have a hierarchical relationship with each other.

[0098] For example, if the server 200 sets a layer corresponding to the second passenger terminal of Incheon International Airport as the unit space 710, which is the highest-level unit space, it may set a layer corresponding to the Sky Hub Lounge in the second passenger terminal as the lower-level unit space 720, and may set a layer corresponding to Starbucks in the Sky Hub Lounge as the lower-level unit space 730.

[0099] In this way, the server 200 defines a layer corresponding to the entire space (airport) as a higher-level unit space, and defines lower layers corresponding to the spaces within it (shopping mall, restaurant area, airline desk, etc.) as lower-level unit spaces, so that the unit spaces have a hierarchical relationship. The display of the augmented content in step 320 may be based on such a hierarchical relationship.

[0100] For example, in step 320, the user terminal 100 or the server 200 may extend and display at least one content associated with the second unit space 720 and at least one content associated with the first unit space 710 in an image by determining that the user terminal 100 is located in the second unit space 720. In other words, when the user terminal 100 enters a lower unit space, the user terminal 100 may extend and display both the content associated with the lower unit space and the content associated with the higher unit space in an image of the AR view 10.

[0101] On the other hand, unit spaces defined by overlapping or unit spaces having a hierarchical relationship may also be defined as the above-mentioned three-dimensional space. A redundant explanation of this will be omitted.

[0102] Hereinafter, a method for extending and displaying content related to the unit space in the image of the AR view 10 when it is determined that the user terminal 100 is located in the above-mentioned preset unit space will be described in more detail.

[0103] As described above, a plurality of unit spaces may be defined in a service space, which is a space in which a user terminal moves.

[0104] The user terminal 100 may not extend and display in the image content associated with other unit spaces adjacent to the unit space in which the user terminal 100 is currently located, content associated with other unit spaces within a predetermined radius from the location of the user terminal 100, or content associated with objects other than the unit space within a predetermined radius from the location of the user terminal 100, but may extend and display in the image only at least one content associated with the unit space in which the user terminal 100 is currently located.

[0105] In other words, the user terminal 100 may display the extended content based on a semantic range defined as a unit space, rather than displaying the extended content based on a predetermined radius or distance from the position of the user terminal 100 that corresponds to the normal rendering range.

[0106] Referring again to FIG. 1, the AR view 10 of the user terminal 100 displays content 30 associated with unit space 3 in which the user terminal 100 is currently located, but may not display content associated with other unit spaces (e.g., unit space 1 or unit space 4 adjacent to unit space 3) that are physically close to the location of the user terminal 100 but in which the user terminal 100 is not located, or content mapped to objects (e.g., objects X, Y, and Z) that are physically close to the location of the user terminal 100 but not within unit space 3.

[0107] In this way, content that does not need to be provided to a user terminal 100 located in unit space 3 separated by a wall / partition within space 5, such as content associated with unit space 1 or unit space 4 or content mapped to objects X, Y, and Z, can be prevented from being displayed by view 10.

[0108] In the embodiment, only content associated with the unit space 3 in which the user terminal 100 is currently located is filtered and displayed by the AR view 10, thereby preventing unnecessary augmented content from being displayed. This reduces the cognitive load on the user and the load on the user terminal.

[0109] The above description of the technical features given with reference to FIGS. 1 and 2 can also be applied to FIGS. 3, 6, 7, and 13, and therefore a duplicated description will be omitted.

[0110] FIG. 4 is a flowchart illustrating a method for changing the display of content in an AR view and / or application settings by determining whether the user terminal has deviated from the unit space, in one example.

[0111] With reference to FIG. 4, a method for determining entry into the unit space of the user terminal 100 and changing the display of the content 30 of the AR view 10 and / or application settings accordingly will be described in more detail.

[0112] In step 312 described with reference to FIG. 3, the user terminal 100 or the server 200 may determine whether the user terminal 100 has entered the unit space to determine whether the user terminal 100 is located within the unit space. When it is determined that the user terminal 100 has entered the unit space, the user terminal 100 may augment and display filtered content as content associated with the unit space in the image. In other words, when it is determined that the user terminal 100 has entered the unit space, the server 200 may filter content associated with the unit space and provide the filtered content to the user terminal 100, thereby allowing the augmented content to be displayed on the user terminal 100.

[0113] In step 410, the user terminal 100 or the server 200 may determine whether the user terminal 100 has deviated from the unit space based on the location of the user terminal 100.

[0114] For example, when determining whether the user terminal 100 or the server 200 has entered the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has entered the unit space if the coordinates corresponding to the position of the user terminal 100 are included within the unit space. Furthermore, when determining whether the user terminal 100 has left the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has departed from the unit space if the coordinates corresponding to the position of the user terminal 100 are no longer included within the unit space.

[0115] Whether the user terminal 100 has entered the unit space may be determined based on whether the coordinates (two-dimensional coordinates or three-dimensional coordinates) corresponding to the position of the user terminal 100 are included in a figure (two-dimensional figure or three-dimensional figure) that is a layer indicating the unit space. Such determination of whether the user terminal 100 has entered the unit space may be made by comparing the coordinates corresponding to the position of the user terminal 100 with the geodata of the unit space.

[0116] As another example, when determining whether to enter the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has entered the unit space if it is determined based on the location of the user terminal 100 that the user terminal 100 has passed a first node predefined in association with the unit space. The first node may be a preset entrance point for the unit space. Furthermore, when determining whether to enter the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has departed from the unit space if it is determined based on the location of the user terminal 100 that the user terminal 100 has passed a second node predefined in association with the unit space. The second node may be a preset exit point for the unit space.

[0117] At least one entry point and one exit point may be set for each unit space. Each entry point and each exit point may be a node that is predefined for the unit space so that the user terminal 100 passes through.

[0118] In this regard, FIG. 8 is a diagram illustrating a method for determining entry into a unit space based on a preset node in one example.

[0119] In the example shown in the figure, when the user terminal 100 passes through node 802 corresponding to the entrance point of unit space 2, it may be determined that the user terminal 100 has entered unit space 2, and when the user terminal 100 passes through node 804 corresponding to the exit point of unit space 2, it may be determined that the user terminal 100 has exited unit space 2. When the user terminal 100 passes through node 806 corresponding to the entrance point of unit space 3, it may be determined that the user terminal 100 has entered unit space 3, and when the user terminal 100 passes through node 808 corresponding to the exit point of unit space 3, it may be determined that the user terminal 100 has exited unit space 3. When the user terminal 100 passes through node 810 corresponding to the entrance point of unit space 4, it may be determined that the user terminal 100 has entered unit space 4.

[0120] Nodes 802, 806, and 810 corresponding to entry points may be located on the entry side of the unit space, and nodes 804 and 808 corresponding to exit points may be located on the exit side of the unit space. If there are multiple entry points or exit points in the unit space, multiple nodes corresponding to entry points or exit points may be located. Each node may be associated with two-dimensional or three-dimensional coordinates, and these coordinates may be included in the geodata of the corresponding unit space.

[0121] If the unit space is not an open space but a space with an entrance and / or exit, the accuracy of the determination can be improved by determining whether the user terminal 100 has entered or left the unit space based on whether the user terminal 100 has passed through the entrance point and / or exit point.

[0122] Regarding the method for determining whether the user terminal 100 has passed through a node, the above-mentioned explanation regarding the positioning method of the user terminal 100 and the explanation regarding the method for determining whether the user terminal 100 is located in the unit space are equally applicable, so duplicate explanations will be omitted.

[0123] At step 420, the user terminal 100 or the server 200 may change the display of the content 30 of the AR view 10 and / or additionally change the settings of an application installed on the user terminal 100 in response to determining that the user terminal 100 has deviated from the unit space.

[0124] For example, if the user terminal 100 or the server 200 determines that the user terminal 100 has deviated from the second unit space and moved to a third unit space, which is another unit space among the plurality of unit spaces defined in the service space, the user terminal 100 or the server 200 may stop augmenting and displaying content associated with the second unit space in the image of the AR view 10, and may augment and display at least one other content associated with the third unit space in the image of the AR view 10. In other words, as it is confirmed that the user terminal 100 has moved to another unit space, the augmented content displayed by the AR view 10 may be dynamically updated to content associated with the corresponding other unit space. This makes it possible to prevent content unrelated to the unit space from which the user terminal 100 has deviated or the unit space into which the user terminal 100 has entered from being augmented in the image of the AR view 10.

[0125] As described above, in the embodiment, it is possible to grasp whether the user terminal 100 has entered a unit space in consideration of the position grasped in real time according to the movement of the user terminal 100. As a result, it is possible to cancel the display of content associated with the unit space into which the user terminal 100 has entered and to activate the display of content associated with the unit space into which the user terminal has entered in real time. For example, when the user terminal 100 tours a museum, which is a service space, even when the user terminal 100 moves through an exhibition hall corresponding to the unit space, it is possible to dynamically perform a switch to display content associated with the exhibition hall into which the user terminal 100 has entered in real time.

[0126] Alternatively / additionally, when the movement of the user terminal 100 to another unit space is confirmed, the settings of the application installed on the user terminal 100 may be appropriately changed according to the attributes of the other unit space.

[0127] The technical features described above with reference to FIGS. 1 to 3, 6, 7, and 13 can also be applied to FIGS. 4 and 8, and therefore overlapping descriptions will be omitted.

[0128] FIG. 5 is a flowchart illustrating a method for displaying a map view in one example.

[0129] In step 510, the user terminal 100 may display a map view 20 including a map matched to the image together with the AR view 10. That is, the map included in the map view 20 may include the current location of the user terminal 100 and the location indicated by the image. The server 200 may control the user terminal 100 to display such a map view 20.

[0130] 1, the map view 20 may include the current location 50 of the user terminal 100. The map view 20 may include a two-dimensional map or a three-dimensional map, and may include a unit space in which the user terminal 100 moves, content provided to the user terminal 100, or an object to which the content is mapped.

[0131] As in step 520, when displaying the map view 20, the user terminal 100 may display the area of ​​the map corresponding to the unit space in which the user terminal 100 is determined to be located so that it is visually separated from the remaining areas.

[0132] 1, in the map view 20, an area corresponding to the unit space in which the user terminal 100 is located may be displayed in three dimensions, while the remaining areas may be displayed in two dimensions, thereby visually distinguishing the unit space in which the user terminal 100 is located. More specifically, in the map view 20, the user terminal 100 may display the boundary (i.e., wall portion) between the area corresponding to the unit space and the remaining areas in three dimensions, and may visually distinguish the unit space in which the user terminal 100 is located by highlighting the area corresponding to the unit space compared to the remaining areas. The highlighting may be performed by displaying the area corresponding to the unit space in a different color from the remaining areas.

[0133] Furthermore, the user terminal 100 may display an animation that shows the effect of displaying the area corresponding to the unit space where the user terminal 100 is located in three dimensions. In other words, when the user terminal 100 enters the unit space, the user terminal 100 may play an animation in the map view 20 that changes the boundary between the area corresponding to the unit space displayed in two dimensions and the remaining area into three dimensions. An operation of highlighting the area corresponding to the unit space may also be performed simultaneously with the playback of the animation. This allows the user to intuitively confirm in the map view 20 that the user terminal 100 has entered a specific unit space.

[0134] Meanwhile, depending on the embodiment, the user terminal 100 may display the map view 20 separately from the AR view 10, that is, on a separate screen.

[0135] In this regard, FIG. 11 is a diagram illustrating a method for displaying a map of a space in which a user terminal moves, in one example.

[0136] The map screen shown in FIG. 11 may be a map view 20 that is displayed separately from the AR view 10. As shown in the figure, even in the map view displayed in FIG. 11, an area corresponding to the unit space in which it is determined that the user terminal 100 is located may be displayed so as to be visually separated from the remaining area. Similarly, even in the map view of FIG. 11, the user terminal 100 may display the boundary (i.e., wall portion) between the area corresponding to the unit space and the remaining area in three dimensions, and may display the area corresponding to the unit space in a highlighted manner compared to the remaining area, thereby visually separating the unit space in which the user terminal 100 is located. The effect of displaying the area corresponding to the unit space in which the user terminal 100 is located in three dimensions as an animation can also be applied to the example of FIG. 11 as is.

[0137] Meanwhile, according to an embodiment, the map view 20 may be configured not to display content or objects in unit spaces other than the unit space into which the user terminal 100 has entered.

[0138] As shown in the figure, a name (representative name) or identifier of the unit space may be labeled in an area corresponding to the unit space on the map in the map view 20. The name (representative name) or identifier of the labeled unit space may be displayed as augmented content on the user terminal 100 when the user terminal 100 enters the unit space or before the user terminal 100 enters the unit space.

[0139] A method for displaying augmented content using the map view 20 will now be described with reference to FIG.

[0140] FIG. 12a is a diagram illustrating a method in one example in which a user terminal provides an AR view and a map view by entering a unit space, and FIG. 12b is a diagram illustrating the map view on the screen of the user terminal of FIG. 12a in more detail.

[0141] 12a, when the user terminal 100 enters the unit space, or when the user terminal 100 approaches an object in the unit space by a certain distance or more after entering the unit space, content 1200 mapped to the object may be augmented and displayed on the image in the AR view 10. The content 1200 may correspond to the content 30 described above.

[0142] In the example shown in the figure, if the object is a comb-shaped pottery, the content 1200 mapped to the object may include text and a three-dimensional image as content for describing the comb-shaped pottery. The three-dimensional image may be a shape corresponding to the object. The text may include information for describing the details of the object. For example, the text may include text for describing the types of patterns on the comb-shaped pottery.

[0143] However, an object may have multiple pieces of content mapped to it. For example, an object that is a pottery comb may have a first piece of content mapped to it that includes the name of the object ("pottery comb") and an icon indicating the type or kind of object, and a second piece of content, such as content 1200 for the object.

[0144] When the user terminal 100 enters the unit space, the first content may first be augmented and displayed as an image in the AR view 10, and when the user terminal 100 identifies the first content, moves toward the object, and approaches the object by more than a certain distance, the second content, content 1200, may be augmented and displayed as an image in the AR view 10.

[0145] In this way, in providing extended content according to this embodiment, in addition to the method of providing extended content based on cement tack range, the method of providing extended content based on normal rendering range can be additionally combined and used.

[0146] This is explained in more detail with reference to FIG.

[0147] Meanwhile, in the map view 20, as described above, the unit space in which the user terminal 100 is located may be visually divided and displayed. Meanwhile, in the map view 20, content 1210 may be displayed corresponding to the content 1200. The content 1210 may be displayed in the map view 20 at the time the content 1200 is displayed by the AR view 10. This allows the user to intuitively identify the location where the content 1200 is displayed by the content 1210 displayed in the map view 20 as well as the AR view 10. When the content 1210 is displayed in the map view 20, an animation effect may be applied.

[0148] As described, in the embodiment, the AR view 10 and the map view 20 can provide content 1200, 1210 to the user terminal 100 in an effective manner for objects within the unit space into which the user terminal 100 has entered.

[0149] The explanation of the technical features given above with reference to Figures 1 to 4, 6 to 8, and 13 can also be applied to Figures 5, 11, and 12, so duplicate explanations will be omitted.

[0150] FIG. 9 is a diagram illustrating a method for providing enhanced content according to the movement of a user terminal within a unit space in one example.

[0151] Referring to Figure 9, a more detailed description will be given of a method for providing extended content by combining an extended content providing method based on a cement range with an extended content providing method based on a normal rendering range.

[0152] The unit space 910 in which the user terminal 100 is located, i.e., the space into which the user terminal 100 has entered, may be associated with multiple contents. For example, the unit space may include multiple objects to which multiple contents are mapped. Also, as described above, multiple contents may be mapped to one object.

[0153] When the user terminal 100 is determined to be located in the unit space 910, the user terminal 100 may, based on the location of the user terminal 100, extend and display, among a plurality of contents, content that is mapped to an object located within a predetermined distance from the location of the user terminal 100 or within a predetermined radius from the location of the user terminal 100, in the image of the AR view 10. For example, even when the user terminal 100 enters the unit space 910, not all of the content associated with the unit space 910 is extended and displayed in the image of the AR view 10, but only some of the content is displayed. Therefore, when the user terminal 100 approaches an object to which content is mapped, the content is extended and displayed in the image of the AR view 10 in the user terminal 100.

[0154] As described above, in the embodiment, content filtered based on the cement range can be re-filtered based on the normal rendering range and provided to the user terminal 100. As a result, in the embodiment, from the user's perspective, content related to a unit space where the user is not located is not provided, and content in the unit space where the user is located, that is far from the current location or not related to the object currently being viewed, is not provided.

[0155] As shown in the example in the figure, assume that a user 900 moves within a unit space 910 toward objects 1 to 6 (indicated by circled characters in the figure) located within the unit space 910. A range 920 indicates the user's movable range. A range 930 indicates the radius within which content is output. The range 930 may be a distance and may be set differently depending on each of the contents mapped to objects 1 to 6. The range 930 may also be set differently depending on the attributes or characteristics of the unit space 910. For example, if the user 900 moves toward object 4 within the unit space 910, content 940 may be displayed in the AR view 10 of the user terminal 110 when object 4 enters the range 930. The content 940 does not have to be displayed when the user terminal 100 enters the unit space 910, but may be displayed when the user terminal 100 approaches object 4.

[0156] A plurality of contents associated with the unit space 910 may be hierarchically organized. For example, when the user terminal 100 enters the unit space 910 or approaches the unit space 910 or a node corresponding to an entry point within a certain radius or distance, content (top layer content) indicating the name (representative name) or identifier of the unit space 910 may be displayed in the AR view 10 of the user terminal 100. Meanwhile, when the user terminal 100 enters the unit space 910, content (upper layer content) including an icon indicating the name and type or kind of an object, such as the first content described with reference to FIG. 12, may be displayed. When the user terminal 100 identifies the first content, moves toward the object, and approaches the object within a certain distance, second content (lower layer content) such as the content 1200 may be augmented and displayed as an image in the AR view 10.

[0157] In this manner, in the embodiment, in addition to providing extended content utilizing the cement range, it is possible to provide hierarchical extended content taking into account the normal rendering range, so that the user can receive only the meaningful content service according to the distance to the object in the unit space.

[0158] The technical features described above with reference to FIGS. 1 to 8 and 11 to 13 can also be applied to FIG. 9, and therefore overlapping descriptions will be omitted.

[0159] FIG. 10 is a diagram illustrating a method for changing the settings of an application installed in a user terminal in accordance with the attributes of a unit space, in one example.

[0160] Hereinafter, a method for changing the settings of an application installed in the user terminal 100 depending on the location of the user terminal 100 in the unit space will be described in more detail with reference to FIG.

[0161] As described above, when the user terminal 100 is positioned in the unit space, at least one of the following application settings may be changed: a change in the display settings of the content 30 augmented and displayed in the video; a change in the display settings of a user interface associated with the AR view 10; and a change in the display settings of a map associated with the AR view 10 (e.g., the map in the map view 20). The change in the display settings of the user interface may be a change in the size of a button included in the user interface. The changed application setting may be the angle, distance, or effect of a camera providing the AR view 10, or a change in the viewpoint or viewpoint angle of the map view 20.

[0162] The settings of such an application may be changed differently depending on the attributes of the unit space in which the user terminal 100 is located. For example, the settings of the application may be changed differently depending on whether the user terminal 100 is located in an indoor space or an outdoor space.

[0163] For example, if the unit space in which the user terminal 100 is determined to be located is an outdoor space, the user terminal 100 or the server 200 may change the application settings so that the content to be augmented in the image of the AR view 10 is displayed relatively larger and the scale of the map of the map view 20 is displayed relatively smaller. Thus, the user terminal 100 may display the augmented content relatively larger in an outdoor space, and the map of the map view 20 may display a relatively larger area of ​​the space. Furthermore, the user terminal 100 may change the camera angle, distance, or effect of the AR view 10 to be suitable for outdoor shooting, or change the viewpoint of the map (e.g., change to a 3D map display viewpoint).

[0164] Furthermore, if the unit space in which the user terminal 100 is determined to be located is an indoor space, the user terminal 100 or the server 200 may change the application settings so that the content to be augmented in the image of the AR view 10 is displayed relatively smaller and the scale of the map in the map view 20 is displayed relatively larger. Thus, the user terminal 100 may display the augmented content relatively smaller in an indoor space and the map in the map view 20 may display a relatively smaller area of ​​the space in more detail. The user terminal 100 may also change the camera angle, distance, or effect of the AR view 10 to be more suitable for indoor and outdoor shooting (e.g., by reducing the aperture value), or change the viewpoint of the map (e.g., change to a two-dimensional map display viewpoint).

[0165] In this way, in the embodiment, by taking into consideration the location ascertained in real time as the user terminal 100 moves, it is possible to determine whether the user terminal 100 is in an indoor space or an outdoor space, and this allows the application settings to be changed dynamically in real time. The user can experience an experience optimized for the attributes of the space to which he or she belongs.

[0166] Meanwhile, the attribute of the unit space described above is not limited to indicating indoors or outdoors, and may include various characteristics associated with the unit space or the type of the unit space. For example, if the unit space is an exhibition hall, the user terminal 100 may be controlled so that application settings are changed according to the requirements of the exhibition hall (i.e., camera settings required by the exhibition hall).

[0167] The technical features described above with reference to FIGS. 1 to 9 and 11 to 13 can also be applied to FIG. 10, and therefore overlapping descriptions will be omitted.

[0168] The service that provides augmented content to the user terminal 100 of the embodiment may be a metaverse service that utilizes location-based AR using 3D mapping / digital twins. Depending on the embodiment, the service can determine the location of the user terminal 100, recognize the real space in which the user exists, and augment content linked to a specific location in this space using the AR view 10. The augmented content can be used to provide information, entertainment, and even social interactions between users. This allows a virtual meta-layer to be added to real-world spaces.

[0169] Depending on the embodiment, it is possible to eliminate the complexity of the user interface, the increase in the cognitive load on the user, and the increase in the load on the user terminal 100 caused by an excessive amount of content extended by the AR view 10.

[0170] In the embodiment, a "unit space" is set for a complex space that is composed of multiple spaces integrated / connected, and by entering such a "unit space," meaningful content in this "unit space" can be provided to the user.

[0171] For example, when providing services in a complex space such as a museum, which has multiple spaces divided by era or theme, i.e., exhibition halls, content corresponding to the exhibition hall that the user has entered can be appropriately provided to the user's user terminal 100. In this case, content of other exhibition halls separated by partitions (walls) is not provided to the user terminal 100.

[0172] On the other hand, when a user walks in an outdoor space, by predefining specific parts of the indoor space and specific parts of the outdoor space as unit spaces, it is possible to ensure that only meaningful content is provided to the user terminal 100 when providing services in an outdoor space or even in a complex space where indoor and outdoor spaces coexist.

[0173] This can be achieved by utilizing a semantic rendering range that defines a service target space having semantic meaning units as a unit space and controls the expansion of content, rather than a rendering range that simply controls the expansion of content based on distance or radius from the user.

[0174] The above-described devices may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also access, record, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device may be described. However, those skilled in the art will understand that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0175] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may independently or collectively instruct the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0176] Methods according to embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. In this case, the medium may continuously record a computer-executable program or temporarily record it for execution or download. The medium may be various recording or storage means in the form of a single piece of hardware or multiple pieces of hardware combined together. It may be a medium directly connected to a computer system or distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to record program instructions, such as ROMs, RAMs, and flash memories. Other examples of media include recording media or storage media managed by app stores that distribute applications, or by websites or servers that provide or distribute various software.

[0177] Although the embodiments have been described above based on limited examples and drawings, those skilled in the art will appreciate that various modifications and variations may be made from the above description. For example, the described techniques may be performed in an order different from that described, and / or the described system, structure, device, circuit, or other element may be coupled or combined in a manner different from that described, or may be substituted or replaced by other elements or equivalents, and still achieve suitable results.

[0178] Therefore, different embodiments are within the scope of the appended claims, provided that they are equivalent to the claims.

Claims

[Claim 1] 1. An enhanced content providing method executed by a computer system that is a server or a user terminal, comprising: determining whether the user terminal is located in a predetermined unit space based on the location of the user terminal; and augmenting and displaying at least one content associated with the unit space in an augmented reality (AR) view including an image captured by a camera of the user terminal when it is determined that the user terminal is located in the unit space; Including, The extended content providing method includes: and changing settings of an application installed on the user terminal to display the AR view when it is determined that the user terminal is located in the unit space. further comprising the application settings include at least one of changing display settings of the content, changing display settings of a user interface associated with the AR view, and changing display settings of a map associated with the AR view; The step of changing the settings of the application includes: If the unit space in which it is determined that the user terminal is located is an outdoor space, changing the settings of the application so that the content is displayed relatively large and the scale of the map is displayed relatively reduced; An extended content providing method, wherein if the unit space in which the user terminal is determined to be located is an indoor space, the application settings are changed so that the content is displayed relatively small and the scale of the map is displayed relatively enlarged.

Images