METHOD AND APPARATUS FOR PROVIDING AUGMENTED CONTENT BY AUGMENTED REALITY VIEW BASED ON PRE-SET UNIT SPACE - Patent application

By determining user location within predefined unit spaces and filtering AR content accordingly, the system addresses the issue of unnecessary content provision in AR systems, improving user experience and terminal efficiency.

JP2024543664AInactive Publication Date: 2024-11-21NAVER CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2024534663
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-01-13
Filing Date
2023-01-05
Publication Date
2024-11-21
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing augmented reality (AR) systems provide unnecessary and inappropriate content based on physical distance from the user terminal, increasing cognitive load and resource consumption.

Method used

Determine if the user terminal is located within a predefined unit space, and provide AR content only for that space, filtering out content associated with other spaces, and adjust display settings based on the unit space attributes.

Benefits of technology

Reduces cognitive load and resource consumption by providing relevant content only within the defined unit space, enhancing user experience and optimizing terminal performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024543664000001_ABST
    Figure 2024543664000001_ABST
Patent Text Reader

Abstract

The present invention provides an extended content providing method, which determines whether a user terminal is located in a preset unit space based on the position of the user terminal, and when it is determined that the user terminal is located in the unit space, extends and displays content related to the unit space in an image captured by a camera using an augmented reality (AR) view.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The following description relates to a method and apparatus for extending and providing content (or content items) to an image using an augmented reality view, and more particularly, to a method and apparatus for extending and providing content associated with a preset unit space to an augmented reality view image based on the preset unit space. [Background technology]

[0002] Augmented reality (AR) refers to a technology that blends virtual objects and information generated by computer technology with the real world to complement it. In other words, AR is a technology that displays virtual content in an expanded real environment, and users can view the expanded content in response to the real environment using electronic devices.

[0003] In a user terminal, which is an electronic device of a user, content associated with objects existing within a certain distance or radius based on the location of the user terminal is extended to the image of the user terminal and provided. In this way, when extended content is provided based on the physical distance from the user terminal, a lot of unnecessary content may be extended, which may increase the cognitive load of the user and the load of the user terminal. Furthermore, there is a risk that inappropriate content that does not match the service desired by the user may be extended to the user terminal.

[0004] As an example of technology relating to various services that utilize augmented reality technology, Korean Patent Publication No. 10-2014-0065963 (published on May 30, 2014) discloses an augmented reality navigator that displays an image of the driving route captured by a camera installed in the vehicle on a display screen and maps virtual display information that provides guidance along the driving route onto the image displayed on the display.

[0005] The above description is merely intended to aid in the understanding of the present invention and may include material that does not form part of the prior art, nor may it include material that the prior art may suggest to one of ordinary skill in the art. Summary of the Invention [Problem to be solved by the invention]

[0006] Provided is a method for providing extended content that is extended to an image by an AR view including an image captured by a camera of a user terminal, and that, when a user terminal is located in a preset unit space, allows only content associated with the unit space to be extended to the image and provided.

[0007] A method is provided for determining whether a user terminal is located in a preset unit space, and if the user terminal is located in the preset unit space, changing application settings for providing an AR view based on attributes of the unit space (e.g., indoor or outdoor).

[0008] The present invention provides a method for filtering content to be expanded and displayed in an AR view by determining whether a user terminal enters or exits a preset unit space, and for changing the display of the unit space that the user terminal enters and exits in a map view provided together with the AR view. [Means for solving the problem]

[0009] According to one aspect, an extended content providing method executed by a computer system which is a server or a user terminal includes a step of determining whether the user terminal is located in a preset unit space based on a position of the user terminal, and when it is determined that the user terminal is located in the unit space, a step of extending and displaying at least one content associated with the unit space into the image using an augmented reality (AR) view including an image captured by a camera of the user terminal.

[0010] The unit space may be independent of the position of the user terminal or the distance from the user terminal and may be predefined as at least a portion of a space in which the user terminal moves, and the content may be mapped to at least one object within the unit space.

[0011] The unit space may be defined as a layer on a map for the space, corresponding to a service target area in which a service including the content is provided within the space, and the content may be associated with the layer.

[0012] The unit space is predefined as at least a portion of a three-dimensional space within the space, and the determining step may determine whether the user terminal is located in the unit space, which is the three-dimensional space, based on a position of the user terminal including a height of the user terminal.

[0013] A plurality of unit spaces including the unit space may be defined in the space in which the user terminal moves, and in the displaying step, content associated with other unit spaces adjacent to the unit space, content associated with other unit spaces existing within a predetermined radius from the position of the user terminal, or content associated with objects other than the unit space existing within a predetermined radius from the position of the user terminal may not be extended and displayed in the image, and only at least one content associated with the unit space in which it is determined that the user terminal is located may be extended and displayed in the image.

[0014] The determining step may include a step of determining that the user terminal has entered the unit space, and the displaying step may include extending and displaying the content filtered as content associated with the unit space when the user terminal has entered the unit space in the image, and the extended content providing method may further include a step of determining whether the user terminal has departed from the unit space based on a position of the user terminal.

[0015] The step of determining whether or not the user terminal has entered the unit space may determine that the user terminal has entered the unit space if coordinates corresponding to the position of the user terminal are included within the unit space, and the step of determining whether or not the user terminal has deviated from the unit space may determine that the user terminal has deviated from the unit space if coordinates corresponding to the position of the user terminal are not included within the unit space.

[0016] The method for providing extended content, wherein the step of determining whether or not the user terminal has entered the unit space determines that the user terminal has entered the unit space if it is determined that the user terminal has passed a first node predefined in association with the unit space based on a location of the user terminal, and the step of determining whether or not the user terminal has left the unit space determines that the user terminal has left the unit space if it is determined that the user terminal has passed a second node predefined in association with the unit space based on a location of the user terminal.

[0017] The extended content providing method may further include, when it is determined that the user terminal has deviated from the unit space and moved to another unit space among the plurality of unit spaces, stopping the content from being extended and displayed on the image, and extending and displaying at least one other content associated with the other unit space on the image.

[0018] The enhanced content providing method may further include changing settings of an application installed on the user terminal to display the AR view when it is determined that the user terminal is located in the unit space, and the settings of the application may include at least one of changing display settings of the content, changing display settings of a user interface associated with the AR view, and changing display settings of a map associated with the AR view.

[0019] The step of changing the settings of the application may include changing the settings of the application so that, if the unit space determined to be where the user terminal is located is an outdoor space, the content is displayed relatively larger and the scale of the map is displayed relatively smaller, and changing the settings of the application so that, if the unit space determined to be where the user terminal is located is an indoor space, the content is displayed relatively smaller and the scale of the map is displayed relatively larger.

[0020] The unit space may be associated with a plurality of contents, and the displaying step may include extending and displaying, based on the position of the user terminal, content among the plurality of contents that is mapped to an object that is located within a predetermined distance from the position of the user terminal or within a predetermined radius from the position of the user terminal when it is determined that the user terminal is located in the unit space, in the image.

[0021] The method for providing augmented content further includes a step of displaying a map view including a map matched to the image together with the AR view, and the map displayed as the map view may include the position of the user terminal, the unit space, and the content or an object to which the content is mapped.

[0022] The displaying of the map view may include displaying an area of ​​the map corresponding to the unit space in which it is determined that the user terminal is located such that the area is visually separated from the remaining area of ​​the map.

[0023] The displaying of the map view may include displaying a boundary between the area corresponding to the unit space and the remaining area in three dimensions, and displaying the area corresponding to the unit space in a highlighted manner compared to the remaining area.

[0024] A plurality of unit spaces are defined in the space in which the user terminal moves, including a first unit space and a second unit space at least partially contained in the first unit space, and the unit space may be the first unit space or the second unit space.

[0025] The second unit space is a sub-unit space of the first unit space, and when the unit space is the second unit space, the displaying step may include extending and displaying at least one content associated with the second unit space and at least one content associated with the first unit space in the image when it is determined that the user terminal is located in the second unit space.

[0026] In another aspect, a computer system for realizing a user terminal or a server includes at least one processor configured to execute computer-readable instructions contained in a memory, and the at least one processor determines whether the user terminal is located in a predetermined unit space based on a position of the user terminal, and when it is determined that the user terminal is located in the unit space, a computer system is provided that extends and displays at least one content associated with the unit section into the image using an Augmented Reality (AR) view including an image captured by a camera of the user terminal. Effect of the Invention

[0027] A unit space is preset as a layer on a map corresponding to a service target area, and when a user terminal is located in the preset unit space, content related to the unit space is filtered and provided through an AR view, thereby preventing unnecessary display of the augmented content compared to providing the augmented content based on the physical distance from the user terminal, thereby reducing the cognitive load on the user and the load on the user terminal.

[0028] Since only the content of the service provided by the unit space into which the user terminal has entered can be provided to the user terminal as extended content, meaningful content can be provided to the user.

[0029] The application settings for providing an AR view can be appropriately changed depending on the attributes of the pre-defined unit space in which the user terminal is located (e.g., indoors or outdoors), so that the display of the map view for this unit space can be dynamically changed in relation to the unit space into which the user terminal enters. [Brief description of the drawings]

[0030] [Figure 1a] 11 is a diagram illustrating a method for providing extended content by extending and displaying content in an AR view image based on a preset unit space in one embodiment. [Figure 1b] FIG. 1b shows a detailed view of the map on the screen of the user terminal of FIG. 1a; [Diagram 2] FIG. 1 illustrates a computer system and a server for implementing the enhanced content provision method in one embodiment. [Diagram 3] 1 is a flowchart illustrating a method for providing extended content by extending and displaying content in an AR view image based on a preset unit space according to an embodiment. [Figure 4] 11 is a flowchart illustrating a method for changing the display of content of an AR view and / or application settings by determining whether a user terminal has deviated from a unit space in one example. [Diagram 5] 1 is a flow diagram illustrating a method for displaying a map view in one example. [Figure 6] FIG. 13 is a diagram showing a method of setting a unit space and mapping content to the unit space in one example. [Figure 7] FIG. 13 illustrates a method for setting unit spaces having overlapping and / or hierarchical relationships in one example. [Figure 8] FIG. 13 is a diagram illustrating a method for determining whether a unit space has been entered based on a preset node in one example. [Figure 9] FIG. 13 is a diagram illustrating a method for providing enhanced content in response to movement of a user terminal within a unit space in one example. [Figure 10] FIG. 11 is a diagram illustrating a method for changing settings of an application installed on a user terminal in accordance with an attribute of a unit space in an example. [Figure 11] FIG. 1 illustrates a method for displaying a map of a space in which a user terminal moves in one example. [Figure 12a] A diagram showing a method in one example in which a user terminal provides an AR view and a map view by the user terminal entering a unit space. [Figure 12b] FIG. 12b shows a detailed view of the map on the screen of the user terminal of FIG. 12a; [Figure 13a] 1 is a diagram illustrating a method for defining a unit space corresponding to a semantic range for providing extended content for a space in one example. [Figure 13b] 1 is a diagram illustrating a method for defining a unit space corresponding to a semantic range for providing extended content for a space in one example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0031] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings.

[0032] The embodiment relates to an extended content providing method for extending and displaying content of a service desired by a user in an AR view image as a location-based AR service, using an AR view displayed on a user terminal 100. In the following detailed description, the content extended and displayed in the image will be referred to as "extended content."

[0033] In an embodiment, a "space" associated with the provision of augmented content may refer to an indoor space and / or an outdoor space. In other words, the spaces and unit spaces described below may be defined as spaces including indoor locations or outdoor locations, or may be defined as composite spaces that combine indoor and outdoor spaces.

[0034] In the following detailed description, for convenience of explanation, the location of a user who possesses the user terminal 100 will be described as the location of the user terminal 100. Also, for convenience of explanation, the terms "user" and "user terminal 100" possessed by the user will be used interchangeably.

[0035] In the detailed description below, "extending" content and / or information (e.g., indicators, etc.) onto an image may be interpreted as encompassing overlaying the content and / or information onto the image / screen of the AR view in some embodiments.

[0036] FIG. 1a is a diagram showing a method for providing extended content in an AR view image based on a preset unit space in one embodiment, and FIG. 1b is a diagram showing in detail a map view on the screen of the user terminal in FIG. 1a.

[0037] As shown in the figure, a user terminal 100 such as a smartphone can use a camera to capture images of the surroundings, and an AR view 10 including the images captured by the camera can be used to extend and display content 30 mapped to objects present in the space.

[0038] In an embodiment, based on the position of the user terminal 100, it may be determined whether the user terminal 100 is located within a preset unit space, and if it is determined that the user terminal 100 is located within the preset unit space, the content 30 associated with the unit space may be extended and displayed in the image of the AR view 10.

[0039] The "predetermined unit space" may be preset by the server 200. The server 200 (e.g., a content providing server) may set at least a part of the space 5 in which the user terminal 100 moves or a divided partial area of ​​the space 5 as the unit space. Such a unit space may be defined independently of the position of the user terminal 100 or the distance from the user terminal 100.

[0040] The space 5 may be an indoor space, an outdoor space, or a composite space including both indoor and outdoor spaces. The space 5 may be a service target area for providing services including the provision of content. Each unit space may be defined as a layer for such a space 5. The layer for the space 5 may be a layer on a map for the space 5.

[0041] As an example, unit spaces 1 to 4 may be defined in a space 5 as shown in the figure.

[0042] The server 200 may associate at least one piece of content with each unit space. At least one object may be placed in the unit space, and the server 200 may associate the content with the unit space by mapping the content to the at least one object in the unit space. That is, the content may be associated with a layer corresponding to the unit space.

[0043] In the example shown in the figure, the user terminal 100 may display content 30 of object A by extending the image using the AR view 10 upon determining that the user terminal 100 is located in the unit space 3. The content 30 may be associated with the preset unit space 3 and may be mapped to object A among the objects arranged in the unit space 3. In this way, in the embodiment, the content 30 associated with the unit space 3 in which it is determined that the user terminal 100 is located may be provided to the user terminal 100 as extended content.

[0044] In this case, in the AR view 10 of the user terminal 100, the content 30 associated with the unit space 3 is displayed, but the content associated with other unit spaces (e.g., unit space 1 or unit space 4) that are physically close to the position of the user terminal 100 but where the user terminal 100 is not located, or the content mapped to objects (e.g., objects X, Y, and Z) that are not in the unit space 3 may not be displayed. In other words, the content associated with the unit space 1 or unit space 4 or the content mapped to objects X, Y, and Z does not need to be provided to the user terminal 100 located in the unit space 3 that is divided by a wall in the space 5.

[0045] In the embodiment, it is possible to prevent the display of unnecessary augmented content as described above by filtering and displaying only the content related to the unit space 3 in which the user terminal 100 is located as the AR view 10. Therefore, it is possible to reduce the cognitive load on the user and the load on the user terminal.

[0046] The content 30 provides information about the object to which the content 30 is mapped. For example, the content 30 may include text, two-dimensional or three-dimensional images, and other multimedia content as information about the object. The content 30 may include an icon indicating the type or kind of object to which the content 30 is mapped.

[0047] As an example, if the space 5 is a museum and each of the unit spaces 1 to 4 corresponds to an exhibition room in the museum, the object may correspond to an item (exhibit, exhibit, relic, etc.) in the exhibition room, and the content 30 may include information for describing the item corresponding to the object A. In the example shown in the figure, only the content 30 mapped to the object A is displayed on the AR view 10, but at least one piece of content mapped to other objects (objects B to E) arranged in the unit space 3 may also be displayed on the AR view 10.

[0048] On the screen of the user terminal 100, a map view 20 including a map mapped onto an image of the AR view 10 may be further displayed together with the AR view 10. The map view 20 may include a current location 50 of the user terminal 100. The map view 20 may include a two-dimensional map or a three-dimensional map. The map view 20 may include a unit space in which the user terminal 100 moves, content provided to the user terminal 100, or an object to which the content is mapped. Meanwhile, as shown in the figure, in the map view 20, an area corresponding to the unit space in which the user terminal 100 is located may be displayed so as to be visually separated from the remaining area.

[0049] The user terminal 100 may communicate with the server 200 to display the augmented content through the AR view 10 and the map view 20. The server 200 may provide the user terminal 100 with content 30 associated with the unit space in which the user terminal 100 is located in response to the movement of the user terminal 100, and may provide the user terminal 100 with map information for displaying the map view 20 in response to the movement of the user terminal 100.

[0050] As described above, the server 200 may be a server that defines and manages unit spaces for the space 5 and manages registration, modification, deletion, etc. of content associated with each unit space. The server 200 may also be a map server that provides digital maps (3D maps and / or 2D maps).

[0051] A more specific method for setting the unit space by the server 200 and a specific method for determining entry of the user terminal 100 into the unit space and providing extended content to the user terminal 100 will be described in more detail with reference to FIGS.

[0052] FIG. 2 illustrates a computer system and a server that executes the enhanced content delivery method in one embodiment.

[0053] The user terminal 100 described with reference to Figures 1a and 1b may be realized by the computer system 100 shown in the figure. For example, a computer program for realizing the method of the embodiment may be installed and executed in the computer system 100, and such a computer system 100 may execute the extended content providing method according to the embodiment under the control of the executed computer program.

[0054] The method for providing extended content according to the embodiment may be executed through a PC-based program or an application dedicated to a mobile terminal. For example, the method for providing extended content according to the embodiment may be implemented in the form of a program that operates independently, or may be implemented in the form of an in-app of a specific application so as to be operable on the specific application. Such a specific application may be installed on the computer system 100, and may execute the method for providing extended content according to the embodiment by providing the extended content 30 through the AR view 10.

[0055] The computer system 100 is an electronic device corresponding to the above-mentioned user terminal 100, and may be a smartphone or a similar device capable of installing and executing an application or program, as shown in Figures 1a and 1b. The computer system 100 may be a personal computer (PC), a laptop computer, a tablet, an Internet of Things (IoT) device, a wearable computer, or the like.

[0056] As shown, computer system 100 may include memory 110, processor 120, communication interface 130, and input / output interface 140 as components for performing the enhanced content provision method.

[0057] The memory 110 is a computer-readable recording medium and may include a random access memory (RAM), a read only memory (ROM), and a permanent mass storage device such as a disk drive. Here, the permanent mass storage device such as a ROM or a disk drive may be included in the computer system 100 as a separate permanent storage device separate from the memory 110. The memory 110 may also store an operating system and at least one program code. Such software components may be loaded into the memory 110 from a computer-readable recording medium separate from the memory 110. Such separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 110 through the communication interface 130, which is not a computer-readable recording medium. For example, the software components may be loaded into the memory 110 of the computer system 100 based on a computer program installed by a file received via the network 160.

[0058] The processor 120 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processor 120 by the memory 110 or the communication interface 130. For example, the processor 120 may be configured to execute instructions received according to program code stored in a storage device such as the memory 110.

[0059] That is, the processor 120 may manage components of the computer system 100 and may execute programs or applications used by the computer system 100. For example, the processor 120 may be configured to execute applications for executing the augmented content providing method of the embodiment and process data received from the server 200 to provide the augmented content 30 by the AR view 10. The processor 120 may also process operations required for the execution of programs or applications and the processing of data, and may be at least one processor of the computer system 100 or at least one core in a processor.

[0060] The communication interface 130 may provide a function for the computer system 100 to communicate with other computer systems (not shown) via the network 160. As an example, requests, instructions, data, files, etc. generated by the processor 120 of the computer system 100 according to program code recorded in a recording device such as the memory 110 may be transmitted to the computer system via the network 160 under the control of the communication interface 130. Conversely, signals, instructions, data, files, etc. from other computer systems may be received by the computer system 100 via the communication interface 130 of the computer system 100 via the network 160. The signals, instructions, data, etc. received via the communication interface 130 may be transmitted to the processor 120 or the memory 110, and files, etc. may be recorded in a recording medium (the above-mentioned permanent recording device) that the computer system 100 may further include. The communication interface 130 may be a hardware module such as a network interface card, a network interface chip, and a networking interface port of the computer system 100, or a software module such as a network device driver or a networking program.

[0061] The input / output interface 140 may be a means for interfacing with the input / output device 150. For example, the input device may include devices such as a microphone, a keyboard, or a mouse, and the output device may include devices such as a display and a speaker. As another example, the input / output interface 140 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 150 may be configured as a single device together with the computer device 100.

[0062] Also, in other embodiments, the computer device 100 may include more components than those in FIG. 2. However, it is not necessary to clearly show most of the conventional components in the figure. For example, the computer system 100 may be implemented to include at least some of the input / output devices connected to the input / output interface 140 described above, and may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, a database, and the like. As a more specific example, when the computer system 100 is implemented in the form of a mobile device such as a smartphone, various components generally included in a mobile device, such as a camera, an acceleration sensor, a gyro sensor, various physical buttons, a button using a touch panel, an input / output port, and a vibrator for vibration, may be further implemented in the computer system 100. For example, the computer system 100 corresponding to the user terminal 100 may include a camera that captures the surroundings to execute the AR view 10. The computer system 100 may display an image captured by the camera as the AR view 10, and may display the content 30 by extending the image of the AR view 10. For example, the computer system 100 may determine whether the computer system 100 is located in a preset unit space by positioning, and if the computer system 100 is located in the preset unit space, may display the content 30 associated with the unit space by extending the image of the AR view 10. However, the actual operation of determining whether the computer system 100 is located in the preset unit space may be performed by the server 200, not the computer system 100.

[0063] The server 200 may be an electronic device that communicates with the computer system 100, provides (augmented) content to the computer system 100, and manages the augmented content. The server 200 is a device that manages (registers, modifies, deletes, stores, maintains, etc.) the content provided to the computer system 100 and the unit space associated with the content, and may include a database or communicate with such a database. The server 200 may also be or include a map server that provides digital maps (3D maps and / or 2D).

[0064] The server 200 may include at least one computer system. The computer system included in the server 200 includes a similar configuration to the computer system 100 described above, and therefore a duplicated description thereof will be omitted.

[0065] In an embodiment, the user terminal 100, which is a computer system 100, may communicate with the server 200 to provide the augmented content 30 through the AR view 10, and may augment and display the content 30 in a video through the AR view 10 based on data and / or information provided by the server 200. In this case, the server 200 may receive the position of the user terminal 100, may determine whether the user terminal 100 is located within a unit space based on the received position, and may provide the user terminal 100 with content associated with the unit space if the user terminal 100 is located within the unit space.

[0066] In the detailed description below, for convenience of explanation, the embodiment will be described focusing on the computer system 100 corresponding to the user terminal 100, but the explanation of the communication with the server 200 and the operation on the server 200 side may be simplified or omitted.

[0067] Also, in the following detailed description, for convenience of explanation, operations (steps) performed by the computer system 100 (or a configuration (e.g., a processor, etc.) of the server 200) will be described as being performed by the computer system 100 (or the server 200).

[0068] The technical features described above with reference to FIG. 1 can also be applied to FIG. 2, so duplicated explanations will be omitted.

[0069] FIG. 3 is a flowchart illustrating a method for providing extended content, in which content is extended and displayed on an AR view image based on a preset unit space, according to an embodiment.

[0070] With reference to FIG. 3, an extended content providing method executed by the computer system 100 will be described. The computer system 100 may be the user terminal 100 described with reference to FIG. 1, and in the following detailed description, the embodiment will be described using the term user terminal 100 instead of the computer system 100. In addition, at least some of the steps 310 to 320 described below and the steps described with reference to FIG. 4 and FIG. 5 may be configured to be executed by the server 200 instead of the user terminal 100. In the following, the execution of each step will be described with a focus on the user terminal 100, but overlapping descriptions of the server 200 may be omitted.

[0071] In step 310, the user terminal 100 or the server 200 may determine whether the user terminal 100 is located in a preset unit space based on the location of the user terminal 100. The user terminal 100 may determine the location of the user terminal 100 by a method based on at least one of GPS, a Visual Positioning System (VPS), and a Wi-Fi Positioning System (WPS), for example, and may determine whether the user terminal 100 is located in the preset unit space based on the determined location. Alternatively, the server 200 may receive the determined location of the user terminal 100 and determine whether the received location is located in the preset unit space.

[0072] Alternatively, whether the user terminal 100 is located in a preset unit space may be determined based on communication between a communication module (e.g., a short-range communication module, an AP (Access Point), a beacon, etc.) present in the unit space and the user terminal 100. As an example, the position of the user terminal 100 may be determined by the strength of communication (i.e., signal strength) between the user terminal 100 and at least one of the communication modules or positioning (e.g., triangulation) based on the communication, and whether the user terminal 100 is located in the unit space may be determined.

[0073] As shown in step 312, the user terminal 100 or the server 200 may determine whether the user terminal 100 has entered the unit space in order to determine whether the user terminal 100 is located within the unit space. A specific method for determining whether the user terminal 100 has entered the unit space or has departed from the unit space will be described in more detail with reference to FIG. 4 and FIG. 8.

[0074] In step 320, the user terminal 100 or the server 200 may extend and display at least one content 30 associated with the unit space in an image using the AR view 10 including an image captured by the camera of the user terminal 100, as a result of the user terminal 100 being determined to be located in the unit space. For example, the user terminal 100 may receive the content 30 or information / data for displaying the content 30 from the server 200, and may thereby display the content 30 in an image using the AR view 10. The server 200 may control the user terminal 100 to extend and display the content 30 associated with the unit space in an image using the AR view 10, as a result of the user terminal 100 being determined to be located in the unit space.

[0075] Alternatively / additionally, in step 320, the user terminal 100 or the server 200 may change settings of an application installed on the user terminal 100 in order to display the AR view 10, based on the determination that the user terminal 100 is located in the unit space. For example, the server 200 may control the user terminal 100 to change settings of an application installed on the user terminal 100.

[0076] The application settings that are changed in this manner may include at least one of changing the display settings of the content 30 that is displayed augmented by the video, changing the display settings of a user interface associated with the AR view 10, and changing the display settings of a map associated with the AR view 10 (such as the map in the map view 20).

[0077] A more specific method for changing application settings will be described in more detail with reference to FIG.

[0078] Hereinafter, a method of setting or defining a unit space for a space in which the user terminal 100 moves and associating content with the unit space will be described in more detail with reference to FIGS. 6, 7, and 13. FIG.

[0079] In this regard, FIG. 6 is a diagram illustrating a method of setting a unit space and mapping content to the unit space in one example.

[0080] The server 200 may define a unit space for the space 600 in which the user terminal 100 moves, independent of the position of the user terminal 100 or the distance from the user terminal 100. Such a unit space may be defined in advance as at least a part of the space 600 prior to providing the extended content to the user terminal 100. The unit space may be an indoor space as in the example shown in the figure. However, depending on the embodiment, the unit space may be an outdoor space or a composite space in which an indoor space and an outdoor space are combined.

[0081] The server 200 may define, for example, a service target area for providing a service as a unit space as each divided area of ​​the space 600. In this case, the unit space may be a layer defined on the space 600 showing a map. In other words, each unit space defined on the space 600 may be a layer.

[0082] A name or an identifier may be assigned to each layer (unit space). For example, as shown in the figure, for a space 600 that is a museum, layers corresponding to each exhibition room may be defined as unit spaces, and each unit space may be assigned the name (or exhibition room number) of the corresponding exhibition room. The name or identifier assigned to the unit space may be displayed on the AR view 10 as an augmented content when the user terminal 100 enters the corresponding exhibition room. This can improve the service experience when the user enters the unit space.

[0083] The server 200 may associate at least one piece of content with each unit space. For example, the server 200 may associate the content with the unit space by mapping the content to an object located in the unit space. Thus, the content becomes associated with a layer corresponding to the unit space.

[0084] In this manner, the unit space set by the server 200 may correspond to a semantic range for providing the extended content corresponding to the service to the user terminal 100.

[0085] In relation to this, FIGS. 13a and 13b are diagrams illustrating a method of defining a unit space corresponding to a semantic range for providing extended content for a space, according to an example.

[0086] As shown in FIG. 13a, a route along which the user terminal 100 moves may be mapped in accordance with a map (or drawing) corresponding to the space 600. Such a route may include a plurality of nodes and links connecting the nodes. The server 200 may set a service target area in the space 600 in which a specific service is provided as a unit space based on such a mapped route. For example, as shown in FIG. 13b, in the space 600 which is a museum, each exhibition room of the museum, such as a prehistoric ancient room, a Paleolithic room, a Bronze Age room, an Ancient Korean room, a Neolithic room, etc., may be set as a unit space based on the mapped route. Each exhibition room set as such a unit space may become a semantic range for providing extended content of a service appropriate for the space.

[0087] As described above, the unit space may be defined based on a map of the space 600 in which the service is provided, or may be defined by geodata based on coordinates. The server 200 may generate and store geodata that defines and divides such unit spaces.

[0088] The geodata indicating the unit space may include two-dimensional coordinates (i.e., x, y coordinates or a range of coordinate values ​​as planar coordinates). The unit space may be composed of a figure composed of a two-dimensional plane. The figure may include a polygon. By comparing the two-dimensional position of the user terminal 100 with the geodata of the unit space, it may be determined whether the user terminal 100 is located in the unit space.

[0089] Also, the unit space may be defined as at least a part of a three-dimensional space within the space 600. In this case, the geodata indicating the unit space may include three-dimensional coordinates (i.e., x, y, z coordinates or a range of coordinate values). When the geodata indicating the unit space includes height information such as a z coordinate, the unit space of the space 600 may indicate a space of a particular floor. In other words, the unit space may be divided by vertical height (e.g., floor). The unit space may be composed of a three-dimensional figure composed of a three-dimensional space.

[0090] In the above-mentioned step 310, the user terminal 100 or the server 200 may determine whether the user terminal is located in a unit space, which is a three-dimensional space, based on the position of the user terminal including the height of the user terminal 100. In other words, it may be determined whether the user terminal 100 is located in the unit space by comparing the three-dimensional position of the user terminal 100 with the geodata of the unit space, which is a three-dimensional space.

[0091] On the other hand, the unit spaces defined for the space 600 may be defined to overlap with each other or to have a hierarchical relationship.

[0092] In this regard, FIG. 7 is a diagram illustrating a method for setting unit spaces having overlapping and / or hierarchical relationships in one example.

[0093] The space 700 shown in the figure may be a space in which the user terminal 100 moves, and may correspond to a service providing area for providing services.

[0094] In the space 700, a plurality of unit spaces 710 to 730 including a first unit space 710 and a second unit space 720 at least a part of which is included in the first unit space 710 may be defined.

[0095] The second unit space 720 may be a space that partially overlaps with the first unit space 710, or may be a space that is completely included in the first unit space 710 as shown in the figure. Meanwhile, the third unit space 730 may be a space that partially overlaps with the first unit space 710 and / or the second unit space 720, or may be a space that is completely included in the first unit space 710 and the second unit space 720 as shown in the figure.

[0096] In the example shown in the figure, the second unit space 720 may be a sub-unit space of the first unit space 710. On the other hand, the third unit space 730 may be a sub-unit space of the first unit space 710 and the second unit space 720.

[0097] In this manner, the server 200 may define layers corresponding to unit spaces that overlap with each other for the space 700, and may define layers corresponding to unit spaces that have a hierarchical relationship with each other. As the unit spaces have a hierarchical relationship with each other, the contents associated with the unit spaces may also have a hierarchical relationship with each other.

[0098] For example, when the server 200 sets a layer corresponding to the second passenger terminal of Incheon International Airport as the unit space 710, which is the highest level unit space, the server 200 may set a layer corresponding to the Sky Hub Lounge in the second passenger terminal as the lower unit space 720, and may set a layer corresponding to Starbucks in the Sky Hub Lounge as the lower unit space 730.

[0099] In this way, the server 200 can define a layer corresponding to the entire space (airport) as a higher-level unit space, and define lower layers corresponding to the spaces inside (shopping mall, restaurant area, airline desks, etc.) as lower-level unit spaces, so that the unit spaces have a hierarchical relationship. The display of the augmented content in step 320 may be based on such a hierarchical relationship.

[0100] For example, in step 320, the user terminal 100 or the server 200 may extend and display at least one content associated with the second unit space 720 and at least one content associated with the first unit space 710 in an image by determining that the user terminal 100 is located in the second unit space 720. In other words, when the user terminal 100 enters a lower unit space, the user terminal 100 may extend and display the content associated with the lower unit space and the content associated with the higher unit space in an image of the AR view 10.

[0101] On the other hand, unit spaces defined by overlapping or unit spaces having a hierarchical relationship may also be defined as the above-mentioned three-dimensional space. A duplicated explanation of this will be omitted.

[0102] Hereinafter, a method for extending and displaying content related to the unit space in the image of the AR view 10 when it is determined that the user terminal 100 is located in the preset unit space will be described in more detail.

[0103] As described above, a plurality of unit spaces may be defined in a service space in which a user terminal moves.

[0104] The user terminal 100 may not extend and display in the image content associated with other unit spaces adjacent to the unit space in which the user terminal 100 is currently located, content associated with other unit spaces within a predetermined radius from the location of the user terminal 100, or content associated with objects other than the unit space within a predetermined radius from the location of the user terminal 100, but may extend and display in the image only at least one piece of content associated with the unit space in which the user terminal 100 is currently located.

[0105] In other words, the user terminal 100 may display the extended content based on a semantic range defined as a unit space, rather than displaying the extended content based on a predetermined radius or distance from the position of the user terminal 100 that corresponds to a normal rendering range.

[0106] Referring again to FIG. 1, the AR view 10 of the user terminal 100 displays content 30 associated with the unit space 3 in which the user terminal 100 is currently located, but does not display content associated with other unit spaces (e.g., unit space 1 or unit space 4 adjacent to unit space 3) that are physically close to the location of the user terminal 100 but in which the user terminal 100 is not located, or content mapped to objects (e.g., objects X, Y, and Z) that are physically close to the location of the user terminal 100 but not within unit space 3.

[0107] In this manner, content that does not need to be provided to a user terminal 100 located in a unit space 3 separated by a wall / partition within space 5, such as content associated with unit space 1 or unit space 4 or content mapped to objects X, Y, and Z, can be prevented from being displayed by the view 10.

[0108] In the embodiment, it is possible to prevent the display of unnecessary augmented content by filtering and displaying only the content associated with the unit space 3 in which the user terminal 100 is currently located by the AR view 10. Therefore, it is possible to reduce the cognitive load on the user and the load on the user terminal.

[0109] The technical features described above with reference to Figs. 1 and 2 can also be applied to Figs. 3, 6, 7, and 13, and therefore duplicated explanations will be omitted.

[0110] FIG. 4 is a flowchart illustrating a method for changing the display of content of an AR view and / or application settings by determining whether a user terminal has deviated from a unit space in one example.

[0111] With reference to FIG. 4, a method for determining entry into the unit space of the user terminal 100 and modifying the display of the content 30 of the AR view 10 and / or application settings accordingly will be described in more detail.

[0112] In step 312 described with reference to FIG. 3, the user terminal 100 or the server 200 may determine whether the user terminal 100 has entered the unit space in order to determine whether the user terminal 100 is located within the unit space. When it is determined that the user terminal 100 has entered the unit space, the user terminal 100 may extend and display the filtered content in the image as the content associated with the unit space. In other words, when it is confirmed that the user terminal 100 has entered the unit space, the server 200 may filter the content associated with the unit space, and may provide the filtered content to the user terminal 100 so that the extended content is displayed on the user terminal 100.

[0113] In step 410, the user terminal 100 or the server 200 may determine, based on the position of the user terminal 100, whether the user terminal 100 has deviated from the unit space.

[0114] For example, when determining entry into the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has entered the unit space if the coordinates corresponding to the position of the user terminal 100 are included within the unit space. Also, when determining entry into the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has departed from the unit space if the coordinates corresponding to the position of the user terminal 100 are no longer included within the unit space.

[0115] Whether the user terminal 100 has entered the unit space may be determined based on whether the coordinates (two-dimensional or three-dimensional coordinates) corresponding to the position of the user terminal 100 are included in a figure (two-dimensional or three-dimensional figure) that is a layer indicating the unit space. Such determination of whether the user terminal 100 has entered the unit space may be made by comparing the coordinates corresponding to the position of the user terminal 100 with the geodata of the unit space.

[0116] As another example, when determining whether to enter the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has entered the unit space if it is determined based on the position of the user terminal 100 that the user terminal 100 has passed a first node predefined in association with the unit space. The first node may be an entrance point predefined for the unit space. Furthermore, when determining whether to enter the unit space, the user terminal 100 or the server 200 may determine that the user terminal 100 has departed from the unit space if it is determined based on the position of the user terminal 100 that the user terminal 100 has passed a second node predefined in association with the unit space. The second node may be an exit point predefined for the unit space.

[0117] At least one of the entry point and the exit point may be set for the unit space. Each of the entry point and the exit point may be a node that is predefined for the unit space so that the user terminal 100 passes through.

[0118] In this regard, FIG. 8 is a diagram illustrating a method for determining entry into a unit space based on a preset node in one example.

[0119] In the example shown in the figure, when the user terminal 100 passes through node 802 corresponding to the entrance point of unit space 2, it may be determined that the user terminal 100 has entered unit space 2, and when the user terminal 100 passes through node 804 corresponding to the exit point of unit space 2, it may be determined that the user terminal 100 has exited unit space 2. When the user terminal 100 passes through node 806 corresponding to the entrance point of unit space 3, it may be determined that the user terminal 100 has entered unit space 3, and when the user terminal 100 passes through node 808 corresponding to the exit point of unit space 3, it may be determined that the user terminal 100 has exited unit space 3. When the user terminal 100 passes through node 810 corresponding to the entrance point of unit space 4, it may be determined that the user terminal 100 has entered unit space 4.

[0120] Nodes 802, 806, and 810 corresponding to entry points may be located on the entry side of the unit space, and nodes 804 and 808 corresponding to exit points may be located on the exit side of the unit space. If there are multiple entry points or exit points in the unit space, multiple nodes corresponding to entry points or exit points may be located. Each node may be associated with two-dimensional or three-dimensional coordinates, and these coordinates may be included in the geodata of the corresponding unit space.

[0121] If the unit space is not an open space but a space with an entrance and / or exit, the accuracy of the determination can be improved by determining whether the user terminal 100 has entered or entered the unit space depending on whether the user terminal 100 has passed through an entrance point and / or an exit point.

[0122] As for the method of determining whether the user terminal 100 has passed through a node, the above-mentioned explanation regarding the positioning method of the user terminal 100 and the explanation regarding the method of determining whether the user terminal 100 is located in the unit space are equally applicable, so duplicate explanations will be omitted.

[0123] At step 420, the user terminal 100 or the server 200 may change the display of the content 30 of the AR view 10 and / or additionally change the settings of an application installed on the user terminal 100 in response to a determination that the user terminal 100 has deviated from the unit space.

[0124] For example, when it is determined that the user terminal 100 has deviated from the second unit space and moved to a third unit space, which is another unit space among the multiple unit spaces defined in the service space, the user terminal 100 or the server 200 may stop extending and displaying the content associated with the second unit space in the image of the AR view 10, and may extend and display at least one other content associated with the third unit space in the image of the AR view 10. In other words, as the movement of the user terminal 100 to another unit space is confirmed, the extended content displayed by the AR view 10 may be dynamically updated to the content associated with the corresponding other unit space. This makes it possible to prevent content unrelated to the unit space from which the user terminal 100 has deviated or the unit space into which the user terminal 100 has entered from being extended to the image of the AR view 10.

[0125] In this manner, in the embodiment, the entry of the user terminal 100 into a unit space can be recognized in consideration of the position recognized in real time according to the movement of the user terminal 100. As a result, the cancellation of the display of the content associated with the unit space into which the user terminal 100 has entered and the activation of the display of the content associated with the unit space into which the user terminal has entered can be performed in real time. For example, when the user terminal 100 tours a museum, which is a service space, even when the user terminal 100 moves through an exhibition hall corresponding to the unit space, a switch to display the content associated with the exhibition hall into which the user terminal 100 has entered can be performed dynamically in real time.

[0126] Alternatively / additionally, upon confirmation of the movement of the user terminal 100 to another unit space, the settings of the application installed on the user terminal 100 may be appropriately changed according to the attributes of the other unit space.

[0127] The technical features described above with reference to FIGS. 1 to 3, 6, 7, and 13 can also be applied to FIGS. 4 and 8, and therefore overlapping descriptions will be omitted.

[0128] FIG. 5 is a flow chart illustrating a method for displaying a map view in one example.

[0129] In step 510, the user terminal 100 may display a map view 20 including a map matched to the image together with the AR view 10. That is, the map included in the map view 20 may include the current location of the user terminal 100 and the location indicated by the image. The server 200 may control the user terminal 100 to display such a map view 20.

[0130] 1, the map view 20 may include a current location 50 of the user terminal 100. The map view 20 may include a two-dimensional or three-dimensional map, and may include a unit space through which the user terminal 100 moves, content provided to the user terminal 100, or an object to which the content is mapped.

[0131] As in step 520, when displaying the map view 20, the user terminal 100 may display the area of ​​the map corresponding to the unit space in which it is determined that the user terminal 100 is located so as to be visually separated from the remaining areas.

[0132] As shown in Fig. 1, in the map view 20, an area corresponding to the unit space in which the user terminal 100 is located may be displayed in three dimensions, while the remaining area may be displayed in two dimensions, thereby visually dividing the unit space in which the user terminal 100 is located. More specifically, in the map view 20, the user terminal 100 may display the boundary (i.e., wall portion) between the area corresponding to the unit space and the remaining area in three dimensions, and may visually divide the unit space in which the user terminal 100 is located by highlighting the area corresponding to the unit space compared to the remaining area. Highlighting may mean displaying the area corresponding to the unit space in a color different from the remaining area.

[0133] Furthermore, the user terminal 100 may display an animation that shows the effect of displaying the area corresponding to the unit space in which the user terminal 100 is located in three dimensions. In other words, when the user terminal 100 enters the unit space, the user terminal 100 may play an animation in the map view 20 that changes the boundary between the area corresponding to the unit space displayed in two dimensions and the remaining area to three dimensions. An operation of highlighting the area corresponding to the unit space may also be executed at the same time as playing the animation. This allows the user to intuitively confirm in the map view 20 that the user terminal 100 has entered a specific unit space.

[0134] Meanwhile, depending on the embodiment, the user terminal 100 may display the map view 20 separately from the AR view 10, i.e., on a separate screen.

[0135] In this regard, FIG. 11 is a diagram illustrating a method for displaying a map of a space in which a user terminal moves, in one example.

[0136] The map screen shown in FIG. 11 may be a map view 20 that is displayed separately from the AR view 10. As shown in the figure, even in the map view displayed in FIG. 11, the area corresponding to the unit space in which it is determined that the user terminal 100 is located may be displayed so as to be visually separated from the remaining area. Similarly, even in the map view of FIG. 11, the user terminal 100 may display the boundary (i.e., wall portion) between the area corresponding to the unit space and the remaining area in three dimensions, and may display the area corresponding to the unit space in a highlighted manner compared to the remaining area, so that the unit space in which the user terminal 100 is located is visually separated. The effect of displaying the area corresponding to the unit space in which the user terminal 100 is located in three dimensions as an animation can also be applied directly to the example of FIG. 11.

[0137] Meanwhile, according to an embodiment, the map view 20 may be configured not to display contents or objects in unit spaces other than the unit space into which the user terminal 100 has entered.

[0138] As shown in the figure, a name (representative name) or identifier of the unit space may be labeled in an area corresponding to the unit space of the map in the map view 20. Such a labeled name (representative name) or identifier of the unit space may be displayed as an extension content on the user terminal 100 when the user terminal 100 enters the unit space or before the user terminal 100 enters the unit space.

[0139] A method for displaying augmented content via the map view 20 will now be described with reference to FIG.

[0140] FIG. 12a is a diagram showing a method in one example in which a user terminal provides an AR view and a map view by the user terminal entering a unit space, and FIG. 12b is a diagram showing the map view on the screen of the user terminal of FIG. 12a in more detail.

[0141] 12a, when the user terminal 100 enters the unit space, or when the user terminal 100 approaches an object in the unit space by a certain distance or more after entering the unit space, content 1200 mapped to the object may be extended and displayed in the image in the AR view 10. The content 1200 may correspond to the content 30 described above.

[0142] In the example shown in the figure, when the object is a comb pottery, the content 1200 mapped to the object may include text and a three-dimensional image as content for describing the comb pottery. The three-dimensional image may be a shape corresponding to the object. The text may include information for describing the details of the object. For example, the text may include text for describing the type of pattern on the comb pottery.

[0143] However, an object may have multiple contents mapped to it. For example, an object that is a comb pottery may have a first content mapped to it that includes the name of the object ("comb pottery") and an icon indicating the type or variety of the object, and a second content, such as content 1200 for the object.

[0144] When the user terminal 100 enters the unit space, the first content may first be augmented and displayed as an image in the AR view 10, and when the user terminal 100 identifies the first content, moves toward the object, and approaches the object by more than a certain distance, the second content, content 1200, may be augmented and displayed as an image in the AR view 10.

[0145] In this way, in providing the extended content according to this embodiment, in addition to the method of providing extended content based on the cement range, a method of providing extended content based on a normal rendering range can be additionally combined and used.

[0146] This is explained in more detail with reference to FIG.

[0147] Meanwhile, in the map view 20, as described above, the unit space in which the user terminal 100 is located may be visually divided and displayed. Meanwhile, in the map view 20, the content 1210 may be displayed corresponding to the content 1200. The content 1210 may be displayed in the map view 20 at the time when the content 1200 is displayed by the AR view 10. This allows the user to intuitively identify the position where the content 1200 is displayed by the content 1210 displayed in the map view 20 as well as the AR view 10. When the content 1210 is displayed in the map view 20, an animation effect may be applied.

[0148] As described, in the embodiment, the AR view 10 and the map view 20 can provide the content 1200, 1210 to the user terminal 100 in an efficient manner for objects in a unit space that the user terminal 100 has entered.

[0149] The technical features described above with reference to Figures 1 to 4, 6 to 8, and 13 can also be applied directly to Figures 5, 11, and 12, so duplicated explanations will be omitted.

[0150] FIG. 9 is a diagram illustrating a method for providing enhanced content according to movement of a user terminal within a unit space in one example.

[0151] With reference to Figure 9, a more detailed description will be given of a method for providing extended content by combining an extended content providing method based on a normal rendering range with an extended content providing method based on a cement range in addition to the extended content providing method.

[0152] The unit space 910 in which the user terminal 100 is located, i.e., the space into which the user terminal 100 has entered, may be associated with multiple contents. For example, the unit space may include multiple objects to which multiple contents are mapped. Also, as described above, multiple contents may be mapped to one object.

[0153] When it is determined that the user terminal 100 is located in the unit space 910, the user terminal 100 may extend and display, among the plurality of contents, content that is mapped to an object located within a predetermined distance from the location of the user terminal 100 or within a predetermined radius from the location of the user terminal 100, in the image of the AR view 10 based on the location of the user terminal 100. For example, even if the user terminal 100 enters the unit space 910, not all content associated with the unit space 910 is extended and displayed in the image of the AR view 10, but only some of the content is displayed. Therefore, when the user terminal 100 approaches an object to which content is mapped, the content is extended and displayed in the image of the AR view 10 in the user terminal 100.

[0154] As described above, in the embodiment, the content filtered based on the cement range can be filtered again based on the normal rendering range and provided to the user terminal 100. As a result, in the embodiment, from the user's perspective, content related to a unit space where the user is not located is not provided, and at the same time, even if the content is in the unit space where the user is located, content that is far from the current location or is not related to the object currently being viewed is not provided.

[0155] As shown in the example in the figure, it is assumed that the user 900 moves within the unit space 910 toward objects 1 to 6 (indicated by circled characters in the figure) located within the unit space 910. A range 920 indicates a user's movable range. A range 930 indicates a radius within which content is output. The range 930 may be a distance, and may be set differently depending on each of the contents mapped to the objects 1 to 6. The range 930 may also be set differently depending on the attributes or characteristics of the unit space 910. For example, when the user 900 moves toward an object 4 within the unit space 910, when the object 4 enters the range 930, the content 940 may be displayed on the AR view 10 of the user terminal 110. The content 940 may not be displayed when the user terminal 100 enters the unit space 910, but may be displayed when the user terminal 100 approaches the object 4.

[0156] A plurality of contents related to the unit space 910 may be hierarchical. For example, when the user terminal 100 enters the unit space 910 or approaches the unit space 910 or a node corresponding to an entrance point by a certain radius or distance or more, first, a content (top layer content) indicating the name (representative name) or identifier of the unit space 910 may be displayed on the AR view 10 of the user terminal 100. Meanwhile, when the user terminal 100 enters the unit space 910, a content (upper layer content) including an icon indicating the name of an object and the type or kind of the object, such as the first content described with reference to FIG. 12, may be displayed. When the user terminal 100 identifies the first content, moves toward the object, and approaches the object by a certain distance or more, a second content (lower layer content) such as the content 1200 may be extended to an image and displayed on the AR view 10.

[0157] In this manner, in the embodiment, in addition to providing the extended content utilizing the cement range, it is possible to provide the extended content hierarchically taking into consideration the normal rendering range. Therefore, the user can receive only the meaningful content service according to the distance to the object in the unit space.

[0158] The technical features described above with reference to FIGS. 1 to 8 and 11 to 13 can also be applied to FIG. 9 as they are, so duplicated explanations will be omitted.

[0159] FIG. 10 is a diagram showing a method for changing settings of an application installed in a user terminal in accordance with an attribute of a unit space in one example.

[0160] Hereinafter, a method for changing the settings of an application installed in the user terminal 100 according to the location of the user terminal 100 in the unit space will be described in more detail with reference to FIG.

[0161] As described above, by positioning the user terminal 100 in the unit space, at least one of the following application settings may be changed: a change in display settings of the content 30 augmented and displayed in the video; a change in display settings of a user interface related to the AR view 10; and a change in display settings of a map related to the AR view 10 (e.g., the map of the map view 20). The change in display settings of the user interface may be a change in the size of a button included in the user interface. The changed application setting may be an angle, distance, or effect of a camera that provides the AR view 10, or a change in the viewpoint or viewpoint angle of the map view 20.

[0162] Such application settings may be changed differently depending on the attributes of the unit space in which the user terminal 100 is located. For example, the application settings may be changed differently depending on whether the user terminal 100 is located in an indoor space or an outdoor space.

[0163] As an example, if the unit space in which the user terminal 100 is determined to be located is an outdoor space, the user terminal 100 or the server 200 may change the application settings to display the content extended in the image of the AR view 10 relatively larger and to display the map of the map view 20 at a relatively smaller scale. Thus, the user terminal 100 may display the extended content relatively larger in an outdoor space and the map of the map view 20 may display a relatively larger area of ​​the space. In addition, the user terminal 100 may change the camera angle, distance, or effect of the AR view 10 to be suitable for outdoor shooting, or change the viewpoint of the map (e.g., change to a 3D map display viewpoint).

[0164] Furthermore, if the unit space in which the user terminal 100 is determined to be located is an indoor space, the user terminal 100 or the server 200 may change the application settings to display the content extended in the image of the AR view 10 relatively smaller and to display the map of the map view 20 at a relatively larger scale. Thus, the user terminal 100 may display the extended content relatively smaller in an indoor space and the map of the map view 20 may display a relatively small area of ​​the space in more detail. Furthermore, the user terminal 100 may change the camera angle, distance, or effect of the AR view 10 to be suitable for indoor and outdoor shooting (e.g., by reducing the aperture value), or change the viewpoint of the map (e.g., change to a two-dimensional map display viewpoint).

[0165] In this manner, in the embodiment, by considering the position grasped in real time by the movement of the user terminal 100, it is possible to grasp whether the user terminal 100 is in an indoor space or an outdoor space, and this makes it possible to dynamically change the application settings in real time. The user can experience an experience optimized for the attributes of the space to which the user belongs.

[0166] Meanwhile, the above-mentioned attribute of the unit space is not limited to indicating indoors or outdoors, and may be various characteristics associated with the unit space or the type of the unit space. For example, if the unit space is an exhibition hall, the user terminal 100 may be controlled so that the application settings are changed according to the requirements of the exhibition hall (i.e., the camera settings required by the exhibition hall).

[0167] The technical features described above with reference to FIGS. 1 to 9 and 11 to 13 can also be applied to FIG. 10 as is, so duplicated explanations will be omitted.

[0168] The service that provides augmented content to the user terminal 100 of the embodiment may be a metaverse service that utilizes location-based AR utilizing 3D mapping / digital twin. Depending on the embodiment, the service may grasp the location of the user terminal 100, recognize the space in which the user actually exists, and extend the content linked to a specific location in this space using the AR view 10. Using the augmented content as a medium, it is possible to provide information, entertainment, and even social interaction between users. This allows a virtual metalayer to be added to the real-world space.

[0169] Depending on the embodiment, it is possible to eliminate the complication of the user interface caused by an excessive amount of content extended by the AR view 10, the increase in the cognitive load on the user, and the increase in the load on the user terminal 100.

[0170] The embodiment sets a "unit space" for a complex space that is composed of multiple spaces integrated / connected, and by entering such a "unit space," meaningful content in this "unit space" can be provided to the user.

[0171] For example, when providing services in a complex space such as a museum, which has multiple spaces divided according to era or theme, i.e., exhibition halls, content corresponding to the exhibition hall the user has entered can be appropriately provided to the user's user terminal 100. In this case, content of other exhibition halls separated by partitions (walls) is not provided to the user terminal 100.

[0172] On the other hand, when a user is walking in an outdoor space, by defining in advance specific parts of the indoor space and specific parts of the outdoor space as unit spaces, it is possible to provide only meaningful content to the user terminal 100 when providing services in outdoor spaces, or even in complex spaces where indoor and outdoor spaces coexist.

[0173] This can be achieved by utilizing a semantic rendering range that defines a service target space having semantic meaning units as a unit space and controls the expansion of the content, rather than a rendering range that simply controls the expansion of the content based on the distance or radius from the user.

[0174] The above-mentioned devices may be realized by hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software to access, record, manipulate, process, and generate data. For convenience of understanding, a single processing device may be described as being used, but one skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0175] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored or executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0176] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously records a computer-executable program or one that temporarily records the program for execution or download. The medium may be one of various recording means or storage means in the form of a single or multiple hardware devices combined, and may be one that is directly connected to a computer system, as well as one that is distributed on a network. Examples of the medium include magnetic media such as hard disks, floppy (subscription trademark) disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to record program instructions such as ROMs, RAMs, flash memories, etc. Examples of other media include recording media and storage media managed by app stores that distribute applications, sites that supply or distribute various other software, and servers.

[0177] Although the embodiments have been described based on the limited embodiments and drawings as above, those skilled in the art will be able to make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from that described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a manner different from that described, or may be counterbalanced or replaced by other components or equivalents, and still achieve suitable results.

[0178] Therefore, different embodiments are within the scope of the appended claims provided that they are equivalent to the claims.

Claims

1. 1. An enhanced content providing method executed by a computer system that is a server or a user terminal, comprising: determining whether the user terminal is located in a preset unit space based on the location of the user terminal; and augmenting and displaying at least one content associated with the unit space in an augmented reality (AR) view including an image captured by a camera of the user terminal when it is determined that the user terminal is located in the unit space; An enhanced content providing method, comprising:

2. The unit space is defined in advance as at least a part of a space in which the user terminal moves, independently of a position of the user terminal or a distance from the user terminal; The method of claim 1 , wherein the content is mapped to at least one object in the unit space.

3. The unit space is defined as a layer on a map for the space, the layer corresponding to a service target area in which a service including the content is provided within the space; The method of claim 2 , wherein the content is associated with the layer.

4. The unit space is predefined as at least a part of a three-dimensional space within the space, The method of claim 2 , wherein the determining step determines whether the user terminal is located in the unit space, which is the three-dimensional space, based on a position of the user terminal including a height of the user terminal.

5. A plurality of unit spaces including the unit space are defined in a space in which the user terminal moves, 2. The method of claim 1, wherein the display step does not extend and display in the image content associated with other unit spaces adjacent to the unit space, content associated with other unit spaces existing within a predetermined radius from the position of the user terminal, or content associated with objects other than the unit space existing within a predetermined radius from the position of the user terminal, but extends and displays in the image only at least one content associated with the unit space determined to be located by the user terminal.

6. The determining step includes: determining whether the user terminal has entered the unit space; Including, The displaying step includes: When the user terminal enters the unit space, the content filtered as content related to the unit space is extended and displayed on the image; determining whether the user terminal has deviated from the unit space based on the location of the user terminal; The method of claim 5 further comprising:

7. The step of determining whether the user terminal has entered the unit space includes determining that the user terminal has entered the unit space if a coordinate corresponding to a position of the user terminal is included in the unit space; The method for providing extended content according to claim 6, wherein the step of determining whether the user terminal has deviated from the unit space determines that the user terminal has deviated from the unit space if coordinates corresponding to the position of the user terminal are not included within the unit space.

8. The step of determining that the user terminal has entered the unit space includes determining that the user terminal has entered the unit space if it is determined that the user terminal has passed a first node predefined in relation to the unit space based on a location of the user terminal; 7. The method of claim 6, wherein the step of determining whether the user terminal has deviated from the unit space comprises determining that the user terminal has deviated from the unit space if it is determined that the user terminal has passed a second node predefined in association with the unit space based on a position of the user terminal.

9. and stopping the content from being extended and displayed on the image when it is determined that the user terminal has moved out of the unit space and into another unit space among the plurality of unit spaces, and extending and displaying at least one other content associated with the other unit space on the image. The method of claim 6 , further comprising:

10. changing settings of an application installed on the user terminal to display the AR view when it is determined that the user terminal is located in the unit space; Further comprising: The method of providing enhanced content as described in claim 1 , wherein the application settings include at least one of changing display settings of the content, changing display settings of a user interface associated with the AR view, and changing display settings of a map associated with the AR view.

11. The step of changing the settings of the application includes: if the unit space in which it is determined that the user terminal is located is an outdoor space, changing a setting of the application so that the content is displayed relatively large and the scale of the map is displayed relatively reduced; The extended content providing method according to claim 10, further comprising changing settings of the application so that, if the unit space in which the user terminal is determined to be located is an indoor space, the content is displayed relatively small and the scale of the map is displayed relatively enlarged.

12. The unit space is associated with a plurality of contents; The displaying step includes: The extended content providing method according to claim 2, wherein, when it is determined that the user terminal is located in the unit space, based on the position of the user terminal, content among the plurality of contents that is mapped to an object that is located within a predetermined distance from the position of the user terminal or within a predetermined radius from the position of the user terminal is extended and displayed in the image.

13. displaying a map view including a map matched to the image together with the AR view. Further comprising: The method of providing enhanced content according to claim 1 , wherein the map displayed by the map view includes a position of the user terminal, the unit space, and the content or an object to which the content is mapped.

14. The step of displaying a map view includes: The method of providing extended content according to claim 13 , further comprising displaying an area of ​​the map corresponding to the unit space in which it is determined that the user terminal is located so as to be visually separated from the remaining area.

15. The step of displaying a map view includes: The method of claim 14 , further comprising displaying a boundary between the area corresponding to the unit space and the remaining area in three dimensions, and displaying the area corresponding to the unit space in a highlighted manner compared to the remaining area.

16. A plurality of unit spaces including a first unit space and a second unit space at least a part of which is included in the first unit space are defined in a space in which the user terminal moves, The extended content providing method according to claim 2 , wherein the unit space is the first unit space or the second unit space.

17. the second unit space is a sub-unit space of the first unit space, When the unit space is the second unit space, The displaying step includes: The method of providing extended content according to claim 16, further comprising: extending and displaying at least one content associated with the second unit space and at least one content associated with the first unit space in the video when it is determined that the user terminal is located in the second unit space.

18. A computer program recorded on a non-transitory computer-readable recording medium for executing the extended content providing method according to any one of claims 1 to 17 on the user terminal which is a computer system.

19. A computer system realizing a user terminal or a server, At least one processor configured to execute computer-readable instructions contained in the memory. Including, The at least one processor A computer system that determines whether the user terminal is located in a preset unit space based on a position of the user terminal, and when it is determined that the user terminal is located in the unit space, augments and displays at least one content associated with the unit space into the image using an augmented reality (AR) view including an image captured by a camera of the user terminal.

Citation Information

Patent Citations

  • Reception device, reception method, transmission device, and transmission method

    JP2015037242A

  • Display device, information processing system, and control method

    JP2016218981A

  • Cutting device

    KR102232940B1

  • Augmented reality system and method with dynamic representation technique of augmented images

    US10665036B1

  • Apparatus and method for providing augmented reality service

    US20130328930A1