Method and apparatus for providing augmented contents through augmented reality view using main stage and virtual stage connected thereto which are separately defined on unit space
Patent Information
- Application Number
- KR1020240097147
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-07-23
- Publication Date
- 2026-09-29
- Estimated Expiration
- 2044-07-23
Smart Images

Figure R1020240097147_ABST
Abstract
Description
Technology Field
[0001] The following description relates to a method and apparatus for providing content (or contents item) to an image using an augmented reality view, and to a technology for providing content through an augmented reality view using a main stage individually defined in a unit space and a virtual stage connected thereto, and for generating content for display in such an AR view. Background Technology
[0002] Augmented Reality (AR) refers to a technology that fuses and complements the real world with virtual objects and information created using computer technology. In other words, augmented reality is a technology that displays virtual content by augmenting it onto the actual environment, allowing users to view the augmented content in correspondence with the real environment through electronic devices.
[0003] When a user terminal, which is an electronic device, is located in a specific unit space, content items associated with that unit space can be augmented and displayed in the AR view of the user terminal. However, considering the spatial constraints of the unit space, it is difficult to map content items corresponding to multiple scenarios or themes to a single unit space, and therefore, it is difficult to satisfy the diverse needs of users. Furthermore, to satisfy these diverse user needs, users are required to install and use individual applications on their terminals that provide content items corresponding to each scenario or theme through the AR view.
[0004] As a technology related to various services utilizing augmented reality technology, for example, Korean Published Patent Application No. 10-2014-0065963 (published on May 30, 2014) discloses an augmented reality navigator that displays an image of a driving path captured by a camera installed in a vehicle on a display and maps virtual display information that guides the driving path onto the image displayed on the display.
[0005] The information described above is for illustrative purposes only and may include content that does not constitute part of the prior art and may not include what the prior art would present to a person skilled in the art. The problem to be solved
[0006] When it is determined that a user terminal is located in a pre-configured unit space, a first content item associated with a main stage representing a first service space corresponding to the unit space is augmented and displayed through the AR (augmented reality) view of the user terminal, and as interaction is performed between the user terminal and a predetermined connection interface, a second content item associated with a virtual stage representing a second service space corresponding to the unit space, which is defined separately from the first service space, is displayed through the AR view.
[0007] A method can be provided to define a main stage representing a first service space corresponding to a unit space and a virtual stage representing a second service space defined separately from the first service space, and to connect the main stage and the virtual stage to generate content for display through the AR view of a user terminal. means of solving the problem
[0008] According to one aspect, a method for providing content performed by a computer system that is a server or a user terminal comprises: a step of determining whether the user terminal is located in a pre-set unit space based on the location of the user terminal; and a step of augmenting and displaying at least one first content item associated with a main stage corresponding to the unit space through an augmented reality (AR) view including an image captured by a camera of the user terminal, as determined that the user terminal is located in the unit space. A method for providing content is provided, comprising the step of displaying at least one second content item associated with a virtual stage connected to the main stage and corresponding to at least a part of the unit space through the AR view, as any one of i) interaction between the user terminal and a predetermined connection node located within the main stage, ii) interaction between the user terminal and a connection content item augmented and displayed through the AR view, or iii) entry into a predefined connection area within the main stage by the user terminal, wherein the main stage represents a first service space corresponding to the unit space, and the virtual stage represents a second service space corresponding to a space including at least a part of the unit space defined separately from the first service space.
[0009] The first content item is displayed augmented in the AR view according to a first scenario defined for the main stage, and the second content item is displayed augmented in the AR view according to a second scenario defined for the virtual stage independent of the first scenario. The step of displaying the first content item augmented is for the user terminal to enter the main stage and display the first content item augmented through the AR view according to the first scenario, and the step of displaying the second content item is for the user terminal to switch from the main stage to the virtual stage and display the second content item through the AR view according to the second scenario.
[0010] A first connection node is defined as the connection node within the main stage, and a second connection node connected to the first connection node is defined within the virtual stage, and the connection between the first connection node and the second connection node includes an attribute connecting the main stage and the virtual stage, and the step of displaying the second content item is such that, as the user terminal performs an interaction with the first connection node, the user terminal switches from the main stage to the virtual stage and displays the second content item through the AR view.
[0011] The first content item above may be mapped to the first connection node and displayed augmented in the AR view.
[0012] The above content provision method may further include the step of displaying a map view including a map that matches the image together with the AR view; and the step of converting the map view to include map data defined according to the second scenario as the user terminal switches from the main stage to the virtual stage.
[0013] By the above user terminal, the main stage and the virtual stage can be recognized as the same positioning space of the unit space.
[0014] In the virtual stage, at least one virtual POI is defined independently of the POI defined in the main stage, and the second content item can be augmented and displayed in the AR view as interaction is performed between the user terminal and the virtual POI.
[0015] The virtual stage above is implemented by inheriting at least a portion of the spatial information defined for the main stage above, and may additionally have a scenario defined for augmenting and displaying the second content item through the AR view.
[0016] A plurality of virtual stages including the virtual stage are connected to the main stage, and at least one of a connection node, a connection content item, or a connection area is defined in the main stage for entering each virtual stage among the plurality of virtual stages of the user terminal, and each virtual stage may represent a service space corresponding to at least a part of the unit space defined separately from the first service space.
[0017] At least one sub-virtual stage is connected to the above-mentioned virtual stage, and the sub-virtual stage represents a third service space corresponding to a space that includes at least a part of the unit space defined separately from the first service space and the second service space, and at least one of a connection node, a connection content item, or a connection area is defined in the above-mentioned virtual stage for the user terminal to enter the above-mentioned virtual stage, and the content provision method may further include the step of augmenting and displaying at least one third content item associated with the sub-virtual stage through the AR view as any one of the following is performed: ii) interaction between the user terminal and the connection node defined in the above-mentioned virtual stage, ii) interaction between the user terminal and the connection content item defined in the above-mentioned virtual stage, or iii) entry into the connection area defined in the above-mentioned virtual stage by the user terminal.
[0018] In the above sub-virtual stage, at least one of a first connection interface including at least one of a connection node for re-entry into the virtual stage, a connection content item, or a connection area; a second connection interface including at least one of a connection node for re-entry into the main stage, a connection content item, or a connection area; and at least one of a third connection interface including at least one of a connection node for entry into another sub-virtual stage connected to the virtual stage, a connection content item, or a connection area are defined, and as an interaction is performed between the user terminal and the first connection interface, the second connection interface, or the third connection interface, the user terminal may enter the virtual stage, the main stage, or the other sub-virtual stage.
[0019] The step of displaying the second content item is to display the second content item through the AR view as the user terminal enters the virtual stage from the main stage, and at least one of a termination node, a termination content item, or a termination area is defined in the virtual stage for terminating the display of the virtual stage at the user terminal, and the content providing method may further include the step of terminating the display of the virtual stage at the user terminal as any one of the following is performed: ii) an interaction between the user terminal and the termination node, ii) an interaction between the user terminal and the termination content item defined in the virtual stage, or iii) entry into the termination area by the user terminal.
[0020] The above AR view may be a web-based AR view executed through a web browser installed on the user terminal.
[0021] The second service space represented by the virtual stage corresponds to a space that includes at least a part of the unit space and a part of another unit space different from the unit space, and the second content item may include path guidance information to a predetermined location within the other unit space.
[0022] The step of augmenting and displaying the second content item may include: turning off the positioning function for the unit space of the user terminal; and displaying VR content or full-screen content corresponding to the view of the camera as the second content item through the AR view.
[0023] The step of displaying the second content item is to display the second content item through the AR view as the user terminal enters the virtual stage from the main stage, and the second content item represents a POI corresponding to a predetermined location within the unit space, and the content providing method may further include the step of entering the main stage from the virtual stage as an interaction is performed between the user terminal and the second content item, and augmenting and displaying a content item including path information to the POI through the AR view.
[0024] In another aspect, a computer system implementing a user terminal or a server comprises at least one processor configured to execute computer-readable instructions contained in memory, wherein the at least one processor determines whether the user terminal is located in a preset unit space based on the location of the user terminal, and, upon determining that the user terminal is located in the unit space, augments and displays at least one first content item associated with a main stage corresponding to the unit space through an augmented reality (AR) view including an image captured by the camera of the user terminal, and, upon any one of i) interaction between the user terminal and a predetermined connection node located within the main stage, ii) interaction between the user terminal and a connection content item augmented and displayed through the AR view, or iii) entry into a preset connection area within the main stage by the user terminal, displays at least one second content item associated with a virtual stage connected to the main stage and corresponding to at least a part of the unit space through the AR view, wherein the main stage represents a first service space corresponding to the unit space, and the virtual stage is defined separately from the first service space A computer system is provided that represents a second service space corresponding to a space including at least a portion of a unit space.
[0025] In another aspect, a method for generating content for display through an augmented reality (AR) view of a user terminal, performed by a computer system, is provided, comprising: a step of defining a main stage representing a first service space corresponding to a unit space, wherein a first content item that is augmented and displayed in the AR view according to a first scenario is mapped to the main stage; a step of defining a virtual stage representing a second service space corresponding to a space including at least a part of the unit space defined separately from the first service space, wherein a second content item that is augmented and displayed in the AR view according to a second scenario independent of the first scenario is mapped to the virtual stage; and a step of connecting the main stage and the virtual stage through at least one connection interface among a connection node defined in the main stage and the virtual stage, respectively, a connection content item defined in the main stage and displayed through the AR view, or a connection area defined within the main stage.
[0026] The step of defining the virtual stage includes defining each virtual stage of a plurality of virtual stages including the virtual stage, and the step of connecting the virtual stages includes connecting the main stage and each virtual stage, and the method of generating the content further includes the step of defining a sub-virtual stage representing a third service space corresponding to a space including at least a part of the unit space defined separately from the first service space, wherein a third content item is mapped to the sub-virtual stage and displayed augmented in the AR view according to a third scenario independent of the first scenario, and the step of connecting the virtual stages may include i) a connection node defined in the virtual stage and the sub-virtual stage, respectively, ii) a connection content item defined in the virtual stage and displayed through the AR view, or iii) connecting the virtual stage and the sub-virtual stage through at least one connection interface among a connection area defined within the virtual stage. Effects of the invention
[0027] Through the embodiment, by defining multi-stages corresponding to multiple service spaces for a unit space, service spaces having individual scenarios (or themes) for providing content for a single unit space can be implemented, and content for display via an AR view can be authored in a form that includes each of these multiple service spaces as a respective stage.
[0028] In the embodiment, content can be displayed through an AR view provided via a single application or web-based AR, in which service spaces having multiple scenarios for providing content for a single unit space are implemented.
[0029] Through the embodiments, physical limitations of the unit space can be overcome, and content items appropriately configured according to multiple scenarios or themes can be provided through an AR view according to the user's needs. Brief explanation of the drawing
[0030] FIG. 1 illustrates a method for providing content through an AR view of a user terminal using a main stage and a virtual stage defined for a unit space according to one embodiment. FIG. 2 shows a computer system and a server performing a content provision method according to one embodiment. FIG. 3 is a flowchart illustrating a method of providing content through an AR view of a user terminal using a main stage and a virtual stage defined for a unit space according to one embodiment. Figure 4 is a flowchart illustrating how a user terminal displays a map view along with an AR view according to one example. FIGS. 5 and 6 are flowcharts illustrating a method in which a user terminal enters a virtual stage and displays content items through an AR view, according to one example. FIG. 7 illustrates a method for generating content for display in an AR view by defining a main stage and a virtual stage in a unit space according to one example. Figure 8 shows a unit space according to one example. FIG. 9 shows a plurality of stages defined for a unit space according to one example. Figure 10 illustrates a method of connecting a main stage and a virtual stage defined for a unit space according to one example. FIG. 11 illustrates a method in which a user terminal switches from a virtual stage to a main stage and outputs route guidance information according to one example. FIG. 12 illustrates a method for a user terminal to enter each virtual stage when a main stage and a plurality of virtual stages are connected, according to one example. FIG. 13 illustrates a method of connecting a main stage and virtual stage(s) according to one example. FIG. 14 illustrates a method for defining a main stage and a virtual stage using a content creation tool according to one example, and generating content for display in an AR view. Specific details for implementing the invention
[0031] Hereinafter, embodiments will be described in detail with reference to the attached drawings.
[0033] The embodiments relate to a method for providing content as a location-based AR service, wherein various content items of a service that the user wishes to receive are displayed on an image of an AR view using an AR view displayed on a user terminal. In the detailed description to be provided below, the content items displayed augmented to the image may also be referred to as "augmented content items." In the detailed description below, the term "content" may refer to individual "content items," but may also refer collectively to the content items provided through the AR service.
[0034] The 'space' associated with the provision of augmented content in the embodiments may refer to an indoor space and / or an outdoor space. That is to say, the space and unit space described below may be defined as a space including an indoor location or an outdoor location, and may also be defined as a composite space combining an indoor space and an outdoor space.
[0035] In the detailed description that follows, the location of the user possessing the user terminal may be described as the location of the user terminal for the sake of convenience of explanation. Additionally, for the sake of convenience of explanation, 'user' and the 'user terminal' possessed by the user may be used interchangeably.
[0036] In the detailed description to be provided below, "augmenting and displaying" content items, etc. on the video may be interpreted as encompassing the meaning of displaying the content and / or information superimposed on the video / screen of the AR view according to the embodiment.
[0038] FIG. 1 illustrates a method for providing content through an AR view of a user terminal using a main stage and a virtual stage defined for a unit space according to one embodiment.
[0039] As described, a user terminal (100), such as a smartphone, can use a camera to capture the surroundings and can display an AR view (10) that includes the image captured by the camera, and can display various content items augmented to the image through the AR view (10), that is, within the AR view (10).
[0040] In the embodiment, it can be determined whether the user terminal (100) is located within a pre-set unit space based on the location of the user terminal (100), and if it is determined that the user terminal (100) is located within the pre-set unit space, a content item associated with the unit space can be augmented and displayed on the image of the AR view (10).
[0041] 'Unit space' may be an indoor space or an outdoor space, or may represent a complex space that includes both indoor and outdoor spaces, and may be a physical area where a service space is defined for providing services including the provision of content items.
[0042] In this regard, FIG. 8 illustrates a unit space according to one example. As illustrated in the example, the unit space may represent an area corresponding to a single floor of a specific building, or an area including the interior and exterior of the building. Alternatively, the unit space may represent an area corresponding to multiple floors of the building. As such, the unit space may be defined in various sizes and / or shapes depending on the service to be provided as a physical area where the service space is defined.
[0043] In embodiments, 'stage' may represent a service space defined within a unit space, which is a physical area. Depending on the service to be provided, the service space may be defined to correspond to the entire unit space, or to a space that includes at least a part of the unit space.
[0044] The service space may correspond to an entire space that can be moved without a separate transition when the user terminal (100) enters it, or to a horizontal partial space that can be connected to another unit space as it moves, or to a vertical partial space that additionally includes an area that can be connected using a movable facility (elevator, escalator, etc.).
[0045] In the service space, multiple nodes defining the movement of the user terminal (100) (i.e., the user) and links connecting the nodes may be defined. In the horizontal space included in the service space, facility nodes such as inter-block connections, crosswalks, and overpasses may be defined, and in the vertical space included in the service space, transition facility nodes such as stairs, elevators, and escalators may be defined to vertically connect the spaces.
[0046] A service space may be a two-dimensional or three-dimensional map that corresponds one-to-one with a space that includes at least a part of a unit space, which is a physical area. Content items that are AR content may be mapped on this service space, or data and / or information for providing various location-based services may be mapped.
[0047] In the unit space of the embodiment, a main stage (12) and at least one virtual stage (14) may be defined. The main stage (12) may represent a first service space corresponding to the unit space, and the virtual stage (14) may represent a second service space corresponding to a space that includes at least a part of the unit space defined separately from the first service space.
[0048] The main stage (12) may represent a first service space for a basic service (or main service) provided through the AR view (10). Meanwhile, the virtual stage (14) may represent a second service space for a service different from the basic service provided through the AR view (10) representing the unit space. The other service may be a service separate from the basic service, provided by reflecting the needs of the user of the unit space.
[0049] When it is determined that the user terminal (100) is located in a unit space, a first content item associated with a main stage (12) representing a first service space corresponding to the unit space may be augmented and displayed through the AR view (10) of the user terminal (100). The service provided through the first service space may be a service that provides basic information or guidance regarding the unit space (e.g., guidance on facilities, directions, etc.), and the first content item may be a content item that is augmented and displayed in the AR view (10) to provide such service. That is, the first content item may represent a content item that is augmented and displayed on the main stage (12) according to the scenario of the service provided through the first service space.
[0050] The main stage (12) may be connected to at least one virtual stage (14) defined for a unit space. The main stage (12) and the virtual stage (14) may be connected through a predetermined connection interface.
[0051] Accordingly, in the embodiment, as interaction is performed between the user terminal (100) and the connection interface, a second content item associated with a virtual stage (14) representing a second service space defined separately from the first service space may be displayed through the AR view (10). The second service space may correspond to a unit space or may correspond to a space that includes at least a part of the unit space. The service provided through the second service space is different from the service provided through the first service space, and may, for example, be a service related to a gourmet street, as illustrated. The second content item may be a content item that is augmented and displayed in the AR view (10) for the provision of such service. That is, the second content item may represent a content item that is augmented and displayed on the virtual stage (14) according to the scenario of the service provided through the second service space. The second content item may be displayed across the entire AR view (10), as illustrated in FIG. 1.
[0052] The above connection interface may be implemented as at least one of a predetermined connection node located within the main stage (12), a connection content item displayed augmented through the AR view (10), or a connection area predefined within the main stage (12). For example, as illustrated, a content item (30) displayed within the main stage (12) may function as such a connection interface. The content item (30) may be the first content item described above. As the content item (30) is selected through the user terminal (100), the user terminal (100) may enter the virtual stage (14) from the main stage (12), and thus, the second content item may be displayed through the AR view (10).
[0053] Meanwhile, as illustrated, when the user terminal (100) enters the virtual stage (14), a user interface (40) for exiting the virtual stage (14) and re-entering the main stage (12) may be displayed on the AR view (10).
[0054] Additionally, a map view (20-1, 20-2) including a map that matches the image of the AR view (10) may be further displayed on the screen of the user terminal (100) along with the AR view (10). The map view (20-1, 20-2) may include the current location of the user terminal (100). The map view (20-1, 20-2) may include a 2D map or a 3D map.
[0055] As illustrated, the map views (20-1, 20-2) may be configured to include different information depending on whether the user terminal (100) has entered the virtual stage (14) or the main stage (12). That is to say, when the user terminal (100) has entered the virtual stage (14), the map view (20-2) may be displayed, and when the user terminal (100) has entered the main stage (12), the map view (20-1) may be displayed. The map views (20-1, 20-2) may be converted to include appropriate information according to the service provided through the stage that the user terminal (100) has entered.
[0056] A user terminal (100) may communicate with a server (200) to perform tasks for entering a main stage (12) or a virtual stage (14), displaying a first or second content item through an AR view (10), and displaying a map view (20-1, 20-2). The server (200) may provide the user terminal (100) with a content item associated with the stage into which the user terminal (100) enters, depending on the movement of the user terminal (100) and interaction with a predetermined connection interface, and may provide the user terminal (100) with map information for displaying an appropriate map view (20-1, 20-2).
[0057] The server (200) may be a server that defines service spaces (i.e., stages) for a unit space, manages the defined service spaces, and manages the registration, modification, deletion, etc. of each service space. Additionally, the server (200) may be a map server that provides digital maps (3D maps and / or 2D maps).
[0058] Such a server (200) may be a computer system that generates content for display on the AR view (10) illustrated in FIG. 1.
[0059] A more specific method for generating content for display on an AR view (10) by a server (200) and a specific method for a user terminal (100) to display such content through an AR view (10) will be described in more detail with reference to FIGS. 2 to 14, which will be described later.
[0061] FIG. 2 shows a computer system and a server performing a content provision method according to one embodiment.
[0062] Referring to FIG. 1 according to embodiments, the user terminal (100) described above may be implemented through the illustrated computer system (100). For example, a computer program for implementing the method of the embodiment may be installed and run on the computer system (100), and the computer system (100) may perform the content provision method according to the embodiments under the control of the run computer program.
[0063] The content provision method according to the embodiments may be performed through a PC-based program or an application dedicated to a mobile terminal. For example, the content provision method according to the embodiments may be implemented in the form of a program that operates independently, or configured as an in-app form of a specific application so that it can operate on said specific application. Such a specific application may be installed on a computer system (100) and perform the content provision method of the embodiment by providing content items through an AR view (10). In the embodiment, a plurality of stages including a main stage (12) and at least one virtual stage (14) are defined for a unit space, and content items according to different scenarios are mapped to each stage, so that content having service spaces with a plurality of scenarios for providing content for a unit space can be displayed through an AR view (10) provided through a single application or web-based AR. If the AR view (10) is a web-based AR view implemented through web-based AR, said specific application may be a web browser for executing the web-based AR view.
[0064] The computer system (100) is an electronic device corresponding to the aforementioned user terminal (100), and may be a smartphone or a similar device capable of installing and running applications or programs as illustrated in FIG. 1a and FIG. 1b. Additionally, the computer system (100) may be a personal computer (PC), a laptop computer, a tablet, an Internet of Things (IoT) device, or a wearable computer, etc.
[0065] As illustrated, the computer system (100) may include a memory (110), a processor (120), a communication interface (130), and an input / output interface (140) as components for executing a content delivery method.
[0066] Memory (110) is a computer-readable recording medium and may include a non-perishable mass storage device such as RAM (random access memory), ROM (read only memory), and a disk drive. Here, a non-perishable mass storage device such as a ROM and a disk drive may be included in the computer system (100) as a separate permanent storage device distinct from memory (110). Additionally, an operating system and at least one program code may be stored in memory (110). These software components may be loaded into memory (110) from a computer-readable recording medium separate from memory (110). This separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD / CD-ROM drive, or memory card. In another embodiment, software components may be loaded into memory (110) through a communication interface (130) rather than a computer-readable recording medium. For example, software components can be loaded into the memory (110) of the computer system (100) based on a computer program installed by files received through the network (160).
[0067] The processor (120) may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor (120) via memory (110) or a communication interface (130). For example, the processor (120) may be configured to execute instructions received according to program code stored in a recording device such as memory (110).
[0068] That is, the processor (120) can manage components of the computer system (100) and can execute programs or applications used by the computer system (100). For example, the processor (120) may be configured to execute an application for performing the content provision method of the embodiment and to process data received from the server (200) to display content items through the AR view (10). Additionally, the processor (120) may process operations necessary for the execution of programs or applications and the processing of data, and may be at least one processor of the computer system (100) or at least one core within the processor.
[0069] The communication interface (130) may provide a function for the computer system (100) to communicate with another computer system (not shown) through a network (160). For example, requests, commands, data, files, etc. generated by the processor (120) of the computer system (100) according to program code stored in a recording device such as memory (110) may be transmitted to another computer system through the network (160) under the control of the communication interface (130). Conversely, signals, commands, data, files, etc. from another computer system may be received by the computer system (100) through the communication interface (130) of the computer system (100) via the network (160). Signals, commands, data, etc. received through the communication interface (130) may be transmitted to the processor (120) or memory (110), and files, etc. may be stored in a storage medium (the permanent storage device described above) that the computer system (100) may further include. For example, the communication interface (130) may be a hardware module such as a network interface card, a network interface chip, and a networking interface port of a computer system (100), or a software module such as a network device driver or a networking program.
[0070] The input / output interface (140) may be a means for interfacing with an input / output device (150). For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display or speaker. As another example, the input / output interface (140) may be a means for interfacing with a device in which the functions for input and output are integrated into one, such as a touchscreen. The input / output device (150) may be composed of a computer system (100) and a single device.
[0071] Additionally, in other embodiments, the computer system (100) may include more components than those of FIG. 2. However, it is not necessary to clearly illustrate most of the prior art components. For example, the computer system (100) may be implemented to include at least some of the input / output devices connected to the input / output interface (140) described above, or may include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, if the computer system (100) is implemented in the form of a mobile device such as a smartphone, the computer system (100) may be implemented to include various components that are generally included in mobile devices, such as a camera, an accelerometer or gyroscope, various physical buttons, buttons using a touch panel, input / output ports, and a vibrator for vibration. For example, the computer system (100) corresponding to the user terminal (100) may include a camera that captures the surroundings to execute the AR view (10). The computer system (100) can display an image captured through a camera as an AR view (10) and can display content items by augmenting the image of the AR view (10). For example, the computer system (100) can determine whether the computer system (100) is located in a pre-set unit space and whether an interaction with a predetermined connection interface has been performed based on positioning, determine entry into a specific stage of the computer system (100), and display content items associated with that stage. However, the actual operation for determining whether the computer system (100) is located in a pre-set unit space and whether the above interaction has been performed may be performed by a server (200) rather than the computer system (100).
[0072] The server (200) may be an electronic device that communicates with the computer system (100) to provide content to the computer system (100) for display in the AR view (10), and author (i.e., create) and manage said content. The server (200) may include a database or communicate with said database as a device that manages (registers, changes, deletes, stores, maintains, etc.) the content to be provided to the computer system (100) and service spaces associated with the content. Additionally, the server (200) may be a map server that provides digital maps (3D maps and / or 2D) or may include said map server.
[0073] The server (200) may include at least one computer system. The computer system included in the server (200) may include configurations similar to the aforementioned computer system (100), and redundant descriptions thereof are omitted.
[0074] In an embodiment, a user terminal (100), which is a computer system (100), can provide content items through an AR view (10) by communicating with a server (200) and, based on data and / or information provided by the server (200), can augment and display content items in an image through the AR view (10). At this time, the server (200) can receive the location of the user terminal (100) and, based on the received location, can determine whether the user terminal (100) is located within a unit space. If the user terminal (100) is located within a unit space, the server (200) can provide a first content item associated with a main stage (12) corresponding to the unit space to the user terminal (100). Additionally, the server (200) can determine that an interaction with a predetermined connection interface has been performed by the user terminal (100), and accordingly, can determine the entry of the user terminal (100) into a virtual stage (14) and provide a second content item associated with the virtual stage (14).
[0075] In the detailed description to be described later, for convenience of explanation, embodiments are described with the computer system (100) corresponding to the user terminal (100) as the focus, and communication with the server (200) and operations on the server (200) side may be briefly explained or omitted.
[0076] Additionally, in the detailed description to be provided below, for convenience of explanation, operations (steps) performed by the configuration (e.g., processor, etc.) of the computer system (100) (or server (200)) may be described as being performed by the computer system (100) (or server (200)).
[0077] The description of the technical features described above with reference to FIGS. 1 and FIGS. 8 can be applied as is to FIG. 2, so redundant descriptions are omitted.
[0079] FIG. 3 is a flowchart illustrating a method of providing content through an AR view of a user terminal using a main stage and a virtual stage defined for a unit space according to one embodiment.
[0080] Referring to FIG. 3, a method for providing content performed by a computer system (100) is described. The computer system (100) may be the user terminal (100) described above with reference to FIG. 1; therefore, in the detailed description to be provided below, the term user terminal (100) is used instead of computer system (100) to describe the embodiment. Additionally, at least some of the steps described below with reference to FIG. 3 to 6 may be configured to be performed by a server (200) rather than a user terminal (100). Below, the execution of the steps is described with a focus on the user terminal (100), and redundant descriptions regarding the server (200) may be omitted.
[0081] In step (310), the user terminal (100) or the server (200) can determine whether the user terminal (100) is located in a pre-set unit space based on the location of the user terminal (100). The user terminal (100) can determine the location of the user terminal (100) through a method based, for example, on at least one of GPS, VPS (Visual Positioning System), and WPS (Wi-Fi Positioning System), and can determine whether the user terminal (100) is located in a pre-set unit space based on the determined location. Alternatively, the server (200) can receive the determined location of the user terminal (100) and determine whether the received location is located in a pre-set unit space.
[0082] Alternatively, whether the user terminal (100) is located in a pre-configured unit space may be determined based on communication between the user terminal (100) and a communication module (e.g., short-range communication module, AP (Access Point), beacon, etc.) existing within the unit space. For example, the location of the user terminal (100) may be determined through the strength of communication (i.e., signal strength) between the user terminal (100) and at least one of the communication modules, or through positioning based on communication (e.g., triangulation), and whether the user terminal (100) is located within the unit space may be determined.
[0083] In step (320), if the user terminal (100) or the server (200) determines that the user terminal (100) has entered the main stage (12) when it is determined that the user terminal (100) is located within the unit space. As described above, the main stage (12) may represent a first service space corresponding to the unit space. The first service space may be defined for a basic service (or main service) provided through the AR view (10).
[0084] In step (330), as the user terminal (100) enters the main stage (12), the user terminal (100) or the server (200) may augment and display at least one first content item associated with the main stage (12) through the AR view (10). That is to say, as the user terminal (100) or the server (200) determines that the user terminal (100) is located in a unit space, the user terminal (100) or the server (200) may augment and display at least one first content item associated with the main stage (12) through the AR view (10). The first content item may represent a content item augmented and displayed in the AR view (10) (i.e., the main stage (12)) according to a first scenario, which is a scenario of a service provided through the first service space.
[0085] In other words, the user terminal (100) or the server (200) can augment and display the first content item through the AR view (10) (i.e., the main stage (12)) according to the first scenario when the user terminal (100) enters the main stage (12).
[0086] In step (340), the user terminal (100) or the server (200) can determine whether interaction is performed between the user terminal (100) and a predetermined connection interface connecting the main stage (12) and the virtual stage (14). Such a connection interface may be defined on the main stage (12).
[0087] In step (350), if the user terminal (100) or the server (200) confirms that an interaction between the connection interface and the user terminal (100) has been performed, it may determine that the user terminal (100) has entered the virtual stage (14). As described above, the virtual stage (14) may represent a second service space corresponding to a space that includes at least a portion of a unit space. The second service space may be defined for a service different from the basic service provided through the AR view (10).
[0088] In step (360), as the user terminal (100) enters the virtual stage (14), the user terminal (100) or the server (200) can augment and display at least one second content item associated with the virtual stage (14) through the AR view (10).
[0089] Meanwhile, the aforementioned 'connection interface' may be at least one of a predetermined connection node (or also named a routing node) located within the main stage (12), a connection content item (30) (or also named a routing content item) augmented and displayed through the AR view (10) (or the main stage (12)), or a connection area (or also named a routing area) predefined within the main stage (12). Interaction between the user terminal (100) and the connection interface may include the user terminal (100) being located at a connection node (or at a location less than a certain distance from the connection node), the connection content item (30) being selected by the user terminal (100) or the connection content item (30) being displayed at a predetermined location on the screen for a certain period of time or longer, or the user terminal (100) being located within the connection area. The connection area may be an area within a unit space (or a first service space) having a predetermined radius or a predetermined width. Alternatively, the connection area may represent a certain radius from the connection node, and in this case, if the user terminal (100) is located within a certain radius or less from the connection node, entry of the user terminal (100) into the virtual stage (14) may be determined.
[0090] In other words, the user terminal (100) or server (200) may display at least one second content item associated with a virtual stage (14) that is connected to the main stage (12) and corresponds to at least a part of the unit space, through the AR view (10), as any one of the following is performed: i) interaction between the user terminal (100) and a predetermined connection node located within the main stage (12); ii) interaction between the user terminal (100) and a connection content item (30) that is augmented and displayed through the AR view (10); or iii) entry into a predefined connection area within the main stage (12) by the user terminal (100). The second content item may represent a content item displayed (or augmented and displayed) in the AR view (10) (i.e., the virtual stage (14)) according to a second scenario, which is a scenario of a service provided through the second service space.
[0091] In other words, the user terminal (100) or server (200) can augment and display a second content item through the AR view (10) (i.e., the virtual stage (14)) according to the second scenario when the user terminal (100) switches from the main stage (12) to the virtual stage (14).
[0092] Meanwhile, in the example of FIG. 1, the connection content item (30) may be a type of first content item and may also be mapped to a connection node.
[0093] As the aforementioned steps (310 to 360) are performed, as illustrated in FIG. 1, a plurality of service spaces capable of providing services according to each of a plurality of scenarios (i.e., a first scenario and a second scenario) can be defined for a unit space, and the user can receive services according to the plurality of scenarios simply by running an AR view representing the unit space through a single application or web browser, without needing to install an application corresponding to each scenario on the user terminal (100). At this time, the user terminal (100) can perform interaction with a predetermined connection interface to enter a stage corresponding to the service space where the scenario for which the user wishes to receive services is defined, and thus, the user can selectively receive the desired services. In the embodiment, a plurality of stages including a main stage (12) and at least one virtual stage (14) can be defined for a unit space, so that various services associated with the unit space can be provided to the user terminal (100) by overcoming the physical limitations of the unit space.
[0094] In step (370), the user terminal (100) or the server (200) can check whether an interaction is performed between the user terminal (100) and a predetermined termination interface for ending the display of the virtual stage (14), that is, for exiting the virtual stage (14). This termination interface may be defined on the virtual stage (14) or included on the screen of the user terminal (100) in a form such as a button UI (40).
[0095] In step (350), when the user terminal (100) or server (200) confirms that an interaction between the termination interface and the user terminal (100) has been performed, the display of the virtual stage (14) in the AR view (10) may be terminated. At this time, the user terminal (100) may re-enter the main stage (12), and thus, the AR view (10) may display the main stage (12).
[0096] For example, the virtual stage (14) may have at least one of a termination node, a termination content item, or a termination area defined as the termination interface for terminating the display of the virtual stage (140) on the user terminal (100). The user terminal (100) or the server (200) may terminate the display of the virtual stage (14) on the user terminal (100) as any one of i) interaction between the user terminal (100) and the termination node, ii) interaction between the user terminal (100) and the termination content item defined in the virtual stage (14), or iii) entry into the termination area by the user terminal (100). By doing so, the user may optionally terminate the service provided through the virtual stage (14) and receive the basic service again through the main stage (12). Alternatively, the virtual stage (14) may additionally have specific conditions or specific scenarios defined for terminating the virtual stage (14).
[0097] Below, with reference to Fig. 9, a method for defining multiple stages (i.e., multi-stage) for a unit space is described in more detail.
[0098] In this regard, FIG. 9 shows a plurality of stages defined for a unit space according to one example.
[0099] In the illustrated example, the unit space is assumed to be a space corresponding to the first floor (1F) of a building. As illustrated, a main stage (910) and a plurality of virtual stages (920 to 940) may be defined corresponding to the unit space. In FIG. 9, the virtual stages (920 to 940) are named stages (1) to (3), each of which may represent a service space customized by a service provider or a service user. For example, as illustrated, a scenario (①-⑤) for providing a service (separate from the main stage (910) or other virtual stages) may be defined in the virtual stage (940). When the user terminal (100) enters the virtual stage (940), a second content item may be displayed in the AR view (10) according to the scenario (①-⑤).
[0100] In the illustrated example, each of the virtual stages (920 to 940) can correspond to a unit space, just like the main stage (910).
[0101] Each of the virtual stages (920 to 940) and the main stage (910) represents a different service space, so they are distinguished from each other in terms of service provision, but since they represent a common positioning space, they can be recognized as the same positioning space by the user terminal (100). That is, according to the embodiment, the main stage (12) and the virtual stage (14) described above can be recognized as the same positioning space of the corresponding unit space. In other words, the visual localization (VL) can be shared between the main stage (12) and the virtual stage (14), and they can represent the same VL space.
[0102] Meanwhile, the virtual stage (14) is connected to the main stage (12), and the 'virtual stage' may be named a 'sub-stage' in that basic services associated with the unit space are provided through the main stage (12).
[0103] In addition, unlike as illustrated in FIG. 9, the second service space represented by the virtual stage (14) may correspond to a space that includes at least a part of the unit space and a part of another unit space that is different from the unit space. That is to say, the virtual stage (14) may be defined to include an area outside the unit space.
[0104] At this time, the second content item displayed through the AR view (10) may include path guidance information to a predetermined location within the other unit space. Accordingly, after the user terminal (100) enters the virtual stage (14) from the main stage (12), it may be guided to a location outside the unit space, which is a predetermined location within the virtual stage (14), and a service associated with the virtual stage (14) may be provided to the user terminal (100) at that location.
[0105] The description of the technical features described above with reference to FIGS. 1, 2, and 8 can be applied as is to FIGS. 3 and 9, so redundant descriptions are omitted.
[0107] Figure 4 is a flowchart illustrating how a user terminal displays a map view along with an AR view according to one example.
[0108] In step (410), the user terminal (100) may display a map view (20-1, 20-2) that includes a map matching the image, together with the AR view (10). That is, the map included in the map view (20-1, 20-2) may include the current location of the user terminal (100) and the location indicated by the image. The server (200) may control the user terminal (100) to display such a map view (20-1, 20-2).
[0109] As illustrated in FIG. 1 above, the map view (20-1, 20-2) may include the current location of the user terminal (100). The map view (20-1, 20-2) may include a two-dimensional map or a three-dimensional map, and may include a unit space in which the user terminal (100) moves, content provided to the user terminal (100), or an object to which the content is mapped.
[0110] Meanwhile, the map view (20-1, 20-2) may be configured differently depending on whether the user terminal (100) has entered the main stage (12) or the virtual stage (14).
[0111] For example, as in step (520), the user terminal (100) or server (200) can convert the map view (20-1) to include map data defined according to a second scenario defined for the virtual stage (14) (e.g., defined according to a first scenario defined for the main stage (12)) as the user terminal (100) or server (200) transitions from the main stage (12) to the virtual stage (14). Accordingly, a map view (20-2) can be generated.
[0112] Accordingly, in the embodiment, even if the user terminal (100) is located in the same unit space, different content items may be displayed in the AR view (10) depending on whether the user terminal (100) has entered the main stage (12) or the virtual stage (14), and the map view (20-1 or 20-2) representing the unit space may also be configured differently.
[0113] Since the map view (20-1 or 20-2) is configured differently depending on the stage that the user terminal (100) has entered, the user can identify information related to the service provided through the stage not only through the AR view (10) but also through the map view (20-1 or 20-2).
[0114] Meanwhile, according to an embodiment, the user terminal (100) may display the map view (20-1, 20-2) separately from the AR view (10), that is, as a separate screen.
[0115] That is, the map view (20-1, 20-2) illustrated in FIG. 1 can be configured to be displayed as a full screen on the user terminal (100) separately from the AR view (10). For example, as a predetermined screen switching interface (button, etc.) is selected on the screen of the user terminal (100), the map view (20-1, 20-2) can be switched to a full screen.
[0116] In the service space represented by the main stage (12) or virtual stage (14), a plurality of nodes defining the movement of the user terminal (100) (i.e., user) and links connecting the nodes may be defined. At least one POI may be defined at at least one of the nodes or at a location in the service space.
[0117] In other words, at least one POI may be defined in the main stage (12), and at least one virtual POI may be defined in the virtual stage (14). In this case, since the second service space represented by the virtual stage (14) is defined separately from the first service space represented by the main stage (12), the at least one virtual POI defined in the virtual stage (14) may be defined independently of the POI defined in the main stage (12).
[0118] At this time, the map view (20-1) may be configured to include information about the POI defined in the main stage (12), and the map view (20-2) may be configured to include information about the POI defined in the virtual stage (14).
[0119] Thus, in the embodiment, by configuring the map view (20-1 or 20-2) differently depending on the stage entered by the user terminal (100), services associated with the user's multiple stages can be provided to the user of the user terminal (100) in a more distinct form when the user terminal (100) is located in the same unit space.
[0120] The description of the technical features described above with reference to FIGS. 1 to 3, FIGS. 8, and FIGS. 9 can be applied as is to FIG. 4, so redundant descriptions are omitted.
[0122] FIGS. 5 and 6 are flowcharts illustrating a method in which a user terminal enters a virtual stage and displays content items through an AR view, according to one example.
[0123] Referring to FIG. 5, when a user terminal (100) enters a virtual stage (14), the content of displaying VR content or full-screen content as a second content through the AR view (10) is explained in more detail.
[0124] In step (510), the user terminal (100) or the server (200) may turn off the positioning function for the unit space of the user terminal (100) when the user terminal (100) enters the virtual stage (14). That is to say, when the user terminal (100) enters the virtual stage (14), the user terminal (100) may be configured not to position the unit space, or at least not to display the result of positioning the unit space through the AR view (10).
[0125] In step (520), the user terminal (100) or the server (200) may display VR content or full-screen content corresponding to the view of the camera of the user terminal (100) as the aforementioned second content item through the AR view (10) (i.e., the screen of the user terminal (100)).
[0126] In this way, in the embodiment, the virtual stage (i.e., sub-stage) (14) can be utilized as a service space that is not positioned by turning off the positioning for the unit space of the user terminal (100). At this time, the second scenario associated with the virtual stage (14) can be defined to display the second content item in the AR view (10) based on the current camera position (i.e., camera viewpoint or view) of the user terminal (100), regardless of the positioning for the unit space. Accordingly, a scenario that enables the display of content items based on the camera view rather than the location of the user terminal (100) can be used for providing services through the second service space.
[0127] For example, the virtual stage (14) may be configured as a VR space that displays content on the screen of the user terminal (100) by enveloping the entire space according to the camera view, regardless of the positioning of the user terminal (100), and the immersive content (content item) displayed in the VR space may be a second content item. Such immersive content may be named VR content. Alternatively, the second content item may be full-screen content that is displayed across the entire AR view (10) (i.e., the screen of the user terminal (100)) as the viewpoint changes according to the camera view.
[0128] As described above, the virtual stage (14) may be configured as a service space that shares a position with the main stage (12), and, depending on the embodiment, may also be configured as a service space where the position for the unit space is turned off. This service space where the position is turned off may correspond to a part of the unit space.
[0129] Below, with reference to FIG. 6, another embodiment of displaying content items through an AR view (10) is described in more detail.
[0130] The user terminal (100) or server (200) may display a second content item through the AR view (10) as the user terminal (100) enters the virtual stage (14). At this time, the displayed second content item may represent a POI corresponding to a predetermined location within (or outside) the unit space.
[0131] The user terminal (100) or server (200) can augment and display a content item containing path information to the corresponding POI through the AR view (10) as interaction between the user terminal (100) and the second content item is performed. At this time, the augmented path information may be displayed on a virtual stage (14), or, depending on the embodiment, may be displayed on the main stage (12) after the user terminal (100) re-enters the main stage (12).
[0132] Below, an example of the path information being displayed on the main stage (12) is described in more detail.
[0133] In step (610), the user terminal (100) or the server (200) can determine whether an interaction has been performed between the user terminal (100) and the second content item. For example, if the user terminal (100) approaches the second content item by a certain distance or more, or if the user selects (or touches) the second content item on the screen, it can be determined that an interaction has been performed between the user terminal (100) and the second content item. The user terminal (100) or the server (200) can identify a POI associated with the second content item or represented by the second content item.
[0134] In step (620), the user terminal (100) or the server (200) can allow the user terminal (100) to re-enter the main stage (12). That is to say, the user terminal (100) can exit the virtual stage (14) and re-enter the main stage (12).
[0135] In step (630), the user terminal (100) can display a content item containing path information to the POI by augmenting it on the main stage (12). Alternatively, the server (200) can control the user terminal (100) to display such path information.
[0136] For example, in a case where a general guidance service for a unit space, which is a specific floor of a building, is provided through the main stage (12), and a gourmet street guidance service for that unit space is provided through the virtual stage (14), the user terminal (100) can enter the virtual stage (14) through a connected content item (30) displayed within the main stage (12), and can select a POI second content item corresponding to a specific restaurant displayed in the virtual stage (14). At this time, route information for moving to the specific restaurant can be displayed through the AR view (10). To display route information, the user terminal (100) can exit the virtual stage (14) and re-enter the main stage (12), and route information can be displayed through the main stage (12).
[0137] Thus, in the embodiment, transitions between stages can be appropriately made to provide information provided through the service more appropriately. That is to say, information about a restaurant can be provided through a virtual stage (14) that provides a sub-service suitable for providing information about a good restaurant, but route guidance for the restaurant can be provided through a main stage (12) that provides a main service suitable for route guidance, and the first and second scenarios can be configured so that the first scenario and the second scenario are configured so that route guidance for the restaurant is provided through a main stage (12) that provides a main service suitable for route guidance.
[0138] Figure 11, which explains a more specific example in this regard, shows a method in which a user terminal switches from a virtual stage to a main stage and outputs route guidance information according to one example.
[0139] As illustrated in the example in FIG. 11, when the user terminal (100) enters the virtual stage (14) (1100), a second content item (1112) may be displayed in the AR view (10). This second content item (1112) may include information about a specific restaurant, such as coupon information for the restaurant, images of the restaurant, etc. When coupon information is selected, the user terminal (100) can obtain a coupon for the restaurant. By interacting with the second content item (1112), the user terminal (100) may request route guidance for the restaurant, for example, by selecting the AR navi button. At this time, the user terminal (100) may return to the main stage (12), and when it enters the main stage (12) (1120), information (1122) related to route guidance may be displayed through the AR view (10). Meanwhile, information (1124) related to route guidance can also be displayed in the map view.
[0140] The description of the technical features described above with reference to FIGS. 1 to 4, FIGS. 8, and FIGS. 9 can be applied as is to FIGS. 5, FIGS. 6, and FIGS. 11, so redundant descriptions are omitted.
[0142] Below, with reference to FIG. 10, the method of configuring the virtual stage (14) and the main stage (12) will be explained in more detail.
[0143] In this regard, FIG. 10 illustrates a method of connecting a main stage and a virtual stage defined for a unit space according to one example.
[0144] In FIG. 10, a main stage (1010) according to one example and a virtual stage (1020) connected to the main stage (1010) are illustrated. The main stage (1010) and the virtual stage (1020) may correspond to the same unit space, for example, a specific floor of a specific building.
[0145] The main stage (1010) and the virtual stage (1020) can correspond to the aforementioned main stage (12) and virtual stage (14).
[0146] The main stage (1010) may have actual spatial information of the unit space mapped thereon, and through the main stage (1010), basic services associated with the unit space may be provided. A scenario for providing basic services (the first scenario described above) may be defined on the main stage (1010), and content items may be mapped accordingly. As illustrated, information regarding structures, etc. included in the unit space may be defined on the main stage (1010), and multiple nodes and links (or edges) connecting two nodes may also be defined. Content items for providing basic services according to the first scenario may be mapped (registered) to the nodes and / or links.
[0147] The virtual stage (1020) shares the same unit space positioning as the main stage (1010), but is a service space separate from the main stage (1010) and may be a service space for providing services different from the basic service. A scenario for providing the other service (the second scenario described above) may be defined in the virtual stage (1020), and content items may be mapped accordingly. Information regarding structures, etc. included in the unit space may also be defined in the virtual stage (1020), and multiple nodes and links (or edges) connecting two nodes may also be defined. Content items for providing the basic service according to the second scenario may be mapped (registered) to the nodes and / or links. The arrangement of nodes and / or links in the virtual stage (1020) may differ from that in the main stage (1010). Additionally, structures may be arranged in the virtual stage (1020) differently from the arrangement of structures in the actual unit space.
[0148] As such, the virtual stage (1020) is a service space separate from the main stage (1010), and components can be defined independently of the components (nodes, links, structures, etc.) defined for the main stage (1010).
[0149] Additionally, as illustrated, at least one POI may be defined in each of the virtual stage (1020) and the main stage (1010). POIs may be defined independently of each other in the virtual stage (1020) and the main stage (1010). That is to say, the types, number, locations, etc., of POIs defined according to the stage may differ from one another (depending on the service provided through the corresponding stage).
[0150] In the implementation of the stage, the virtual stage (1020) may inherit at least some of the spatial information defined for the main stage (1010). That is to say, the virtual stage (1020) may include at least some of the spatial information defined for the main stage (1010) (e.g., spatial information of some structures placed in a unit space). Although at least some of the spatial information is inherited by the virtual stage (1020), a scenario (second scenario) for augmenting and displaying the aforementioned second content item through the AR view (10) may be additionally defined.
[0151] Meanwhile, as described above, the virtual stage (1020) can be connected to the main stage (1010) through a predetermined connection interface. The connection interface may be implemented as at least one of a predetermined connection node located within the main stage (1010), a connection content item augmented and displayed through an AR view (10), or a connection area predefined within the main stage (1010).
[0152] In FIG. 10, connection nodes (1012, 1022) are illustrated as connection interfaces. A first connection node (1012) may be defined as a connection node within the main stage (1010), and a second connection node (1022) connected to the first connection node (1012) may be defined within the virtual stage (1020). By connecting the first connection node (1012) and the second connection node (1022) to each other, the main stage (1010) and the virtual stage (1020) may be connected to each other. That is to say, the connection between the first connection node (1012) and the second connection node (1022) may include an attribute that connects the main stage (1010) and the virtual stage (1020). The first connection node (1012) and the second connection node (1022) may be connected through a link (edge), and the attribute may be assigned to this edge. The first connection node (1012) and the second connection node (1022) may represent the same location. By connecting the main stage (1010) and the virtual stage (1020) through the first connection node (1012) and the second connection node (1022), the main stage (1010) and the virtual stage (1020) can be recognized and operated as the same positioning space.
[0153] In the step (360) described above with reference to FIG. 3, when displaying the second content item, the user terminal (100) or the server (200) may enable the user terminal (100) to switch from the main stage (12) to the virtual stage (14) and display the second content item through the AR view (10) as the user terminal (100) performs an interaction with the first connection node (1012). At this time, the second connection node (1022) connected to the first connection node (1012) may correspond to the entry position of the virtual stage (14) (i.e., the starting position of the virtual stage (14)).
[0154] Meanwhile, according to an embodiment, the first content item may be mapped to the first connection node (1012) and displayed augmented in the AR view (10). That is to say, the first scenario may include defining a first connection node as a connection interface and a first content item mapped thereto.
[0155] The above-mentioned connection content item may represent a content item mapped to the first connection node (1012), and for example, the connection content item (30) described above with reference to FIG. 1 may be a content item mapped to the first connection node (1012). Alternatively, depending on the embodiment, a polygon defined by a content item mapped to the main stage (12) (or a component other than the connection node) or other map data may be connected to a specific location of the sub-stage (14) and utilized as a connection interface. Alternatively, a connection with the sub-stage (14) may be implemented by defining a separate user interface (coordinates and attributes).
[0156] Additionally, as illustrated in FIG. 10, VR content or full-screen content (1024) may be defined in relation to the entry position of the virtual stage (1020) (i.e., the second connection node (1022)). VR content or full-screen content (1024) may be displayed on the screen according to the view of the camera after turning off the positioning function for the unit space of the user terminal (100). Since the above description regarding VR content or full-screen content (1024) can be similarly applied with reference to FIG. 5, a redundant description is omitted.
[0157] Below, with reference to FIG. 13, a method for defining multiple virtual stages and connecting them is described in more detail.
[0158] FIG. 13 illustrates a method of connecting a main stage and virtual stage(s) according to one example.
[0159] FIG. 13 conceptually illustrates an example in which multiple virtual stages are defined for a single unit space (e.g., the first floor of a museum). As illustrated, multiple virtual stages can be defined for a single unit space.
[0160] For example, a plurality of virtual stages, including a virtual stage (14, 1020), may be connected to a single main stage (12, 1010). Each virtual stage may represent a service space corresponding to at least a part of the unit space defined separately from the first service space. At this time, at least one connection interface among a connection node, a connection content item, or a connection area may be defined in the main stage (12, 1010) as a connection interface for entering each virtual stage among the corresponding plurality of virtual stages of the user terminal (100).
[0161] Additionally, as illustrated in FIG. 13, at least one sub-virtual stage may be connected to a single virtual stage. A sub-virtual stage may represent a third service space corresponding to a space that includes at least a portion of a unit space defined separately from the first service space and the second service space. Since a sub-virtual stage may represent a service space separate from the virtual stage and may be defined in the same way as the virtual stage, redundant descriptions are omitted. The relationship between the virtual stage (13) and the sub-virtual stage connected thereto is similar to the relationship between the main stage (12) and the virtual stage (14) connected thereto, so redundant descriptions are omitted.
[0162] Similar to the relationship between the main stage (12) and the virtual stage (14) connected thereto, at least one of a connection node, a connection content item, or a connection area may be defined as a connection interface in the virtual stage (14) for entry of the user terminal (100) into the sub-virtual stage. The user terminal (100) or the server (200) may augment and display at least one third content item associated with the sub-virtual stage through the AR view (10) as any one of the following is performed: ii) interaction between the user terminal (100) and the connection node defined in the virtual stage (14), ii) interaction between the user terminal (100) and the connection content item defined in the virtual stage (14), or iii) entry into the connection area defined in the virtual stage (14) by the user terminal (100). The third content item may be associated with another service provided through the sub-virtual stage and may be mapped to the sub-virtual stage according to a scenario for providing said other service. Accordingly, the user terminal (100) can enter a sub-virtual stage according to interaction with a connection interface defined in a virtual stage (14), and can display a third content item in the sub-virtual stage.
[0163] Meanwhile, the virtual stage (14) can be connected to other virtual stages, and since the previously described content can be similarly applied to the connection between these stages, a redundant description is omitted.
[0164] Additionally, the user terminal (100) may return to the virtual stage (14) (or main stage (12)) through the sub-virtual stage.
[0165] To this end, at least one of a first connection interface including at least one of a connection node for re-entry into a virtual stage (14), a connection content item, or a connection area; a second connection interface including at least one of a connection node for re-entry into a main stage (12), a connection content item, or a connection area; and a third connection interface including at least one of a connection node for entry into another sub-virtual stage connected to the virtual stage (14), a connection content item, or a connection area may be defined in the sub-virtual stage.
[0166] As the user terminal (100) or server (200) performs an interaction with the user terminal (100) and the first connection interface, the second connection interface, or the third connection interface, the user terminal (100) may be allowed to enter the virtual stage (14), the main stage (12), or the other sub-virtual stage.
[0167] Referring to the example in FIG. 13, an example of a connection between stages can be described as follows: a main stage corresponding to a unit space called the first floor of a museum may have virtual stage 1 and virtual stage 2 connected to it. Virtual stage 1 may have content items mapped according to a theme (or scenario) called "In Search of the Three Kingdoms Period," and virtual stage 2 may have content items mapped according to a theme (or scenario) called "Joseon Luxury Goods Tour." A user terminal (100) can enter a desired virtual stage by interacting with the connection interface of the virtual stage to be entered between virtual stage 1 and virtual stage 2, taking into account the service to be provided.
[0168] Meanwhile, virtual stage 1 can be connected to multiple sub-virtual stages 1_1, 1_2, and 1_3, and sub-virtual stages 1_1, 1_2, and 1_3 can be connected to each other. Sub-virtual stages 1_1, 1_2, and 1_3 may each have content items mapped according to the themes (or scenarios) of 'Silla', 'Goguryeo', and 'Baekje'. Similarly, virtual stage 2 can be connected to sub-virtual stage 2_1. Sub-virtual stage 2_1 may have content items mapped according to the theme (or scenario) of 'Intensive Exploration of Daedongyeojido'.
[0169] According to the arrangement (1300) of the stages in FIG. 13, the user terminal (100) can move between the stages and receive appropriate services through the AR view as needed. Meanwhile, the user terminal (100) can return to a higher stage and receive services by interacting with the termination interface (40) as described above.
[0170] Thus, in the embodiment, a museum app that provides a tour service through an AR view (10) that follows a special path according to a theme (scenario) and offers experiential content items related to artifacts provides basic services (search and artifact description, etc.) through a main stage, but for users who want a tour service through an AR view (10) of a separate theme, additional services can be provided by selectively entering a virtual stage in the same unit space.
[0171] As illustrated in FIG. 13, the connection between the stages can be unidirectional or bidirectional, and in the case of bidirectional, bidirectional entry between the stages can be made through the connection interface.
[0172] Meanwhile, a sub-virtual stage connected to a virtual stage (14) may inherit attributes (properties) from the virtual stage (14). In this way, the virtual stage (14) and the sub-virtual stage may have a nesting structure. When the sub-virtual stage ends, the user terminal (100) may enter the main sub-stage (14) or the initial main stage (12).
[0173] The description of the technical features described above with reference to FIGS. 1 to 6, FIGS. 8, FIGS. 9, and FIGS. 11 can be applied as is to FIGS. 10 and FIGS. 13, so redundant descriptions are omitted.
[0175] FIG. 7 illustrates a method for generating content for display in an AR view by defining a main stage and a virtual stage in a unit space according to one example.
[0176] Referring to FIG. 7, a method for generating content for display via an augmented reality (AR) view of a user terminal (100), performed by a computer system, is described in more detail. The computer system may be the aforementioned server (200) or user terminal (100), or a computer device having tools or software installed to configure the main stage (12) and the virtual stage (14).
[0177] Below, embodiments are described in which the steps (710 to 740) are performed by a computer system that may be one of these various forms of electronic devices.
[0178] In step (710), the computer system may define a main stage (12) representing a first service space corresponding to a unit space. A first content item that is augmented and displayed in the AR view (10) of a user terminal (100) according to a first scenario for providing basic services for the unit space may be mapped to the main stage (12). The computer system may define a main stage (12) representing a first service space corresponding to a unit space. The computer system may define at least one node and / or link, other structure, etc., on the main stage (12), and may map a content item to the defined node, link, or structure. The computer system may retrieve location information (location coordinates, elevation information, etc.) of the unit space and utilize it to define the main stage (12).
[0179] In step (720), the computer system may define a virtual stage (14) representing a second service space corresponding to a space that includes at least a portion of a unit space defined separately from the first service space represented by the main stage (12). In the virtual stage (14), a second content item that is augmented and displayed in the AR view (10) according to a second scenario independent of the first scenario may be mapped. The second scenario may be defined in the virtual stage (14) for a different service (different from the basic service) provided through the second service space. The computer system may define at least one node and / or link, other structure, etc., in the virtual stage (14), and may map a content item to the defined node, link, or structure. The computer system may retrieve location information (location coordinates, elevation information, etc.) of the unit space and utilize it to define the virtual stage (14). This location information may be positioning information inherited from the main stage (12).
[0180] At least one of a connection node, a connection content item, or a connection area may be defined as the aforementioned connection interface on the main stage (12) and / or virtual stage (14). The type, number, and placement location of such connection interfaces may vary depending on the number of other stages connected to the stage and the area of the unit space covered by the other stages.
[0181] In step (730), the computer system can connect the main stage (12) and the virtual stage (14) through a connection interface defined in the main stage (12) and / or the virtual stage (14). For example, the computer system can connect the main stage (12) and the virtual stage (14) through at least one connection interface among i) a connection node defined in the main stage (12) and the virtual stage (14), respectively, ii) a connection content item defined in the main stage (12) and displayed through the AR view (10), or iii) a connection area defined within the main stage (12).
[0182] Meanwhile, as in step (722), the computer system can define multiple virtual stages in a manner similar to defining a virtual stage, and can additionally define sub-virtual stages connected to the virtual stages.
[0183] That is, the computer system can define each virtual stage of a plurality of virtual stages including a virtual stage (14), and can connect the main stage (12) with each virtual stage.
[0184] Additionally, the computer system may define a sub-virtual stage representing a third service space that includes at least a portion of a unit space defined separately from the first service space. As described above, a third content item that is augmented and displayed in the AR view (10) according to a third scenario independent of the first scenario may be mapped to the sub-virtual stage.
[0185] Meanwhile, the computer system can connect the virtual stage (14) and the sub-virtual stage in a manner similar to connecting the main stage (12) and the virtual stage (14).
[0186] For example, as in step (733), the computer system can connect the virtual stage (14) and the sub-virtual stage through a predetermined connection interface, and the virtual stage (14) and the sub-virtual stage can be connected through at least one connection interface among i) a connection node defined in the virtual stage (14) and the sub-virtual stage, respectively, ii) a connection content item defined in the virtual stage (14) and displayed through the AR view (10), or iii) a connection area defined within the virtual stage (14).
[0187] In this way, by defining the main stage (12), virtual stage (14), and sub-virtual stage, content for display on an AR view (10) can be created, for example, having the arrangement (1300) of stages shown in FIG. 13.
[0188] In this regard, FIG. 14 illustrates a method for defining a main stage and a virtual stage using a content creation tool according to one example, and generating content for display in an AR view.
[0189] In FIG. 14, a content creation tool (1400) is schematically illustrated. This content creation tool (1400) can be executed by a computer system that performs the aforementioned steps (710 to 740).
[0190] As illustrated, the content creation tool (1400) may be configured to include a UI (1410) for creating a main stage, a UI (1430) for creating a virtual stage, and a settings UI (1420).
[0191] In the UI for creating the main stage (1410) and the UI for creating the virtual stage (1430), components defined for the respective stages (nodes, links, structures, POIs, content items, etc.) may be displayed. These components may be displayed in three dimensions. For example, in the illustrated example, VR content or full-screen content (1434) is displayed in the UI for creating the virtual stage (1430). The user can roughly infer the content items that will actually be displayed through the AR view (10) by looking at the graphics displayed through the UI for creating the main stage (1410) and the UI for creating the virtual stage (1430).
[0192] Meanwhile, as illustrated, POIs can be independently defined in the main stage (12) of the UI (1410) for main stage production and the virtual stage (14) of the UI (1430) for virtual stage production according to the services provided through the respective stages. For example, in the virtual stage (14) or the map view (20-2) associated therewith, POIs or structures can be placed independently of POIs or structures located in the actual unit space. For instance, settings such as creating a virtual pond in an area corresponding to an empty floor in reality, or defining a POI corresponding to a meeting room in reality as a 'magic room', can be made possible according to the scenario or theme.
[0193] A first connection node (1412) and a second connection node (1432) may be defined in the UI (1410) for main stage production and the UI (1430) for virtual stage production, and these connection nodes (1412, 1432) may constitute a connection interface. The attributes of the connection nodes (1412, 1432) may be set through a connection node setting UI included in the setting UI (1420). The setting UI (1420) may further include a UI for setting a connection range / location as a connection interface, a UI for setting content mapping, etc. The setting UI (1420) may provide items that allow input of the location coordinates, attributes, name, etc. of the mapped content.
[0194] In this way, in the embodiment, content for display on the AR view (10) can be created by defining the main stage (12) and the virtual stage (14) through an intuitive form of content creation tool (1400) such as illustrated in FIG. 14 and connecting the main stage (12) and the virtual stage (14) to each other.
[0195] Meanwhile, according to the embodiment, a consumer consuming content through the AR view (10) (i.e., a user of the user terminal (100)) may also be the subject defining the virtual stage (14). That is to say, regarding the unit space, the user (user account) may separately create a virtual stage (14) representing a service space customized by themselves, and by uploading this to a service that provides the AR view (10), they or others may be able to receive the service through the virtual stage (14) via the user terminal (100) (for a fee or for free).
[0196] A service providing an AR view (10) may distribute a divided space, which is at least a portion of a unit space, to a user for a fee or for free, and the user may separately create a virtual stage (14) representing a service space corresponding to the distributed divided space. Accordingly, in the embodiment, virtual stages created by multiple users may be defined for a single unit space, and multiple services customized by users may be provided on the AR view (10) through these virtual stages connected to the main stage (12). The customized services may be services in which a scenario for providing / displaying content items is defined by the user.
[0197] The description of the technical features described above with reference to FIGS. 1 to 6, FIGS. 8 to 11, and FIG. 13 can be applied as is to FIGS. 7 and FIG. 14, so redundant descriptions are omitted.
[0199] FIG. 12 illustrates a method for a user terminal to enter each virtual stage when a main stage and a plurality of virtual stages are connected, according to one example.
[0200] FIG. 12 illustrates a method for a user terminal (100) to enter each virtual stage in a case where a main stage (1200) defined for one unit space and a plurality of virtual stages (1230, 1240) are connected thereto.
[0201] As illustrated, when a user terminal (100) enters the main stage (1200), a plurality of connection interfaces may be displayed on the AR view (10). These connection interfaces may include a first connection content item (1210) and a second connection content item (1220). The first connection content item (1210) may be a connection interface for entering a virtual stage 1 (1230) that provides services related to restaurant guides, and the second connection content item (1220) may be a connection interface for entering a virtual stage 2 (1240) that provides services related to the Neom project.
[0202] As the user terminal (100) interacts with the first connected content item (1210), the user terminal (100) enters the virtual stage 1 (1230), and as the second content item, AR content (1232) related to a restaurant, for example, can be displayed on the AR view (10).
[0203] Meanwhile, as the user terminal (100) interacts with the second connected content item (1220), the user terminal (100) enters the virtual stage 2 (1240), and as the second content item, VR content (or full-screen content) (1242) related to Neom, for example, can be displayed on the AR view (10).
[0204] Thus, in the embodiment, a plurality of virtual stages can be connected to the main stage (12), and the user can conveniently enter the virtual stage to receive the desired service by selecting an appropriate connection interface. If the user does not want additional services other than the basic service, the user can block the provision of unnecessary information by not selecting a connection interface.
[0205] As described above, in the embodiment, multiple stages in which various scenarios are defined for a location-based AR space implemented through mapping and positioning can be defined, and thus, services based on multiple scenarios can be provided through a single app.
[0206] In addition, depending on the embodiment, connection interfaces for entering each of the plurality of stages created by users who are consumers of the content as described above may be displayed on the main stage (1200) in a form similar to that shown in FIG. 12.
[0207] The description of the technical features described above with reference to FIGS. 1 to 11, FIG. 13, and FIG. 14 can be applied as is to FIG. 12, so redundant descriptions are omitted.
[0209] In the above-described embodiment, when the user terminal (100) enters the virtual stage (14) from the main stage (12) (e.g., when an interaction with the above-described connection interface occurs), a notification may be sent to the user terminal (100), or, depending on a scenario defined in the main stage (12) or the virtual stage (14), the user terminal (100) may be switched to the virtual stage without notification to the user terminal (100) or automatically after notification.
[0210] In the embodiment, since the stages can be connected via a specific location in a unit space, it may be possible to proceed with the scenario by entering another virtual stage (14) associated with the scenario that occurred in the main stage (120) according to the user's selection. In the embodiment, since multiple sub-stages are defined, a service having an interactive scenario for the user can be provided depending on which sub-stage the user selects.
[0212] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.
[0213] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.
[0214] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a program executable by a computer, or temporarily store it for execution or download. Additionally, the medium may be various recording or storage means in the form of a single or several hardware combined, and may not be limited to a medium directly connected to a computer system but may exist distributed over a network. Examples of media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to store program instructions, including ROM, RAM, and flash memory. Additionally, other examples of media may include recording or storage media managed by app stores that distribute applications or sites and servers that supply or distribute various other software.
[0215] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.
[0216] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.
Claims
Claim 1 A method for providing content performed by a computer system that is a server or a user terminal, comprising: a step of determining whether the user terminal is located in a pre-set unit space based on the location of the user terminal; and a step of augmenting and displaying at least one first content item associated with a main stage corresponding to the unit space through an AR (augmented reality) view including an image captured by the camera of the user terminal, as determined that the user terminal is located in the unit space. and, as any one of i) interaction between the user terminal and a predetermined connection node located within the main stage, ii) interaction between the user terminal and a connection content item augmented and displayed through the AR view, or iii) entry into a predefined connection area within the main stage by the user terminal is performed, the method comprises the step of entering a virtual stage connected to the main stage and corresponding to at least a part of the unit space from the main stage through the AR view, and displaying at least one second content item associated with the virtual stage, wherein the main stage represents a first service space corresponding to a physical area of the unit space, and the virtual stage represents a second service space corresponding to a physical area but defined separately from the first service space, and the main stage and the virtual stage are recognized by the user terminal as the same positioning space of the unit space, and at least one virtual POI is defined in the virtual stage independently of the POI defined in the main stage, and while in the state of entering the virtual stage, the second content item is in the AR view as interaction between the user terminal and the virtual POI is performed A method of providing content that is displayed through augmentation. Claim 2 A method for providing content according to claim 1, wherein the first content item is augmented and displayed in the AR view according to a first scenario defined for the main stage, and the second content item is augmented and displayed in the AR view according to a second scenario defined for the virtual stage independent of the first scenario, and the step of augmenting and displaying the first content item is for the user terminal to enter the main stage and augment and display the first content item through the AR view according to the first scenario, and the step of displaying the second content item is for the user terminal to switch from the main stage to the virtual stage and display the second content item through the AR view according to the second scenario. Claim 3 A method for providing content according to claim 1, wherein a first connection node is defined as the connection node within the main stage, and a second connection node connected to the first connection node is defined within the virtual stage, and the connection between the first connection node and the second connection node includes an attribute connecting the main stage and the virtual stage, and the step of displaying the second content item is, as the user terminal performs an interaction with the first connection node, the user terminal switches from the main stage to the virtual stage and displays the second content item through the AR view. Claim 4 A method for providing content according to paragraph 3, wherein the first content item is mapped to the first connection node and is displayed augmented in the AR view. Claim 5 A method for providing content according to claim 2, further comprising: a step of displaying a map view including a map that matches the image together with the AR view; and a step of converting the map view to include map data defined according to the second scenario as the user terminal switches from the main stage to the virtual stage. Claim 6 delete Claim 7 delete Claim 8 A method for providing content according to claim 1, wherein the virtual stage is implemented by inheriting at least a portion of the spatial information defined for the main stage, and a scenario for augmenting and displaying the second content item through the AR view is additionally defined. Claim 9 A method for providing content according to claim 1, wherein a plurality of virtual stages including the virtual stage are connected to the main stage, and at least one of a connection node, a connection content item, or a connection area is defined in the main stage for entering each virtual stage among the plurality of virtual stages of the user terminal, and each virtual stage represents a service space corresponding to at least a part of the unit space defined separately from the first service space. Claim 10 A method for providing content according to claim 1, wherein at least one sub-virtual stage is connected to the virtual stage, and the sub-virtual stage represents a third service space corresponding to a space including at least a part of the unit space defined separately from the first service space and the second service space, and at least one of a connection node, a connection content item, or a connection area is defined in the virtual stage for entry of the user terminal into the sub-virtual stage, and further comprising the step of augmenting and displaying at least one third content item associated with the sub-virtual stage through the AR view as any one of ii) interaction between the user terminal and the connection node defined in the virtual stage, iii) interaction between the user terminal and the connection content item defined in the virtual stage, or iii) entry into the connection area defined in the virtual stage by the user terminal is performed. Claim 11 In claim 10, the above sub-virtual stage is defined with at least one of a first connection interface including at least one of a connection node for re-entry into the virtual stage, a connection content item, or a connection area; a second connection interface including at least one of a connection node for re-entry into the main stage, a connection content item, or a connection area; and at least one of a third connection interface including at least one of a connection node for entry into another sub-virtual stage connected to the virtual stage, a connection content item, or a connection area; and as an interaction is performed between the user terminal and the first connection interface, the second connection interface, or the third connection interface, the user terminal enters the virtual stage, the main stage, or the other sub-virtual stage, a method for providing content. Claim 12 A method for providing content according to claim 1, wherein the step of displaying the second content item further comprises the step of displaying the second content item through the AR view as the user terminal enters the virtual stage from the main stage, wherein at least one of a termination node, a termination content item, or a termination area is defined in the virtual stage for terminating the display of the virtual stage at the user terminal, and wherein the display of the virtual stage at the user terminal is terminated as any one of ii) an interaction between the user terminal and the termination node, iii) an interaction between the user terminal and the termination content item defined in the virtual stage, or iii) entry into the termination area by the user terminal is performed. Claim 13 A content provision method according to claim 1, wherein the AR view is a web-based AR view executed through a web browser installed on the user terminal. Claim 14 A method for providing content according to claim 1, wherein the first service space is a service space defined to provide a route guidance service for the physical area, the second service space is a service space defined to provide the second content item including information about the place represented by the virtual POI, and further comprising the step of exiting the virtual stage and re-entering the main stage to provide route guidance to the place represented by the virtual POI when the second content item is selected by the user terminal while in a state of entering the virtual stage. Claim 15 A method for providing content performed by a computer system that is a server or a user terminal, comprising: a step of determining whether the user terminal is located in a pre-set unit space based on the location of the user terminal; and a step of augmenting and displaying at least one first content item associated with a main stage corresponding to the unit space through an AR (augmented reality) view including an image captured by the camera of the user terminal, as determined that the user terminal is located in the unit space. and, as any one of i) interaction between the user terminal and a predetermined connection node located within the main stage, ii) interaction between the user terminal and a connection content item augmented and displayed through the AR view, or iii) entry into a predefined connection area within the main stage by the user terminal is performed, the method comprises the step of entering a virtual stage connected to the main stage and corresponding to at least a part of the unit space from the main stage through the AR view, and displaying at least one second content item associated with the virtual stage, wherein the main stage represents a first service space corresponding to the unit space, and the virtual stage represents a second service space corresponding to a space including at least a part of the unit space defined separately from the first service space, and the step of augmenting and displaying the second content item comprises the step of turning off the positioning function of the user terminal for the unit space; A method for providing content, comprising the step of displaying VR content or full-screen content as a second content item through the AR view, corresponding to the view of the camera based on the current location of the user terminal and the location of the camera, regardless of the positional relationship of the user terminal within the unit space. Claim 16 delete Claim 17 A computer program stored on a non-transient computer-readable recording medium to execute the content provision method of claim 1 on the user terminal, which is a computer system. Claim 18 A computer system implementing a user terminal or a server comprises at least one processor configured to execute computer-readable instructions contained in memory, wherein the at least one processor determines whether the user terminal is located in a preset unit space based on the location of the user terminal, and, upon determining that the user terminal is located in the unit space, augments and displays at least one first content item associated with a main stage corresponding to the unit space through an augmented reality (AR) view including an image captured by the camera of the user terminal, and, upon any one of i) interaction between the user terminal and a predetermined connection node located within the main stage, ii) interaction between the user terminal and a connection content item augmented and displayed through the AR view, or iii) entry into a preset connection area within the main stage by the user terminal, enters a virtual stage connected to the main stage and corresponding to at least a part of the unit space through the AR view, and displays at least one second content item associated with the virtual stage, wherein the main stage represents a first service space corresponding to a physical area of the unit space, and the virtual stage A computer system that represents a second service space defined separately from the first service space but corresponding to the physical area, wherein the main stage and the virtual stage are recognized by the user terminal as the same positioning space of the unit space, and at least one virtual POI is defined in the virtual stage independently of the POI defined in the main stage, and wherein, when the user terminal enters the virtual stage, the second content item is augmented and displayed in the AR view as interaction between the user terminal and the virtual POI is performed. Claim 19 A method for generating content for display via an augmented reality (AR) view of a user terminal, performed by a computer system, comprising: a step of defining a main stage representing a first service space corresponding to a physical area of a unit space, wherein a first content item is mapped to the main stage and displayed augmented in the AR view according to a first scenario while in a state of entering the main stage; a step of defining a virtual stage representing a second service space that is defined separately from the first service space but corresponds to the physical area, wherein a second content item is mapped to the virtual stage and displayed augmented in the AR view according to a second scenario independent of the first scenario while in a state of entering the virtual stage; A method for generating content for display through an AR view, comprising: i) a connection node defined in the main stage and the virtual stage, respectively; ii) a connection content item defined in the main stage and displayed through the AR view; or iii) connecting the main stage and the virtual stage through at least one connection interface among connection areas defined within the main stage; wherein, by the user terminal, the main stage and the virtual stage are recognized as the same positioning space of the unit space, and at least one virtual POI is defined in the virtual stage independently of the POI defined in the main stage; and, when the user terminal enters the virtual stage, the second content item is augmented and displayed in the AR view as interaction between the user terminal and the virtual POI is performed. Claim 20 A method for generating content for display via an AR view according to claim 19, wherein the step of defining the virtual stage comprises defining each virtual stage of a plurality of virtual stages including the virtual stage, and the step of connecting the virtual stages comprises connecting the main stage and each virtual stage, and further comprises the step of defining a sub-virtual stage representing a third service space corresponding to a space including at least a part of the unit space defined separately from the first service space, wherein a third content item augmented and displayed in the AR view according to a third scenario independent of the first scenario is mapped to the sub-virtual stage, and the step of connecting the virtual stages comprises i) a connection node defined in the virtual stage and the sub-virtual stage, respectively, ii) a connection content item defined in the virtual stage and displayed through the AR view, or iii) connecting the virtual stage and the sub-virtual stage through at least one connection interface among a connection area defined within the virtual stage.
Citation Information
Patent Citations
An system and method for providing experiential contents using augmented reality
KR1020160139633A
Method and apparatus for route guidance using augmented reality view
KR1020220037789A
Method and apparatus for providing augmented contents through augmented reality view based on preset unit space
KR1020230109291A
Method and apparatus for display virtual realiry contents on user terminal based on the determination that the user terminal is located in the pre-determined customized region
KR1020240030345A