Method and apparatus for generating custom regions with associated service elements in a space using a custom region generation tool

Abstract

Provided is a method for generating a custom area associated with a service element using a custom area generation tool, the method comprising: using a first user interface (UI) of the custom area generation tool to set an area in space corresponding to the custom area; associating a service element with the set area; and using a second UI of the custom area generation tool to set a scenario condition for controlling a user terminal based on the service element by positioning the user terminal in the set area.

Description

[Technical Field]

[0001] The following description relates to a method and apparatus for generating a custom area in a space with associated service elements, and relates to a method and apparatus for generating a custom area by using a custom area generation tool to set an area in the space corresponding to the custom area, associating a service element with the set area, and setting scenario conditions for controlling a user terminal based on the service element. [Background technology]

[0002] Augmented reality (AR) is a technology that complements the real world by blending virtual objects and information generated by computer technology. In other words, AR is a technology that displays virtual content in an augmented real-world environment, allowing users to view augmented content corresponding to the real-world environment through electronic devices.

[0003] A user terminal, which is a user's electronic device, is provided with content related to objects located within a predetermined distance or a predetermined radius from the user terminal's location, augmented to the user terminal's video. If augmented content is provided based solely on the physical distance from the user terminal, more content than necessary will be augmented, increasing the user's cognitive load and the load on the user terminal. Furthermore, content that does not match the service intended by the user may be augmented to the user terminal.

[0004] To solve these problems, it is necessary to set up an area within the space for controlling user devices, such as providing AR content to the user devices, and a tool for conveniently setting up such an area is needed.

[0005] As an example of technology relating to various services that utilize augmented reality technology, Korean Patent Publication No. 10-2014-0065963 (published on May 30, 2014, Patent Document 1) discloses an augmented reality navigator that is installed in a vehicle, displays an image of the driving route captured by a camera on a display, and maps virtual display information that guides the driving route onto the image displayed on the display.

[0006] The information provided above is merely to aid in the understanding of the present invention and may contain material that does not form part of the prior art, or that the prior art would suggest to one of ordinary skill in the art. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Korean Patent Publication No. 10-2014-0065963 (Publication date: May 30, 2014) Summary of the Invention [Problem to be solved by the invention]

[0008] A method for generating a custom area can be provided by using a custom area generation tool to set an area in space corresponding to the custom area, associating a service element with the set area, and setting a scenario condition for controlling a user terminal based on the service element.

[0009] Using a user interface (UI) provided by the custom area generation tool, a custom area can be set in two-dimensional and / or three-dimensional space within a space, service elements can be associated with the custom area, and based on the service elements, a scenario can be defined for providing services or information associated with the space and / or controlling the settings of the user terminal, thereby generating a custom area for controlling the user terminal according to the scenario.

[0010] Various conditions, such as whether a user terminal has entered or exited the custom area, are set as scenario conditions in the custom area, and different content and UI are provided to the user terminal and different setting controls are performed on the user terminal depending on whether the scenario conditions are met. [Means for solving the problem]

[0011] According to one aspect, there is provided a method for generating a custom area using a custom area generation tool executed by a computer system for generating a custom area associated with at least one service element, the method including: setting an area in space corresponding to the custom area using a first user interface (UI) of the custom area generation tool; associating the service element with the set area; and using a second UI of the custom area generation tool to set a scenario condition for controlling the user terminal based on the service element when the user terminal is located in the custom area corresponding to the set area.

[0012] The set area may include at least one of a two-dimensional space that is at least a part of the space and a three-dimensional space that is at least a part of the space, which is set using the first UI.

[0013] The step of setting the area may include a step of displaying, through the first UI, at least one of a map of the space, point cloud data (PCD) collected from the space, and an image of the space taken, and a step of setting the area based on input received from a user according to the geometry of the space identified by at least one of the displayed map of the space, the PCD, and the image.

[0014] The first UI may be a UI for creating an indoor map of the space.

[0015] The step of setting the area may automatically set the area based on the position of a predetermined object within the space, a predetermined two-dimensional space within the space, or a predetermined polygon within the space.

[0016] The area may be set to include a two-dimensional space and a three-dimensional space having a set height range, and when the user terminal is located in the two-dimensional space and the height of the user terminal falls within the set height range, the user terminal may be determined to be located in the custom area and controlled based on the set scenario conditions and the service elements.

[0017] The scenario conditions may include 3DoF (Degree Of Freedom) or 6DoF attitude conditions of the user terminal, and when it is determined that the user terminal is located in the custom area, if the attitude of the user terminal satisfies the attitude conditions, the user terminal may be configured to be controlled based on the service elements.

[0018] The scenario conditions may be set to control the user terminal differently based on the service elements when the user terminal enters the custom area and when the user terminal exits the custom area.

[0019] The service element may include data for displaying AR (augmented reality) content related to a service associated with the space, and when a user terminal is located in the custom area, the AR content may be displayed in an AR view including images captured by a camera of the user terminal in accordance with the set scenario conditions.

[0020] The scenario conditions may be set so that different AR content is displayed by the AR view when the user terminal enters the custom area and when the user terminal exits the custom area.

[0021] The scenario conditions may be set so that when the user terminal moves according to route guidance to a destination, different AR content is displayed by the AR view when the user terminal enters the custom area and when the user terminal exits the custom area.

[0022] Whether the user terminal has entered the custom area or whether the user terminal has exited the custom area may be determined based on a route presented to the user terminal according to the route guidance.

[0023] The scenario conditions may be set so that when the user terminal is positioned in the custom area, the AR content displayed by the AR view is AR content determined based on other custom areas that the user terminal entered before the user terminal entered the custom area.

[0024] The scenario conditions may be set so that when the user terminal is located in the custom area, the AR content is displayed by the AR view as AR content determined based on the points the user terminal has passed through.

[0025] The scenario conditions include at least one of i) a first scenario condition indicating whether the user terminal has passed through a predetermined other custom area that is not the custom area, and ii) a second scenario condition indicating whether the number of user terminals located in the custom area is within a predetermined range, and the scenario conditions may be set to provide the user terminal with different services or information associated with the space based on the service elements and / or control the settings of the user terminal differently depending on whether the scenario conditions are met.

[0026] A unique ID may be assigned to the created custom area, and the set area, the set scenario conditions, and the ID may be stored in association with each other.

[0027] The second UI may include a third UI for setting at least one control state of the user terminal and at least one trigger condition for reaching the control state based on the service element, and the scenario conditions may be set according to the control state and the trigger condition set through the third UI.

[0028] The control state may include displaying the content indicated by the service element, canceling the display of the content, the display format of the content, or the time of displaying the content, and the trigger condition may include at least one of whether the custom area has been entered, whether the custom area has been exited, whether the user terminal has passed through a specific point, and whether the user terminal has passed through another specified custom area.

[0029] The third UI includes a graph in which the control states are nodes and the trigger conditions are edges connecting the nodes, and the nodes and edges are configured to be able to be added, changed, or deleted by a user, and the step of setting the scenario conditions may set the scenario conditions by using the graph to set the control states corresponding to the nodes selected by the user and to set the trigger conditions corresponding to the edges selected by the user.

[0030] The set area may be associated with the service element by directly placing the service element in the set area, and when the service element associated with the set area or the set area is selected, the second UI may be provided.

[0031] When generating another custom area, the method for generating a custom area may further include a step of importing the set area and the set scenario conditions of the generated custom area, where the form of the set area may be duplicated and used to set a corresponding area in the other custom area, and the scenario conditions may be duplicated and used to set the scenario conditions of the other custom area.

[0032] According to another aspect, there is provided a computer system for generating a custom area associated with at least one service element using a custom area generation tool for generating the custom area, the computer system including at least one processor configured to execute computer-readable instructions contained in a memory, wherein the at least one processor uses a first user interface (UI) of the custom area generation tool to set an area in a space corresponding to the custom area, associate the service element with the set area, and uses a second UI of the custom area generation tool to set a scenario condition for controlling the user terminal based on the service element by the user terminal being located in the custom area corresponding to the set area. [Effects of the Invention]

[0033] A custom area generation tool may be provided for conveniently setting areas within the space corresponding to custom areas in two-dimensional and / or three-dimensional spaces, associating service elements with the areas, and intuitively defining scenario conditions for providing services or information associated with the space and / or controlling settings of the user terminal based on the service elements.

[0034] The custom region generation tool can provide a UI for manually setting a region corresponding to the custom region, taking into account the geometry of the space, or automatically setting the region based on pre-stored mapping information for the space.

[0035] The custom area generation tool can provide a UI for intuitively setting at least one control state of the user terminal and at least one trigger condition for reaching that control state in order to set scenario conditions for an area corresponding to the custom area. [Brief explanation of the drawings]

[0036] [Figure 1A]FIG. 10 illustrates a method for controlling a user terminal based on the user terminal being located in a pre-defined custom area in one embodiment. [Figure 1B] FIG. 10 illustrates a method for creating a custom area from an administrator terminal in one embodiment. [Figure 2] FIG. 1 illustrates a computer system that executes a method for generating a custom region. [Figure 3] 1 is a flowchart illustrating a method for creating a custom region in one embodiment. [Figure 4] 10 is a flowchart illustrating a method for setting a region corresponding to a custom region using a custom region generation tool in one embodiment. [Figure 5A] 10A and 10B illustrate how a user interface provided by a custom region generation tool can be used to set a region including two-dimensional and / or three-dimensional space. [Figure 5B] 10A and 10B illustrate how a user interface provided by a custom region generation tool can be used to set a region including two-dimensional and / or three-dimensional space. [Figure 5C] 10A and 10B illustrate how a user interface provided by a custom region generation tool can be used to set a region including two-dimensional and / or three-dimensional space. [Figure 5D] FIG. 1 illustrates a custom region defined as a three-dimensional space in one embodiment. [Figure 6A] FIG. 10 is a diagram illustrating a method for setting scenario conditions for a region corresponding to a custom region using a user interface provided by a custom region generation tool in one embodiment. [Figure 6B] FIG. 10 is a diagram illustrating a method for setting scenario conditions for a region corresponding to a custom region using a user interface provided by a custom region generation tool in one embodiment. [Figure 6C]FIG. 10 is a diagram illustrating a method for setting scenario conditions for a region corresponding to a custom region using a user interface provided by a custom region generation tool in one embodiment. [Figure 7A] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 7B] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 7C] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 7D] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 8A] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 8B] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 8C] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 9A] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 9B] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 9C]10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 10] FIG. 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area, according to one embodiment. [Figure 11A] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 11B] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 11C] 10 illustrates a method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area in one embodiment. [Figure 12] FIG. 2 is a diagram illustrating the degree of freedom (DoF) of a user terminal in one embodiment. [Figure 13] FIG. 10 illustrates a custom region including multiple points, in one embodiment. [Figure 14] FIG. 10 is a diagram illustrating a method in which multiple custom areas are set in a space and scenario conditions for controlling a user terminal are set for each custom area in one embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0037] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings.

[0038] FIG. 1A illustrates a method for controlling a user terminal based on the user terminal's location in a pre-defined custom area in one embodiment.

[0039] In the following detailed description, "control" of the user terminal 100 may include, for example, as shown in FIGS. 1A and 1B , at least one of using the AR view 10 of the user terminal 100 to augment and display content (e.g., AR content 30) indicating services or information associated with the space 5 in the image of the AR view 10; displaying a user interface (UI) related to services associated with the space 5 on the user terminal 100; displaying map element content 35 related to services associated with the space 5 on a map (or map view 20) of the user terminal 100; and controlling the settings of the user terminal 100 to provide the user terminal 100 with services associated with the space 5. However, "control" of the user terminal in the embodiments of the present disclosure should not be limited to the above-described examples, and may include controlling the functions and / or operations of the user terminal.

[0040] In the embodiment, the "space 5" associated with the provision of augmented content may refer to an indoor space and / or an outdoor space. In other words, the space 5 described below may be defined as a space including an indoor location or an outdoor location, or may be defined as a composite space combining an indoor space and an outdoor space. The space 5 may be at least a part of a service target area for providing services including the provision of content.

[0041] In the detailed description below, for convenience of explanation, the location of a user who carries the user terminal 100 may be described as the location of the user terminal 100. Also, for convenience of explanation, the terms "user" and "user terminal 100" carried by the user may be used interchangeably.

[0042] In the detailed description below, "extending" content and / or information (e.g., indicators, etc.) onto a video may be interpreted to encompass overlaying the content and / or information onto the video / screen of the AR view, depending on the embodiment.

[0043] As shown in the figure, a user terminal 100 such as a smartphone may be capable of capturing images of the surroundings using a camera and displaying AR content 30 using an AR view 10 including images captured by the camera. The AR content 30 may be associated with an object present in a space 5. Such AR content 30 may be mapped to the object (or a node representing the object).

[0044] At least one custom area may be defined on the map of the space 5 shown in the figure. In the example shown in the figure, two custom areas, a first custom area 60 and a second custom area 70, are defined. At least one service element may be associated with each custom area 60, 70. Furthermore, a scenario (i.e., a scenario condition) may be defined for each custom area 60, 70 to provide a service or information associated with the space 5 based on the service element or to control the settings of the user terminal 100. The service or information may include information for advertising or marketing. Such a scenario condition may include a condition for controlling the user terminal 100. The "custom areas 60, 70" may be predefined on the server 200. For example, at least a portion of the space 5 or a divided partial area of ​​the space 5 may be defined as the "custom areas 60, 70" on the server 200.

[0045] The method of generating the custom areas 60, 70 by setting areas corresponding to each custom area 60, 70, associating service elements with the set areas, and setting scenario conditions for the set areas will be described in more detail with reference to Figures 1B to 14.

[0046] The custom areas 60 and 70 may be generated and utilized for controlling the user terminal 100. As shown in the figure, it may be determined whether the user terminal 100 is located in a first custom area 60 within the space 5 based on the location of the user terminal 100. If it is determined that the user terminal 100 is located in the first custom area 60, AR content 30 may be displayed in the AR view 10 of the user terminal 100 based on a service element associated with the custom area 60. For example, when the user terminal 100 enters the first custom area 60, the AR content 30 associated with the object "metal type" is displayed in the AR view 10. At this time, the current location 50 of the user terminal 100 may be displayed in the map view 20. The current location 50 may correspond to a position 50' in the space 5. In the embodiment shown in the figure, when the user terminal 100 enters the first custom area 60, an AR content 30 associated with "metal type," which is an object located outside the first custom area 60, is displayed. However, depending on the service element associated with the first custom area 60, when the user terminal 100 enters the first custom area 60, other AR content associated with an object located inside the first custom area 60, such as the "Epitaph of Princess Suyeong," may be displayed.

[0047] Meanwhile, in other embodiments, based on the position of the user terminal 100, other types of content may be displayed in the AR view 10, an appropriate UI may be provided, appropriate map element content may be displayed, or the settings of the user terminal 100 may be appropriately changed according to various scenario conditions defined for the first custom area 60, such as when the user terminal 100 exits the first custom area 60.

[0048] The map view 20 displayed together with the AR view 10 on the screen of the user terminal 100 may include a map that matches the image of the AR view 10. The map view 20 may include a current location 50 of the user terminal 100. The map view 20 may include a two-dimensional map or a three-dimensional map. The map view 20 may include objects in the space 5 through which the user terminal 100 moves. The map view 20 may display map element content 35 corresponding to the AR content 30. The map element content 35 may be displayed when the AR content 30 is displayed in the AR view 10 or when an object associated with the AR content 30 is included in the map view 20.

[0049] The user terminal 100 may communicate with the server 200 for control upon entering / exiting the custom areas 60, 70. For example, the server 200 may cause the user terminal 100 to be controlled based on a service element associated with the custom area 60, 70 in which the user terminal 100 is located.

[0050] The server 200 is a computer system that manages the custom areas 60, 70 set in the space 5, and may be a server that manages the association of service elements and the setting of scenario conditions for the custom areas 60, 70. The server 200 may also be a map server that provides digital maps (3D maps and / or 2D maps).

[0051] Hereinafter, with reference to Figures 1B to 14, a method for generating custom areas 60, 70 using a custom area generation tool will be described in more detail, and a specific method for controlling the user terminal 100 based on the position of the user terminal 100 relative to the custom areas 60, 70 and / or entry / exit will be described in more detail.

[0052] FIG. 1B illustrates a method for creating a custom area by an administrator terminal in one embodiment.

[0053] Referring to FIG. 1B, a method will be described for setting areas within space 5 that correspond to the above-described custom areas 60, 70, associating service elements with the areas (i.e., custom areas 60, 70), and setting scenario conditions for providing services or information associated with space 5 to user terminal 100 or controlling the settings of user terminal 100.

[0054] The custom areas 60, 70 may be generated by a custom area generation tool 102. The custom area generation tool 102 may be included in software or an application executed on the administrator terminal 101.

[0055] The administrator terminal 101 may be a service provider terminal used to set custom areas 60, 70 on a map of the space 5, and may be separate from the user terminal 100 that receives the provision of the above-mentioned services and content, i.e., on which the content and information is displayed.

[0056] The administrator terminal 101 may generate the custom areas 60, 70 by executing the custom area generation tool 102 (i.e., software or an application including the custom area generation tool 102), setting areas corresponding to the custom areas 60, 70 within the space 5 based on input from a user of the administrator terminal 101, associating service elements with the set areas, and setting scenario conditions for controlling the user terminal 100 based on the service elements for the set areas.

[0057] Once the custom areas 60 , 70 are created through the administrator terminal 101 , they may be registered with the server 200 .

[0058] The custom area generation tool 102 may include a first UI 103 for setting an area corresponding to the custom area 60, 70 to be generated, and a second UI 104 for setting the scenario conditions for the set area. Although not shown in the figure, the custom area generation tool 102 may further include an additional UI for associating a service element with the set area.

[0059] For example, the first UI 103 may load data representing the space 5 and may set areas corresponding to the custom areas 60 and 70 based on user input for the loaded data. The data representing the space 5 may include at least one of a map relating to the space 5, point cloud data (PCD) collected from the space 5, and images captured of the space 5. The user may set the areas corresponding to the custom areas 60 and 70 by selecting the areas corresponding to the loaded data. Meanwhile, the second UI 104 may include a UI for the user to set scenario conditions for the set areas. As an example, the second UI 104 may include a UI (a third UI described below) for setting at least one control state of the user terminal 100 when the user terminal 100 is located within the set areas corresponding to the custom areas 60 and 70 and setting at least one trigger condition for the control state.

[0060] The first UI 103 and a specific method for setting areas corresponding to the custom areas 60 and 70 through the first UI 103 will be described in more detail with reference to Figures 3 to 5. The second UI 104 and a specific method for setting scenario conditions for areas set through the second UI 104 will be described in more detail with reference to Figures 3 to 6.

[0061] While the administrator terminal 101 and the user terminal 100 have been described as being separate from each other, in some embodiments, the user terminal 100 may be used to generate custom areas 60, 70 within the space 5. In such an embodiment, the custom area generation tool 102 may be executed on the user terminal 100.

[0062] In other words, the user terminal 100 that receives the provision of the service for the space 5 can also create custom areas 60, 70 for providing the service for the space 5. In this case, the service for the space 5 may be based on crowdsourcing of the user terminal 100.

[0063] Furthermore, at least one location or at least one area within the space 5 for generating a custom area 60, 70 within the space 5 may be sold to the user terminal 100. The user terminal 100 may be able to purchase the location or area for generating the custom area 60, 70 through the server 200, and the custom area 60, 70 may be generated in the purchased location or area. In this manner, the user terminal 100 may generate its own custom area 60, 70 in the location or area it has purchased, thereby allowing other user terminals located in the custom area 60, 70 to display desired AR content in their AR views, or allowing other user terminals to be controlled according to the scenario conditions of the custom area 60, 70. In such an embodiment, the location or area available for purchase by the user terminal 100 may belong to a portion of the space 5 permitted by the service provider, rather than the entire range of the space 5. In other words, the user terminal 100 can personalize the creation of custom areas 60, 70 by purchasing locations or areas that belong to a portion of the space 5 permitted by the service provider (i.e., locations or areas that are permitted for sale).

[0064] The above description of the technical features given with reference to FIG. 1A can be applied to FIG. 1B as well, so duplicated description will be omitted.

[0065] FIG. 2 illustrates a computer system that implements the method for generating a custom region.

[0066] In the embodiment, the administrator terminal 101 described with reference to Fig. 1B may be realized by the computer system 2 shown in the figure. On the other hand, the user terminal 100 described with reference to Fig. 1A may also be realized by the computer system 2.

[0067] For example, a computer program for implementing the method of the embodiment may be installed and executed in a computer system 2, and such a computer system 2 may execute the method of generating custom areas 60, 70 according to the embodiment under the control of the executed computer program.

[0068] The method for generating custom areas 60, 70 according to the embodiment may be executed through a PC-based program or a mobile terminal-specific application including a custom area generation tool 102. For example, the method for generating custom areas 60, 70 according to the embodiment may be implemented in the form of an independently operating program or a function executed by a specific program. In the embodiment, the method for generating custom areas 60, 70 may be executed through a custom area generation tool 102 including such a program.

[0069] The computer system 2 is an electronic device corresponding to the administrator terminal 101 (and the user terminal 100) described above, and may be a personal computer (PC) or smart device, or other similar device, on which an application or program can be installed and executed, as shown in FIG. 1B (and FIG. 1A). For example, the computer system 2 may be a smartphone, a PC, a laptop computer, a tablet, an Internet of Things (IoT) device, or a wearable computer.

[0070] As shown, the computer system 2 may include memory 110, a processor 120, a communication interface 130, and an input / output interface 140 as components for executing the method of generating custom regions 60, .

[0071] Memory 110 is a computer-readable recording medium and may include random access memory (RAM), read-only memory (ROM), and a persistent mass storage device such as a disk drive. Here, a persistent mass storage device such as a ROM or a disk drive may be included in computer system 2 as a separate persistent storage device distinct from memory 110. Memory 110 may also store an operating system and at least one program code. Such software components may be loaded into memory 110 from a computer-readable recording medium separate from memory 110. Such separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, or a memory card. In other embodiments, software components may be loaded into memory 110 through communication interface 130, which is not a computer-readable recording medium. For example, software components may be loaded into memory 110 of computer system 2 based on a computer program installed by a file received over network 160.

[0072] Processor 120 may be configured to process computer program instructions by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to processor 120 by memory 110 or by communication interface 130. For example, processor 120 may be configured to execute instructions received according to program code stored in a storage device such as memory 110.

[0073] That is, processor 120 can manage the components of computer system 2 and can execute programs or applications used by computer system 2. For example, processor 120 can be configured to execute custom area generation tool 102 for generating custom areas 60, 70 of the embodiments and process data received from a user and / or server 200 for generating custom areas 60, 70. Processor 120 can also process calculations necessary for executing programs or applications, processing data, and the like, and can be at least one processor of computer system 2 or at least one core within a processor.

[0074] The communication interface 130 may provide a function for the computer system 2 to communicate with other computer systems (not shown) via the network 160. For example, requests, instructions, data, files, etc. generated by the processor 120 of the computer system 2 in accordance with program code stored in a storage device such as the memory 110 may be transmitted to the other computer systems via the network 160 under the control of the communication interface 130. Conversely, signals, instructions, data, files, etc. from the other computer systems may be received by the computer system 2 via the communication interface 130 of the computer system 2 via the network 160. The signals, instructions, data, etc. received via the communication interface 130 may be transmitted to the processor 120 or the memory 110, and files, etc. may be recorded on a storage device (the above-mentioned permanent storage device) that the computer system 2 may further include. For example, the communication interface 130 may be a hardware module such as a network interface card, a network interface chip, or a networking interface port of the computer system 2, or a software module such as a network device driver or a networking program.

[0075] The input / output interface 140 may be a means for interfacing with the input / output device 150. For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display or speaker. As another example, the input / output interface 140 may be a means for interfacing with a device that integrates input and output functions into one, such as a touch screen. The input / output device 150 may be configured as a single device together with the computer system 2.

[0076] Also, in other embodiments, computer system 2 may include more components than those shown in FIG. 2 . However, it is not necessary to explicitly illustrate most of the conventional components. For example, computer system 2 may be implemented to include at least some of the input / output devices connected to input / output interface 140 described above, and may further include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, if computer system 2 is implemented in the form of a mobile device such as a smartphone, computer system 2 may further include various components typically found in mobile devices, such as a camera, an acceleration sensor, a gyro sensor, various physical buttons, buttons using a touch panel, input / output ports, and a vibrator for vibration.

[0077] Meanwhile, the computer system 2 corresponding to the user terminal 100 may include a camera that captures images of the surroundings to execute the AR view 10. In this case, the computer system 2 may display an image captured by the camera as the AR view 10 and may display the AR content 30 by extending the image of the AR view 10. For example, the computer system 2 may determine whether the user terminal 100 is located in a pre-defined custom area 60, 70 through positioning, and if the user terminal 100 is located in the custom area 60, 70, display the AR content 30 based on the service elements associated with the custom area 60, 70 in the AR view 10. The positioning of the user terminal 100 may be performed using a visual localization or a Visual Positioning System (VPS). Alternatively, the positioning of the user terminal 100 may be performed using a marker recognition method, a GPS method, a Wi-Fi Positioning System (WPS), a Bluetooth module, an odometry method, or the like. Meanwhile, the actual operation of determining whether the computer system 2 is located in the custom area 60, 70 may be performed by the server 200, rather than the computer system 2. The server 200 may communicate with the user terminal 100 and provide the user terminal 100 with data for controlling the user terminal 100, thereby controlling the user terminal 100. The user terminal 100 may communicate with the server 200 and be controlled based on the data and / or information provided by the server 200. In this case, the server 200 may receive the location of the user terminal 100, determine whether the user terminal 100 is located in the custom area 60, 70 based on the received location, and, if the user terminal 100 is located in the custom area 60, 70, control the user terminal 100 based on the service elements associated with the custom area 60, 70.

[0078] The server 200 is a device that manages (registers, modifies, deletes, saves, maintains, etc.) the data and content provided to the user terminal 100 and the custom regions 60, 70, and may include a database or communicate with such a database. The server 200 may also be or include a map server that provides digital maps (3D maps and / or 2D).

[0079] The server 200 may provide the administrator terminal 101 with data that is required when the administrator terminal 101 generates the custom areas 60, 70. For example, data indicating the space 5 loaded by the administrator terminal 101 may be provided by the server 200. In addition, the custom areas 60, 70 generated by the administrator terminal 101 (i.e., the set areas and set scenario conditions corresponding to the custom areas 60, 70) may be registered and stored in the server 200.

[0080] The server 200 may include at least one computer system. The computer system included in the server 200 may have a configuration similar to that of the computer system 2 described above, and a duplicated description thereof will be omitted.

[0081] In the detailed description below, for convenience of explanation, the embodiment will be described focusing on the computer system 2 corresponding to the administrator terminal 101 and the user terminal 100, and explanations of communication with the server 200 and operations on the server 200 side may be simplified or omitted. Also, for convenience of explanation, operations (steps) performed by the components (e.g., processor, etc.) of the computer system 2 (or the server 200) may be described as being performed by the computer system 2 (or the server 200).

[0082] The above description of the technical features given with reference to FIGS. 1A and 1B can be applied to FIG. 2 as well, so duplicated description will be omitted.

[0083] FIG. 3 is a flow chart illustrating a method for creating a custom region in one embodiment.

[0084] 3, a method for generating custom areas 60, 70 executed by a computer system 2 will be described. Although the computer system 2 may be the administrator terminal 101 described with reference to FIGS. 1A and 1B, the following detailed description will use the term administrator terminal 101 instead of the computer system 2 to describe the embodiment. The administrator terminal 101 may be replaced by a user terminal 100 on which a custom area generation tool 102 is installed.

[0085] Furthermore, at least some of the substantial calculations and operations of steps 310 to 350 described below and steps described with reference to Fig. 4 may be configured to be executed by the server 200 rather than the administrator terminal 101. Below, the execution of the steps will be described mainly with the administrator terminal 101, and redundant explanations of the server 200 may be omitted.

[0086] The administrator terminal 101 may generate the custom areas 60, 70 using a custom area generation tool 102 for generating custom areas 60, 70 associated with at least one service element. The custom area generation tool 102 may be a program or part of a program installed on the administrator terminal 101 or may be a program or part of a program running on the server 200.

[0087] For example, the custom area generation tool 102 may be a creation tool for generating custom areas 60, 70 for a space 5 to provide a location-based AR service. The custom area generation tool 102 may generate, augment, and display 3D content such as AR content on the user terminal 100 by setting areas corresponding to the custom areas 60, 70, setting predetermined scenario conditions (i.e., spatial conditions, etc.) for the areas corresponding to the custom areas 60, 70, and associating specific service elements with the areas. That is, the custom area generation tool 102 may have a function of setting a 2D space and / or a 3D space as areas corresponding to the custom areas 60, 70, and associating a service for outputting 3D content with the set areas. The custom area generation tool 102 may manage each custom area 60, 70 using a unique ID, and may associate and manage the areas corresponding to the custom areas 60, 70 with scenario conditions through the IDs of the custom areas 60, 70.

[0088] The following provides further details on how to use the custom region generation tool 102 and its user interfaces 103, 104 to generate custom regions 60, 70.

[0089] In step 310, the administrator terminal 101 may use a first user interface (UI) 103 of the custom area generation tool 102 to set areas corresponding to the custom areas 60 and 70 within the space 5.

[0090] The first UI 103 may include a user interface for setting areas corresponding to the custom areas 60, 70 in the space 5 according to an absolute coordinate system.

[0091] The administrator terminal 101 may use the first UI 103 to set areas corresponding to the custom areas 60, 70 as two-dimensional spaces and / or three-dimensional spaces. That is, the set areas may include at least one of a two-dimensional space that is at least a part of the space 5 and a three-dimensional space that is at least a part of the space 5 set using the first UI 103. The space set in this manner may also be set as a multi-dimensional space that includes both a two-dimensional space and a three-dimensional space.

[0092] The administrator terminal 101 may load data related to the space 5 using the custom area generation tool 102 through the first UI 103, and may set areas corresponding to the custom areas 60, 70 according to user input for such loaded data. As an example, the administrator terminal 101 may load a map of the space 5 through the first UI 103, and may set areas corresponding to the custom areas 60, 70 on the map according to user input for the map.

[0093] The first UI 103 may be a map creation tool for generating a map of the space 5. For example, three-dimensional data of the space 5 may be loaded (or rendered) through the first UI 103. The three-dimensional data may be at least one of three-dimensional point cloud data (PCD) obtained by scanning the space 5, a photographed image of the space 5, and a blueprint or drawing showing the space 5. As an example, if the space 5 is indoors, the first UI 103 may include an indoor map generation UI for creating an indoor map for the space 5 or may be part of the indoor map generation UI. The indoor map generation UI may provide a function for setting detailed spaces (such as exhibition rooms), means of transportation such as stairs, escalators, and elevators, facilities such as restrooms, signs, labels, and information displays, other obstacles such as pillars, route information within the space 5, nodes, and links connecting the nodes.

[0094] In this regard, the method of step 310 of rendering the three-dimensional data of the space 5 through the first UI 103 and setting the areas corresponding to the custom areas 60 and 70 will be described in more detail with reference to FIG.

[0095] FIG. 4 is a flowchart illustrating a method for setting a region corresponding to a custom region using a custom region generation tool in one example.

[0096] In step 410, the administrator terminal 101 may display, through the first UI 103, at least one of a map of the space 5, PCDs collected from the space 5, and images taken of the space 5. In other words, such data representing the space 5 may be rendered on the first UI 103. The PCDs / images may be collected by the administrator terminal 101 or another device such as a mapping robot by directly scanning / taking pictures of the space 5. The map of the space 5 may be generated based on the collected PCDs / images.

[0097] In step 420, the administrator terminal 101 may receive input from the user according to the geometry of the space 5 identified by at least one of the map of the space 5 displayed through the first UI 103, the PCD showing the space 5, and the image.

[0098] In step 430, the administrator terminal 101 may set the areas by defining the areas corresponding to the custom areas 60, 70 according to the input received from the user.

[0099] In this manner, the data representing the space 5 displayed through the first UI 103 may be displayed so that the geometry of the space 5 can be identified. That is, through the displayed data representing the space 5, the user can identify (at least roughly) the physical structure of the space 5 and set areas corresponding to the custom areas 60, 70 based on this. For example, the user can set areas corresponding to the custom areas 60, 70 while checking specific rooms, facilities, walls, ceilings, floors, etc. within the space 5 through the data representing the space 5 displayed through the UI 103. The user may set areas corresponding to the custom areas 60, 70 by at least one of inputting coordinate values ​​corresponding to the area, selecting a point, and selecting an area by dragging. In this manner, the user using the UI 103 can appropriately set areas corresponding to the custom areas 60, 70 while intuitively checking the physical structure of the space 5.

[0100] When the indoor map generation UI includes the first UI 103, the custom regions 60, 70 can be generated together with the construction of an indoor map for the space 5.

[0101] Meanwhile, the areas corresponding to the custom areas 60 and 70 may be set automatically rather than by direct area designation by the user. For example, the administrator terminal 101 may receive user input through the first UI 103 (step 440) and automatically set the areas corresponding to the custom areas 60 and 70 using the user input and pre-stored mapping information related to the space 5 (step 450).

[0102] In other words, areas corresponding to the custom areas 60 and 70 can be automatically set based on mapping information stored in advance in the server 200 or the administrator terminal 101 for the space 5, even with minimal user input. The mapping information is information stored in the server 200 or the administrator terminal 101 for constructing a map for the space 5, and may be information regarding the position of a predetermined object within the space 5, a predetermined two-dimensional space within the space 5, or a predetermined polygon within the space (i.e., a three-dimensional space).

[0103] The administrator terminal 101 may automatically set areas corresponding to the custom areas 60 and 70 based on the position of an object preset within the space 5, a two-dimensional space preset within the space 5, or a polygon preset within the space 5, which correspond to such mapping information. A user input for triggering such automatic setting of areas by the administrator terminal 101 may be a semantic input for selecting a portion of the space 5. For example, such a user input may be the input of a two-dimensional or three-dimensional space preset within the space 5, or the name or identifier of a landmark. In other words, the user can automatically set areas corresponding to the custom areas 60 and 70 on the custom area generation tool 102 without directly inputting coordinates or setting areas, by simply inputting the name of a predetermined exhibition room A or landmark A within the space 5 or sending input for defining the space (e.g., the entire space between pillar A and pillar B) to the administrator terminal 101.

[0104] Hereinafter, with reference to FIGS. 5A to 5D, a specific example for setting areas corresponding to the custom areas 60 and 70 and the areas corresponding to the set custom areas 60 and 70 will be described in more detail.

[0105] 5A-5C are diagrams illustrating a method for setting a region including two-dimensional and / or three-dimensional space using a user interface provided by a custom region generation tool, and FIG. 5D is a diagram illustrating a custom region set as a three-dimensional space in one example.

[0106] The custom areas 500, 530, and 540 correspond to the above-described custom areas 60 and 70, that is, may represent areas before scenario conditions are set.

[0107] The first UIs 502 to 506 described below may be enlarged or reduced as needed.

[0108] FIG. 5A shows an example in which a custom region 500 including a two-dimensional space is set on a first UI 502. In the example shown in the figure, a map (or a blueprint or drawing) showing the space 5 is loaded on the first UI 502 as data showing the space 5. Multiple custom regions 500 may be set on such loaded data showing the space 5. Each of the custom regions 500 is defined to show a means of transportation such as stairs, escalators, or elevators, or to show a specific space (such as an exhibition room) within the space 5. As shown in the figure, multiple nodes may be defined on the map of the space 5, which is data showing the space 5.

[0109] The user may set each of the custom regions 500 by dragging or specifying coordinates on data such as a map of the space 5 loaded on the first UI 502.

[0110] 5B illustrates an example in which a custom region 500 including a two-dimensional space and / or a three-dimensional space is set on a first UI 504. As in the illustrated example, a PCD 510 representing the space 5 is rendered on the first UI 504 as data representing the entire space 5. The PCD 510 may be displayed superimposed on a map of the space 5 and / or an image captured of the space 5. In the illustrated example, the PCD 510 is displayed superimposed on the map of the space 5.

[0111] A plurality of custom regions 500 may be set on the data representing such loaded space 5. Each of the custom regions 500 may be set as a two-dimensional space and / or a three-dimensional space. The user may identify the geometry of the space 5 using the PCD 510 and / or an image, and may appropriately set each of the custom regions 500 while taking into consideration the geometry of the space 5. Therefore, the custom regions 500 are set so as to accurately reflect the shape of the actual space 5.

[0112] 5C illustrates an example in which a custom region 530 including a three-dimensional space is set on the first UI 506. In the illustrated example, a PCD representing the space 5 is rendered on the first UI 506 as data representing the space 5. Although not illustrated, the PCD may be superimposed on a map of the space 5 and / or an image captured of the space 5.

[0113] As shown in the figure, the custom region 530 may be set in the form of a three-dimensional polygon on the data representing the rendering space 5. The user may set the custom region 530 by dragging or specifying coordinates on the data representing the rendered space 5. The custom region 530 may be configured as a composite space that includes two-dimensional space in addition to the three-dimensional space. The polygons and lines corresponding to the custom region 530 may be defined by a combination of coordinates.

[0114] 5D further illustrates a custom region 540 established in three-dimensional space, which may correspond to custom region 530 described above.

[0115] As described above, the custom region 540 may be set on data representing the space 5, such as a map of the space 5, to include at least one of a two-dimensional space and a three-dimensional space.

[0116] Once the association of service elements with the custom area 540 and the setting of scenario conditions are complete, the user terminal 100 or the server 200 may control the user terminal 100 based on the service elements associated with the custom area 540 when the user terminal 100 is located in the custom area 540.

[0117] As shown, the custom region 540 may be configured to include a two-dimensional area and a three-dimensional space with a set height range, or the custom region 540 may be configured as a multi-dimensional space including two-dimensional and three-dimensional spaces.

[0118] The two-dimensional region that makes up custom region 540 may include a two-dimensional coordinate space (x, z). The height range that makes up custom region 540 may include a y-axis coordinate space. The height range may be a range with an upper and lower limit (H), as shown in the figure, or it may be a range without an upper or lower limit, as shown in the figure.

[0119] When the user terminal 100 is located in a two-dimensional area that constitutes the custom area 540 and the height of the user terminal 100 falls within a set height range that constitutes the custom area 540, the user terminal 100 or the server 200 may determine that the user terminal 100 is located in the custom area 540 and may control the user terminal 100 based on the scenario conditions set for the custom area 540 and the service elements associated with the custom area 540. In this case, the height of the user terminal 100 may be acquired by a sensor included in the user terminal 100. The height of the user terminal 100 may indicate, for example, the height of the camera of the user terminal 100.

[0120] On the other hand, while FIG. 5D shows one height range (H), multiple height ranges may be set in the custom area 540, and service elements may be associated with each height range to define scenario conditions.

[0121] In this way, by setting the custom area 540 in a three-dimensional space, even if the user terminal 100 is located in the same two-dimensional space, the user terminal 100 can be controlled differently according to different scenario conditions depending on the height of the user terminal 100.

[0122] Meanwhile, a measuring device capable of precise positioning may be used to scan the space 5. Such a measuring device may be the administrator terminal 101 or another device. The positioning of the measuring device may be performed using a method such as visual localization, a Visual Positioning System (VPS), a marker recognition method, a GPS method, a Wi-Fi Positioning System (WPS), a Bluetooth (registered trademark) module, or an odometry method.

[0123] In this case, a predetermined range of area may be automatically set as an area corresponding to the custom area 60, 70 by measuring the position of the measuring device within the space 5. That is, the area corresponding to the custom area 60, 70 may be automatically set on a map of the space 5 based on the area and / or object recognized by measuring the position of the measuring device. In other words, the custom area 60, 70 may be generated by directly scanning the space 5 using the measuring device, and the first UI 103 may be used as an auxiliary means to change and adjust the automatically set area.

[0124] Next, in step 320, the administrator terminal 101 may associate a service element with the area set in step 310. For example, a user of the administrator terminal 101 may associate the service element with the set area by directly placing the service element in the set area through the first UI 103. The custom area generation tool 102 may provide a separate UI for selecting and placing the service element to be associated with the set area. The user may select and place the service element by a method such as clicking or drag-and-drop.

[0125] The service element associated with the set area may include data for performing at least one of the following operations for the user terminal 100 that enters the set custom area 60, 70: displaying content in the AR view 10 of the user terminal 100; displaying a UI related to a service on the user terminal 100; displaying map element content on a map of the user terminal 100; and controlling settings of the user terminal 100 to provide the service to the user terminal 100. As an example, the service element may include data for displaying augmented reality (AR) content related to a service associated with the space 5. In step 320, the administrator terminal 101 may associate a service element corresponding to AR content with the set area, and may perform such association by, for example, directly placing the AR content in the set area.

[0126] The user may change the position (e.g., height) of the service element (or AR content) placed within the set area, or set the position of the placed service element. In this case, the "position" may correspond to the position where the AR content is output when the user terminal 100 is located in the custom area 60, 70.

[0127] On the other hand, after a service element is associated with a set area, when the service element or the set area is selected, the second UI 104 may be provided to the administrator terminal 101.

[0128] In step 330, the administrator terminal 101 may use the second UI 104 of the custom area generation tool 102 to set scenario conditions for controlling the user terminal 100 based on service elements when the user terminal 100 is located in the custom area 60, 70 corresponding to (generated) the area set in step 310.

[0129] Such scenario conditions may include scenario conditions that are conditions for controlling the user terminal 100, such as providing services or information associated with the space 5 or controlling the settings of the user terminal 100.

[0130] In an embodiment, scenario conditions may be defined for each service element and may be part of the service element, in other words, a service element associated with a custom region 60, 70 may be configured to include the scenario or scenario conditions.

[0131] After the scenario conditions are set and the custom areas 60, 70 are generated, if the user terminal 100 is positioned in the custom areas 60, 70 on the map, the user terminal 100 may be controlled based on the service elements in accordance with the scenario conditions. For example, services or information associated with the space 5 may be provided to the user terminal 100 or the settings of the user terminal 100 may be controlled based on the service elements in accordance with the scenario conditions defined in the generated custom areas 60, 70.

[0132] The scenario conditions may be set so that the user terminal 100 is controlled differently based on service elements when it enters a custom area 60, 70 and when it exits a custom area 60, 70. In other words, when the user terminal 100 is located in a particular custom area 60, 70, it may be determined whether it has entered or exited that custom area 60, 70, and according to the determination result and the set scenario conditions, the user terminal 100 may be controlled differently when entering and exiting the custom area 60, 70.

[0133] A method for controlling user terminals located in a custom area according to various scenario conditions defined for the custom area will be described in more detail with reference to FIGS. 7A to 11C.

[0134] The second UI 104 may include a third UI for setting at least one control state of the user terminal 100 and at least one trigger condition for reaching the control state based on the service elements associated with the region. Scenario conditions may be set according to the control state and the trigger condition set through the third UI.

[0135] The control state set through the third UI may include displaying the content or UI indicated by the service element, canceling the display of the content or UI, the display format of the content or UI, or the time of displaying the content or UI (e.g., the display time of the content, the display duration, etc.). Also, when the service element includes data for controlling the settings of the user terminal 100, the control state set through the third UI may include the type of settings of the user terminal 100 to be controlled or activation / deactivation of the settings of the user terminal 100.

[0136] Controlling the settings of the user terminal 100 may include controlling the functions and / or operations of the user terminal 100 related to the services the user terminal 100 receives within the space 5. Controlling the functions and / or operations may include turning the functions and / or operations on / off or activating / deactivating them. For example, controlling the settings of the user terminal 100 may include executing or stopping a module for recognizing objects within the space 5 or the custom areas 60 and 70 that the user terminal 100 has entered. The module for object recognition may be, for example, a module for Vision Object Tracking (VOT). Alternatively, the module for object recognition may be a configuration used for object recognition using a smart lens of the user terminal 100. Such a module may be part of the processor 120 or may be implemented separately within the user terminal 100. Alternatively, such a module may be a software module executed by the processor 120. Depending on the scenario conditions set in the above example, when the user terminal 100 enters the custom area 60, 70, the module for object recognition of the user terminal 100 may be turned on or initiated, thereby enabling the user terminal 100 to recognize objects in the space 5 or the custom area 60, 70. When the user terminal 100 leaves the custom area 60, 70, the module for object recognition of the user terminal 100 may be turned off or deactivated again.

[0137] The trigger condition set through the third UI may include at least one of whether the user terminal 100 enters the created custom area 60, 70, whether the user terminal 100 exits the custom area 60, 70, whether the user terminal 100 passes through a specific point, and whether the user terminal 100 passes through another predetermined custom area. The specific point and the other custom area may be set through the third UI. A trigger condition may be set for each control state.

[0138] By completing the setting of the control state and trigger condition as the scenario conditions, the setting of the scenario for controlling the user terminal 100 located in the custom area 60, 70 may be completed.

[0139] In this regard, FIGS. 6A to 6C are diagrams illustrating a method for setting scenario conditions for an area corresponding to a custom area using a user interface provided by a custom area generation tool, according to an example.

[0140] 6A shows an example of a UI 630 for setting a trigger condition included in the third UI 602. FIG. 6B shows an example of a UI 640 for setting a control state included in the third UI 604.

[0141] In the example shown in the figure, seven control states (states 1 to 7) 610-1 to 610-7 are defined, and trigger conditions are expressed as lines connecting the control states.

[0142] The control states and trigger conditions shown in the figure may constitute the scenario conditions set for the custom regions 60, 70.

[0143] Each control state may include a name of the control state (states 1 to 7) and setting information for the control state. Such name and setting information may be set through UI 640. When a control state is selected, UI 640 may be displayed for setting the name and / or setting information for the control state.

[0144] A trigger condition may indicate a condition for a transition from one control state to another. The specific content of such a trigger condition may be set through the UI 630. When a specific trigger condition 620 is selected, the UI 630 may be displayed for setting the content of the condition for that trigger condition.

[0145] As shown in the figure, the third UI 602, 604 may include a graph in which control states are nodes and trigger conditions are edges connecting the nodes. The nodes and edges constituting the graph may be configured to be addable, modifiable, or deletable by a user of the administrator terminal 101. In other words, the user can add, modify, or delete control states and / or trigger conditions.

[0146] In this way, scenario conditions in the administrator terminal 101 can be set using the graph included in the third UI 602, 604 by setting control states corresponding to nodes selected by the user (e.g., using UI 640) and setting trigger conditions corresponding to edges selected by the user (e.g., using UI 630).

[0147] Thus, a user of the custom region generation tool 102 can set scenario conditions for the custom regions 60, 70 in an intuitive manner.

[0148] The graph included in the third UI 602, 604 may be a Finite State Machine (FSM), where each node may represent a state of the FSM and each edge may represent an edge connecting states of the FSM.

[0149] For example, if the service element includes data for displaying content, e.g., AR content, the first state 610-1 may indicate a start state, the second state 610-2 may indicate an idle state, the third state 610-3 may indicate a state upon entering the custom area 60, 70, the fourth to sixth states 610-4 to 610-6 may indicate states for controlling the display of the content, and the seventh state 610-7 may indicate a state for deactivating the display of the content. The setting information for the states may include the transparency of the content, the playback state of animations included in the content, the display time of the content, etc. The setting information for the seventh state 610-7 may include a content deactivation method (e.g., fade-out). As described above, the trigger conditions represented by the edges connecting states 610-1 to 610-7 may be set as conditions for transitioning from one state to another, such as whether the user terminal 100 has entered custom areas 60, 70, whether the user terminal 100 has exited custom areas 60, 70, whether the user terminal 100 has passed through a specific point, and whether the user terminal 100 has passed through a specified other custom area.

[0150] 6C shows a third UI 606, which is an abstract representation of the above-described third UIs 602 and 604, in one example. As shown in the figure, the abstracted third UI 606 may be provided for setting scenario conditions. Through the third UI 606, scenario conditions can be set more intuitively.

[0151] As shown in the example, each control state may include whether to activate the content (e.g., deactivate, activate, or fade out) and how to display the content (transparency, display form, display time, number of times displayed, display of a specific animation, etc.). Also, each trigger condition may include the type of condition set for the custom region 60, 70 and a directional condition (e.g., a condition based on entering or exiting).

[0152] By using the third UI 602, 604, 606 shown with reference to Figures 6A to 6C, in an embodiment, a user can set each control state and trigger condition that make up a scenario condition in an intuitive manner.

[0153] The custom areas 60 and 70 can be generated by setting areas corresponding to the custom areas 60 and 70 through the above-described steps 310 to 330, associating service elements with the set areas, and setting scenario conditions.

[0154] As described above, a unique ID may be assigned to each custom region 60, 70 that is created.

[0155] In step 340, the administrator terminal 101 may store the area set in step 310 and the scenario conditions set in step 320 in association with such an ID. For example, the administrator terminal 101 may store the set area and scenario conditions by associating them with the ID on the server 200, or may store the set area and scenario conditions by associating them with the ID locally.

[0156] In an embodiment, multiple custom areas can be set in the space 5, and an ID can be assigned to each of them. At least one service element can be associated with each ID of such a custom area. By individually matching the service elements with the IDs of the custom areas, the user terminal 100 can be correctly controlled according to these custom areas, even if some areas in the space 5 are overlapped with each other when the custom areas are set.

[0157] In step 350, when creating another custom area, the administrator terminal 101 may import the set area and set scenario conditions (e.g., stored in association with an ID) of the previously created custom area 60, 70. In other words, the form (shape, size, etc.) and set scenario conditions of the previously created custom area 60, 70 can be used when creating another custom area.

[0158] The shape of a region corresponding to a pre-created custom region 60, 70 may be duplicated and used to set a region corresponding to another custom region. For example, the first UI 103 may include a function for importing (or loading) a region corresponding to a pre-created custom region when setting a region in step 310 described above. In this case, only the shape (two-dimensional and / or three-dimensional) of the region corresponding to the pre-created custom region 60, 70 may be duplicated, and the coordinates may be based on the coordinates at the duplicated position (i.e., based on the duplicated position). Therefore, by specifying a region with the same shape as the pre-created custom region 60, 70 at another position selected for generating the other custom region, the other custom region can be generated.

[0159] Meanwhile, scenario conditions set in the pre-created custom areas 60 and 70 may also be duplicated and used to set scenario conditions for other custom areas.

[0160] In step 350, the administrator terminal 101 may import only some of the forms (shapes, sizes, etc.) and some of the set scenario conditions of the pre-created custom areas 60 and 70 in accordance with the user's selection. Also, the administrator terminal 101 may appropriately modify the imported forms (shapes, sizes, etc.) and scenario conditions (e.g., by utilizing the first UI 103 and the second UI 104) in accordance with the user's input to create other custom areas.

[0161] In this way, the custom area generation tool 102 in this embodiment allows you to generate new custom areas by utilizing previously generated custom areas 60 and 70, making it easy to generate custom areas with similar shapes and scenario conditions.

[0162] The above description of the technical features given with reference to FIGS. 1A, 1B and 2 can be applied to FIGS. 3 to 6 as well, so duplicated description will be omitted.

[0163] 7A-11C illustrate a method for controlling user terminals located in a custom region according to various scenario conditions defined for the custom region, in one example.

[0164] A method for controlling the user terminal 100 using a custom area generated by the above-described method for generating a custom area will be described in more detail with reference to FIGS. 7A to 11C.

[0165] As described above, the service elements associated with the generated custom area may include data for displaying augmented reality (AR) content related to the service associated with the space. When a user terminal is positioned in the custom area, AR content may be displayed by the AR view 10 according to the scenario conditions set for the custom area. Thus, in the examples of FIGS. 7A to 11C, a method for displaying AR content on the user terminal 100 will be described as a method for controlling the user terminal 100 that has entered the custom area.

[0166] FIG. 7A illustrates an AR view 10 according to an embodiment in a state where a custom region does not exist, and the position of the user terminal 100 at that time. As illustrated in the figure, the AR view 10 may display both AR content displayed on the first floor of the space (e.g., AR content associated with an object located on the first floor) and AR content (A2) displayed on the second floor (e.g., AR content associated with an object located on the second floor). An example of the AR content displayed at this time may be an image and / or text corresponding to a signboard. That is, in the example of FIG. 7A, even though the user terminal 100 is located on the first floor, the AR content (A2) on the second floor is also displayed on the AR view 10. This complicates the implementation of the AR view 10 in the user terminal 100, and increases the burden on the user terminal 100 for implementing such an AR view 10.

[0167] 7B-7D show the case where two custom regions (CR_1 and CR_2) have been created in the same space as shown in FIG. 7A. Each of the custom regions (CR_1 and CR_2) may have been created using the custom region tool 102 described above. Custom region (CR_1) represents the first floor of the space, and custom region (CR_2) represents the second floor of the space. Each of the custom regions (CR_1 and CR_2) represents a three-dimensional space and may correspond to a cubic polygon, as shown in the figures.

[0168] 7C, when the user terminal 100 is located on the first floor in the custom area (CR_1), only the AR content (A1) for the first floor may be displayed on the AR view 10 of the user terminal 100. In other words, when the user terminal 100 is located in the custom area (CR_1), the AR content (AR2) for the second floor is not displayed.

[0169] 7D, when the user terminal 100 is located on the second floor and in the custom area (CR_2), only the AR content for the second floor (AR2) may be displayed in the AR view 10 of the user terminal 100. In other words, when the user terminal 100 is located in the custom area (CR_2), the AR content for the first floor is not displayed. In some embodiments, the AR content for the floor may be displayed in the AR view 10 if the user terminal 100 is positioned so as to look down on it (for example, by maintaining a posture in which the AR view 10 is positioned so as to face the first floor).

[0170] As shown in Figures 7C and 7D, by appropriately setting custom areas (CR_1, CR_2) for each floor, the user terminal 100 can display only the AR content of the custom area in which the user terminal 100 is located, depending on the location of the user terminal 100.

[0171] Meanwhile, in the generated custom area, a scenario condition may be set such that different AR contents are displayed by the AR view 10 when the user terminal 100 enters the custom area and when the user terminal 100 exits the custom area. In other words, even if the user terminal 100 is located within the same custom area, different AR contents may be displayed by the AR view 10 when the user terminal 100 enters the custom area and when the user terminal 100 exits the custom area.

[0172] In this regard, FIGS. 8A to 8C show a case where six custom regions (CR_1 to CR_6) are generated in the same space as that shown in FIGS. 7A to 7D.

[0173] As shown in the figure, in addition to the custom areas (CR_1 to CR_6), multiple nodes may be defined within the space. Lines connecting the nodes are called "links." The defined nodes and links may be used to provide route guidance to a predetermined destination for the user terminal 100. Multiple nodes may be defined within each of the custom areas (CR_1 to CR_6).

[0174] 8A to 8C show a route (R) along which the user terminal 100 travels in accordance with such route guidance. The route (R) may be provided to the user terminal 100 as route guidance information.

[0175] The service elements associated with each custom area may be associated with at least one node within that custom area.

[0176] The scenario conditions of the custom area may be set so that different AR content is displayed in the AR view 10 when the user terminal 100 moves according to route guidance to the destination, i.e., moves along the route (R) presented by the route guidance, and when the user terminal 100 moves out of the custom area.

[0177] At this time, whether the user terminal 100 enters or exits the custom area 100 may be determined based on the route (R) presented to the user terminal in accordance with the route guidance. In other words, the user terminal 100 or the server 200 can determine, based on the route (R), what nodes the user terminal 100 has passed through or what nodes it will pass through, and thereby determine whether the user terminal 100 has entered or exited the custom area in which it is currently located.

[0178] For example, as shown in FIG. 8B , it is assumed that the user terminal 100 has entered a custom area (CR1) based on the current location of the user terminal 100 and the route (R) that the user terminal 100 has already traveled or is traveling along. At this time, AR content including an arrow pointing toward the entrance / exit direction along with text such as "Entering the building" may be displayed on the AR view 10 of the user terminal 100. Such AR content may be displayed in association with a specific node (Gate node) within the custom area (CR1). In the example shown in the figure, the custom area (CR1) may be outdoors, and the custom area (CR2) may be indoors.

[0179] When the user terminal 100 enters the custom area (CR2), information related to the indoor space including the custom area (CR2) may be displayed as AR content on the AR view 10. Alternatively, welcome content such as "Welcome" may be displayed on the AR view 10. Meanwhile, as shown in FIG. 8C , it is assumed that the user terminal 100 has left the custom area (CR2) based on the current location of the user terminal 100 and the route (R) that the user terminal 100 has already traveled or will travel. At this time, AR content including an arrow pointing toward the entrance / exit along with text such as "Move outside the building" may be displayed on the AR view 10 of the user terminal 100. Such AR content may be associated with a specific node (Gate node) within the custom area (CR2) and displayed.

[0180] In this manner, in the embodiment, the user terminal 100's entry / exit into a particular custom area can be determined based on the travel path provided to the user terminal 100, and appropriate AR content can be displayed in the AR view 10 accordingly.

[0181] 9A to 9C, we will explain in more detail the case where multiple custom areas are set for one space (exhibition room space). As shown in the figure, four CRs are generated for one exhibition room space. Three objects, namely, work A, work B, and work C, exist in the exhibition room space.

[0182] The scenario condition set for the long-distance extended CR may be to display AR content including first information of works A, B, and C on the AR view 10 of the user terminal 100 located in the long-distance extended CR. The first information may include only summary information such as the title of the work.

[0183] Meanwhile, a scenario condition set for the CR for work A may be to display AR content including second information of work A in the AR view 10, and to deactivate all AR content associated with other works. The second information may include information about the first work that is richer and more detailed than the first information. That is, the user terminal 100 that has entered the CR for work A can centrally check detailed information about work A associated with the CR for work A. The same explanation may also be applied to the CR for work B and the CR for work C.

[0184] In this manner, in an embodiment, multiple custom areas can be generated for a single space that output AR content with different amounts of information, thereby enhancing the user's experience receiving the AR content.

[0185] 10 shows a case where two custom areas are generated within the space described above with reference to FIGS. 7A to 7D, and a specific point or sub-area is set in each custom area. For example, a point or sub-area (Point B) is set within the custom area (CR_1) corresponding to the first floor, and a point or sub-area (Point A) is set within the custom area (CR_2) corresponding to the second floor.

[0186] The scenario conditions set for the custom area (CR_1) may be set so that the AR content is displayed differently in each of the following cases: when entering the custom area (CR_1) at a specific point or subarea (Point B) and when not; when exiting the custom area (CR_1) at a specific point or subarea (Point B) and when not; when entering the custom area (CR_1) at another custom area (CR_2) and when not; and when entering the custom area (CR_1) at a specific point or subarea (Point A) of another custom area (CR_2) and when not.

[0187] In other words, the scenario conditions may be set so that, when the user terminal 100 is located in a custom area, AR content determined based on other custom areas that the user terminal 100 entered / passed through before the user terminal 100 entered that custom area is displayed by the AR view 10. Alternatively, the scenario conditions may be set so that, when the user terminal 100 is located in a custom area, AR content determined based on points that the user terminal 100 passed through is displayed by the AR view 10.

[0188] The above-mentioned "determined AR content" may be existing AR content displayed in a different form, with different animations or effects applied, or may be AR content with different content displayed, or existing AR content with additional content (audio, text, images, video, etc.) added to it.

[0189] 11A to 11C, a method for displaying different AR contents using the AR view 10 in consideration of the direction of the user terminal 100 will be described.

[0190] In Fig. 11A, the user terminal 100 enters the custom area (CR_A) via the custom area (CR_A_1). In Fig. 11B, the user terminal 100 enters the custom area (CR_A) via the custom area (CR_A_2).

[0191] 11A and 11B, the user terminal 100 is located in the same custom area (CR_A), but the content displayed by the AR view 10 is different in each case. As an example, when the user terminal 100 passes through the custom area (CR_A_1), it is determined that the user terminal 100 is entering a specific space (a restaurant), and AR content that provides information about the entrance to the specific space or additional services (e.g., recommended menu items at the restaurant) may be displayed on the AR view 10. On the other hand, when the user terminal 100 passes through the custom area (CR_A_2), it is determined that the user terminal 100 is leaving the specific space (a restaurant), and AR content that provides information about the outdoors, a parking lot, or additional services (e.g., information about other dessert cafes) may be displayed on the AR view 10.

[0192] As another example, if the user terminal 100 enters a specific space (such as a shopping mall) through a custom area indicating a parking lot, the user terminal 100 or the server 200 may determine that the user visited the specific space using a private car as a means of transportation. Alternatively, if the user terminal 100 enters a specific space (such as a shopping mall) through a custom area indicating an entrance to a subway station, the user terminal 100 or the server 200 may determine that the user visited the specific space using public transportation as a means of transportation. In this case, when the user terminal 100 enters a custom area within the specific space or exits the specific space, content customized for the transportation used by the user may be output to the AR view 10 of the user terminal 100. For example, a user who uses a private car may be provided with AR content including information about how to get to the parking lot or information about vehicle accessories, and a user who uses public transportation may be provided with AR content including information about how to get to the subway station.

[0193] The technical features described above with reference to FIGS. 1A to 6C can also be applied to FIGS. 7A to 11C, and therefore overlapping descriptions will be omitted.

[0194] Other examples of scenario conditions set for the custom areas 60 and 70 will be described in more detail below.

[0195] FIG. 12 is a diagram showing the DoF (Degree Of Freedom) of a user terminal in one example.

[0196] The custom regions 60, 70 may define 3DoF or 6DoF attitude conditions for the user terminal 100. 6DoF may refer to movement along the x-, y-, and z-axes, and rotation along the x-, y-, and z-axes (roll, yaw, and pitch).

[0197] Such posture conditions may be included in the scenario conditions set for the custom regions 60, 70, and may be included in the service elements associated with the custom regions 60, 70, as described above.

[0198] When the user terminal 100 is determined to be located in the custom area 60, 70, and the attitude of the user terminal 100 satisfies the attitude conditions defined in the custom area 60, 70, the user terminal 100 or the server 200 may control the user terminal 100 based on the service elements associated with the custom area 60, 70. The attitude of the user terminal 100 may be acquired from a sensor provided in the user terminal 100, for example, a gyro sensor.

[0199] By defining such posture conditions in the custom regions 60, 70, for example, the user terminal 100 may be controlled based on the service element only when the user terminal 100 enters the custom region 60, 70 and the AR view 10 maintains a specific angle or a specific angle range. As an example, AR content that is displayed in a specific region within the custom region 60, 70, for example, at a position above or below a predetermined height, may be displayed in the AR view 10 of the user terminal 100 only when the user terminal 100 enters the custom region 60, 70 and the AR view 10 maintains an angle or angle range that reflects the specific region above or below the predetermined height.

[0200] Therefore, in the embodiment, the AR content can be displayed at a more appropriate position and viewpoint of the AR view 10.

[0201] In addition, the custom areas 60, 70 may have at least one of the following conditions set as scenario conditions: a first condition indicating a time condition, a second condition indicating the movement of the user terminal 100, and a third condition indicating an operation on the user terminal 100.

[0202] The first condition may be, for example, a condition requiring the user terminal 100 to stay in the custom area 60, 70 for a predetermined time or more (e.g., three seconds or more), or for a predetermined time or less. Alternatively, the first condition may be a condition requiring the user terminal 100 to enter the custom area 60, 70 during a predetermined time period, or to enter the custom area 60, 70 at a time other than the predetermined time period. The second condition may be, for example, a condition indicating a physical operation of the user terminal 100, such as a condition requiring the user to shake the user terminal 100 a predetermined number of times or with a predetermined strength or more. Alternatively, the second condition may be a condition requiring the user terminal 100 to move in a specific shape (e.g., a figure eight). The third condition may be a condition requiring the user terminal 100 to be electronically operated, such as pressing a specific button or key, making a specific gesture, inputting a specific voice or audio, or photographing a specific object.

[0203] When the user terminal 100 is determined to be located in the custom area 60, 70, and the user terminal 100 satisfies at least one scenario condition among the first to third conditions, the user terminal 100 or the server 200 may control the user terminal 100 based on the service elements associated with the custom area 60, 70. For example, the user terminal 100 may display AR content differently, display a UI differently, display map element content differently, or control the settings of the user terminal 100 differently, depending on whether the scenario condition is satisfied.

[0204] The above description of the technical features given with reference to FIGS. 1A to 11C can be applied to FIG. 12 as well, so duplicated description will be omitted.

[0205] FIG. 13 is a diagram showing an example of a generated custom region, which includes a plurality of points.

[0206] The custom area 1300 may include a point indicating entrance / exit A and a point indicating entrance / exit B. The custom area 1300 may further include a point indicating object A and a point indicating object B. The user terminal 100 or the server 200 may determine whether the user terminal 100 has entered or exited the custom area 1300 by tracking the location of the user terminal 100.

[0207] A plurality of service elements may be associated with the custom area 1300. In this case, each of the plurality of service elements may be associated with a different point within the custom area 1300. A scenario or scenario condition defined in the custom area may be defined such that services or information associated with the space 5 are controlled differently depending on the order in which the user terminal 100 passes through the points associated with each service element. The services or information provided differently may be AR content, or may be other types of content such as audio, text, images, or video that can be output by the user terminal 100.

[0208] As an example, a scenario condition may be defined in the custom area 1300 such that different types of content are output to the user terminal 100 when the user terminal 100 enters the custom area 1300 and when the user terminal 100 exits the custom area 1300.

[0209] Alternatively, scenario conditions may be defined in the custom area 1300 such that different types of content are output to the user terminal 100 depending on whether the user terminal 100 enters through a specific point within the custom area 1300 (e.g., at least one of the points of Entrance A, Entrance B, Object A, and Object B shown in the figure) or whether the user terminal 100 enters the custom area 1300 after passing through a specific point outside the custom area 1300. For example, when the user terminal 100 enters the custom area 1300 through the point representing Entrance A, general welcome content may be output to the user terminal 100, and when the user terminal 100 enters the custom area 1300 through the point representing Entrance B, other content, such as coupon content, may be output to the user terminal 100. The coupon content may include a discount coupon or a special offer that can be used within the space 5.

[0210] Alternatively, a scenario condition may be defined in the custom area 1300 such that, when the user terminal 100 enters the custom area 1300, the user terminal 100 is requested to perform an additional action, such as requesting the user to move along the edge of the custom area 1300, and a different type of content is output to the user terminal 100 as a result of the action being performed. The request for the additional action may also be provided to the user terminal 100 in the form of content or a UI.

[0211] Alternatively, a scenario condition may be defined in the custom area 1300 that counts the number of times the user terminal 100 enters the custom area 1300 and outputs specific content to the user terminal 100 if the user terminal 100 enters the custom area 1300 more than n times (n is a natural number greater than or equal to 2) (the number of times the user terminal 100 enters the custom area 1300 may be counted within a predetermined period of time (e.g., one hour or one day)), or that outputs specific content to the user terminal 100 if the user terminal 100 stays in the custom area 1300 for a predetermined period of time or more.

[0212] On the other hand, when the user terminal 100 exits (i.e., exits) the custom area 1300, all content displayed on the user terminal 100 may be hidden, i.e., the display may be canceled. When the user terminal 100 exits the custom area 1300, a predetermined notification sound may be output from the user terminal 100. Alternatively, when the user terminal 100 exits the custom area 1300, AR content notifying the user that the user terminal 100 has exited the custom area 1300 may be displayed on the AR view 10.

[0213] In this way, in the embodiment, the user terminal 100 can determine whether to enter / exit the custom area 1300, and depending on the determination result, the display of the AR content can be changed (for example, the entry guide AR content can be expanded when entering, and the exit guide AR content can be expanded when exiting), the UI display can be changed, the display of the map element content can be changed, or the setting control of the user terminal 100 can be changed.

[0214] The technical features described above with reference to FIGS. 1A to 12 can be applied to FIG. 13 as well, so duplicated explanations will be omitted.

[0215] FIG. 14 is a diagram showing a method in which a plurality of custom areas are set in a space and a scenario condition for controlling a user terminal is set for each custom area in one example.

[0216] Other examples of scenario conditions defined for each of the multiple custom areas 1410 to 1440 set in the space 1400 will be described in more detail below.

[0217] The custom areas 60 and 70 may be any one of the custom areas 1410 to 1440.

[0218] At least one of the following scenario conditions may be defined for any one of the custom areas 60, 70 among the custom areas 1410 to 1440: i) a first scenario condition indicating whether the user terminal 100 has passed through a predetermined custom area other than the custom area 60, 70; and ii) a second scenario condition indicating whether the number of user terminals located in the custom area 60, 70 falls within a predetermined range. Depending on whether the scenario condition is satisfied, the user terminal 100 may be provided with different services or information associated with the space 5, 1400, or the settings of the user terminal 100 may be controlled differently based on the service elements associated with the custom area 60, 70.

[0219] The first scenario condition may be a condition that requires the user terminal 100, having entered the custom areas 60 and 70, to enter another specific custom area before entering the custom areas 60 and 70. For example, the first scenario condition may be satisfied if the user terminal 100 enters the custom area 1410 (within a predetermined time) after entering a specific custom area among the custom areas 1420 to 1440. Alternatively, the first scenario condition may be satisfied if the user terminal 100 enters the custom area 1410 (within a predetermined time) after entering at least some of the custom areas 1410 to 1640 in a specific order. Depending on whether the first scenario condition is satisfied, the user terminal 100 may display AR content differently, display a UI differently, display map element content differently, or perform setting control of the user terminal 100 differently.

[0220] The second scenario condition may be a condition that requires the number of user terminals located in the custom areas 60, 70, or that the cumulative number of user terminals that have entered the custom areas 60, 70 (within a predetermined time period) be greater than or equal to a predetermined number, or less than a predetermined number. Alternatively, the second scenario condition may be a condition that requires the number of user terminals located in a custom area other than the custom area 60, 70 into which the user terminal 100 has entered, or that the cumulative number of user terminals that have entered the other custom area (within a predetermined time period) be greater than or equal to a predetermined number, or less than a predetermined number. Alternatively, the second scenario condition may be a condition that requires the number of user terminals located in both the custom areas 60, 70 and the other custom areas, or that the cumulative number of user terminals that have entered both custom areas (within a predetermined time period) be greater than or equal to a predetermined number, or less than a predetermined number. The user terminal 100 may display AR content differently, display UI differently, display map element content differently, or control the settings of the user terminal 100 differently depending on whether the second scenario condition is satisfied.

[0221] The first and second scenario conditions may be used in combination. For example, when the user terminal 100 enters the custom area 60, 70, the user terminal 100 or the server 200 may determine whether the first and second scenario conditions are met, and may control the user terminal 100 based on the service elements only if both scenario conditions are met. Alternatively, the control of the user terminal 100 based on the service elements may differ depending on whether the first or second scenario condition is met.

[0222] The technical features described above with reference to FIGS. 1A to 13 can be applied to FIG. 14 as well, so duplicated explanations will be omitted.

[0223] As described above, in the embodiment, a "custom range" method is used, which is easier to handle and enables AR content to be displayed on the user terminal 100 and the user terminal 100 to be controlled in a natural manner, compared to a "rendering range"-based method that displays AR content and controls the user terminal 100 based on the distance or radius to the position of an object located in a space, or a "semantic range"-based method that divides a space into semantic unit areas and displays AR content and controls the user terminal 100 when the user terminal 100 enters a unit space. The custom range may use a "custom area" described with reference to the embodiment. The "custom range" method may use a custom area in which service elements for displaying AR content and controlling the user terminal 100 are associated and scenario conditions are defined.

[0224] When using a "rendering range" based method or a "semantic range" based method, the AR content may be inappropriately displayed at the position of an object in the AR view 10 depending on the position of the user terminal 100, and in some cases, the AR content may be displayed in an occlusion area. The "custom area" method described with reference to the embodiments can solve this problem by utilizing a custom area.

[0225] The above-described devices may be implemented using hardware components, software components, and / or a combination of hardware and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also access, record, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, a single processing device may be described. However, those skilled in the art will understand that a processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0226] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to operate as desired or may independently or collectively instruct the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored on one or more computer-readable storage media.

[0227] Methods according to embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. In this case, the medium may continuously record a computer-executable program or may temporarily record the program for execution or download. The medium may be various recording or storage means in the form of a single piece of hardware or multiple pieces of hardware combined together. It may be a medium directly connected to a computer system or distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to record program instructions, such as ROMs, RAMs, and flash memories. Other examples of media include recording media or storage media managed by app stores that distribute applications, or by websites or servers that provide or distribute various software.

[0228] Although the embodiments have been described above based on limited examples and drawings, those skilled in the art will appreciate that various modifications and variations may be made from the above description. For example, the described techniques may be performed in an order different from that described, and / or the described system, structure, device, circuit, or other element may be coupled or combined in a manner different from that described, or may be substituted or replaced by other elements or equivalents, and still achieve suitable results.

[0229] Therefore, different embodiments are within the scope of the appended claims, provided that they are equivalent to the claims.

Claims

1. 1. A method for generating a custom area associated with at least one service element using a custom area generation tool executed by a computer system, the method comprising: Using a first UI of the custom area generation tool, set an area in space that corresponds to the custom area; Associating the service element with the set area, and using a second UI of the custom area generation tool, setting a scenario condition for controlling the user terminal based on the service element when the user terminal is located in the custom area corresponding to the set area; How to generate custom regions, including:

2. the set area is set using the first UI and includes at least one of a two-dimensional space that is at least a part of the space and a three-dimensional space that is at least a part of the space; The method for generating a custom region according to claim 1 .

3. The step of setting the region includes: Displaying at least one of a map of the space, point cloud data (PCD) collected from the space, and an image of the space through the first UI; setting the area according to a geometry of the space identified by a displayed map of the space, the PCD, and / or the image, and based on input received from a user; The method of generating a custom region of claim 1 , comprising:

4. the first UI is a UI for creating an indoor map related to the space; The method for generating a custom region according to claim 1 .

5. The step of setting the region includes: automatically setting the region based on a position of a predetermined object in the space, a predetermined two-dimensional space in the space, or a predetermined polygon in the space; The method for generating a custom region according to claim 1 .

6. The region is set to include a two-dimensional space and a three-dimensional space having a set height range; When the user terminal is located in the two-dimensional space and the height of the user terminal is within the set height range, the user terminal is determined to be located in the custom area and is controlled based on the set scenario conditions and the service elements. The method for generating a custom region according to claim 1 .

7. The scenario conditions include a 3DoF or 6DoF attitude condition of the user terminal, and when it is determined that the user terminal is located in the custom area, if the attitude of the user terminal satisfies the attitude condition, the user terminal is configured to be controlled based on the service element. The method for generating a custom region according to claim 1 .

8. The scenario conditions are set so that the user terminal is controlled differently based on the service elements when the user terminal enters the custom area and when the user terminal leaves the custom area. The method for generating a custom region according to claim 1 .

9. the service element includes data for displaying AR content related to a service associated with the space; When the user terminal is located in the custom area, the AR content is displayed using an AR view including an image captured by a camera of the user terminal in accordance with the set scenario conditions. The method for generating a custom region according to claim 1 .

10. The scenario conditions are: The AR content is set to be displayed by the AR view in a case where the user terminal enters the custom area and a case where the user terminal exits the custom area. The method for generating a custom region according to claim 9.

11. The scenario conditions are: When the user terminal moves according to route guidance to a destination, different AR content is displayed by the AR view when the user terminal enters the custom area and when the user terminal exits the custom area. The method for generating a custom region according to claim 10.

12. Whether the user terminal enters the custom area or exits the custom area is determined based on a route presented to the user terminal according to the route guidance. The method for generating a custom region according to claim 11 .

13. The scenario condition is set so that, when the user terminal is located in the custom area, AR content determined based on another custom area into which the user terminal has entered before the user terminal has entered the custom area is displayed by the AR view as the AR content. The method for generating a custom region according to claim 9.

14. the scenario condition is set so that, when the user terminal is located in the custom area, AR content determined based on points passed by the user terminal is displayed by the AR view as the AR content; The method for generating a custom region according to claim 9.

15. The scenario conditions include at least one of i) a first scenario condition indicating whether the user terminal has passed through a predetermined custom area other than the custom area, and ii) a second scenario condition indicating whether the number of user terminals located in the custom area is within a predetermined range; the scenario conditions are configured to provide the user terminal with a service or information associated with the space based on the service elements and / or to control settings of the user terminal differently depending on whether the scenario conditions are met; The method for generating a custom region according to claim 1 .

16. A unique ID is assigned to the generated custom area; The set area and the set scenario condition are stored in association with the ID. The method for generating a custom region according to claim 1 .

17. The second UI includes: a third UI for setting at least one control state of the user terminal and at least one trigger condition for reaching the control state based on the service element; the scenario conditions are set according to the control state and the trigger conditions set through the third UI; The method for generating a custom region according to claim 1 .

18. The control state includes display of the content indicated by the service element, cancellation of display of the content, display form of the content, or display time of the content; the trigger condition includes at least one of whether the user terminal has entered the custom area, whether the user terminal has exited the custom area, whether the user terminal has passed through a specific point, and whether the user terminal has passed through another predetermined custom area; 20. The method for generating a custom region of claim 17.

19. the third UI includes a graph in which the control states are nodes and the trigger conditions are edges connecting the nodes; The nodes and edges are configured to be addable, modifiable, or deletable by a user; The step of setting a scenario condition includes: using the graph to set the scenario conditions by setting the control states corresponding to nodes selected by the user and setting the trigger conditions corresponding to edges selected by the user; 20. The method for generating a custom region of claim 17.

20. Associating the service element with the defined region by placing the service element directly in the defined region; When the service element associated with the set area or the set area is selected, the second UI is provided. The method for generating a custom region according to claim 1 .

21. When creating another custom area, importing the set area and the set scenario conditions of the created custom area. further comprising The shape of the set area is duplicated and used to set an area corresponding to the other custom area, The scenario conditions are duplicated and used to set the scenario conditions of the other custom areas. The method for generating a custom region according to claim 1 .

22. 1. A computer system for generating a custom area associated with at least one service element using a custom area generation tool for generating the custom area, the computer system comprising: at least one processor configured to execute computer-readable instructions contained in the memory; Including, The at least one processor Using a first UI of the custom area generation tool, set an area corresponding to the custom area in space; Associating the service element with the set area, and using a second UI of the custom area generation tool, setting a scenario condition for controlling the user terminal based on the service element when the user terminal is located in the custom area corresponding to the set area. Computer system.

Images