Method and device for providing three-dimensional digital twin content that provides information content items in association with hierarchically structured unit spaces

Abstract

Provided is a method for providing three-dimensional digital twin content corresponding to a real-world space. The method for providing three-dimensional digital twin content comprises: defining a plurality of unit spaces each corresponding to at least a part of a real-world space and having a hierarchical relationship with each other; mapping a content item to each unit space; and providing three-dimensional digital twin content corresponding to the real-world space to a user terminal on the basis of an interaction from the user terminal.

Description

Method and device for providing three-dimensional digital twin content that provides information content items in association with hierarchically structured unit spaces

[0001] The present invention relates to a method and device for providing three-dimensional digital twin content corresponding to a real-world space, and to a method and device for providing three-dimensional digital twin content by defining a plurality of unit spaces, each of which corresponds to at least a part of a real-world space and has a hierarchical relationship with each other, so as to enable expression of related information content items for each unit space.

[0002] Digital twins are a technology that enables various simulations by creating a virtual space identical (or similar) to a real-world space. For example, by modeling a virtual space in three dimensions corresponding to a real-world space, a three-dimensional digital twin of the real-world space can be created.

[0003] 3D digital twin content can be useful for visualizing information about real-world spaces, exploring information existing in them, and monitoring them, by expressing three-dimensional information about real-world spaces that are difficult to accurately represent in two dimensions. This allows 3D digital twin content to provide consumers with an immersive experience of real-world spaces.

[0004] When 3D digital twin content is displayed on the screen of a user terminal such as a computer or smartphone, due to screen limitations, the displayed 3D digital twin content contains only limited information, which hinders effective information delivery to the user.

[0005] Therefore, a technology is required to provide 3D digital twin content to user terminals to increase the recognition and usability of information provided through 3D digital twin content.

[0006] Korean Patent No. 10-1989982 (registration date: June 11, 2019) discloses a modeling system using digital twin-based indoor space analysis that can predict changes in the floating population and number of people indoors according to indoor structure and environmental conditions through digital twin-based simulation analysis, thereby planning indoor structures and managing environmental conditions in advance.

[0007] The information described above is for the purpose of understanding only and may contain matters that do not form part of the prior art and may not contain what the prior art would suggest to a person skilled in the art.

[0008] A method and computer system for providing three-dimensional digital twin content can be provided by defining a plurality of unit spaces corresponding to at least a part of a real-world space and having a hierarchical relationship with each other, and expressing related information content items for each unit space.

[0009] A method can be provided to increase the usability of 3D digital twin content by defining unit spaces that hierarchically divide real-world space, either manually by input from an administrator or consumer, or automatically based on 2D map information, or by providing 3D digital twin content through a service scenario of a service provided through 3D digital twin content.

[0010] A method can be provided to increase visibility of information content items provided through 3D digital twin content by highlighting only 3D digital twin content corresponding to a selected unit space and providing it together with content items mapped to the unit space.

[0011] According to one aspect, a method for providing three-dimensional digital twin content corresponding to a real-world space performed by a computer system is provided, the method comprising: defining a plurality of unit spaces, each of which corresponds to at least a portion of the real-world space and has a hierarchical relationship with each other; mapping a content item associated with each unit space to each unit space of the unit spaces; and providing, based on an interaction from a user terminal, first three-dimensional digital twin content corresponding to the real-world space to the user terminal, wherein the providing step comprises: rendering, based on a selection from the user terminal, second three-dimensional digital twin content corresponding to a selected unit space among the unit spaces and including a content item mapped to the selected unit space, so that the second three-dimensional digital twin content is displayed on the user terminal.

[0012] The first three-dimensional digital twin content and the second three-dimensional digital twin content may be constructed by modeling the real-world space in three dimensions based on images obtained by photographing the real-world space.

[0013] Each of the above unit spaces has a three-dimensional position range corresponding to a three-dimensional position range of the real-world space, and at least one unit space among the above unit spaces can correspond to an area of ​​at least a part of an object located in the real-world space.

[0014] The step of defining the plurality of unit spaces may define the unit spaces based on a preset service scenario of a service to be provided through the first 3D digital twin content and the second 3D digital twin content.

[0015] The step of defining the plurality of unit spaces may define the at least one unit space based on a three-dimensional position range corresponding to a three-dimensional position range of the real-world space input for at least one unit space among the plurality of unit spaces.

[0016] The step of defining the plurality of unit spaces may include a step of automatically defining at least one unit space among the plurality of unit spaces based on a two-dimensional map corresponding to the real-world space.

[0017] The step of automatically defining at least one unit space may automatically define a unit space corresponding to an administrative district or semantic unit district defined in relation to the real-world space on the two-dimensional map as the at least one unit space.

[0018] The step of automatically defining at least one unit space may include the step of obtaining footprint information of an area corresponding to the real-world space on the two-dimensional map; the step of matching the footprint information to a three-dimensional model corresponding to the real-world space; and the step of defining the at least one unit space within the matched three-dimensional model using meta information associated with the footprint information.

[0019] The step of automatically defining at least one unit space may include the step of associating meta information associated with the footprint information to the at least one unit space.

[0020] The step of defining the plurality of unit spaces may include a step of matching the POIs included in a two-dimensional map corresponding to the real-world space to features included in a three-dimensional model corresponding to the real-world space based on location information about the POIs; and a step of automatically defining at least one feature or a part thereof among the matched features as the at least one unit space.

[0021] The step of automatically defining at least one feature or a part thereof among the above-mentioned matched features as the at least one unit space may automatically define at least one feature that satisfies a regularity according to a predetermined condition among the above-mentioned matched features as the at least one unit space.

[0022] The providing step may include: a step of rendering the first three-dimensional digital twin content to display the first three-dimensional digital twin content at the user terminal; a step of displaying, at the user terminal, a first user interface for entering a first unit space among the unit spaces in association with the rendered first three-dimensional digital twin content; and a step of rendering the second three-dimensional digital twin content to display, at the user terminal, the second three-dimensional digital twin content corresponding to the first unit space when the first user interface is selected by the user terminal.

[0023] The step of providing may include: a step of displaying, on the user terminal, a second user interface for entering a second unit space, which is a lower layer of the first unit space among the unit spaces, in association with the rendered second three-dimensional digital twin content; and a step of rendering the third three-dimensional digital twin content so that the third three-dimensional digital twin content corresponding to the second unit space is displayed on the user terminal when the second user interface is selected by the user terminal.

[0024] The step of rendering the second 3D digital twin content may be performed by at least one of: enlarging the second 3D digital twin content among the first 3D digital twin content and displaying it on the user terminal; relatively emphasizing the second 3D digital twin content among the first 3D digital twin content and displaying it; and de-displaying a portion of the first 3D digital twin content other than the second 3D digital twin content, thereby rendering the second 3D digital twin content so that the second 3D digital twin content is displayed on the user terminal.

[0025] The method for providing the above 3D digital twin content may further include a step of providing the user terminal with a sharing function that enables the user to share the second 3D digital twin content corresponding to the selected unit space with another user.

[0026] The step of defining the plurality of unit spaces may define at least one of the plurality of unit spaces based on a first input from the user terminal.

[0027] The step of mapping the above content item may map the content item to at least one of the unit spaces based on a second input from the user terminal.

[0028] The first three-dimensional digital twin content and the second three-dimensional digital twin content are configured to provide real estate information for at least one building included in the real-world space, and the step of mapping the content items may map the content items to each of the unit spaces by at least one of: mapping collective real estate information of a set of buildings included in the real-world space in association with a first unit space among the unit spaces, mapping building-specific real estate information of each building of the building set in association with a second unit space among the unit spaces, mapping floor-specific real estate information of each floor of each building in association with a third unit space among the unit spaces, and mapping generation-specific real estate information of a generation of each floor in association with a fourth unit space among the unit spaces.

[0029] The first three-dimensional digital twin content includes a three-dimensional model corresponding to the building set, the first unit space corresponds to a first building among buildings included in the building set, the first user interface is provided on the user terminal to enable selection of the first building, and the step of rendering the second three-dimensional digital twin content includes rendering the second three-dimensional digital twin content so that the second three-dimensional digital twin content including the three-dimensional model corresponding to the first building is displayed on the user terminal when the first user interface is selected, and the rendered second three-dimensional digital twin content may include a second user interface for entering a second unit space corresponding to at least one of a high-rise, a mid-rise, and a low-rise of the first building, which is a lower layer of the first unit space, and real estate information for at least one of a high-rise, a mid-rise, and a low-rise indicated by the second unit space.

[0030] The step of providing may include a step of displaying at least a portion of the first 3D digital twin content by augmenting the image within an AR (augmented reality) view including an image of the real-world space captured by a camera of the user terminal.

[0031] In another aspect, a computer system for providing three-dimensional digital twin content corresponding to a real-world space is provided, comprising at least one processor configured to execute computer-readable instructions contained in a memory, wherein the at least one processor defines a plurality of unit spaces, each of which corresponds to at least a portion of the real-world space and has a hierarchical relationship with each other, maps a content item associated with each unit space of the unit spaces, provides first three-dimensional digital twin content corresponding to the real-world space to the user terminal based on an interaction from the user terminal, and renders second three-dimensional digital twin content to display, on the user terminal, second three-dimensional digital twin content corresponding to a selected unit space among the unit spaces and including a content item mapped to the selected unit space based on a selection from the user terminal.

[0032] By defining multiple unit spaces corresponding to at least a portion of a real-world space and having a hierarchical relationship with each other, it is possible to create and provide three-dimensional digital twin content capable of expressing related information content items for each unit space.

[0033] 3D digital twin content can be created and provided by defining unit spaces that hierarchically divide real-world space, either manually by service scenarios of services provided through 3D digital twin content, or automatically based on 2D map information, based on input from administrators or consumers.

[0034] By highlighting only the 3D digital twin content corresponding to the selected unit space and providing it together with the content items mapped to the unit space, the visibility of information content items provided through the 3D digital twin content can be increased.

[0035] FIG. 1 illustrates a method for providing three-dimensional digital twin content corresponding to a real-world space according to one embodiment.

[0036] FIG. 2 illustrates a computer system for generating and providing three-dimensional digital twin content according to one embodiment.

[0037] FIG. 3 is a flowchart illustrating a method for providing three-dimensional digital twin content corresponding to a real-world space according to one embodiment.

[0038] FIG. 4 is a flowchart illustrating a method for defining a plurality of unit spaces corresponding to at least a portion of a real-world space and having a hierarchical relationship with each other, according to an example.

[0039] FIG. 5 is a flowchart illustrating a method for automatically defining at least one unit space among a plurality of unit spaces corresponding to at least a portion of a real-world space and having a hierarchical relationship with each other, according to an example.

[0040] FIG. 6 is a flowchart illustrating a method for providing three-dimensional digital twin content and a user interface associated therewith to a user terminal according to an example.

[0041] FIG. 7 is a flowchart illustrating a method for providing three-dimensional digital twin content to be displayed through an AR view on a user terminal according to an example.

[0042] Figure 8 illustrates a method for defining multiple unit spaces according to an example.

[0043] Figure 9 illustrates a scenario for providing a real estate information service through 3D digital twin content according to an example.

[0044] FIG. 10 illustrates a method for displaying second three-dimensional digital twin content corresponding to a unit space selected from first three-dimensional digital twin content displayed on a user terminal according to an example.

[0045] FIGS. 11 to 13 illustrate a method for defining a unit space using a tool for defining (tagging) at least one unit space in a three-dimensional model (or three-dimensional map) of a real-world space, according to an example.

[0046] Figure 14 shows footprint information obtained from a two-dimensional map corresponding to a real-world space, according to an example.

[0047] FIG. 15 illustrates a method for matching footprint information obtained from a two-dimensional map corresponding to a real-world space with a three-dimensional model (or three-dimensional map) for the real-world space, according to an example.

[0048] Hereinafter, examples are described in detail with reference to the attached drawings.

[0049]

[0050] FIG. 1 illustrates a method for providing three-dimensional digital twin content corresponding to a real-world space according to one embodiment.

[0051] In Fig. 1, a method is illustrated in which three-dimensional digital twin content (20) corresponding to real-world space is provided through a screen of a user terminal (100) by a computer system (200).

[0052] The computer system (200) may be an electronic device that generates three-dimensional digital twin content (20) and provides it to a user terminal (100). The computer system (200) may be a device that renders the three-dimensional digital twin content (20) so that it can be displayed on the user terminal (100). For example, the computer system (200) may be a server that generates three-dimensional digital twin content (20) and transmits it to the user terminal (100).

[0053] In FIG. 1, the screen of a user terminal (100) is indicated as a user terminal (100) for convenience of explanation. The user terminal (100) may be an electronic device such as a smartphone, a personal computer (PC), a laptop computer, a tablet, an Internet of Things (IoT) device, or a wearable computer.

[0054] The 3D digital twin content (20) is constructed by modeling a real-world space in three dimensions, and may be generated based on images acquired by photographing real-world spaces using a camera (e.g., a camera-equipped drone, autonomous vehicle, or unmanned aerial vehicle). For example, the images acquired by photographing real-world spaces may be aligned to generate a 3D model (or 3D map) corresponding to the real-world space, and the 3D digital twin content (20) may be generated based on this 3D model. Accordingly, the 3D digital twin content (20) is not limited to simply diagramming a real-world space using shapes, etc., but may also include details of features (objects) included in the real-world space.

[0055] The 3D digital twin content (20) can simulate a real-world space, such as a 2D map or a 3D map, or a semantically distinct space. For example, in the illustrated embodiment, the digital twin content (20) can correspond to a specific apartment complex (i.e., Apartment H (complex)). Accordingly, the 3D digital twin content (20) can include multiple buildings (apartment buildings, commercial buildings, other facilities, etc.) included in Apartment H.

[0056] The illustrated 3D digital twin content (20) can be displayed on a user terminal (100) to provide a service that provides information (e.g., a real estate information service, a location service, a route guidance service, an AR (Augmented Reality) service, etc.) to the user terminal (100).

[0057] In an embodiment, the computer system (200) may define a plurality of unit spaces, each of which corresponds to at least a portion of a real-world space and has a hierarchical relationship with each other, in connection with the three-dimensional digital twin content (20), and may map a content item (i.e., an information content item to be provided to the user terminal (100)) associated with each unit space.

[0058] The computer system (200) can provide three-dimensional digital twin content (20) corresponding to real-world space to the user terminal (100) based on an interaction from the user terminal (100). In other words, the computer system (200) can render the three-dimensional digital twin content (20) so that it can be displayed on the user terminal (100).

[0059] The computer system (200) can render three-dimensional digital twin content (20) corresponding to the entire real-world space as illustrated or corresponding to a unit space corresponding to a relatively upper layer among defined unit spaces so that it is displayed on the user terminal (100), and can render corresponding three-dimensional digital twin content corresponding to a unit space selected according to a selection from the user terminal (100) (i.e., a unit space corresponding to a relatively lower layer) so that it is displayed on the user terminal (100).

[0060] Rendering of three-dimensional digital twin content (20) by a computer system (200) in the present disclosure may encompass a case where at least part of the rendering process is performed at a user terminal (100), and thus may encompass providing data and information required for performing such rendering process at the user terminal (100).

[0061] As in the illustrated example, the 3D digital twin content (20) may include a content item (30) mapped to a first unit space to which the 3D digital twin content (20) corresponds. The first unit space may represent an apartment complex. The content item (30) (or a part thereof) associated with the first unit space may be mapped to the first unit space after the first unit space is defined, or may be meta information entered in association with the first unit space when defining the first unit space. The content item (30) may include the name of the apartment complex, as illustrated.

[0062] Meanwhile, the 3D digital twin content (20) may further include a content item (35) associated with a second unit space corresponding to a lower layer of the first unit space. The second unit space may represent each apartment building (building) included in an apartment complex. The content item (35) (or a part thereof) associated with the second unit space may be mapped to the second unit space after the second unit space is defined, or may be meta information entered in association with the second unit space when defining the second unit space. The content item (35) may include the building number, total floor number, and number of related additional content items (e.g., number of properties) of each apartment building, as illustrated. The building number and / or total floor number among the content items (35) may be the meta information.

[0063] Due to limitations in the screen and performance of the user terminal (100), the 3D digital twin content (20) (i.e., the first 3D digital twin content (20)) may not be suitable for expressing content items associated with all included buildings. Accordingly, the computer system (200) may render the second 3D digital twin content so that, based on a selection from the user terminal (100), the second 3D digital twin content corresponds to a selected unit space among the unit spaces defined in association with the 3D digital twin content (20) and includes content items mapped to the selected unit space, so that the second 3D digital twin content is displayed on the user terminal (100). The second 3D digital twin content may be a portion of the first 3D digital twin content (20) or an enlarged version of the first 3D digital twin content (20). In the example of FIG. 1, the second 3D digital twin content may correspond to a building selected by the user terminal (100).

[0064] In an embodiment, based on a selection from the user terminal (100), a second three-dimensional digital twin content representing a lower layer, i.e., a narrower spatial range, may be displayed on the user terminal (100), so that content items associated with the second three-dimensional digital twin content may be presented more effectively on the user terminal (100). To explain based on the illustrated example, for example, when Building 214 is selected from the first three-dimensional digital twin content (20), the second three-dimensional digital twin content corresponding to Building 214 may be displayed on the user terminal (100), and further, as more detailed information on the content item (35), for example, the aforementioned additional content items (e.g., information on specific properties) may be included in the second three-dimensional digital twin content.

[0065] In this way, in the embodiment, the recognition and usability of information provided through 3D digital twin content (20) on the user terminal (100) can be maximized.

[0066] A specific method for defining a plurality of unit spaces to configure 3D digital twin content (20), a method for mapping content items to each unit space, and a specific method for rendering 3D digital twin content (20) according to a selection from a user terminal (100) will be described in more detail with reference to FIGS. 2 to 15, which will be described later.

[0067]

[0068] FIG. 2 illustrates a computer system for generating and providing three-dimensional digital twin content according to one embodiment.

[0069] The computer system (200) (or server) described above with reference to FIG. 1 according to the embodiments may be implemented through the computer system (200) illustrated in FIG. 2. For example, a computer program for implementing the method of the embodiment may be installed and run on the computer system (200), and such computer system (200) may perform the method for providing 3D digital twin content (20) according to the embodiments under the control of the run computer program.

[0070] The computer system (200) may be a computer that constitutes a server as the aforementioned electronic device. Alternatively, the computer system (200) may include a server and an administrator terminal for controlling the server. Such an administrator terminal may be a smartphone, a personal computer (PC), a laptop computer, a tablet, an Internet of Things (IoT) device, or a wearable computer. Such an administrator terminal may have installed thereon a program, application, or software including a tool for generating the aforementioned three-dimensional digital twin content (20).

[0071] As illustrated, the computer system (200) may include memory (110), a processor (120), a communication interface (130), and an input / output interface (140) as components.

[0072] The memory (110) is a computer-readable recording medium, and may include a random access memory (RAM), a read only memory (ROM), and a permanent mass storage device such as a disk drive. Here, the ROM and the permanent mass storage device such as the disk drive may be included in the computer system (200) as a separate permanent storage device distinct from the memory (110). In addition, the memory (110) may store an operating system and at least one program code. These software components may be loaded into the memory (110) from a computer-readable recording medium separate from the memory (110). This separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory (110) through a communication interface (130) rather than a computer-readable recording medium. For example, software components may be loaded into the memory (110) of a computer system (200) based on a computer program that is installed by files received over a network (160).

[0073] The processor (120) may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to the processor (120) via the memory (110) or the communication interface (130). For example, the processor (120) may be configured to execute instructions received according to program code stored in a storage device such as the memory (110).

[0074] That is, the processor (120) can manage components of the computer system (200) and execute programs or applications used by the computer system (200). For example, the processor (120) can execute a program for performing a method of providing three-dimensional digital twin content (20) of the embodiment. In addition, the processor (120) can process operations necessary for executing related programs or applications and processing data, and can be at least one processor of the computer system (200) or at least one core within the processor.

[0075] The communication interface (130) may provide a function for the computer system (200) to communicate with another computer system (not shown), such as a user terminal (100) or an administrator terminal, via a network (160). For example, requests, commands, data, files, etc. generated by the processor (120) of the computer system (200) according to program codes stored in a recording device such as a memory (110) may be transmitted to another computer system via the network (160) under the control of the communication interface (130). Conversely, signals, commands, data, files, etc. from another computer system may be received by the computer system (200) via the communication interface (130) of the computer system (200) via the network (160). Signals, commands, data, etc. received through the communication interface (130) may be transmitted to the processor (120) or memory (110), and files, etc. may be stored in a storage medium (the aforementioned permanent storage device) that the computer system (200) may further include. For example, the communication interface (130) may be a hardware module such as a network interface card, a network interface chip, and a networking interface port of the computer system (200), or a software module such as a network device driver or a networking program.

[0076] The input / output interface (140) may be a means for interfacing with an input / output device (150). For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display or speaker. As another example, the input / output interface (140) may be a means for interfacing with a device that integrates input and output functions, such as a touchscreen. The input / output device (150) may also be configured as a single device with the computer system (200).

[0077] Furthermore, in other embodiments, the computer system (200) may include more components than those illustrated in FIG. 2. However, most conventional components need not be explicitly illustrated. For example, the computer system (200) may be implemented to include at least some of the input / output devices connected to the aforementioned input / output interface (140), or may further include other components such as a transceiver, a Global Positioning System (GPS) module, a camera, various sensors, a database, and the like.

[0078] When the computer system (200) is a server (200) that communicates with a user terminal (100), the computer system (200) can control the user terminal (100) to display three-dimensional digital twin content (20).

[0079] In some embodiments, the computer system (200) may include a database as a device for managing (registering, changing, deleting, storing, maintaining, etc.) data and content to be provided to the user terminal (100) and two-dimensional maps and three-dimensional maps, or may be configured to communicate with a database or external service that provides the same. In addition, the server (200) may include a map server that provides digital maps (three-dimensional maps and / or two-dimensional maps) or may be configured to communicate with such a map server.

[0080] Meanwhile, the user terminal (100) or administrator terminal described above can also be implemented as a computer system including configurations similar to those illustrated in FIG. 2, and thus, redundant descriptions are omitted.

[0081] In the detailed description to be provided below, for convenience of explanation, embodiments will be described with a focus on the computer system (200), and operations on the user terminal (100) side may be briefly described or omitted. In addition, for convenience of explanation, operations (steps) performed by components (e.g., processors, etc.) of the computer system (200) may be described as being performed by the computer system (200).

[0082] The description of the technical features described above with reference to FIG. 1 can also be applied to FIG. 2, so any redundant description will be omitted.

[0083]

[0084] FIG. 3 is a flowchart illustrating a method for providing three-dimensional digital twin content corresponding to a real-world space according to one embodiment.

[0085] Referring to FIG. 3, a method for providing three-dimensional digital twin content (20) corresponding to a real-world space performed by a computer system (200) is described in more detail.

[0086] In step (310), the computer system (200) may define a plurality of unit spaces, each corresponding to at least a portion of a real-world space and having a hierarchical relationship with one another. The real-world space may represent, for example, a large-scale space such as a city level or a town-level space such as an apartment complex. Each unit space may be a hierarchical division of such a real-world space. For example, each unit space may be a unit space layer that hierarchically divides the real-world space. Each unit space may be a unit that renders or outputs (i.e., displays on the user terminal (100)) 3D digital twin content according to a selection from the user terminal (100).

[0087] Each unit space may have a three-dimensional position range corresponding to a three-dimensional position range of real-world space. In other words, each unit space may be a space that divides real-world space into physical three-dimensional position ranges. The three-dimensional position range may be a range of three-dimensional position coordinates. In addition, at least one of the unit spaces may correspond to at least a portion of an area of ​​a feature or object (e.g., a building, a facility, etc.) located in real-world space. Such an area may also represent a three-dimensional space.

[0088] At least one of these unit spaces may be defined based on input from an administrator (administrator terminal) of the computer system (200). Alternatively, the content item may be defined based on input from a user terminal (100) rather than an administrator terminal. In other words, the user terminal (100) may be both a consumer of the 3D digital twin content (20) and a creator of the 3D digital twin content (20). In this way, the computer system (200) may define at least one of a plurality of unit spaces from the administrator terminal or the user terminal (100).

[0089] Additionally, the computer system (200) can define at least one unit space either manually (i.e., manually) based on input from a user or administrator, or automatically based on information obtained from a two-dimensional map. A specific method for defining a unit space is described in more detail with reference to FIGS. 4 and 5, which will be described later.

[0090] In step (320), the computer system (200) can map content items associated with each unit space of the defined unit spaces. The content items mapped to the unit spaces may be informative content items for providing information about the unit spaces. For example, the content items may include at least one of text, images, and other media content that describe the location indicated by the unit space. Alternatively, the content items may include real estate information about the location indicated by the unit space. The real estate information may include at least one of listing information (sale, lease, monthly rent, etc.) for the location, market price information, and descriptive information helpful for real estate transactions.

[0091] These content items can be registered for the unit space based on input by an administrator (administrator terminal) of the computer system (200) that defined the unit space. Alternatively, the content items can be registered for the unit space based on input from a user terminal (100), regardless of the person who defined the unit space. In other words, the user terminal (100) can be both a consumer of the 3D digital twin content (20) and a creator (creator) of the 3D digital twin content (20). In this way, the computer system (200) can map the content item to at least one of the defined unit spaces based on input from the administrator terminal or the user terminal (100).

[0092] Meanwhile, steps (310 and 320) are steps for generating three-dimensional digital twin content (20) in which a plurality of unit spaces are defined, and may be performed in advance before step (330) for providing the three-dimensional digital twin content (20) to the user terminal (100). In other words, the three-dimensional digital twin content (20) in which the unit spaces are defined, which is generated in advance by steps (310 and 320), may be provided to the user terminal (100) based on an interaction by the user terminal (100).

[0093] In this way, in step (330), the computer system (200) can provide the user terminal (100) with first three-dimensional digital twin content (20) corresponding to a real-world space or a unit space of a relatively higher layer defined for the real-world space, based on an interaction from the user terminal (100).

[0094] A user of a user terminal (100) can virtually explore a real-world space using the first three-dimensional digital twin content (20). An interaction from the user terminal (100) may be a request for the first three-dimensional digital twin content (20) corresponding to a specific real-world space or unit space for the computer system (200), a search request for the real-world space or unit space, or a selection of the real-world space or unit space. For example, the first three-dimensional digital twin content (20) may represent a set of buildings (e.g., an apartment complex) as described above with reference to FIG. 1.

[0095] Meanwhile, in step (332), the computer system (200) may render second three-dimensional digital twin content (100) to display second three-dimensional digital twin content including content items mapped to a selected unit space among unit spaces defined for a real-world space, based on a selection from the user terminal (100), on the user terminal (100). The second three-dimensional digital twin content may be a partial content of the first three-dimensional digital twin content (20). The second three-dimensional digital twin content may correspond to a unit space that is relatively lower in layer than the first three-dimensional digital twin content (20). For example, the second three-dimensional digital twin content may represent a selected building (e.g., an apartment building selected from an apartment complex) among the sets of buildings described above with reference to FIG. 1.

[0096] A user of a user terminal (100) can virtually explore a real-world space in greater detail using the second three-dimensional digital twin content (20). That is, the user terminal (100) can virtually explore a narrower range of unit space using the second three-dimensional digital twin content, and can more clearly identify content items mapped to the narrower range of unit space.

[0097] Meanwhile, the selection from the user terminal (100) in step (332) may be, for example, selection of a unit space (or a user interface representing a unit space) corresponding to the second 3D digital twin content from the first 3D digital twin content (20).

[0098] In addition, if there is a unit space of a lower layer than the unit space corresponding to the second 3D digital twin content, the computer system (200) can provide the 3D digital twin content corresponding to the unit space of the lower layer to the user terminal (100) based on a selection from the user terminal (100) for the unit space of the lower layer.

[0099] Thus, a user of a user terminal (100) can virtually explore hierarchical unit spaces of a real-world space in detail using the hierarchically provided 3D digital twin content according to selection, and can more clearly identify content items mapped to each unit space. Accordingly, the usability of the entire (first) 3D digital twin content (20) can be maximized.

[0100] Meanwhile, the first 3D digital twin content (20) and the second 3D digital twin content are constructed by modeling real-world spaces in three dimensions, and may be constructed based on images acquired by photographing real-world spaces using a camera (e.g., a camera-equipped drone, an autonomous vehicle, or an unmanned aerial vehicle). For example, the images acquired by photographing real-world spaces may be aligned to create a 3D model (or a 3D map) corresponding to the real-world space, and the first 3D digital twin content (20) and the second 3D digital twin content may be created based on this 3D model. Accordingly, the first 3D digital twin content (20) and the second 3D digital twin content may not simply diagram the real-world space using shapes, etc., but may also include details of features (objects) included in the real-world space.

[0101] In step (340), the computer system (200) may provide a sharing function that allows the user terminal (100) to share the second three-dimensional digital twin content corresponding to the selected unit space with other users. When this sharing function is selected by the user terminal (100), the user terminal (100) may share the second three-dimensional digital twin content representing the selected unit space with other users. In other words, in the embodiment, the three-dimensional digital twin content may be shared with other users on a 'unit space' basis.

[0102] As described above, a user of a user terminal (100) can become a creator of three-dimensional digital twin content by defining a unit space and / or mapping content items to the defined unit space, and the user can share three-dimensional digital twin content representing a specific unit space as UGC with other users (other user terminals) through the sharing function. For example, the computer system (200) can generate a link for sharing three-dimensional digital twin content representing a specific unit space, and when the link is selected on the receiving terminal side, the three-dimensional digital twin content (20) can be rendered so that the three-dimensional digital twin content of the specific unit space is displayed on the receiving terminal side. Accordingly, in the embodiment, not the entire three-dimensional digital twin content (20), but the three-dimensional digital twin content representing a specific unit space can be shared, and thus, the receiving user terminal side can display only the three-dimensional digital twin content representing a specific unit space using only a small amount of resources without having to load the entire three-dimensional digital twin content (20). In other words, the resources required to render 3D digital twin content in a computer system (200) and a user terminal (100) can also be reduced.

[0103] The description of the technical features described above with reference to FIGS. 1 and 2 can also be applied to FIG. 3, so any redundant description will be omitted.

[0104]

[0105] FIG. 4 is a flowchart illustrating a method for defining a plurality of unit spaces corresponding to at least a portion of a real-world space and having a hierarchical relationship with each other, according to an example.

[0106] As described above, the computer system (200) can define at least one unit space in a manual (i.e., manual) manner based on input from a user terminal (100) or an administrator terminal, or in an automatic manner based on information obtained from a two-dimensional map.

[0107] First, we describe a method for defining a unit space using a manual method, referring to steps (410 to 416).

[0108] As in step (410), the computer system (200) can define the unit space in a manual manner (i.e., in a manual manner) based on input from a user terminal (100) or an administrator terminal.

[0109] In step (412), the computer system (200) can receive input for defining a unit space from a user terminal (100) or an administrator terminal.

[0110] In step (414), the computer system (200) can define at least one unit space based on the input entered for at least one unit space among a plurality of unit spaces (defined corresponding to real-world space).

[0111] The input for defining a unit space may be a three-dimensional position range corresponding to a three-dimensional position range of a real-world space. The three-dimensional position range may be a range of three-dimensional position coordinates. For example, in the step (412) described above, when three-dimensional position information (x, y, z coordinates, coordinate range, lengths of each side of a rectangular parallelepiped corresponding to the unit space, etc.) for defining a specific unit space, i.e., defining the geometry of a specific unit space, is input from the user terminal (100) or the administrator terminal, the computer system (200) may define the unit space based on the input. Meanwhile, the input for defining the unit space from the user terminal (100) or the administrator terminal may include rotation information for the corresponding unit space (i.e., yaw, pitch, roll; rotation angles about the x-axis, y-axis, and z-axis). The computer system (200) may define a unit space, which is a three-dimensional space, based on the input position information and rotation information.

[0112] In step (416), the computer system (200) may associate meta-information with the defined unit space. The meta-information may be input from a user terminal (100) or an administrator terminal. The meta-information may be, for example, the name of the defined unit space. The meta-information may include other metadata for defining the unit space. At least a portion of the associated meta-information may be displayed together with three-dimensional digital twin content corresponding to the corresponding unit space. The content item (30) of FIG. 1 may represent meta-information.

[0113] In relation to this, a method of defining a unit space using a manual method is described in more detail with reference to FIGS. 11 to 13.

[0114] FIGS. 11 to 13 illustrate a method for defining a unit space using a tool for defining (tagging) at least one unit space in a three-dimensional model (or three-dimensional map) of a real-world space, according to an example.

[0115] Figures 11 to 13 each show a tool screen of an administrator terminal or user terminal (100) on which a tool for defining (tagging) a unit space is installed.

[0116] A three-dimensional model (or three-dimensional map) (1100) may be displayed on one side of the tool screen. The administrator terminal or the user terminal (100) may define a unit space (1110) through direct selection in the three-dimensional model (1100) or inputting the position information (and the rotation information) for the unit space position range setting UI (1140) of the unit space tagging UI (1120). As illustrated, the unit space (1110) may be defined in a size and shape according to the input information, and may be, for example, a rectangular parallelepiped. The administrator terminal or the user terminal (100) may also input the name of the corresponding unit space (1110) (for example, Apartment H in FIG. 11) into the unit space name setting UI (1130) of the unit space tagging UI (1120). The information entered through the unit space name setting UI (1130) and the unit space location range setting UI (1140) may be the aforementioned meta information. In Fig. 11, the entire apartment complex is defined as a unit space (1110).

[0117] The unit space tagging UI (1120) may further include an AR content setting UI (1150) for defining properties related to AR content to be output in the AR view of the user terminal (100) in relation to the corresponding unit space (1110) or properties for outputting 3D digital twin content through the AR view. In addition, although not illustrated, the unit space tagging UI (1120) may further include a UI for mapping content items to the corresponding unit space (1110).

[0118] Meanwhile, Fig. 12 shows a method for defining a unit space (1210), which is a lower layer of a unit space (1110). In Fig. 12, a unit space (1210) representing a selected XXX building in Apartment H, which is a unit space (1110), is defined. At this time, XXX building can be entered as the name of the unit space (1110).

[0119] Next, Fig. 13 shows a method for defining a unit space (1310) which is a lower level of a unit space (1210). In Fig. 13, a unit space (1310) representing a high-rise area selected from the XXX building of H Apartment, which is the unit space (1210), is defined. At this time, the name of the unit space (1110) may be input as the XXX building high-rise area. Depending on the embodiment, a mid-rise or low-rise area of ​​the XXX building may be selected as the unit space (1310) which is a lower level of the unit space (1210), or a specific floor of the XXX building may be selected.

[0120] As described with reference to FIGS. 11 to 13, unit spaces (1110 to 1310) can be defined by an administrator terminal or a user terminal (100) using a tool for defining a unit space.

[0121] Next, we describe a method for defining a unit space using an automatic method that utilizes information from a two-dimensional map, with reference to steps (420 to 428).

[0122] As in step (420), the computer system (200) can automatically define at least one unit space among a plurality of unit spaces based on a two-dimensional map corresponding to a real-world space. Here, the two-dimensional map may be a commercial map provided through a map provision service. The two-dimensional map may be aligned with a three-dimensional map (or a three-dimensional model) for providing three-dimensional digital twin content of the embodiment, and at least one unit space may be automatically defined based on this alignment. In other words, the unit space defined in the two-dimensional map may be utilized to define a unit space for configuring three-dimensional digital twin content.

[0123] For example, the computer system (200) can automatically define a unit space corresponding to an administrative district or semantic unit district defined in relation to a real-world space on a two-dimensional map, i.e., within or including the real-world space, as at least one unit space for three-dimensional digital twin content.

[0124] The computer system (200) can automatically define an area of ​​a 3D map (or a 3D model) that matches an administrative district on a 2D map as at least one unit space for 3D digital twin content, or can automatically define an area of ​​a 3D map (or a 3D model) that matches a semantic unit district on a 2D map as at least one unit space for 3D digital twin content. A semantic unit district does not correspond to an administrative district, but may represent an area that is semantically, according to the characteristics of the area, or conventionally distinguished on a 2D map. The semantic unit district may be, for example, xx Street (e.g., Garosu-gil, Seocho Culture and Arts Street, etc.), xx District (e.g., a specific industrial area, a commercial area, a specific apartment complex, etc.), xx Market, etc.

[0125] The computer system (200) can, for example, match a location coordinate range corresponding to an administrative district or semantic unit district on a two-dimensional map to a three-dimensional map (or three-dimensional model), and automatically define the location coordinate range on the matched three-dimensional map (or three-dimensional model) as a unit space.

[0126] The computer system (200) may also perform matching between administrative districts or semantic unit districts and a 3D map (or 3D model) based on a search for administrative districts or semantic unit districts through a tool of a user terminal (100) or an administrator terminal (semi-automatic method).

[0127] The computer system (200) can automatically define at least one unit space using footprint information, as described in FIG. 14 and steps (422 to 428). In this regard, FIG. 14 illustrates footprint information obtained from a two-dimensional map corresponding to a real-world space, according to an example.

[0128] Steps (422 to 428) may represent an example of a method for matching a region corresponding to a real-world space on the aforementioned two-dimensional map with a three-dimensional map (or three-dimensional model).

[0129] In step (422), the computer system (200) can obtain footprint information (1400) of an area corresponding to a real-world space on a two-dimensional map. The area corresponding to the real-world space may include, for example, the administrative district or semantic unit area described above. The computer system (200) can obtain footprint information (1400) based on a location range (e.g., a location coordinate range) that includes the administrative district or semantic unit area. The footprint information (1400) is extracted from a two-dimensional map and may include information included in the two-dimensional map. For example, as illustrated, the footprint information (1400) may identify a specific apartment complex and may include the name of each building within the apartment complex (e.g., the building number of each apartment building, etc.). The information of the two-dimensional map included in such footprint information (1400) may be meta information associated with the footprint information (1400), and the meta information of the footprint information (1400) may be meta information associated with a unit space defined as a result.

[0130] In step (424), the computer system (200) can match the acquired footprint information (1400) to a three-dimensional model (three-dimensional map) corresponding to the real-world space. The computer system (200) can adjust the viewpoint of the three-dimensional model and / or, additionally, enlarge or reduce the three-dimensional model so that the three-dimensional model can display a top view of the real-world space, and can match the three-dimensional model displayed in this top view with the footprint information (1400).

[0131] In relation to this, FIG. 15 illustrates a method for matching footprint information obtained from a two-dimensional map corresponding to a real-world space with a three-dimensional model (or three-dimensional map) for the real-world space, according to an example.

[0132] In FIG. 15, a method is illustrated in which footprint information (1400) is matched to a three-dimensional model (1500) displayed in a top view, and ultimately unit spaces (1510, 1520) are automatically defined. As illustrated, by accurately matching the three-dimensional model (1500) and footprint information (1400), a first unit space (1510) representing a specific apartment complex and a second unit space (1520) representing a building (apartment building) included in the apartment complex can be automatically defined based on the two-dimensional map information included in the footprint information (1400).

[0133] As in step (426), the computer system (200) can define at least one unit space within the matched three-dimensional model using meta information associated with the footprint information (1400).

[0134] First, the computer system (200) can match the footprint information (1400) to the 3D model (1500) through shape matching and / or coordinate matching as illustrated in FIG. 15 according to step (424), and then, according to step (426), can automatically define unit spaces (1510, 1520) on the 3D model (1500) using meta information associated with the footprint information (1400), such as a location range representing an apartment complex, an apartment complex name, and the names of each building included in the apartment complex.

[0135] In step (428), the computer system (200) can associate meta information associated with the footprint information (1400) to at least one defined unit space (1510, 1520).

[0136] For example, the computer system (200) can match the footprint information (1400) with the 3D model (1500), and automatically define the 3D areas of the 3D model (1500) corresponding to the buildings including the building numbers of the footprint information (1400) as unit spaces (1510). The apartment complex name or the building number of each building may be associated as meta information in this unit space (1510). In addition, the computer system (200) can automatically define the 3D areas of the 3D model (1500) corresponding to each building including the building number of the footprint information (1400) as unit spaces (1520). The building number of the corresponding apartment building, the total number of floors, etc. may be associated as meta information in this unit space (1520). Meanwhile, since the footprint information (1400) does not include a height value, the height value defined in the 3D model (1500) can be used as the height value of the unit space (1510, 1520).

[0137] As described, the computer system (200) can manually or automatically define at least one unit area among the unit spaces for composing the three-dimensional digital twin content (20). The definition of such a unit space and the association of meta information to the unit space can be referred to as 'tagging' of the unit space.

[0138] Meanwhile, in FIG. 8, a plurality of exemplary unit spaces are illustrated, and a method of defining a plurality of unit spaces is illustrated. As illustrated, the unit spaces (810 to 840) may have a hierarchical relationship, such as a unit space (810) corresponding to the administrative district of Seoul, a unit space (820) corresponding to the administrative district of Songpa-gu, a unit space (830) corresponding to Apartment H located in Songpa-gu, and a unit space (840) representing a specific building of Apartment H. Meanwhile, although not illustrated, a unit space representing a high-rise, a mid-rise, or a low-rise may exist below the unit space (840), a unit space representing each floor may exist even lower, and a unit space representing each household may exist even lower.

[0139] The description of the technical features described above with reference to FIGS. 1 to 3 can also be applied to FIGS. 4, 8, and 11 to 15, so redundant descriptions are omitted.

[0140]

[0141] FIG. 5 is a flowchart illustrating a method for automatically defining at least one unit space among a plurality of unit spaces corresponding to at least a portion of a real-world space and having a hierarchical relationship with each other, according to an example.

[0142] Referring to FIG. 5, a method for automatically defining a unit space for configuring three-dimensional digital twin content (20) based on POI information included in a two-dimensional map by a computer system (200) is described in more detail.

[0143] In step (510), the computer system (200) can match POIs included in a two-dimensional map corresponding to a real-world space to features included in a three-dimensional model (or three-dimensional map) corresponding to the real-world space based on location information about the POIs. This matching can be achieved through shape matching and / or coordinate matching between the two-dimensional map and the three-dimensional model, and the contents regarding matching between the aforementioned footprint information (1400) and the three-dimensional model (1500) can be similarly applied.

[0144] In step (520), the computer system (200) can automatically define at least one feature or a portion thereof among the matched features in the 3D model as at least one unit space. The matched features may be, for example, buildings within the matched apartment complex described above with reference to FIG. 15.

[0145] The computer system (200) can automatically define at least one feature that satisfies a rule according to a predetermined condition among the matched features as at least one unit space for composing the three-dimensional digital twin content (20).

[0146] For example, the computer system (200) can automatically define, among the matched features, those that have similar shapes, those that are within a certain radius or location range, or those that have similar names or numbers, etc., as one unit space, and can automatically define each of the features (buildings) belonging to one unit space as a lower unit space.

[0147] In this way, as illustrated in FIG. 15, the three-dimensional areas of the three-dimensional model (1500) corresponding to the buildings including the same number can be automatically defined as a unit space (1510), and the three-dimensional areas of the three-dimensional model (1500) corresponding to each building can also be automatically defined as a unit space (1520).

[0148] Meanwhile, defining the unit space(s) described above in a manual and / or automatic manner may be based on a preset service scenario of a service that the computer system (200) intends to provide through the first 3D digital twin content (20) and the second 3D digital twin content described above. That is, depending on the context of the service scenario of the service to be provided, for example, depending on whether the service to be provided is a real estate provision service or another location / road guidance service, the number of unit spaces defined or the location range included in the unit space may vary. For example, the computer system (200) may provide a template for defining unit spaces according to the service scenario (for example, to the tool of FIGS. 11 to 13), and at least one unit space may be defined in a manual and / or automatic manner according to this template.

[0149] Meanwhile, if a 3D map matching the 2D map is already built, matching between the 3D and 2D maps may be unnecessary. In such cases, unit space(s) can be defined by directly selecting location ranges and other parameters from the 3D map, without utilizing the 2D map.

[0150] The description of the technical features described above with reference to FIGS. 1 to 4, 8, and 11 to 15 can also be applied to FIG. 5, so any duplicate description will be omitted.

[0151]

[0152] FIG. 6 is a flowchart illustrating a method for providing three-dimensional digital twin content and a user interface associated therewith to a user terminal according to an example.

[0153] A method for providing three-dimensional digital twin content (20) to a user terminal (100) will be described in more detail with reference to FIG. 6 and FIG. 1.

[0154] The computer system (200) can render the first three-dimensional digital twin content (20) to display the first three-dimensional digital twin content (20) on the user terminal (100).

[0155] In step (610), the computer system (200) may provide, to the user terminal (100), a first user interface for entering a first unit space in association with the rendered first three-dimensional digital twin content (20). That is, the computer system (200) may display, on the user terminal (100), a first user interface for entering a first unit space among the unit spaces in association with the rendered first three-dimensional digital twin content (20). Displaying the user interface or content on the user terminal (100) may be that the computer system (200) controls the user terminal (100) so that the user terminal (100) displays the user interface or content. The first user interface may be included in the first three-dimensional digital twin content (20), and in the example of FIG. 1, each building included in the first three-dimensional digital twin content (20) may be displayed. The first user interface may be displayed with visual emphasis to indicate to the user that it is selectable.

[0156] In step (620), the computer system (200) may provide the second three-dimensional digital twin content corresponding to the first unit space to the user terminal (100) as the first user interface is selected by the user terminal (100). That is, the computer system (200) may render the second three-dimensional digital twin content so that the second three-dimensional digital twin content corresponding to the first unit space is displayed on the user terminal (100) as the first user interface is selected by the user terminal (100).

[0157] In step (630), the computer system (200) may provide, to the user terminal (100), a second user interface for entering a second unit space, which is a lower layer of the first unit space, in association with the rendered second three-dimensional digital twin content. That is, the computer system (200) may display, on the user terminal (100), a second user interface for entering the second unit space, in association with the rendered second three-dimensional digital twin content. The second user interface may be included in the second three-dimensional digital twin content, and may be each floor included in the second three-dimensional digital twin content, which is a selected building, or may be a high-rise, middle-rise, or upper-rise area including multiple floors. The second user interface may be displayed with emphasis so that the user can visually recognize that it is selectable.

[0158] In step (640), the computer system (200) may provide the third three-dimensional digital twin content corresponding to the second unit space to the user terminal (100) as the second user interface is selected by the user terminal (100). That is, the computer system (200) may render the third three-dimensional digital twin content so that the third three-dimensional digital twin content corresponding to the second unit space is displayed on the user terminal (100) as the second user interface is selected by the user terminal (100).

[0159] Meanwhile, as the first / second user interface is selected, the second / third three-dimensional digital twin content may be highlighted and displayed on the user terminal (100), or the remaining parts of the first three-dimensional digital twin content (20) may be displayed without being displayed.

[0160] For example, the computer system (200) can render the second / third 3D digital twin content to display the second / third 3D digital twin content on the user terminal (100) by at least one of: enlarging the second / third 3D digital twin content among the first 3D digital twin content (20) and displaying it on the user terminal (100), relatively emphasizing the second / third 3D digital twin content among the first 3D digital twin content (20) and displaying it, and de-displaying a portion of the first 3D digital twin content (20) other than the second / third 3D digital twin content.

[0161] Accordingly, in the embodiment, when displaying the first three-dimensional digital twin content (20) corresponding to the entire real-world space, content items related to the second / third three-dimensional digital twin content that are difficult to effectively express can be displayed with high visibility on the user terminal (100). The user terminal (100) can display only the three-dimensional digital twin content corresponding to the targeted unit space, so that the targeted unit space can be expressed in detail without duplication or complexity of information on the three-dimensional digital twin content.

[0162] Below, with reference to FIGS. 9 and 10, a method for providing a real estate information service using three-dimensional digital twin content (20) is described in more detail.

[0163] In relation to this, FIG. 9 illustrates a scenario for providing a real estate information service through three-dimensional digital twin content, according to an example. FIG. 10 illustrates a method for displaying second three-dimensional digital twin content corresponding to a unit space selected from first three-dimensional digital twin content displayed on a user terminal when providing a real estate information service, according to an example.

[0164] In FIG. 10, the first three-dimensional digital twin content (20, 1010) and the second three-dimensional digital twin content (1030) can be configured to provide real estate information for at least one building included in a real-world space.

[0165] The computer system (200) can map content items including real estate information to each unit space to provide real estate information through the first three-dimensional digital twin content (20, 1010) and the second three-dimensional digital twin content (1030).

[0166] For example, the computer system (200) may map content items to each unit space by at least one of: mapping collective real estate information (e.g., listing information for the entire complex, market price information, etc.) of a set of buildings (apartment complexes) included in a real-world space in association with a first unit space, which is a relatively upper layer among unit spaces; mapping building-specific real estate information (e.g., listing information for each building, market price information, etc.) of each building (each apartment building) of the set of buildings in association with a second unit space, which is a lower layer of the first unit space; mapping floor-specific real estate information (e.g., listing information for each building, market price information, etc.) of each floor of each building in association with a third unit space, which is a lower layer of the second unit space; and mapping generation-specific real estate information (e.g., listing information for each generation, market price information, etc.) of each generation on each floor in association with a fourth unit space, which is a lower layer of the third unit space. Mapping (registration) of these content items can be done by an administrator or real estate agent (who has the authority to register content items).

[0167] Referring to FIG. 10, an example may be described, wherein the first three-dimensional digital twin content (1010) may include a three-dimensional model corresponding to a set of buildings, which is an apartment complex. In this case, the first unit space may correspond to the first building (building 312) among the buildings included in the set of buildings. The first user interface (1020) may be provided on the user terminal (100) to enable selection of the first building. When the first user interface (1020) is selected, the computer system (200) may render the second three-dimensional digital twin content (1030) to display the second three-dimensional digital twin content (1030) including the three-dimensional model corresponding to the first building on the user terminal (100). Accordingly, when a specific building is selected from among the buildings included in the first three-dimensional digital twin content (1010) displayed by the user terminal (100), the second three-dimensional digital twin content (1030) corresponding to the building may be displayed on the user terminal (100).

[0168] Here, the second three-dimensional digital twin content (1030) may include a second user interface (1040-1 to 1040-3) for entering a second unit space corresponding to at least one of a high-rise, a mid-rise, and a low-rise of a first building, which is a lower layer of the first unit space, and real estate information (1045-1, only the high-rise is displayed in FIG. 10) for at least one of a high-rise, a mid-rise, and a low-rise indicated by the second unit space.

[0169] When the second user interface (1040-1 to 1040-3) is selected, the user terminal (100) can display three-dimensional digital twin content representing a unit space of the selected lower layer, and can also display additional real estate information for the unit space of the lower layer. For example, while the real estate information (1045-1) may only include average information on properties in high-rise buildings or the number of properties, the additional real estate information may include specific information on each property included on each floor of the high-rise buildings.

[0170] Additionally, as illustrated, each of the second unit spaces selectable through the second user interface (1040-1 to 1040-3) can be visually distinguished.

[0171] In short, according to a scenario as described in FIG. 9, a real estate information service may be provided to a user terminal. For example, when a specific building is selected while a 3D digital twin content (910) of an entire apartment complex is displayed on a user terminal (100), a 3D digital twin content (920) of the entire building of the specific building may be displayed. When a high-rise is selected therefrom, a 3D digital twin content (930) corresponding to the high-rise of the building may be displayed. When a specific floor is selected therefrom, a 3D digital twin content (940) corresponding to the specific floor of the building may be displayed. When a specific generation is selected therefrom, a 3D digital twin content (950) corresponding to the specific generation of the building may be displayed. The 3D digital twin contents (910 to 950) may be displayed together with (mapped) content items corresponding to each case.

[0172] Accordingly, users can accurately grasp the market price information and surrounding environmental information of the property of interest through a virtual forest using 3D digital twin content (910 to 950) without having to visit the property of interest in person.

[0173] The description of the technical features described above with reference to FIGS. 1 to 5, 8, and 11 to 15 can also be applied to FIGS. 6, 9, and 10, so redundant descriptions are omitted.

[0174]

[0175] FIG. 7 is a flowchart illustrating a method for providing three-dimensional digital twin content to be displayed through an AR view on a user terminal according to an example.

[0176] The 3D digital twin content of the embodiment and the information contained therein may also be provided through an augmented reality (AR) view of the user terminal (100). In other words, the 3D digital twin content of the embodiment and the information contained therein may be used to implement the AR view of the user terminal (100) and the AR content augmented therein.

[0177] For example, as in step (710), the computer system (200) can display at least a part of the first 3D digital twin content (20) by augmenting the image within an AR view including an image of a real-world space captured by a camera of the user terminal (100). That is, if the location that the user terminal (100) is looking at through the camera matches the location included in the first 3D digital twin content (20), the first 3D digital twin content (20) (or a part thereof) corresponding to the location can be displayed. For example, if the user terminal (100) is looking at a specific building or a high-rise of a specific building of an H apartment complex through the camera, a 3D digital twin content (e.g., the second / third 3D digital twin content described above) corresponding to a unit space representing the specific building or high-rise can be displayed in the AR view, and together with this, a content item mapped to the corresponding 3D digital twin content can also be augmented and displayed together in the AR view.

[0178] The description of the technical features described above with reference to FIGS. 1 to 6 and FIGS. 8 to 15 can also be applied to FIG. 7, so any duplicate description will be omitted.

[0179]

[0180] In an embodiment, three-dimensional digital twin content and information content items associated therewith can be provided by being divided into defined unit spaces based on service scenarios to be provided, etc., so that the complexity of service provision can be reduced and the efficiency of information transmission through service provision can be achieved.

[0181] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0182] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0183] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0184] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0185] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. A method for providing three-dimensional digital twin content corresponding to a real-world space performed by a computer system, A step of defining a plurality of unit spaces, each of which corresponds to at least a part of the real-world space and has a hierarchical relationship with each other; A step of mapping a content item associated with each unit space of the above unit spaces to each unit space; and A step of providing first 3D digital twin content corresponding to the real-world space to the user terminal based on an interaction from the user terminal. Including, The steps provided above are: A step of rendering the second three-dimensional digital twin content so that the second three-dimensional digital twin content corresponding to the selected unit space among the unit spaces and including a content item mapped to the selected unit space is displayed on the user terminal based on the selection from the user terminal. A method for providing three-dimensional digital twin content, comprising:

2. In paragraph 1, A method for providing three-dimensional digital twin content, wherein the first three-dimensional digital twin content and the second three-dimensional digital twin content are constructed by modeling the real-world space in three dimensions based on images acquired by photographing the real-world space.

3. In paragraph 1, Each of the above unit spaces has a three-dimensional position range corresponding to the three-dimensional position range of the real-world space, A method for providing three-dimensional digital twin content, wherein at least one of the above unit spaces corresponds to at least a portion of an area of ​​an object located in the real-world space.

4. In paragraph 1, The step of defining the above multiple unit spaces is: A method for providing three-dimensional digital twin content, which defines the unit spaces based on preset service scenarios of services to be provided through the first three-dimensional digital twin content and the second three-dimensional digital twin content.

5. In paragraph 3, The step of defining the above multiple unit spaces is: A step of defining at least one unit space based on a three-dimensional position range corresponding to a three-dimensional position range of the input real-world space for at least one unit space among the plurality of unit spaces. A method for providing three-dimensional digital twin content, comprising:

6. In paragraph 1, The step of defining the above multiple unit spaces is: A step of automatically defining at least one unit space among the plurality of unit spaces based on a two-dimensional map corresponding to the real-world space. A method for providing three-dimensional digital twin content, comprising:

7. In paragraph 6, The step of automatically defining at least one unit space is: A method for providing three-dimensional digital twin content, which automatically defines a unit space corresponding to an administrative district or semantic unit district defined in relation to the real-world space on the two-dimensional map as at least one unit space.

8. In paragraph 6, The step of automatically defining at least one unit space is: A step of obtaining footprint information of an area corresponding to the real-world space on the above two-dimensional map; A step of matching the above footprint information to a three-dimensional model corresponding to the real-world space; and A step of defining at least one unit space within the matched three-dimensional model by using meta information associated with the above footprint information. A method for providing three-dimensional digital twin content, comprising:

9. In paragraph 8, The step of automatically defining at least one unit space is: A step of associating meta information associated with the footprint information to at least one unit space. A method for providing three-dimensional digital twin content, comprising:

10. In paragraph 6, The step of defining the above multiple unit spaces is: A step of matching POIs to objects included in a three-dimensional model corresponding to the real-world space based on location information about POIs included in a two-dimensional map corresponding to the real-world space; and A step of automatically defining at least one feature or a part thereof among the above-mentioned matched features as at least one unit space. A method for providing three-dimensional digital twin content, comprising:

11. In paragraph 10, The step of automatically defining at least one feature or a part thereof among the above-mentioned matched features as at least one unit space is as follows: A method for providing three-dimensional digital twin content, which automatically defines at least one feature satisfying a rule according to a predetermined condition among the above-mentioned matched features as at least one unit space.

12. In paragraph 1, The steps provided above are: A step of rendering the first 3D digital twin content to display the first 3D digital twin content in the user terminal; In the user terminal, a step of displaying a first user interface for entering a first unit space among the unit spaces in association with the rendered first three-dimensional digital twin content; and A step of rendering the second three-dimensional digital twin content so that the second three-dimensional digital twin content corresponding to the first unit space is displayed on the user terminal as the first user interface is selected by the user terminal. A method for providing three-dimensional digital twin content, comprising:

13. In paragraph 12, The steps provided above are: In the user terminal, a step of displaying a second user interface for entering a second unit space, which is a lower layer of the first unit space among the unit spaces, in relation to the rendered second three-dimensional digital twin content; and A step of rendering the third three-dimensional digital twin content so that the third three-dimensional digital twin content corresponding to the second unit space is displayed on the user terminal as the second user interface is selected by the user terminal. A method for providing three-dimensional digital twin content, comprising:

14. In paragraph 12, The step of rendering the above second three-dimensional digital twin content is: A method for providing three-dimensional digital twin content, rendering the second three-dimensional digital twin content so that the second three-dimensional digital twin content is displayed on the user terminal by at least one of: enlarging the second three-dimensional digital twin content among the first three-dimensional digital twin content and displaying it on the user terminal, relatively emphasizing the second three-dimensional digital twin content among the first three-dimensional digital twin content and displaying it, and de-displaying a portion of the first three-dimensional digital twin content other than the second three-dimensional digital twin content.

15. In paragraph 1, A step of providing a sharing function to the user terminal so that the second 3D digital twin content corresponding to the selected unit space can be shared with other users. A method for providing three-dimensional digital twin content, further comprising:

16. In paragraph 1, The step of defining the above multiple unit spaces is: A method for providing three-dimensional digital twin content defining at least one of the plurality of unit spaces based on a first input from the user terminal.

17. In paragraph 1, The steps for mapping the above content items are: A method for providing three-dimensional digital twin content, wherein a content item is mapped to at least one of the unit spaces based on a second input from the user terminal.

18. In paragraph 12, The first three-dimensional digital twin content and the second three-dimensional digital twin content are configured to provide real estate information for at least one building included in the real-world space, The steps for mapping the above content items are: Mapping real estate information of a set of buildings included in the real-world space in relation to a first unit space among the above unit spaces, Mapping real estate information for each building in the building set in relation to the second unit space among the above unit spaces; Mapping real estate information for each floor of each building in relation to the third unit space among the above unit spaces, and Mapping real estate information for each generation of each floor in relation to the fourth unit space among the above unit spaces A method for providing three-dimensional digital twin content, wherein the content item is mapped to each unit space by at least one of:

19. In Article 18, The above first three-dimensional digital twin content includes a three-dimensional model corresponding to the building set, The above first unit space corresponds to the first building among the buildings included in the above building set, The above first user interface is provided on the user terminal to enable selection of the first building, The step of rendering the above second three-dimensional digital twin content is: When the first user interface is selected, the second three-dimensional digital twin content including a three-dimensional model corresponding to the first building is rendered to display the second three-dimensional digital twin content on the user terminal, The rendered second three-dimensional digital twin content is, A second user interface for entering a second unit space corresponding to at least one of the high-rise, mid-rise and low-rise portions of the first building, which is a lower level of the first unit space, and real estate information for at least one of the high-rise, mid-rise and low-rise portions indicated by the second unit space A method for providing three-dimensional digital twin content, comprising:

20. In a computer system that provides three-dimensional digital twin content corresponding to real-world space, At least one processor configured to execute computer-readable instructions contained in memory Including, At least one processor of the above, Define a plurality of unit spaces, each of which corresponds to at least a part of the above real-world space and has a hierarchical relationship with each other, Map the content items associated with each unit space to each unit space of the above unit spaces, Based on the interaction from the user terminal, providing the first 3D digital twin content corresponding to the real-world space to the user terminal, A computer system that renders second three-dimensional digital twin content to display, on the user terminal, second three-dimensional digital twin content corresponding to a selected unit space among the unit spaces and including a content item mapped to the selected unit space, based on a selection from the user terminal.

Images