Apparatus and method for object information management based on virtual space

KR103023107B1Active Publication Date: 2026-09-21IND UNIV COOP FOUND KOAEA AEROSPACE UNIV
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
KR1020230068413
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-05-26
Publication Date
2026-09-21
Estimated Expiration
2043-05-26

Smart Images

  • Figure 112023058742915-PAT00001_ABST
    Figure 112023058742915-PAT00001_ABST
Patent Text Reader

Abstract

A device and method for managing object information based on a virtual space are disclosed. A method for managing object information based on a virtual space according to one embodiment of the present invention may include: (a) acquiring spatial data for a target space and user-generated data generated in relation to the target space; (b) extracting type information and location information of an object that existed or exists in the target space from the user-generated data; (c) generating a symbol corresponding to the object based on the type information; and (d) placing the symbol in a virtual space constructed to correspond to the target space using the location information and the spatial data.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to a device and method for managing object information based on a virtual space. For example, the present invention relates to a physics engine-based mixed reality 3D virtual space construction technology capable of effectively processing real-time sensor data.

[0002] This research was supported by funding from the project "Development of an Intelligent Service Platform for Spatial Information Convergence" (Research Period: August 1, 2017 – June 30, 2023). (Project Name: Gyeonggi Regional Cooperation Research Center (GRRC) Imaging, Audio-Spatial Convergence Technology Research Center, Supervising Agency: Gyeonggi Province) Background Technology

[0003] Recently, many users upload data such as text, photos, and videos to internet communities or social network services (SNS) to share with an unspecified number of people, and some of this includes real-time information related to the real world.

[0004] For example, there may be cases where a user discovers a wild bear while hiking or finds a collapsed retaining wall while walking and films it to upload to a community, and as another example, a user who visits an event such as a fair or local festival may upload social media about the event site to share it with acquaintances.

[0005] Meanwhile, entities such as public institutions are providing real-time data linked to various spaces through Open APIs, and utilizing this real-time data, various information is being provided to users in applications such as maps and bus / subway applications.

[0006] Therefore, real-time data provided by entities such as public institutions and data uploaded by various users can be processed (post-processed) using artificial intelligence models, and a physics engine-based 3D virtual space can be constructed that treats real-time information related to the real space corresponding to these results as real-time sensor data, allowing for visual and chronological organization and utilization. Since the virtual space constructed in this way can have the same positional relationship with the actual real space, it is expected to be utilized as a Mixed Reality service platform.

[0007] The technology forming the background of the present invention is disclosed in Korean Registered Patent Publication No. 10-2332818. The problem to be solved

[0008] The present invention aims to solve the problems of the aforementioned conventional technology by providing a virtual space-based object information management device and method that reflects data acquired in real space into a virtual space implementing topographic features having positional relationships equivalent to real space, thereby enabling verification of the flow of changes in various information linked to the space based on the actual location in real space, regardless of the flow of time.

[0009] The present invention aims to solve the problems of the aforementioned conventional technology by symbolizing and reflecting object information included in spatial data of a space and various user-generated data collected in conjunction with that space onto a virtual space constructed to correspond to real space, and to provide users with various content based on such object symbol information.

[0010] However, the technical problems that the embodiments of the present invention aim to solve are not limited to the technical problems described above, and other technical problems may exist. means of solving the problem

[0011] As a technical means for achieving the above-mentioned technical problem, a virtual space-based object information management method according to one embodiment of the present invention may include: (a) acquiring spatial data for a target space and user-generated data generated in relation to the target space; (b) extracting type information and location information of an object that existed or exists in the target space from the user-generated data; (c) generating a symbol corresponding to the object based on the type information; and (d) placing the symbol in a virtual space constructed to correspond to the target space using the location information and the spatial data.

[0012] In addition, a virtual space-based object information management method according to one embodiment of the present invention may include the step of (e) displaying information about at least some of the symbols on an interface that visualizes the virtual space and outputting it through a user terminal.

[0013] Additionally, the above step (e) may include a step of selecting the symbol to be output through the interface by considering the user information of the user.

[0014] In addition, the user-generated data may include image data.

[0015] In addition, the object can be identified from the image data.

[0016] In addition, the above location information can be obtained using the shooting parameters of the user terminal that captured the image data.

[0017] Additionally, the above step (b) may include the step of obtaining a reference position of the user terminal at the time of capturing the image data and the step of calculating the position information from the reference position using the shooting parameter which includes focal length information associated with the object identified from the image data.

[0018] Additionally, the above step (d) may include a step of determining at least one of the shape and position of the symbol using the spatial data.

[0019] Meanwhile, a virtual space-based object information management device according to one embodiment of the present invention may include a collection unit that acquires spatial data for a target space and user-generated data generated in relation to the target space; an object extraction unit that extracts type information and location information of an object that existed or exists in the target space from the user-generated data; and a symbol generation unit that generates a symbol corresponding to the object based on the type information and places the symbol in a virtual space constructed to correspond to the target space using the location information and the spatial data.

[0020] In addition, a virtual space-based object information management device according to one embodiment of the present invention may include an output unit that displays information regarding at least some of the symbols on an interface that visualizes the virtual space and outputs it through a user terminal.

[0021] In addition, the output unit may select the symbol to be output through the interface by taking into account the user information of the user.

[0022] In addition, the object extraction unit may obtain a reference position of the user terminal at the time of capturing the image data and calculate the position information from the reference position using the shooting parameter which includes focal length information associated with the object identified from the image data.

[0023] In addition, the symbol generation unit can determine at least one of the shape and position of the symbol using the spatial data.

[0024] The means for solving the problem described above are merely exemplary and should not be interpreted as intended to limit the present invention. In addition to the exemplary embodiments described above, additional embodiments may exist in the drawings and the detailed description of the invention. Effects of the invention

[0025] According to the means for solving the problem of the present invention described above, a virtual space-based object information management device and method can be provided that reflect data acquired in real space into a virtual space implementing topographic features having a positional relationship equivalent to real space, thereby enabling verification of the flow of changes in various information linked to the space based on the actual location in real space, regardless of the flow of time.

[0026] According to the solution to the problem of the present invention described above, information that can be usefully utilized in real space can be extracted from user-generated data generated by various entities in internet communities, social network services (SNS), etc., and reflected in virtual space.

[0027] According to the means for solving the problem of the present invention described above, spatial data of a space and object information included in various user-generated data collected in conjunction with the space are symbolized and reflected in a virtual space constructed to correspond to a real space, and various content based on such object symbol information can be provided to the user.

[0028] However, the effects obtainable from this invention are not limited to those described above, and other effects may exist. Brief explanation of the drawing

[0029] FIG. 1 is a schematic diagram of a virtual space service providing system including a virtual space-based object information management device according to one embodiment of the present invention. FIG. 2 is a conceptual diagram showing an example of uploading user-generated data through a first user terminal and displaying virtual space information through a second user terminal. FIG. 3 is a conceptual diagram illustrating the virtual space construction process of a virtual space-based object information management device according to one embodiment of the present invention. Figure 4 is a conceptual diagram illustrating a process for extracting and managing information about objects that existed or exist in the target space. FIG. 5 is a conceptual diagram illustrating the process of providing virtual space information of a virtual space-based object information management device according to one embodiment of the present invention. FIG. 6 is a schematic diagram of a virtual space-based object information management device according to one embodiment of the present invention. FIG. 7 is an operation flowchart of a virtual space-based object information management method according to one embodiment of the present invention. Specific details for implementing the invention

[0030] Embodiments of the present invention are described below with reference to the attached drawings to enable those skilled in the art to easily implement the invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0031] Throughout this specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" or "indirectly connected" with other elements interposed between them.

[0032] Throughout the entire specification, when a component is described as being located "on," "on top," "on top," "under," "on bottom," or "on bottom" of another component, this includes not only cases where the component is in contact with the other component but also cases where another component exists between the two components.

[0033] Throughout this specification, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0034] The present invention relates to a device and method for managing object information based on a virtual space. For example, the present invention relates to a physics engine-based mixed reality 3D virtual space construction technology capable of effectively processing real-time sensor data.

[0035] FIG. 1 is a schematic diagram of a virtual space service providing system including a virtual space-based object information management device according to one embodiment of the present invention.

[0036] Referring to FIG. 1, a virtual space service providing system (10) according to one embodiment of the present invention may include a virtual space-based object information management device (100) (hereinafter referred to as 'object information management device (100)'), a user terminal (200, 300), and an external server (400, 500).

[0037] The object information management device (100), user terminals (200, 300), and external servers (400, 500) can communicate with each other through a network (20). The network (20) refers to a connection structure that enables information exchange between each node, such as terminals and servers. Examples of such a network (20) include, but are not limited to, a 3GPP (3rd Generation Partnership Project) network, an LTE (Long Term Evolution) network, a 5G network, a WIMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Wi-Fi network, a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, and a DMB (Digital Multimedia Broadcasting) network.

[0038] The user terminal (200, 300) may be any type of wireless communication device, such as a smartphone, smartpad, tablet PC, PCS (Personal Communication System), GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal.

[0039] Meanwhile, in the description of the embodiments of the present invention, the user terminals (200, 300) may be classified into a first user terminal (200) that generates user-generated data collected by the object information management device (100) and a second user terminal (300) that receives and outputs an interface from the object information management device (100) that visualizes a virtual space in which a symbol corresponding to at least one object is placed, based on virtual space information generated by the object information management device (100), but is not limited thereto. It is preferable to understand that the distinction between the first user terminal (200) and the second user terminal (300) in the description of the embodiments of the present invention is determined relatively according to the content of the interaction with the object information management device (100) disclosed herein.

[0040] Additionally, in the description of the embodiments of the present invention, the external server (400, 500) may be a server or device operated by an entity that provides spatial data for a target space (actual space) corresponding to a virtual space constructed and managed by the object information management device (100) to the object information management device (100). For example, the external server (400, 500) may be classified into a public data server (400) and a topographical feature server (500), but is not limited thereto.

[0041] Below, the specific functions and operations of the object information management device (100) will be described.

[0042] The object information management device (100) can acquire spatial data for the target space and user-generated data generated in relation to the target space.

[0043] FIG. 2 is a conceptual diagram showing an example of uploading user-generated data through a first user terminal and displaying virtual space information through a second user terminal.

[0044] Referring to FIG. 2, the object information management device (100) can acquire image data captured by the first user terminal (200) of a part of the target space (real space) as user-generated data. For example, the object information management device (100) can acquire image data by crawling content (e.g., posts, etc.) on an online community or social network service (SNS) that is captured and uploaded by the first user terminal (200).

[0045] Additionally, with reference to FIG. 2, the object information management device (100) can identify location information reflected in user-generated data. Specifically, the object information management device (100) can identify location information linked to user-generated data based on the location (shooting location) information of the first user terminal (200) at the time of shooting of the image data acquired as user-generated data by acquiring the shooting parameters at the time of shooting using the first user terminal (200) together with the image data.

[0046] More specifically, referring to FIG. 2, the object information management device (100) can acquire shooting parameters or terminal positioning information (e.g., GPS information, etc.) including latitude information (Latitude; Lat), longitude information (Longitude; Lon), altitude information (Altitude; Alt), angle information (Angle, Ang), etc., together with image data.

[0047] For reference, in the description of the embodiments of the present invention, 'target space' may refer to a specific spatial range in which a virtual space corresponding to the real space is constructed by the object information management device (100) as a predetermined area (region, space) existing in reality. For example, the target space may be determined in various ways, such as a specific existing building, facility, park, mountain, lake, tourist attraction, etc.

[0048] In addition, the object information management device (100) disclosed herein can construct a virtual three-dimensional space corresponding to a target space using a physics engine, and the virtual space constructed using the physics engine is referred to as a 'virtual space'.

[0049] In this regard, referring to FIG. 2, the virtual space may be implemented so that topographical features of the real space (e.g., buildings, roads, etc.) correspond thereto, and the object information management device (100) disclosed herein may analyze and process user-generated data using an artificial intelligence-based analysis tool, etc. to identify objects existing in the space and paths that can be defined for the movement of pedestrians in the space, and may reflect (display) the identified objects and / or paths in the virtual space in real time by considering location information identified from the user-generated data.

[0050] Additionally, referring to FIG. 2, the object information management device (100) can support the user to intuitively check the flow of time in which data occurred by adjusting the time axis based on user input, etc., which is authorized through a second user terminal (300) that outputs virtual space-based content, and can reproduce the movement path of real space objects such as other users, vehicles, and structures according to the flow of time through the symbols described later.

[0051] FIG. 3 is a conceptual diagram illustrating the virtual space construction process of a virtual space-based object information management device according to one embodiment of the present invention.

[0052] Referring to FIG. 3, the object information management device (100) acquires spatial data for a target space (e.g., 'real-time public data', 'sensor data', etc. in FIG. 3) and user-generated data generated in relation to the target space (e.g., 'lifelog data', etc. in FIG. 3), processes the spatial data and user sensor data to create a database, and can provide the data to the user through a server.

[0053] Figure 4 is a conceptual diagram illustrating a process for extracting and managing information about objects that existed or exist in the target space.

[0054] Referring to FIG. 4, the object information management device (100) can extract type information and location information of an object that existed or exists in the target space from user-generated data.

[0055] Specifically, the object information management device (100) can identify objects from image data. In this regard, the object information management device (100) may possess an artificial intelligence-based object identification model that has been trained to separate the appearance area of ​​an object present (appearing) in the input image data from the background area and to recognize the type information (Class) of the object. For example, the object identification model may be a deep learning model, a machine learning model, a neural network model (artificial neural network model), a neuro-fuzzy model, etc., and the artificial intelligence model may be a neural network model for machine learning that has already been known in the past or will be developed in the future, such as a Convolutional Neural Network (CNN), a Recurrent Neural Network (RNN), a Deep Neural Network, etc., but is not limited thereto.

[0056] More specifically, according to one embodiment of the present invention, the object information management device (100) may have an object identification model constructed to perform semantic segmentation that outputs object classification information of each pixel constituting the input image data.

[0057] Meanwhile, in the description of the embodiments of the present invention, objects identified from user-generated data may broadly include structures that are fixedly present in the target space (e.g., stairs, handrails, wheelchair ramps, elevators, benches, lighting, fixed shops, etc.), objects that are movable and whose position changes within the target space and which existed at a location reflected in the image data at the time of shooting (e.g., other pedestrians, vehicles, wildlife, mobile shops, etc.), and objects that are temporarily recognized by specific situations occurring in the target space (e.g., vehicles involved in accidents, debris from collapsed structures, rainwater accumulated due to heavy rain, falling rocks, etc.). In this regard, the object information management device (100) may generate a symbol corresponding to the object based on the type information of the identified object in the form of a symbol, avatar, figure, or cropped image according to the type of the object.

[0058] In particular, the objects identified from user-generated data by the object information management device (100) disclosed herein may widely include various hazardous materials that are difficult to provide through conventional map / spatial information such as digital maps, such as wild animals, rocks, and puddles (potholes), and which can act as risk factors during the user's movement.

[0059] In addition, the objects identified from user-generated data by the object information management device (100) disclosed herein may broadly include various facilities / structures that affect the user's movement / walking convenience, such as ramps, elevators, stairs, handrails, braille blocks, sidewalk blocks, curbs, wheelchairs, strollers, and personal mobility devices, but whose existence is difficult to determine and whose precise location information is difficult to obtain through conventional map / spatial information such as digital maps.

[0060] In addition, since the object identified from user-generated data by the object information management device (100) disclosed herein may include objects that are movable and whose position changes within the target space as described above, or objects that are temporarily recognized by specific situations occurring in the target space, there is an advantage in that various information regarding object elements that a user visiting the target space should pay attention to or refer to can be provided by reflecting symbols generated in correspondence with the object in a virtual space and providing them to the user, even though it is difficult to reflect them on conventional maps / spatial information such as numerical maps due to the existence of time-series variability within the target space. In this regard, the object information management device (100) processes spatial data and user-generated data that reflect time information obtained in conjunction with user-generated data to create a database, and by adjusting the time axis based on user input, etc., it can support intuitive verification of the flow of time regarding the databased data.

[0061] Additionally, the object information management device (100) can calculate the location information of the object using the shooting parameters (e.g., latitude and longitude, altitude, shooting azimuth, time, etc. shown in FIG. 4) of the first user terminal (200) that captured the acquired image data.

[0062] In other words, the object information management device (100) can obtain a reference position (shooting position) of the user terminal (200) at the time of shooting the image data. Additionally, the object information management device (100) can calculate the position information (object position) of the object from the reference position using a shooting parameter that includes focal length information associated with the object identified from the image data.

[0063] Additionally, the object information management device (100) can generate a symbol corresponding to the object based on the type information of the identified object. For example, referring to FIG. 4, the symbol can be widely generated in the form of an image cropped from an area identified as corresponding to the object within the image data, a symbol according to the type of the object, an avatar, a figure, etc.

[0064] Meanwhile, according to one embodiment of the present invention, the type information of an object may include objects related to mobility convenience. For example, objects related to mobility convenience may include objects corresponding to elements that affect the user's movement / walking convenience, such as ramps, elevators, stairs, handrails, braille blocks, sidewalk blocks, curbs, wheelchairs, strollers, and personal mobility devices.

[0065] In addition, according to one embodiment of the present invention, the type information of an object may include objects related to risk factors. For example, the objects related to factors may include objects corresponding to factors that must be avoided for safety when moving or walking within the target space of the user, such as wild animals, rocks, and puddles (potholes).

[0066] In addition, according to one embodiment of the present invention, the object information management device (100) can generate a symbol such that the size, additional text insertion, color, etc. of the symbol are displayed with emphasis compared to other objects, so that the object that is redundantly recognized from multiple user-generated data at a given location is distinguished from other objects that have a relatively low number of recognitions from user-generated data and recognized by the user.

[0067] For example, in the case where the target space is a 'mountain,' regarding two objects at different locations recognized as identically corresponding to a 'bench,' the first object (bench) identified from a relatively large number of user-generated data (image data) may be located in a position suitable for many hikers to rest compared to the second object (bench) identified from a relatively small number of user-generated data (image data), or there may be a tendency for many users to perceive that location as a photo spot; therefore, even if the symbol generated corresponding to the first object corresponds to an object of the same type, it may be generated with an emphasized shape (e.g., high-saturation color, addition of highlight text such as 'popular,' expansion of symbol size, etc.) that can be more easily identified by the user compared to the symbol generated corresponding to the second object.

[0068] Additionally, the object information management device (100) can place a symbol generated using location information and spatial data in a virtual space that has been constructed to correspond to a target space. For example, the object information providing device (100) can place a symbol corresponding to an object identified in user-generated data (image data) on the constructed virtual space while considering the location information of the object, and can determine at least one of the shape and location of the symbol placed in the virtual space using spatial data already secured for the target space.

[0069] Additionally, the object information management device (100) can display information about at least some of the symbols placed on an interface that visualizes a virtual space corresponding to a target space and output it through a user terminal (300). In this regard, the object information management device (100) can select the symbols to be output through the interface by taking into account the user's user information.

[0070] For example, an object information management device (100) may obtain user information including personal details and preference information of a user of a second user terminal (300) that receives an interface for displaying virtual space-based symbols from the second user terminal (300), and may selectively display some of the symbols among a plurality of symbols generated corresponding to the target space according to the obtained user information on the interface.

[0071] For example, personal information may include the user's gender, age, occupation, address, etc., and preference information may include the purpose of exploration or visit to the virtual space, but is not limited to these; it goes without saying that various elements that can be considered to identify types of objects that a specific user might be interested in among the various objects that exist or existed in the target space can be treated as user information.

[0072] For example, if the object information management device (100) specifies a specific category among categories such as 'shopping', 'foodie tour', 'exercise', and 'date' for the user's purpose of visiting the target space, it can selectively reflect and output only the symbols with relatively high relevance to that category on the interface. To this end, the object information management device (100) may pre-possess type information for each object identified using user-generated data for the target space and meta information (numerical values, etc.) that evaluates the relevance to individual categories.

[0073] As another example, when the object information management device (100) obtains the user's age and gender information, it may prioritize reflecting on the interface a symbol generated in correspondence with an object identified from user-generated data created by users of the same gender in the corresponding age group, but is not limited thereto.

[0074] Additionally, according to one embodiment of the present invention, the object information management device (100) receives a selection input for a user's object type information from a second user terminal (300), and can selectively output a symbol corresponding to the type information corresponding to the received selection input on an interface.

[0075] For example, when a selection input is received from a second user terminal (300) for selecting type information corresponding to an object related to mobility convenience, the object information management device (100) can visualize an interface that includes a symbol generated corresponding to an object that affects the user's mobility / walking convenience, such as a ramp, elevator, stairs, handrail, braille block, sidewalk block, curbstone, wheelchair, stroller, personal mobility.

[0076] As another example, when a selection input is received from a second user terminal (300) for selecting type information corresponding to a risk factor-related object, the object information management device (100) can visualize an interface that includes a symbol generated corresponding to an object that must be avoided for safety when moving / walking within the user's target space, such as wild animals, rocks, or puddles (potholes).

[0077] In this regard, FIG. 5 is a conceptual diagram illustrating the process of providing virtual space information of a virtual space-based object information management device according to one embodiment of the present invention.

[0078] Referring to FIG. 5, the object information management device (100) can display information about at least some of the symbols placed corresponding to each object in an interface that visualizes a virtual space and output it through a second user terminal (300). To do this, terminal location information and time information are obtained from the second user terminal (300), and terrain / object data corresponding to the terminal location information is obtained from a terrain feature server (500), and the position, shape, size, etc. of the symbols output on the interface can be adjusted by taking into account the terrain slope, etc. at the corresponding location.

[0079] FIG. 6 is a schematic diagram of a virtual space-based object information management device according to one embodiment of the present invention.

[0080] Referring to FIG. 6, the object information management device (100) may include a collection unit (110), an object extraction unit (120), a symbol generation unit (130), and an output unit (140).

[0081] The collection unit (110) can obtain spatial data for the target space and user-generated data generated in relation to the target space.

[0082] The object extraction unit (120) can extract type information and location information of objects that existed or exist in the target space from user-generated data.

[0083] According to one embodiment of the present invention, the object extraction unit (120) can obtain a reference position of the user terminal (200) at the time of capturing the image data. Additionally, the object extraction unit (120) can calculate the position information of the object from the reference position using a shooting parameter that includes focal length information associated with the object identified from the image data.

[0084] The symbol generation unit (130) can generate a symbol corresponding to an object based on the type information of the identified object. Additionally, the symbol generation unit (130) can place the generated symbol using location information and spatial data in a virtual space that has been constructed to correspond to the target space.

[0085] Specifically, the symbol generation unit (130) can determine at least one of the shape and position of a symbol placed in a virtual space using spatial data already secured for the target space.

[0086] The output unit (140) can display information about at least some of the symbols placed in an interface that visualizes a virtual space corresponding to a target space and output it through a user terminal (300). In this regard, the output unit (140) can select the symbols to be output through the interface by taking into account the user's user information.

[0087] Below, based on the details described above, we will briefly examine the operation flow of the present invention.

[0088] FIG. 7 is an operation flowchart of a virtual space-based object information management method according to one embodiment of the present invention.

[0089] The virtual space-based object information management method illustrated in FIG. 7 can be performed by the object information management device (100) described above. Therefore, even if the content described below is omitted, the description of the object information management device (100) can be equally applied to the description of the virtual space-based object information management method.

[0090] Referring to FIG. 7, in step S11, the collection unit (110) can obtain (a) spatial data for the target space and user-generated data generated in relation to the target space.

[0091] Next, in step S12, the object extraction unit (120) can extract (b) type information and location information of an object that existed or exists in the target space from user-generated data.

[0092] Specifically, in step S12, the object extraction unit (120) can obtain the reference position of the user terminal (200) at the time of capturing the image data.

[0093] Additionally, in step S12, the object extraction unit (120) can calculate the position information of an object from a reference position using shooting parameters that include focal length information associated with an object identified from the image data. Specifically, in step S12, the object extraction unit (120) can calculate the relative position information of an object from a reference position of the user terminal (200) at the time of shooting the image data using shooting parameters obtained together with the image data (e.g., latitude, longitude, altitude, angle information, focal length information, etc.). In other words, the position information associated with the reference position may be identified using the obtained shooting parameters.

[0094] Next, in step S13, the symbol generation unit (130) can generate a symbol corresponding to the object based on the type information of (c) the object.

[0095] Next, in step S14, the symbol generation unit (130) can place the symbol generated using location information and spatial data in a virtual space that has been constructed to correspond to (d) the target space.

[0096] Specifically, in step S14, the symbol generation unit (130) can determine at least one of the shape and position of a symbol placed in a virtual space using spatial data already secured for the target space.

[0097] Next, in step S15, the output unit (140) can output information about at least some of the symbols placed in the interface that visualizes the virtual space corresponding to the target space (e) through the user terminal (300).

[0098] Specifically, in step S15, the output unit (140) can select a symbol to be output through the interface by considering the user's user information.

[0099] In the description above, steps S11 through S15 may be further divided into additional steps or combined into fewer steps according to an embodiment of the present invention. Additionally, some steps may be omitted as necessary, and the order between steps may be changed.

[0100] A virtual space-based object information management method according to one embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

[0101] In addition, the aforementioned virtual space-based object information management method can also be implemented in the form of a computer program or application executed by a computer and stored on a recording medium.

[0102] The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical concept or essential features of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0103] The scope of the present invention is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and the concept of equivalents thereof should be interpreted as being included within the scope of the present invention. Explanation of the symbols

[0104] 10: Virtual Space Service Provision System 100: Virtual space-based object information management device 110: Collection Department 120: Object Extraction Unit 130: Symbol generation section 140: Output section 200: First user terminal 300: Second user terminal 400, 500: External server 20: Network

Claims

Claim 1 A method for managing object information based on a virtual space, performed by a virtual space-based object information management device, comprising: (a) acquiring spatial data for a target space and user-generated data generated in relation to the target space; (b) extracting type information and location information of an object that existed or exists in the target space from the user-generated data; (c) generating a symbol corresponding to the object based on the type information; (d) placing the symbol in a virtual space constructed to correspond to the target space using the location information and the spatial data. The object information management method comprises: (e) a step of displaying information about at least some of the symbols on an interface that visualizes the virtual space and outputting it through a user terminal; wherein step (e) includes a step of selecting the symbols to be output through the interface by considering the user's user information; wherein the step of selecting the symbols is performed using meta-information that evaluates the correlation between a category reflecting the purpose of visiting the target space among the user information and the type information; and wherein step (c) is characterized by generating the symbols such that the more an object is redundantly recognized from multiple user-generated data, the more it is displayed with emphasis compared to other objects that have a relatively lower number of recognitions from user-generated data. Claim 2 delete Claim 3 delete Claim 4 A method for managing object information according to claim 1, wherein the user-generated data includes image data, and the object is identified from the image data. Claim 5 A method for managing object information according to claim 4, wherein the location information is obtained using the shooting parameters of a user terminal that captured the image data. Claim 6 In claim 5, the above step (b) comprises: a step of obtaining a reference position of the user terminal at the time of shooting the image data; and a step of calculating the position information from the reference position using the shooting parameter including focal length information associated with the object identified from the image data. Claim 7 A method for managing object information according to claim 1, wherein step (d) comprises determining at least one of the shape and position of the symbol using the spatial data. Claim 8 An object information management device based on a virtual space comprises: a collection unit for acquiring spatial data for a target space and user-generated data generated in relation to the target space; an object extraction unit for extracting type information and location information of an object that existed or exists in the target space from the user-generated data; a symbol generation unit for generating a symbol corresponding to the object based on the type information and placing the symbol in a virtual space constructed to correspond to the target space using the location information and the spatial data; and an output unit for displaying information regarding at least some of the symbols on an interface visualizing the virtual space and outputting it through a user terminal, wherein the output unit selects the symbol to be output through the interface by considering the user information of the user, and selects the symbol using meta-information that evaluates the correlation between the type information and a category reflecting the purpose of visiting the target space among the user information; and wherein the symbol generation unit generates the symbol such that an object that is redundantly recognized from multiple user-generated data is displayed with emphasis compared to other objects that have a relatively low number of recognitions from the user-generated data. Claim 9 delete Claim 10 delete Claim 11 An object information management device according to claim 8, wherein the user-generated data includes image data, and the object is identified from the image data. Claim 12 An object information management device according to claim 11, wherein the above location information is obtained using the shooting parameters of a user terminal that captured the above image data. Claim 13 In claim 12, the object extraction unit obtains a reference position of the user terminal at the time of shooting the image data, and calculates the position information from the reference position using the shooting parameter which includes focal length information associated with the object identified from the image data, an object information management device. Claim 14 In claim 8, the object information management device wherein the symbol generation unit determines at least one of the shape and position of the symbol using the spatial data. Claim 15 A computer-readable recording medium having a program for executing a method according to any one of paragraphs 1, 4 through 7 on a computer.

Citation Information

Patent Citations

  • Image processing apparatus, and image processing method

    JP2009104249A

  • Display control device, display control method, and recording medium

    JP2014191718A

  • Image processing device, image processing method, and program

    JP6933727B2

  • Augmented reality systems

    KR1020120093991A

  • Method, apparatus and computer-readable recording medium for providing traditional cultural properties content through mixed reality

    KR1020230064002A