Asset registration method and system for implementing virtual object from image

Abstract

The present invention provides an asset registration method comprising: recognizing a specific object from an image; searching for a mesh model corresponding to the specific object from a database; generating a virtual object corresponding to the specific object by using the mesh model; and registering the virtual object as an asset of a user account.

Description

Asset registration method and system for implementing virtual objects from images

[0001] The present invention relates to an asset registration method and an asset registration system for implementing a virtual object from an image.

[0002] Recently, interest has been growing in three-dimensional virtual spaces where social, economic, and cultural activities take place, just like in the real world. These virtual spaces can be implemented not only through devices like computers, laptops, and smartphones, but also through wearable devices, utilizing virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR).

[0003] In particular, virtual spaces are being developed in a wide range of fields, from autonomous driving to tourism and gaming, and thus, interest in methods to implement virtual spaces similar to real spaces to provide users with experiences similar to real life is also growing.

[0004] Meanwhile, as the value of valuing quality of life is rapidly rising in the current generation, interest in interior design for specific spaces where people work or rest (e.g., indoor and outdoor spaces) is increasing.

[0005] Users who want to design the interior of such spaces usually review the flooring, wallpaper, or furniture provided by interior design companies, but in this process, there is a lack of a way to check the space with the actual interior design completed.

[0006] Therefore, there are often cases where the user is not satisfied with the interior design while the construction is in progress or after it has been completed. In this process, disputes may arise with the interior design company, or the time and money consumed may increase as the interior is changed through additional construction.

[0007] Accordingly, there is a need for a method to implement a virtual space similar to an actual space, change the state of the interior in the virtual space, and check the completed state of the interior.

[0008] (Patent Document 1) Korean Patent Publication No. 10-2018-0106480 (October 1, 2018)

[0009] (Patent Document 2) Korean Patent No. 10-2364822 (February 15, 2022)

[0010] In addition, the present invention was derived from research conducted as part of the following national research and development project.

[0011] (National Research and Development Project 1)

[0012] Assignment ID: 1711193642

[0013] Assignment Number: 2021-0-00320-003

[0014] Ministry of Science and ICT

[0015] Project Management (Professional) Agency Name: Information and Communications Technology Planning and Evaluation Institute

[0016] Research Project Name: Development of Core Technology for Realistic Content

[0017] Research Project Name: Development of Real-Space Target XR Generation and Transformation / Augmentation Technology

[0018] Contribution rate: 1 / 3

[0019] Project implementation organization name: Electronics and Telecommunications Research Institute

[0020] Research period: January 1, 2023 - December 31, 2023

[0021] (National Research and Development Project 2)

[0022] Assignment ID: 1711159733

[0023] Assignment Number: 2021-0-00320-002

[0024] Ministry of Science and ICT

[0025] Project Management (Professional) Agency Name: Information and Communications Technology Planning and Evaluation Institute

[0026] Research Project Name: Development of Core Technology for Realistic Content

[0027] Research Project Name: Development of Real-Space Target XR Generation and Transformation / Augmentation Technology

[0028] Contribution rate: 1 / 3

[0029] Project implementation organization name: Electronics and Telecommunications Research Institute

[0030] Research period: January 1, 2022 - December 31, 2022

[0031] (National Research and Development Project 3)

[0032] Assignment ID: 1711134463

[0033] Assignment Number: 2021-0-00320-001

[0034] Ministry of Science and ICT

[0035] Project Management (Professional) Agency Name: Information and Communications Technology Planning and Evaluation Institute

[0036] Research Project Name: Development of Core Technology for Realistic Content (R&D)

[0037] Research Project Name: Development of Real-Space Target XR Generation and Transformation / Augmentation Technology

[0038] Contribution rate: 1 / 3

[0039] Project implementation organization name: Electronics and Telecommunications Research Institute

[0040] Research period: April 1, 2021 - December 31, 2021

[0041] The present invention relates to an asset registration method and an asset registration system capable of implementing a virtual object from an image and placing the virtual object in a virtual space according to a user input.

[0042] In addition, the present invention relates to an asset registration method and an asset registration system that change the appearance of a virtual object according to user input.

[0043] In addition, the present invention relates to an asset registration method and an asset registration system that can share a virtual space in which virtual objects are placed with different users.

[0044] In addition, the present invention relates to an asset registration method and an asset registration system that share a virtual space in which a virtual object is placed with another user, and enable a user who has shared the virtual space to replace a virtual object placed in the virtual space with another virtual object.

[0045] In order to solve the problem discussed above, the asset registration method according to the present invention may include the steps of recognizing a specific object in an image; searching a mesh model corresponding to the specific object from a database; creating a virtual object corresponding to the specific object using the mesh model; and registering the virtual object as an asset of a pre-specified user account.

[0046] In addition, the asset registration system according to the present invention includes a storage unit in which an image is stored; and a control unit that recognizes a specific object in the image and creates a virtual object corresponding to the specific object, wherein the control unit can search for a mesh model corresponding to the specific object from a database, create a virtual object corresponding to the specific object using the mesh model, and register the virtual object as an asset of a user account specified in advance.

[0047] In addition, a program stored in a computer-readable recording medium according to the present invention is a program stored in a computer-readable recording medium, which is executed by one or more processes in an electronic device, and the program may include commands to perform the steps of: recognizing a specific object in an image; searching a mesh model corresponding to the specific object from a database; creating a virtual object corresponding to the specific object using the mesh model; and registering the virtual object as an asset of a pre-specified user account.

[0048] According to various embodiments of the present invention, an asset registration method and an asset registration system recognize a specific object in an image, implement it as a virtual object, and place the virtual object in a virtual space according to a user input, thereby enabling the placement of a specific object to be confirmed in various ways before placing the specific object in a real space or before changing the position of the specific object in the real space.

[0049] In addition, according to various embodiments of the present invention, the asset registration method and the asset registration system can change the appearance of a virtual object implemented based on an actual image according to a user input, thereby allowing a user in a virtual space to change the appearance of a virtual object according to his or her intention and test various arrangements, and efficiently search for the appearance of an object that best suits the space.

[0050] In addition, according to various embodiments of the present invention, the asset registration method and the asset registration system can be implemented to provide a place to sell products similar to virtual objects placed in a virtual space, thereby placing the product most suitable for the user's intention at the most suitable location in the real space.

[0051] In addition, according to various embodiments of the present invention, the asset registration method and the asset registration system share a virtual space in which a virtual object is placed with another user, and the user who has shared the virtual space replaces the virtual object placed in the virtual space with another virtual object, thereby enabling each user to clearly express his or her intention during a collaborative process between different users.

[0052] In addition, according to various embodiments of the present invention, the asset registration method and the asset registration system can effectively shorten the process for deriving an agreed opinion in a collaborative process between different users by comparing a virtual object placed in a virtual space by a specific user with a virtual object replaced by a user who shares the virtual space, and providing other similar virtual objects based on the comparison result.

[0053] Figures 1 to 3 illustrate an asset registration system according to the present invention.

[0054] Figure 4 is a flowchart of an asset registration method according to the present invention.

[0055] Figures 5 to 8 illustrate an embodiment of generating a virtual object based on a spatial image.

[0056] Figure 9 illustrates an embodiment of registering assets to a user account.

[0057] Figures 10a to 12b illustrate an embodiment of placing a virtual object in a virtual space.

[0058] Figure 13a illustrates an embodiment of transforming a virtual object.

[0059] Figure 13b illustrates an embodiment of providing a product similar to a virtual object.

[0060] Figure 14 illustrates an embodiment of registering a virtual space to a user account.

[0061] Figures 15a to 16 illustrate an embodiment providing another virtual space in which similar virtual objects are placed.

[0062] Figures 17a to 18b illustrate an embodiment of sharing a virtual space.

[0063] Figure 19 illustrates an embodiment of comparing different virtual objects.

[0064] Figures 1 to 3 illustrate an asset registration system according to the present invention.

[0065] Referring to FIG. 1, the asset registration system (100) according to the present invention can recognize a specific object (11) in a spatial image (10), create a virtual object (20) corresponding to the recognized specific object (11), and register it as a user's asset.

[0066] Here, the spatial image (10) may be an image or video taken of a specific space, and this spatial image (10) may be input from the outside or taken through a user terminal.

[0067] In this regard, user terminals may be referred to as tablets, personal computers, smartphones, and wearable devices. In such cases, the asset registration system (100) may be implemented to be provided through user terminals such as tablets, personal computers, smartphones, and wearable devices. For example, the asset registration system (100) may be provided in the form of an application or software, or may be provided on a web page.

[0068] Accordingly, the asset registration system (100) can acquire a spatial image (10) by capturing a specific space using a photographing module (e.g., a camera, a webcam, etc.) implemented in a user terminal. In addition, the asset registration system (100) can also acquire an image or video previously stored in the user terminal as a spatial image (10). In addition, the asset registration system (100) can also acquire an image or video received from another external device as a spatial image (10).

[0069] A specific object (11) is an actual object captured in a spatial image (10), and various material objects such as furniture, electronic products, lighting, clothing, office supplies, hobby supplies, interior decoration items, and vehicles can be referenced.

[0070] The virtual object (20) may be implemented as a three-dimensional model corresponding to a specific object (11). Accordingly, the virtual object (20) may have a similar shape to the specific object (11) and may be implemented to have similar physical characteristics to the physical characteristics of the specific object (11) in the virtual space.

[0071] In one embodiment, the virtual object (20) may be implemented based on a mesh model. That is, the virtual object (20) may include a plurality of vertices, edges connecting each vertex, and a polygon formed by the plurality of edges.

[0072] Additionally, the virtual object (20) may include a texture applied to the surface of the mesh model. For example, the texture is an image applied to the surface of the mesh model, and the area applied to each face (or polygon) of the mesh model may be predetermined within the image.

[0073] At this time, the texture may include information such as color and material for each area of ​​the virtual object (20). Therefore, the texture of the virtual object (20) may be applied to the mesh model, so that the color and material of a specific object (11) may be implemented.

[0074] In addition, the virtual space is a three-dimensional space implemented in advance for placing a virtual object (20), and can be implemented in various sizes so that the virtual object (20) can be placed. In addition, the virtual space may include a background image determined in advance according to the characteristics of the space in which the virtual object (20) is placed. In this case, the size of the virtual space may be set to a predetermined size or may be set based on user input.

[0075] For example, a virtual space can be implemented to include background images suitable for indoor settings, such as a bedroom, office, kitchen, living room, or study, or for outdoor settings, such as a park, mountain, valley, or ocean. Furthermore, a virtual space can be implemented as an empty space with a predetermined size.

[0076] For another example, a virtual space may be implemented by recognizing a background image in a spatial image (10). In this case, the asset registration system (100) may recognize an area in the spatial image (10) excluding a specific object (11) as a background area and generate a background image based on the recognized background area. Accordingly, the asset registration system (100) may implement a virtual space by inserting a background image into an empty space of a predetermined size.

[0077] These virtual spaces can be implemented based on virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR), and can be implemented to be accessible using various platforms provided through user terminals.

[0078] Meanwhile, the asset may include data generated based on user input. For example, the asset may include a virtual object (20) generated by recognizing a specific object (11) in a spatial image (10) based on user input. As another example, the asset may include a virtual object (20) generated from a specific object (11) and transformed based on user input. As yet another example, the asset may include a virtual space in which a virtual object (20) is placed based on user input.

[0079] That is, the asset registration system (100) can register the assets of a specific user by matching and storing information related to a virtual object (20) and information related to a virtual space in a user account previously stored for the specific user.

[0080] Here, a user account may include personal information about the user, such as an ID, password, name, and date of birth. These user accounts may be established based on user input.

[0081] For example, the asset registration system (100) can receive user account information via a user terminal. At this time, the asset registration system (100) can register the user as a member based on the user account. Accordingly, a user registered as a member can log into the asset registration system (100) based on the user account entered during member registration, thereby checking information such as pre-stored user accounts, virtual objects, and virtual spaces.

[0082] Meanwhile, referring to FIG. 2, the asset registration system (100) according to the present invention places a virtual object (20) in a predetermined virtual space (30), shares the virtual space (30) in which the virtual object (20) is placed through different user terminals, and can replace the virtual object (20) with another virtual object in the shared virtual space (30).

[0083] Through this, the asset registration system (100) can check a virtual space (30) in which a virtual object (20) is placed through a specific user terminal from another user terminal, replace the virtual object (20) placed in the virtual space (30) with another virtual object, and check the virtual space in which the other virtual object is placed again from the specific user terminal.

[0084] At this time, the asset registration system (100) can match and store information related to a virtual object (20) and information related to a virtual space (30) in a user account previously saved for a specific user.

[0085] Referring to FIG. 3, the asset registration system (100) according to the present invention may include an input unit (110), a communication unit (120), an output unit (130), a storage unit (140), and a control unit (150).

[0086] The input unit (110) can input a spatial image (10). For example, the input unit (110) can input a spatial image (10) based on a user input through a user terminal.

[0087] Additionally, the input unit (110) can receive user input for changing the appearance of a virtual object (20) and user input for placing a virtual object (20) in a virtual space (30).

[0088] In addition, the input unit (110) can receive user input for sharing the virtual space (30) with another user terminal. In addition, the input unit (110) can receive user input for replacing a virtual object (20) placed in the virtual space (30) with another virtual object.

[0089] Additionally, the input unit (110) can input user input for executing the overall operation of the asset registration system (100).

[0090] The communication unit (120) can be connected to an external device via a wireless or wired network. Accordingly, the communication unit (120) can receive information required for the overall operation of the asset registration system (100) from the external device.

[0091] For example, the communication unit (120) can receive information related to a virtual object (20) and information related to a virtual space (30) from another user terminal. In addition, the communication unit (120) can receive information related to a product corresponding to the virtual object (20) from a predetermined web server, such as detailed information about the product and a purchase page for the product.

[0092] The output unit (130) can output a virtual object (20) generated based on a spatial image (10). For example, the output unit (130) can output the virtual object (20) so that a user can visually confirm it through a display screen of a user terminal.

[0093] Additionally, the output unit (130) can output information related to the virtual object (20) and information related to the virtual space (30). Additionally, the output unit (130) can output information related to a product corresponding to the virtual object (20).

[0094] The storage unit (140) can store data and commands required for the overall operation of the asset registration system (100) according to the present invention.

[0095] For example, the storage unit (140) may store a spatial image (10), a virtual object (20), and commands required to create a virtual object (20) from the spatial image (10). In addition, the storage unit (140) may store a user account.

[0096] Additionally, the storage unit (140) stores commands required to implement a virtual space (30), and commands required to place a virtual object (20) in the virtual space (30) can be stored.

[0097] The control unit (150) can control the overall operation of the asset registration system (100) according to the present invention. For example, the control unit (150) can generate a virtual object (20) from a spatial image (10) and transform the virtual object (20) based on user input.

[0098] In addition, the control unit (150) can place a virtual object (20) in a predetermined virtual space (30) based on user input, and adjust the position and direction of the virtual object (20) placed in the virtual space (30).

[0099] In addition, the control unit (150) can obtain information related to a product corresponding to a virtual object (20) based on user input and provide the information to the user.

[0100] In addition, the control unit (150) can share the virtual space (30) with other user terminals and replace the virtual object (20) placed in the virtual space (30) with another virtual object.

[0101] Through the above configurations, the asset registration system (100) according to the present invention recognizes a specific object in an image, implements it as a virtual object, and places the virtual object in a virtual space according to a user input, thereby enabling the placement of a specific object to be confirmed in various ways before placing the specific object in a real space or before changing the location of the specific object in the real space.

[0102] In addition, the asset registration system (100) according to the present invention can implement a highly complete space through collaboration with other users by placing virtual objects in a virtual space and sharing the virtual space in which the virtual objects are placed with other users.

[0103] Based on the configuration of the asset registration system (100) discussed above, the asset registration method will be described in more detail below.

[0104] Figure 4 is a flowchart of an asset registration method according to the present invention. Figures 5 to 8 illustrate an embodiment of creating a virtual object based on a spatial image. Figure 9 illustrates an embodiment of registering an asset to a user account. Figures 10a to 12b illustrate an embodiment of placing a virtual object in a virtual space. Figure 13a illustrates an embodiment of modifying a virtual object. Figure 13b illustrates an embodiment of providing a product similar to a virtual object. Figure 14 illustrates an embodiment of registering a virtual space to a user account. Figures 15a to 16 illustrate an embodiment of providing another virtual space in which similar virtual objects are placed. Figures 17a to 18b illustrate an embodiment of sharing a virtual space. Figure 19 illustrates an embodiment of comparing different virtual objects.

[0105] Referring to FIG. 4, the asset registration system (100) according to the present invention can recognize a specific object in a spatial image (S100).

[0106] Specifically, the asset registration system (100) can recognize a specific object corresponding to a specific point according to a user input selecting a specific point with respect to a spatial image.

[0107] Referring to FIG. 5a, for example, the asset registration system (100) may receive a user input for selecting a specific point corresponding to a sofa in a spatial image (10) in which a sofa and a table are captured. Accordingly, as shown in FIG. 5b, the asset registration system (100) may recognize an area including the selected specific point as a specific object (12) based on the user input.

[0108] To this end, the asset registration system (100) can analyze the color and frequency domains of a plurality of pixels included in a spatial image to estimate depth information for each pixel, and recognize a plurality of objects included in the spatial image based on the estimated depth information.

[0109] Accordingly, the asset registration system (100) can recognize any object including a point selected according to user input as a specific object (12).

[0110] Alternatively, the asset registration system (100) can estimate boundaries for different objects by analyzing the color and frequency domains of multiple pixels included in a spatial image. Accordingly, the asset registration system (100) can recognize areas corresponding to one or more objects included in the spatial image based on the estimated boundaries.

[0111] Accordingly, the asset registration system (100) can recognize any object including a point selected according to user input as a specific object (12).

[0112] Furthermore, the asset registration system (100) can specify a category for a previously recognized specific object. In this case, the category for the specific object may refer to a category corresponding to the external appearance of the specific object among multiple categories predefined to indicate the type of the specific object.

[0113] Specifically, the asset registration system (100) can extract feature points from a previously recognized specific object. At this time, the asset registration system (100) can extract feature points using feature point extraction techniques such as Harris corner, Shi & Tomasi, SIFT-DoG, and FAST.

[0114] Accordingly, the asset registration system (100) can compare feature point information predetermined for each category with feature points extracted from a specific object, and specify a category for a specific object based on the comparison result.

[0115] Alternatively, the asset registration system (100) may be equipped with an artificial neural network trained to output a category corresponding to a specific object when an image of a specific object is input, using a learning object image in which label data is labeled by category.

[0116] In this case, the asset registration system (100) can obtain a category corresponding to a specific object by inputting an image of the recognized specific object into a pre-trained artificial neural network when a specific object is recognized based on a user input.

[0117] Furthermore, the asset registration system (100) can specify a first category for a previously recognized specific object and re-specify a second category included in the first category.

[0118] For example, the first category may be a category for a space in which a specific object is placed, and the second category may be a category indicating the types of objects that can be placed in the space according to the first category.

[0119] Depending on the embodiment, the first category may refer to an office, bedroom, bathroom, airport, game room, classroom, parking lot, etc., and the second category may refer to a chair, bed, desk, computer, laptop, blackboard, table lamp, ceiling lamp, window frame, curtain, parking stopper, etc.

[0120] Furthermore, the asset registration system (100) can estimate an area where a specific object selected according to user input is obscured by another object, and restore the estimated area.

[0121] For example, the asset registration system (100) can restore an area where a specific object is covered by another object by using an object restoration model that has been learned in advance for each category specified in advance for a specific object.

[0122] In such cases, the object restoration model can be implemented to learn the appearance of objects by category using real images, generate a simulated image by simulating the appearance of previously learned objects from noise images, and repeat the process of comparing the simulated image with the real image and re-learning the appearance of the object based on the comparison result.

[0123] Such object restoration models can be performed based on generative adversarial networks, and other conventionally known techniques may also be used.

[0124] As another example, the asset registration system (100) may restore the occluded area of ​​a specific object by specifying an occluded area for a specific object and estimating the pixel values ​​of the occluded area by performing interpolation on the distribution of a plurality of pixel values ​​adjacent to the specified area.

[0125] Referring again to FIG. 4, the asset registration system (100) according to the present invention can search for a mesh model corresponding to the specific object from a predetermined database (S200).

[0126] Specifically, the asset registration system (100) may be provided with a database that includes multiple different mesh models for each category related to a specific object.

[0127] Referring to FIG. 6, for example, the asset registration system (100) may store in advance virtual objects (21) (or mesh models) corresponding to a single-person leather chair (21a), a multi-person leather chair (21b), and a single-person wooden chair (21c) for a category including a virtual object (21) (or mesh model) related to a chair.

[0128] Accordingly, when a specific object (12) is recognized and a category for the specific object (12) is specified, the asset registration system (100) can specify (or acquire) a mesh model (31) most similar to the specific object (12) from a database corresponding to the category.

[0129] For example, referring to FIG. 7a, the asset registration system (100) may include a pre-trained artificial neural network so that when a specific object is input by category for a specific object, a mesh model corresponding to the specific object is output.

[0130] Accordingly, as shown in FIG. 7b, when a specific object is recognized, the asset registration system (100) can input the specific object into a pre-learned artificial neural network to obtain a mesh model corresponding to the specific object.

[0131] For another example, the asset registration system (100) may store feature point information corresponding to a specific object in advance, matched to each of a plurality of mesh models included in the database. Accordingly, the asset registration system (100) may extract feature points from a specific object, and, among the feature point information corresponding to the feature points extracted from the specific object among the feature point information matched to each of the plurality of mesh models, thereby specifying a mesh model corresponding to the specific object.

[0132] Furthermore, the asset registration system (100) can apply the color of a specific object in a spatial image as a texture to a mesh model.

[0133] Specifically, the asset registration system (100) can specify one or more areas having different colors in a specific object. Accordingly, the asset registration system (100) can specify areas corresponding to each area of ​​a specific object in a mesh model, and assign colors to each area of ​​the mesh model based on pixel values ​​contained in each area of ​​the specific object.

[0134] For example, the asset registration system (100) can adjust the size of the mesh model or rotate the mesh model to adjust it to a shape most similar to a specific object. At this time, the asset registration system (100) can analyze the posture of a specific object with respect to multiple directions (e.g., yaw, pitch, roll) and adjust the size and direction of the mesh model based on the analysis results.

[0135] Accordingly, the asset registration system (100) can divide the object model into multiple regions by comparing multiple pixels included in the object model with multiple regions pre-specified for the mesh model.

[0136] Next, the asset registration system (100) can specify the color of each region based on the pixel values ​​of the plurality of regions divided in the object model, and apply the specified color to the region of the mesh model corresponding to each of the plurality of regions divided in the object model.

[0137] As another example, the asset registration system (100) can determine a predetermined area-specific color for a mesh model based on the pixel value of a specific object.

[0138] To this end, the asset registration system (100) can specify an area corresponding to a predetermined area of ​​a mesh model for a specific object. Accordingly, the asset registration system (100) can determine the color of a predetermined area of ​​a mesh model based on pixel values ​​contained in the predetermined area for a specific object.

[0139] Referring again to FIG. 4, the asset registration system (100) according to the present invention can create a virtual object corresponding to a specific object using a mesh model (S300).

[0140] Specifically, the asset registration system (100) can compare a mesh model with a specific object and adjust the position of at least one of a plurality of vertices constituting the mesh model based on the comparison result.

[0141] Referring to FIG. 8, for example, the asset registration system (100) can compare a specific object (13) and a mesh model (31) by overlapping them, and based on the comparison result, adjust the positions of vertices included in the mesh model (31) so that the appearance of the mesh model (31) corresponds to the specific object.

[0142] Accordingly, the asset registration system (100) can generate a corrected virtual object (32) based on the position of the adjusted vertex.

[0143] As another example, the asset registration system (100) can adjust the positions of vertices implemented in the mesh model based on information related to the boundary of a specific object, and map a texture to the mesh model based on information related to a specific object.

[0144] At this time, the asset registration system (100) may correct the previously mapped texture based on the previously adjusted vertex positions and map the corrected texture to the mesh model. Alternatively, the asset registration system (100) may correct the texture after the vertex positions of the mesh model have been adjusted and map the corrected texture to the mesh model.

[0145] Through this, the asset registration system (100) can create a virtual object corresponding to a specific object.

[0146] Referring again to FIG. 4, the asset registration system (100) according to the present invention can register a virtual object as an asset of a user account (S400).

[0147] Specifically, the asset registration system (100) can generate virtual object information to represent a virtual object generated from a spatial image, and store the generated virtual object information by matching it to a user account.

[0148] Referring to FIG. 9, for example, the asset registration system (100) can generate a registration number as virtual object information for a virtual object generated from a spatial image, and store the generated registration number by matching it to a user account.

[0149] Through this, when a plurality of virtual objects (20a, 20b, 20c, 20d) are created from one or more spatial images, the asset registration system (100) can assign a registration number to each of the plurality of virtual objects (20a, 20b, 20c, 20d) and store the plurality of registration numbers assigned to each virtual object (20a, 20b, 20c, 20d) by matching them to a user account.

[0150] As another example, the asset registration system (100) can check whether an identical virtual object has been previously created for a virtual object created from a spatial image, and if an identical virtual object has not been previously created, can generate a serial number as virtual object information, and store the generated serial number by matching it to a user account.

[0151] Additionally, the asset registration system (100) can store the serial number assigned to the previously created identical virtual object by matching it to the user account if the same virtual object has been created previously.

[0152] Furthermore, the asset registration system (100) according to the present invention can specify at least one asset to be placed in a predetermined virtual space among a plurality of assets registered according to a user account based on a user input, and can render a virtual object corresponding to at least one asset previously specified based on the user input at a location corresponding to the user input in the virtual space.

[0153] Referring to FIG. 10A, for example, the asset registration system (100) may implement a virtual space (40) based on a user input selecting one of a plurality of pre-stored virtual spaces. Subsequently, the asset registration system (100) may specify a virtual object (22) to be placed in the virtual space (40) based on a user input specifying one of a plurality of virtual objects (20) matched to a user account.

[0154] Accordingly, the asset registration system (100) can place the specified virtual object (22) at the specified location (41) based on a user input selecting a specific location (41) on the previously implemented virtual space (40), as shown in FIG. 10b.

[0155] For another example, the asset registration system (100) may implement a virtual space based on user input that sets at least one of the size and background of the virtual space. Subsequently, the asset registration system (100) may display one or more virtual objects matching a user account on one side of the virtual space, and, based on user input selecting one of the displayed one or more virtual objects, may specify a virtual object to be placed in the virtual space.

[0156] Accordingly, the asset registration system (100) can place a specified virtual object at a specific point in a virtual space based on a user input selecting the specific point in the virtual space when the virtual object is specified.

[0157] As another example, the asset registration system (100) may display one or more virtual objects matching a user account on one side of a specific point in a virtual space based on a user input selecting the specific point. Accordingly, the asset registration system (100) may place the selected virtual object on the specific point based on a user input selecting one of the displayed one or more virtual objects.

[0158] Furthermore, the asset registration system (100) can specify a virtual object whose position in the virtual space is to be changed among a plurality of virtual objects placed in the virtual space based on user input, and can re-render the previously specified virtual object in the virtual space at a position corresponding to the user input based on the user input.

[0159] Referring to FIG. 11a, for example, the asset registration system (100) can receive a user input for selecting one virtual object (23) among a plurality of virtual objects placed in a virtual space (40) to change its position according to the user input.

[0160] Accordingly, as shown in FIG. 11b, the asset registration system (100) can specify a virtual object (23) selected based on user input, and then, based on user input selecting a specific location (42) in the virtual space (40), place the specified virtual object (23) at the specific location (42).

[0161] As another example, the asset registration system (100) may receive a user input to drag one of a plurality of virtual objects placed in the virtual space to a different location in the virtual space. In this case, the asset registration system (100) may re-render the dragged virtual object at the different location.

[0162] Furthermore, the asset registration system (100) can specify a virtual object to be changed to another virtual object among a plurality of virtual objects placed in a virtual space based on a user input, and can replace the previously specified virtual object with the other virtual object based on a user input selecting a virtual object different from the specified virtual object.

[0163] Referring to FIG. 12a, for example, the asset registration system (100) can receive a user input to select one virtual object (24) among a plurality of virtual objects placed in a virtual space (40) to be changed to another virtual object according to the user input.

[0164] Accordingly, as shown in FIG. 12b, the asset registration system (100) can receive user input for specifying a virtual object (24) selected based on user input and selecting another virtual object (25a) to replace the virtual object (24) among a plurality of virtual objects (20) matched to the user account.

[0165] Through this, the asset registration system (100) can remove a previously rendered virtual object (24) from the virtual space and render another virtual object (25) specified according to user input at the same location as the virtual object (24).

[0166] For another example, the asset registration system (100) may receive a user input for selecting one of a plurality of virtual objects matched to a user account. In this case, the asset registration system (100) may replace one or more virtual objects classified into the same category as the virtual object selected according to the user input, among the plurality of virtual objects implemented in the virtual space, with the virtual object selected according to the user input.

[0167] Furthermore, the asset registration system (100) may receive, from a predetermined server device, another virtual object classified into the same category as the virtual object placed in the virtual space, remove the virtual object placed in the virtual space, and place the other virtual object received from the server device in the location where the virtual object was removed.

[0168] For example, the asset registration system (100) may receive user input to change a first virtual object placed in a virtual space to a third virtual object different from the first virtual object. In this case, the asset registration system (100) may transmit information related to the first virtual object (e.g., a category corresponding to the first virtual object) to a predetermined server device.

[0169] Through this, the asset registration system (100) can receive a third virtual object belonging to the same category as the first virtual object from the server device. Accordingly, the asset registration system (100) can replace the first virtual object placed in the virtual space with the third virtual object.

[0170] At this time, when the asset registration system (100) receives one third virtual object from the server device, it replaces the first virtual object with the third virtual object, and when it receives multiple third virtual objects from the server device, it displays multiple third virtual objects through the user terminal, specifies one of the multiple third virtual objects based on a user input, and replaces the first virtual object placed in the virtual space with the specified one third virtual object.

[0171] In this regard, the predetermined server device may be a server that implements a virtual object based on information crawled from a website such as a shopping mall or portal site.

[0172] For example, a predetermined server device can collect images from a website, recognize specific objects contained in the collected images, and create a virtual object. The virtual object created from the collected images can include information related to the website from which the images were collected (e.g., links, product information, etc.).

[0173] In such a case, the third virtual object may be a virtual object created based on an image collected from a website selling products in the category to which the first virtual object belongs.

[0174] Alternatively, the predetermined server device may be a server that stores virtual objects created by an asset registration system (100) implemented for another user.

[0175] For example, when a virtual object is created based on a spatial image, the asset registration system (100) can transmit information related to the created virtual object (e.g., the virtual object and category) to a server device. Accordingly, the server device can receive information related to the virtual object from the asset registration system (100) and store the virtual object by category.

[0176] Through this, the server device can receive a category for a virtual object from the asset registration system (100) and provide a virtual object corresponding to the received category to the asset registration system (100).

[0177] In this case, the third virtual object may be a virtual object belonging to the same category as the first virtual object among a plurality of virtual objects generated by another user terminal recognizing a specific object from a spatial image.

[0178] Furthermore, the asset registration system (100) can change the appearance of a virtual object based on user input.

[0179] Specifically, the asset registration system (100) can specify at least one of a plurality of vertices included in a mesh model corresponding to a virtual object based on a user input selecting a specific point on a virtual object, and can move the position of the previously specified vertex based on a user input selecting a point different from the previously selected specific point within a predetermined range from the virtual object.

[0180] For example, the asset registration system (100) can specify one or more vertices implemented at the bottom among a plurality of vertices included in a mesh model created in the shape of a chair based on a user input selecting the end of a leg of a chair for a virtual object created in the shape of a chair.

[0181] Next, the asset registration system (100) can increase or decrease the leg length of the chair by moving the position of the previously specified vertex based on a user input of selecting a specific point within a predetermined range from the virtual object.

[0182] At this time, the asset registration system (100) can specify all vertices corresponding to the four legs of a chair-shaped mesh model implemented with four legs. Alternatively, the asset registration system (100) can specify a single vertex selected based on user input. In this case, the asset registration system (100) can also move the vertices corresponding to the other three legs implemented in the mesh model based on the position of the single selected vertex.

[0183] Through this, the asset registration system (100) can create another virtual object with a deformed appearance from a virtual object using a mesh model with moved vertex positions.

[0184] Furthermore, when the shape of the virtual object is transformed according to user input, the asset registration system (100) may correct the texture of the virtual object so that it is mapped to the transformed mesh model according to the transformation of the mesh model of the virtual object.

[0185] In addition, the asset registration system (100) can specify at least one of a plurality of polygons included in a mesh model corresponding to the virtual object based on a user input selecting a specific point on the virtual object, and can change the color of a texture corresponding to the at least one specified polygon based on a user input selecting one of a plurality of predetermined colors.

[0186] At this time, specifying at least one of the plurality of polygons included in the mesh model may be specifying at least one polygon corresponding to a texture having the same color as a specific point selected according to user input.

[0187] Additionally, the asset registration system (100) may specify at least a portion of a texture corresponding to a virtual object based on a user input selecting a specific point on the virtual object, and may change the color of at least a portion of the specified area based on a user input selecting one of a plurality of predetermined colors.

[0188] Referring to FIG. 13a, for example, the asset registration system (100) can specify at least a portion of a texture area corresponding to a seat area (27) based on a user input selecting a seat area (27) in a chair-shaped virtual object (26).

[0189] At this time, the asset registration system (100) displays a color chart (52) and, based on a user input selecting a specific point in the color chart (52), can change the color of the seat area (27) of the virtual object (26) to a color selected according to the user input.

[0190] Furthermore, the asset registration system (100) may display an address of a web page where a product corresponding to a virtual object whose appearance has been changed according to user input can be purchased.

[0191] Referring to FIG. 13b, the asset registration system (100) compares a plurality of product images stored in a predetermined server device with a virtual object (28) whose appearance has been altered, and based on the comparison result, specifies one or more product images corresponding to the virtual object (28) whose appearance has been altered, and obtains and displays product information (53) corresponding to the specified one or more product images. The product information (53) may include a name, consumer price, purchase link, etc. for the product.

[0192] Through the above configurations, the asset registration system (100) according to the present invention recognizes a specific object in an image, implements it as a virtual object, and places the virtual object in a virtual space according to a user input, thereby enabling the placement of a specific object to be confirmed in various ways before placing the specific object in a real space or before changing the location of the specific object in the real space.

[0193] In addition, the asset registration system (100) according to the present invention changes the appearance of a virtual object implemented based on an actual image according to user input, thereby allowing a user in a virtual space to change the appearance of a virtual object according to his / her intention and test various arrangements, and efficiently search for the appearance of an object that best suits the space.

[0194] In addition, the asset registration system (100) according to the present invention implements a real object as a virtual object and places it in a virtual space, thereby enabling a user to efficiently and easily implement a virtual space similar to a real space.

[0195] In addition, the asset registration system (100) according to the present invention can be implemented to place a product most suitable for the user's intention in the most suitable location in the real space by providing a sales location for a product similar to a virtual object placed in a virtual space.

[0196] Furthermore, the asset registration system (100) can register a virtual space in which a virtual object is placed according to user input to a pre-stored user account as the user's asset.

[0197] Specifically, the asset registration system (100) can generate virtual space information to indicate a virtual space in which a virtual object is placed, and store the generated virtual space information by matching it to a user account.

[0198] At this time, the virtual space information may include information related to the virtual space and information related to virtual objects placed in the virtual space. For example, the information related to the virtual space may include information related to the size and background of the virtual space, and the information related to the virtual object placed in the virtual space may include virtual object information for the placed virtual object in the virtual space and information related to the location where the virtual object is placed in the virtual space.

[0199] Referring to FIG. 14, for example, the asset registration system (100) can generate a registration number as virtual space information for a virtual space (40a, 40b, 40c) in which virtual objects (20a, 20b, 20c, 20d) are placed, and store the generated registration number by matching it to a user account.

[0200] At this time, the asset registration system (100) can store the registration numbers assigned to one or more virtual objects (20a, 20b, 20c, 20d) placed in the virtual space (40a, 40b, 40c) by matching them with the registration numbers assigned to the virtual space (40a, 40b, 40c). In addition, the asset registration system (100) can store information related to the location where one or more virtual objects (20a, 20b, 20c, 20d) are placed in the virtual space (40a, 40b, 40c) by matching them with the registration numbers assigned to the virtual space (40a, 40b, 40c).

[0201] Furthermore, the asset registration system (100) can render a virtual space matched to a user account based on user input, and display information related to a virtual object placed in the rendered virtual space based on user input.

[0202] For example, the asset registration system (100) can display a plurality of virtual spaces matched to a user account, and based on a user input selecting one of the displayed plurality of virtual spaces, render the selected virtual space and a plurality of virtual objects placed in the virtual space.

[0203] Additionally, the asset registration system (100) can display information related to a selected virtual object based on a user input selecting one of a plurality of virtual objects placed in a rendered virtual space.

[0204] At this time, the asset registration system (100) may display information related to the virtual object, such as information related to the spatial image in which the virtual object was created, the time at which the virtual object was created, etc. Alternatively, the asset registration system (100) may display a category corresponding to the virtual object, as information related to the virtual object.

[0205] Furthermore, the asset registration system (100) may display an address of a web page where a product corresponding to the virtual object can be purchased as information related to the virtual object.

[0206] For example, the asset registration system (100) can compare a virtual object with multiple product images stored in a predetermined server device, identify one or more product images corresponding to the virtual object based on the comparison results, and obtain product information corresponding to the identified one or more product images. The product information may include the product's name, consumer price, purchase link, etc.

[0207] To this end, the asset registration system (100) can capture a virtual object at a plurality of predetermined angles to generate one or more comparison images, and compare the one or more comparison images with a plurality of product images to obtain product information of products having a similarity level higher than a predetermined level.

[0208] Similarity can be calculated using various techniques, such as comparison through image histograms or comparison based on edge detection. Similarity can also be calculated by comparing color differences across regions of virtual objects.

[0209] As another example, the asset registration system (100) can obtain product information for one or more products classified into the same category as the category corresponding to the virtual object among a plurality of products stored in a predetermined server device.

[0210] Furthermore, the asset registration system (100) can provide one or more virtual spaces similar to a virtual space in which a virtual object is placed according to a user input among a plurality of virtual spaces stored in a predetermined server device.

[0211] Specifically, the asset registration system (100) can receive information related to a second virtual space corresponding to a first virtual space in which a first virtual object is placed from a predetermined server device, and display the second virtual space through a user terminal.

[0212] Referring to FIG. 15a, for example, the asset registration system (100) can transmit information (e.g., category) related to the first virtual object (29) to a predetermined server device based on a user input selecting the first virtual object (29) placed in the first virtual space (40).

[0213] Accordingly, the asset registration system (100) can receive a plurality of second virtual spaces (43) in which virtual objects belonging to a category corresponding to the first virtual object (29) are arranged from a predetermined server device, and display the plurality of second virtual spaces (43) through a user terminal.

[0214] At this time, referring to FIG. 15b, when the asset registration system (100) receives a plurality of second virtual spaces (43) from a server device, it can display one of the second virtual spaces (44) based on a user input selecting one of the plurality of second virtual spaces (44a).

[0215] As another example, referring to FIG. 16, the asset registration system (100) may transmit information (e.g., category) related to the first virtual object (34) and information (e.g., category) related to a fourth virtual object (35) adjacent to the first virtual object (34) to a predetermined server device based on a user input selecting a first virtual object (34) placed in a first virtual space.

[0216] Accordingly, the asset registration system (100) can receive a second virtual space in which virtual objects (36a, 36b, 36c, 36d) belonging to the category of the first virtual object (34) and virtual objects (37a, 37b, 37c, 37d) belonging to the category of the fourth virtual object (35) are arranged from a predetermined server device, and display the second virtual space through a user terminal.

[0217] Here, the fourth virtual object (35) may be one virtual object among a plurality of virtual objects arranged in the first virtual space that is arranged at the closest distance to a point on the first virtual object (34), or may be a virtual object with the largest size among a plurality of virtual objects arranged in the first virtual space.

[0218] Alternatively, the fourth virtual object (35) may be a virtual object having the greatest relationship with the first virtual object (34) among a plurality of virtual objects arranged in the first virtual space, if the relationship between virtual objects is predetermined.

[0219] To this end, the asset registration system (100) can match and store a virtual space in which a virtual object is placed according to user input to a pre-saved user account.

[0220] Specifically, the asset registration system (100) can generate virtual space information to indicate a virtual space in which a virtual object is placed, and store the generated virtual space information by matching it to a user account.

[0221] At this time, the virtual space information may include information related to the virtual space and information related to virtual objects placed in the virtual space. For example, the information related to the virtual space may include information related to the size and background of the virtual space, and the information related to the virtual object placed in the virtual space may include virtual object information for the placed virtual object in the virtual space and information related to the location where the virtual object is placed in the virtual space.

[0222] Through this, the asset registration system (100) can render a virtual space matched to a user account based on user input, and display information related to a virtual object placed in the rendered virtual space based on user input.

[0223] Furthermore, the asset registration system (100) according to the present invention can transmit a virtual space in which a first virtual object is placed to a second user terminal different from a user terminal (hereinafter, a first user terminal).

[0224] Specifically, the asset registration system (100) can specify a second user terminal based on user input and transmit a virtual space in which a first virtual object is placed to the second user terminal.

[0225] Referring to FIG. 17a, for example, the asset registration system (100) may input a phone number (301) and a user ID, etc., as a user account for a second user terminal. Accordingly, the asset registration system (100) may specify a second user terminal based on the input user account and transmit a virtual space (40) to the specified second user terminal.

[0226] For another example, the asset registration system (100) may be connected to a second user terminal via a wireless network such as Bluetooth, Near Field Communication (NFC), or Wi-Fi, as well as a wired network. In this case, the asset registration system (100) may transmit a virtual space to the second user terminal connected via the wireless or wired network.

[0227] Furthermore, the asset registration system (100) according to the present invention can receive a virtual space in which a first virtual object placed in a virtual space by a second user terminal is changed into a second virtual object different from the first virtual object.

[0228] That is, the asset registration system (100) can allow a second user terminal to receive a virtual space, change a first virtual object placed in the virtual space into a second virtual object different from the first virtual object, and transmit the virtual space in which the second virtual object is placed to the first user terminal.

[0229] Specifically, the asset registration system (100) can cause a second user terminal to receive and display a virtual space from a first user terminal, specify a first virtual object based on a user input for selecting one virtual object to be replaced with another virtual object among a plurality of virtual objects arranged in the virtual space, and specify a second virtual object based on a user input for selecting one virtual object among a plurality of virtual objects belonging to the same category as the first virtual object, and change the first virtual object to the second virtual object.

[0230] Referring to FIG. 17b, for example, the asset registration system (100) can display a virtual space (60) received from a first user terminal (200) on a second user terminal (300). Subsequently, the asset registration system (100) can display a plurality of virtual objects (62) belonging to the same category as the first virtual object (61) based on a user input specifying a first virtual object (61) placed in the virtual space through the second user terminal (300).

[0231] Accordingly, the asset registration system (100) can replace the first virtual object (61) with the second virtual object (61a) based on a user input specifying one of the plurality of virtual objects (62).

[0232] As another example, the asset registration system (100) may display one or more virtual objects belonging to the same category as the first virtual object among a plurality of virtual objects matched to a user account corresponding to the second user terminal, based on a user input specifying one first virtual object in a virtual space displayed on the second user terminal.

[0233] Accordingly, the asset registration system (100) can place a virtual object created through a second user terminal in a virtual space created through a first user terminal.

[0234] As another example, the asset registration system (100) may receive a plurality of virtual objects corresponding to a first virtual object from a predetermined server device based on a user input specifying a first virtual object in a virtual space displayed on a second user terminal, and display the received plurality of virtual objects.

[0235] At this time, the asset registration system (100) can receive one or more virtual objects belonging to the same category as the first virtual object from a predetermined server device, and at this time, the one or more virtual objects received from the predetermined server device can be virtual objects created based on images collected from a website selling products of the category to which the first virtual object belongs, or can be virtual objects belonging to the same category as the first virtual object among a plurality of virtual objects created by another user terminal recognizing a specific object from a spatial image.

[0236] Furthermore, the asset registration system (100) according to the present invention can display a virtual space in which a second virtual object is placed through a first user terminal.

[0237] Specifically, the asset registration system (100) transmits a virtual space in which a first virtual object is replaced with a second virtual object to a first user terminal through the second user terminal based on a user input, and the first user terminal receives and displays the virtual space in which the second virtual object is placed, and stores either the first virtual space in which the first virtual object is placed or the second virtual space in which the first virtual object is replaced with the second virtual object by matching it to a user account based on the user input.

[0238] Referring to FIG. 18a, for example, the asset registration system (100) displays a first virtual space (40) in which a first virtual object is placed by a first user terminal, and a second virtual space (60) in which a second virtual object is placed by a second user terminal, and can match and store at least one of the first virtual space (40) and the second virtual space (60) to a user account based on a user input.

[0239] Furthermore, the asset registration system (100) can compare a first virtual object placed in a first virtual space with a second virtual object placed in a second virtual space, and based on the comparison result, receive a fifth virtual object corresponding to at least one of the first virtual object and the second virtual object from a predetermined server device, and display the fifth virtual object on at least one of the first user terminal and the second user terminal.

[0240] Specifically, the asset registration system (100) can compare a first virtual object with a second virtual object in which the first virtual object is replaced by a second user terminal based on a user input, and request a virtual object corresponding to the comparison result from a predetermined server device.

[0241] Referring to FIGS. 18a and 18b, for example, the asset registration system (100) displays a first virtual space in which a first virtual object (70) is placed by a first user terminal and a second virtual space in which a second virtual object (80) is placed by a second user terminal, and can compare the first virtual object (70) and the second virtual object (80) based on a user input requesting another virtual object similar to the first virtual object (70) and the second virtual object (80).

[0242] Accordingly, the asset registration system (100) can receive one or more virtual objects (63) corresponding to the comparison result from a predetermined server device and display them on the first user terminal.

[0243] In this regard, the asset registration system (100) can compare a first mesh model for a first virtual object and a second mesh model for a second virtual object. That is, the asset registration system (100) can compare the shape of each region of the first mesh model and the shape of each region of the second mesh model.

[0244] Referring to FIG. 19, in one embodiment, the asset registration system (100) compares the positions of vertices of the first mesh model (72) with the positions of vertices of the second mesh model (82), and based on the comparison results, extracts vertices whose distance difference between the vertices is within a predetermined range, thereby generating similarity information. Accordingly, the similarity information may include information related to vertices whose positional differences between the vertices in the first mesh model (72) and the second mesh model (82) are within a predetermined range.

[0245] Through this, the asset registration system (100) can identify areas with similar shapes for different objects belonging to the same category.

[0246] In another embodiment, the asset registration system (100) may compare the positions of vertices of the first mesh model (72) with the positions of vertices of the second mesh model (82), and based on the comparison results, extract vertices whose distance difference between the vertices falls outside a predetermined range to generate difference information. Accordingly, the difference information may include information related to vertices whose positional differences between the vertices in the first mesh model (72) and the second mesh model (82) fall outside a predetermined range.

[0247] At this time, the asset registration system (100) can specify one of the first virtual object and the second virtual object as a reference virtual object based on a user input selecting one of the first virtual object and the second virtual object, and, in the specified reference virtual object, can generate difference information using information related to vertices whose positional differences in the mesh model with other virtual objects are outside a predetermined range.

[0248] Through this, the asset registration system (100) can identify areas with different shapes for different objects belonging to the same category.

[0249] As another example, the asset registration system (100) can compare a first texture for a first virtual object (70) and a second texture for a second virtual object (80). That is, the asset registration system (100) can compare the color of each area of ​​the first texture and the color of each area of ​​the second texture.

[0250] In one embodiment, the asset registration system (100) can compare a predetermined region-specific color value (71) in a first texture with a predetermined region-specific color value (81) in a second texture, and, based on the comparison result, can extract a region in which the difference in the region-specific color value is within a predetermined range and color information in the region to generate similar information.

[0251] In another embodiment, the asset registration system (100) can compare a predetermined color value (71) for each region in a first texture with a predetermined color value (81) for each region in a second texture, and, based on the comparison result, can extract color information from a region where the difference in the color value for each region is outside a predetermined range and generate difference information.

[0252] At this time, the asset registration system (100) can specify either the first virtual object or the second virtual object as a reference virtual object based on a user input selecting either the first virtual object or the second virtual object, and, in the specified reference virtual object, can extract color information from an area where the difference in color value from another virtual object by area exceeds a predetermined range and generate difference information.

[0253] Furthermore, the asset registration system (100) may transmit at least one of similar information and difference information according to the comparison result, together with information (e.g., category) related to the first virtual object and the second virtual object, to a predetermined server device, and receive information related to the fifth virtual object (90) from the server device.

[0254] For example, the asset registration system (100) may receive, from a server device, one or more virtual objects corresponding to similar information based on a comparison result between the first virtual object and the second virtual object among a plurality of virtual objects having the same category as the first virtual object and the second virtual object.

[0255] As another example, the asset registration system (100) may specify one of the first virtual object and the second virtual object as a reference virtual object based on a user input, generate difference information according to the reference virtual object, and receive, from a server device, one or more virtual objects corresponding to the difference information according to the reference virtual object among a plurality of virtual objects having the same category as the first virtual object and the second virtual object.

[0256] At this time, the asset registration system (100) can receive one or more virtual objects from the server device, from among the first virtual object and the second virtual object, one or more virtual objects corresponding to a virtual object different from the reference virtual object being excluded.

[0257] That is, the asset registration system (100) can receive, as a fifth virtual object, another virtual object that corresponds to at least one of the shape of the mesh model constituting the reference virtual object and the color of the texture applied to the mesh model, for one virtual object specified as a reference virtual object according to user input among the first virtual object and the second virtual object.

[0258] Through the above configurations, the asset registration system (100) according to the present invention can implement a virtual space of a desired shape by placing virtual objects in a virtual space according to user input.

[0259] In addition, the asset registration system (100) according to the present invention shares a virtual space in which a virtual object is placed with other users, and the users who have shared the virtual space replace the virtual object placed in the virtual space with another virtual object, thereby enabling each user to clearly express their intentions during a collaborative process between different users.

[0260] In addition, the asset registration system (100) according to the present invention can effectively shorten the process for deriving an agreed opinion in a collaborative process between different users by comparing a virtual object placed in a virtual space by a specific user with a virtual object replaced by a user who shares the virtual space, and providing other similar virtual objects based on the comparison result.

[0261] Furthermore, the present invention discussed above can be implemented as computer-readable code or instructions on a program-recorded medium. That is, the various control methods according to the present invention can be provided in the form of programs, either integrated or individually.

[0262] Meanwhile, computer-readable media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid-state disk drives (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.

[0263] Furthermore, the computer-readable medium may include a storage device and may be a server or cloud storage device accessible via communication. In this case, the computer may download the program according to the present invention from the server or cloud storage device via wired or wireless communication.

[0264] Furthermore, in the present invention, the computer described above is an electronic device equipped with a processor, i.e., a CPU (Central Processing Unit), and there is no particular limitation on its type.

[0265] Meanwhile, the detailed description above should not be construed as limiting in any respect and should be considered illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are intended to be included within the scope of the present invention.

Claims

1. Step of recognizing a specific object in an image; A step of retrieving a mesh model corresponding to the specific object from a database; A step of creating a virtual object corresponding to the specific object using the mesh model; and A method for registering an asset, comprising the step of registering the virtual object as an asset of a pre-specified user account.

2. In paragraph 1, A step in which a user input for placing the virtual object in a predetermined virtual space is input to a first user terminal; An asset registration method further comprising the step of placing the first virtual object at a specific location corresponding to the user input in the virtual space.

3. In the second paragraph, the step of placing the virtual object is: A step in which a user input is input to change the virtual object placed in the virtual space into a third virtual object different from the virtual object; A step of transmitting information related to the above virtual object to a predetermined server device; A step of receiving a third virtual object belonging to the same category as the virtual object from the server device; and An asset registration method comprising a step of replacing the virtual object placed in the virtual space with the third virtual object.

4. In paragraph 2, A step of transmitting information related to the virtual object and information related to a fourth virtual object adjacent to the virtual object to a predetermined server device based on a user input selecting the virtual object placed in the virtual space; A step of receiving from the server device another virtual space in which any virtual object belonging to the category of the virtual object and any virtual object belonging to the category of the fourth virtual object are placed; and An asset registration method further comprising a step of displaying the other virtual space through the first user terminal.

5. In paragraph 2, A step of transmitting the virtual space in which the virtual object is placed to a second user terminal different from the first user terminal; A step of receiving a virtual space in which the virtual object placed in the virtual space by the second user terminal is changed into a second virtual object different from the virtual object; and A method for registering assets, further comprising the step of displaying the virtual space in which the second virtual object is placed.

6. In paragraph 5, An asset registration method further comprising the step of matching and storing one of a first virtual space in which the virtual object is placed and a second virtual space in which the virtual object is changed into the second virtual object, based on a user input, to a user account.

7. In paragraph 6, A step of comparing the virtual object placed in the first virtual space with the second virtual object placed in the second virtual space; A step of receiving a fifth virtual object corresponding to at least one of the virtual object and the second virtual object from a predetermined server device based on the comparison result; and A method for registering assets, further comprising the step of displaying the fifth virtual object.

8. In paragraph 1, A step of specifying at least one of a plurality of vertices included in the mesh model corresponding to the virtual object based on a user input selecting a specific point on the virtual object; A step of moving the position of the specified vertex based on a user input selecting a point other than the selected specific point within a predetermined range from the virtual object; and An asset registration method further comprising a step of creating another virtual object with a deformed appearance from the virtual object using a mesh model in which the positions of the vertices have been moved.

9. Storage unit where the video is stored; and A control unit for recognizing a specific object in the above image and generating a virtual object corresponding to the specific object is included. The above control unit, An asset registration system that retrieves a mesh model corresponding to the specific object from a database, creates a virtual object corresponding to the specific object using the mesh model, and registers the virtual object as an asset of a pre-specified user account.

10. A program that is executed by one or more processes in an electronic device and stored in a computer-readable recording medium, The above program is, A step of recognizing a specific object in an image; A step of retrieving a mesh model corresponding to the specific object from a database; A step of creating a virtual object corresponding to the specific object using the mesh model; and A program stored on a computer-readable recording medium, characterized in that it includes commands for performing a step of registering the virtual object as an asset of a pre-specified user account.

Images