Method and device for providing interior design market platform service using realistic scene images based on virtual space content data

The distributed rendering method for virtual space content data addresses the inefficiencies in current interior design technologies by enabling users to create and share realistic scene images, reducing costs and improving quality and speed in interior design and sales processes.

JP7588438B2Active Publication Date: 2024-11-22ARCHIDRAW INC
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023512206
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-08-20
Filing Date
2021-08-20
Publication Date
2024-11-22
Estimated Expiration
2041-08-20

AI Technical Summary

Technical Problem

Current interior design and rendering technologies require excessive time, computing power, and specialized manpower to create realistic virtual space images, leading to high costs and reduced quality due to the complexity of rendering highly detailed interior scenes, and the need for professional designers.

Method used

A method and apparatus for providing interior design market platform services using a distributed rendering approach based on virtual space content data, allowing users to create and share realistic scene images through a cloud service network, reducing the need for professional photography and enabling efficient, automated interior design and sales processes.

Benefits of technology

Enables the creation of realistic interior scene images efficiently, reducing costs associated with professional photography and expert labor, while improving the quality and speed of interior design and product sales services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007588438000001
    Figure 0007588438000001
  • Figure 0007588438000002
    Figure 0007588438000002
  • Figure 0007588438000003
    Figure 0007588438000003
Patent Text Reader

Abstract

An operating method of a service providing device according to an embodiment of the present invention includes the steps of: processing distributed rendering based on virtual space content data created by one or more user terminals to create one or more realistic scene image contents; matching the one or more realistic scene image contents with creator information and registering them in a database; providing an order interface authoring service using the realistic scene images to an interior business terminal; and registering interior product information based on the authoring data input from the interior business terminal in an interior market platform interface.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a service providing method and an apparatus thereof, and more particularly to a method and an apparatus thereof for providing an interior design market platform service using realistic scene images based on virtual space content data. [Background technology]

[0002] Generally, when working on architectural drawings and design, a CAD program is installed on a PC or laptop, and drawings are created using a mouse or tablet, and the results are calculated. However, as society develops from an industrial society to an information society, virtual reality technology is emerging that can more easily provide users with 3D modeling results themselves, rather than drawings, in a user experience format, replacing functions such as model houses.

[0003] For example, Virtual Reality (VR) or Augmented Reality (AR) has been generated for the purpose of virtual tours of the interior of buildings (houses, apartments, offices, hospitals, churches, etc.) and interior or furniture layout simulations (or room simulations), and various methods have been proposed to provide users with simulated environments and situations based on this and allow them to interact with them.

[0004] For this purpose, methods are used in which three-dimensional data of buildings and interior structures is generated in advance by hand or with a 3D scanner, and virtual reality is provided based on this data. However, this method requires a three-dimensional architectural modeling process based on estimation from scanned information or drawings, which is not only difficult to produce, but also has the problem of reduced accuracy due to limitations in data processing and manual work.

[0005] In addition, if a user wants to design an interior through furniture and objects that are arbitrarily placed in the room structure, these must be precisely installed and harmoniously arranged in a three-dimensional space, but the reality is that this task is very difficult unless you are a professional 3D designer. Therefore, in order to realistically create and generate the room information and interior of a building using current technology alone, specialized manpower is required, which consumes excessive time and costs.

[0006] Furthermore, the information and interior design of the room constructed in this way is currently provided through a display device that displays the interior of the virtual space in two-dimensional or three-dimensional images.

[0007] Such a display device can output various furniture and objects that can be seen in a visual field image according to the user's viewpoint in accordance with the virtual space interior content data, and typically the user can select one of these and input the movement of the furniture position, and can be provided with detailed information regarding the purchase.

[0008] However, in order to provide such information, it is necessary to render the virtual space interior content data into a three-dimensional scene image and output it through the user's display device.

[0009] In particular, in recent years, in order to make 3D rendering appear more realistic, a technology has been proposed that applies global illumination rendering technology based on ray tracing, which analyzes the physical interactions between light and media, to create rendering effects that look like real photographs.

[0010] Unlike modeling and animation, whose quality can be easily supplemented by hand, rendering cannot be replaced by hand, so the type of rendering technology used greatly affects performance and determines the reality and quality of the generated image. Compared to the past, global illumination and shading technologies have advanced, making it possible to render ultra-realistic images, but it still requires a lot of calculation time.

[0011] Although rendering technology has developed and the speed of computers that calculate rendering has improved rapidly, the time required for final rendering has not been shortened because the required image quality has also improved. In fact, it still takes at least several minutes to even several days to obtain the rendering result for one scene, precisely because the required image quality has improved dramatically.

[0012] Therefore, it remains difficult to quickly perform such rendering processing for extremely complex and diverse content data in which various spaces and objects are arranged, such as virtual space interior content, and provide the data to a user terminal.

[0013] In addition, realistic scene rendering, such as rendering processing based on global illumination, tracks the movement path emitted from a light source, so that replacing a specific object requires recalculating the entire scene, which significantly increases the amount of additional calculations due to object conversion. As a result, excessive computing power and data processing capacity are required, and there are limitations to providing it as a commercial service.

[0014] To overcome this, a method has been proposed to isolate and simply replace specific objects within a scene image; however, this method has the drawback of reducing the sense of realism and service quality due to the strangeness caused by light sources and peripheral afterimages of existing objects.

[0015] Meanwhile, recently, various online market platforms have appeared for selling interior design construction and related interior products, and these online market platforms provide a screen interface for checking the aesthetics of the interior design and products in advance by using photos of the space where the interior design has been constructed or the space where the interior products are arranged.

[0016] However, as the competition for promotion within the interior online market platform intensifies, more and more sellers are taking higher quality interior design photos and photos of interior products for promotion.

[0017] In particular, the use of expensive interior photography taken by professional photographers using high-performance cameras in photo studios equipped with set facilities has resulted in a phenomenon of subject-object reversal, where sales and popularity are determined by the composition and quality of the photographs rather than the aesthetics of the interior design or the product itself.

[0018] Most of the costs involved in interior photography come from the need for highly specialized human resources and camera equipment, which leads to the problem that sellers are spending excessive amounts of money on photography rather than on the quality of the product itself in order to compete. This expenditure is reflected in the cost of interior design services and products, resulting in a decline in the overall quality of services and products in the interior market and rising prices, leading to consumer dissatisfaction. Summary of the Invention [Problem to be solved by the invention]

[0019] The present invention has been made to solve the above-mentioned problems, and has an object to provide a market platform interface and a market platform service thereof, which build a realistic interior scene image database using a distributed rendering method based on virtual space content data generated and shared by general users, enable interior businesses and product sellers to design interiors and sell products using images from the interior scene image database, and enable realistic scene images shared by various users to be used in services and product sales while reducing costs associated with interior photography, etc. [Means for solving the problem]

[0020] To solve the above problems, an operating method of a service providing device according to an embodiment of the present invention includes the steps of: processing distributed rendering based on virtual space content data created by one or more user terminals to create one or more realistic scene image contents; matching the one or more realistic scene image contents with creator information and registering them in a database; providing an order interface authoring service using the realistic scene images to an interior business terminal; and registering interior product information based on the authoring data input from the interior business terminal in an interior market platform interface.

[0021] In addition, a service providing device according to an embodiment of the present invention for solving the above problem includes a space and interior rendering unit that processes distributed rendering based on virtual space content data created by one or more user terminals to create one or more realistic scene image contents, and a service providing unit that matches the one or more realistic scene image contents with creator information and registers them in a database, wherein the service providing unit includes a virtual space interior content production module that provides an order interface authoring service using the realistic scene image to an interior business terminal, and a market platform interface module that registers interior product information based on the authoring data input from the interior business terminal in an interior market platform interface.

[0022] To solve the above problem, an operating method of a service providing device according to an embodiment of the present invention includes the steps of: processing distributed rendering based on three-dimensional furniture data to construct one or more realistic scene image contents corresponding to furniture items to be sold; providing a furniture sales interface authoring service using the realistic scene image contents to a furniture seller terminal; and registering furniture product information based on the authoring data input from the furniture seller terminal to a furniture sales market platform interface.

[0023] In addition, a service providing device according to an embodiment of the present invention for solving the above problem includes a space and interior rendering unit that processes distributed rendering based on 3D furniture data to create one or more realistic scene image contents corresponding to furniture items to be sold, and a service providing unit that provides a furniture sales interface authoring service using the realistic scene image contents to a furniture seller terminal and registers furniture product information based on the authoring data input from the furniture seller terminal to a furniture sales market platform interface.

[0024] To solve the above problem, an operating method of a service providing device according to an embodiment of the present invention includes the steps of: processing distributed rendering based on virtual space content data created by one or more user terminals to create one or more realistic scene image contents; matching the one or more realistic scene image contents with creator information and registering them in a database; providing a real estate brokerage interface authoring service using the realistic scene image to a real estate business terminal; and registering real estate product information based on the authoring data input from the real estate business terminal to a real estate market platform interface.

[0025] In addition, a service providing device according to an embodiment of the present invention for solving the above problem includes a space and interior rendering unit that processes distributed rendering based on virtual space content data created by one or more user terminals to create one or more realistic scene image contents, and a service providing unit that matches the one or more realistic scene image contents with creator information and registers them in a database, wherein the service providing unit includes a virtual space interior content production module that provides an intermediary interface authoring service using the realistic scene images to a real estate business terminal, and a market platform interface module that registers real estate product information based on the authoring data input from the real estate business terminal to a real estate market platform interface.

[0026] On the other hand, the operating method of a service providing device according to an embodiment of the present invention for solving the above problem can be realized by a program for executing the method on a computer, and a computer-readable recording medium on which the program is recorded. Effect of the Invention

[0027] According to an embodiment of the present invention, a realistic interior scene image database using a distributed rendering method can be constructed based on virtual space content data generated and shared by general users, enabling interior businesses and product sellers to design interiors and sell products using images from the interior scene image database, thereby providing a market platform interface and service that allows realistic scene images shared by various users to be used for services and product sales while reducing costs associated with interior photography, etc.

[0028] In addition, according to an embodiment of the present invention, in order to create a realistic scene image, a user can intuitively and conveniently create space and interior design information through an automated process based on a user style for space and interior arranged on indoor structural information, without having to perform separate precise design or request work from an expert.

[0029] Furthermore, according to an embodiment of the present invention, virtual space content configured in various ways, such as space and interior design, can be efficiently and quickly pre-rendered via a cloud service network, and global illumination and shading effects can be applied to provide a natural, rich, lifelike three-dimensional scene image of the virtual space interior via a user terminal. [Brief description of the drawings]

[0030] [Figure 1] FIG. 1 is a diagram for illustrating an overall system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram for explaining in more detail a service providing device according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a block diagram for explaining a service providing unit according to an embodiment of the present invention in more detail. [Figure 4]4 is a flowchart illustrating in more detail a service providing method according to an embodiment of the present invention. [Diagram 5] FIG. 13 is a diagram illustrating a market platform interface based on a realistic scene image according to an embodiment of the present invention. [Figure 6-8] 10 is a diagram illustrating an example of an indoor structure information interface output from a service providing device by executing a method according to an embodiment of the present invention. [Figure 9] FIG. 2 is a block diagram illustrating a spatial and interior rendering unit according to an embodiment of the present invention in more detail. [Figure 10-11] 1 is an exemplary diagram of a realistic scene image rendered according to an embodiment of the present invention; [Figure 12-15] 4A and 4B are flowcharts and reference diagrams for explaining in more detail the operation of a rendering unit according to an embodiment of the present invention; [Figure 16-20] 4 is a flowchart and reference diagram for explaining an object conversion operation of a rendering unit according to an embodiment of the present invention in more detail; [Figure 21-25] FIG. 11 is a diagram for explaining a system and an operation according to a second embodiment of the present invention. [Figure 26-30] FIG. 11 is a diagram for explaining a system and an operation according to a third embodiment of the present invention. [Figure 31-35] FIG. 13 is a diagram for explaining a system and an operation according to a fourth embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0031] The following merely illustrates the principles of the present invention. Thus, those skilled in the art should be able to invent various devices that embody the principles of the present invention and are included in the concept and scope of the present invention, even if not explicitly described or illustrated in the present specification. It should be understood that all conditional terms and embodiments listed in this specification are, in principle, clearly intended only for the purpose of understanding the concept of the present invention, and are not limited to the embodiments and conditions specifically listed in this specification.

[0032] Additionally, all detailed descriptions reciting specific embodiments, as well as principles, aspects, and embodiments of the present invention, should be understood to be intended to include both structural and functional equivalents of such items, which should be understood to include not only currently known equivalents, but also equivalents developed in the future, i.e., any elements invented that perform the same function, regardless of structure.

[0033] Thus, for example, the block diagrams herein should be understood to illustrate a conceptual view of illustrative circuitry embodying the principles of the invention. Similarly, all flow charts, state transition diagrams, pseudo code, and the like may be substantially depicted on a computer readable medium and should be understood to illustrate various processes performed by a computer or processor, whether or not a computer or processor is explicitly depicted.

[0034] The functions of the various elements illustrated in the figures, including functional blocks represented as processors or similar concepts, may be provided through the use of dedicated hardware, or hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, a single shared processor, or a plurality of individual processors, some of which may be shared.

[0035] Additionally, the express use of terms such as processor, control, or similar concepts should not be construed as exclusively referring to hardware capable of executing software, but should be understood to implicitly include, without limitation, digital signal processor (DSP) hardware, read only memory (ROM), random access memory (RAM), and non-volatile memory for storing software, as well as other hardware commonly known and commonly used.

[0036] In the claims of this specification, elements expressed as means for performing a function described in the detailed description are intended to include any method of performing that function, including, for example, a combination of circuit elements performing that function, or any type of software, including firmware / microcode, etc., combined with appropriate circuitry for executing the software to perform that function. The invention defined by such claims is such that the functionality provided by the various recited means is combined and combined in the manner required by the claims, and any means that can provide that functionality should be understood to be equivalent to what is understood from this specification.

[0037] The above-mentioned objects, features and advantages will become more apparent from the following detailed description in conjunction with the accompanying drawings, so that those skilled in the art to which the present invention pertains can easily carry out the technical idea of ​​the present invention. In addition, in describing the present invention, if it is determined that a detailed description of the known art related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted.

[0038] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0039] FIG. 1 is a diagram for explaining an outline of an overall system according to an embodiment of the present invention.

[0040] Referring to FIG. 1, the overall system according to an embodiment of the present invention includes a service providing device, one or more cloud devices 200, a consumer terminal 300, a content creator terminal 400, and an interior business operator terminal 500.

[0041] First, the consumer terminal 300, content creator terminal 400, and interior business terminal 500 described in this specification may be collectively referred to as user terminals 300, 400, and 500 depending on their general functions. First, the general functions and operation of each terminal will be described in detail.

[0042] The user terminals 300, 400, 500 are one or more electronic devices that operate according to user input and output a user interface, and examples of such electronic devices include mobile phones, smartphones, computers, notebook computers (laptop computers), digital broadcasting terminals, PDAs (Personal Digital Assistants), PMPs (Portable Multimedia Players), navigation systems, and virtual reality devices.

[0043] In addition, the user terminals 300, 400, and 500 may be installed with and operate a program or application for executing the method according to an embodiment of the present invention in conjunction with the service providing device 100.

[0044] As a result, the service providing apparatus 100 according to an embodiment of the present invention can provide each user terminal 300, 400, 500 with an interface for generating and editing indoor structural information output from the user terminal 300, 400, 500 or information required for operating the interface, and the indoor structural information generated according to an embodiment of the present invention can be stored in the service providing apparatus 100 or uploaded to a separate server (not shown) and managed according to user information.

[0045] Here, the indoor structural information may include two-dimensional or three-dimensional building floor plan information, and may include structural information that can be used for indoor interior simulation by integrating three-dimensional modeling information. The indoor structural information may include one or more walls and connection information of the walls, and may form one or more closed spaces.

[0046] To facilitate the generation of such indoor structural information, the user terminals 300, 400, 500 may be equipped with internal or external distance measuring sensors and angle measuring sensors, and may determine the indoor structural information in response to user input.

[0047] In addition, the service providing device 100 can acquire pre-stored or uploaded indoor structure information corresponding to user information from the user terminals 300, 400, and 500, and can provide an interior layout editing function corresponding to the acquired indoor structure information.

[0048] In particular, according to an embodiment of the present invention, the service providing device 100 can provide the user terminals 300, 400, and 500 with an interior layout automation function that can automate furniture interior arrangement and space design based on user style information analysis in response to the user's indoor structure information.

[0049] More specifically, when the service providing device 100 according to an embodiment of the present invention acquires indoor structural information of a user, it generates interior layout automation information including a spatial layout and an interior arrangement design determined in accordance with the indoor structural information through a style information analysis process corresponding to the user, and can output the interior layout automation information through the user terminal 300, 400, 500.

[0050] The automation information output in this manner can be used for interior rendering processing of the indoor structural information in the service providing device 100, and the indoor structural information after the rendering processing can be output via an indoor structural information interface of the user terminal 300, 400, 500.

[0051] As a result, the indoor structural information obtained by automating the design of the interior furniture and spatial layout can be used for editing, information sharing and storage through user input, and can also be used as an indoor simulation and a function linked to the purchase of each piece of furniture to be placed.

[0052] For example, the service providing device 100 can provide a function of visualizing a three-dimensional space similar to reality in a virtual space displayed on a display of the user terminal 300, 400, 500, etc., and arranging three-dimensional objects based on the interior layout automation information on an indoor simulation graphic based on the indoor structure information. As a result, the indoor simulation can be preferably used for a floor plan that simulates furniture and the like to be arranged in a room, and an application that provides the indoor simulation may include a floor plan application.

[0053] As a result, the service providing device 100 according to an embodiment of the present invention can generate interior arrangement and spatial layout design according to a user style in indoor structure information in response to a user input, and provide rendering information to the user terminals 300, 400, and 500. As a result, a user can be provided with a spatial layout and furniture arrangement in a style desired by the user without the need for separate precise design or design work, and can edit the same to construct various two-dimensional and three-dimensional indoor structure information.

[0054] For this purpose, a separate server device can store the predetermined application that can be installed in the user terminals 300, 400, 500 and information required to provide the indoor simulation, and can provide user registration and indoor structure information management for the users of the user terminals 300, 400, 500. The user terminals 300, 400, 500 can download and install applications from the server device.

[0055] In addition, the service providing device 100 according to an embodiment of the present invention can perform more realistic and lifelike scene image rendering for virtual space interior content including three-dimensional indoor structure information, and provide the rendered image data to the user terminals 300, 400, and 500.

[0056] Here, the rendered image data may be a three-dimensional image projected corresponding to a first viewpoint set corresponding to the virtual space interior, or may be image data to which one or more rendering effect calculation processes have been applied to realize a realistic scene.

[0057] More specifically, the rendering effect may include effect processing that applies various lighting algorithms, such as the well-known REYES structure, in response to three-dimensional data. However, REYES is fast but has a problem of low realism, and a rendering technique based on global illumination interprets the interaction between light and media in a more physically sophisticated manner, but has a problem of requiring high-end computing due to the large amount of calculations.

[0058] In particular, global illumination can provide a more realistic feel by calculating both direct light from light sources and indirect light reflected from other materials and objects. Phenomena such as soft shadows, caustics, and color bleeding can all appear as a result of global illumination effects. Ray tracing is a method of simulating the movement of light in the real world, but it requires a very large amount of calculations, making it difficult to realize in real time even on the latest hardware of the current generation.

[0059] Therefore, the service providing apparatus 100 according to an embodiment of the present invention can effectively construct pre-rendered 3D virtual space interior content by distributing a ray tracing process based on global illumination by using a cloud-based rendering service network configured by one or more cloud devices 200. This is based on the rendering optimization process of the service providing apparatus 100, which allows computing resources to be effectively shared and calculation time to be efficiently reduced.

[0060] Here, the service providing device 100 may be a master device that distributes realistic scene rendering tasks into partial image rendering tasks and assigns them to the cloud device 200, and the cloud device 200 may be a slave device that processes the partial image rendering and transmits optimized realistic scene partial images to the service providing device 100.

[0061] More specifically, the service providing device 100 according to an embodiment of the present invention can configure distributed processing data optimized for realistic distributed rendering processing of a scene image projected to a first viewpoint corresponding to a 3D virtual space interior content provided to the user terminals 300, 400, 500, transmit the configured distributed processing data to one or more cloud devices 200 connected to a rendering service network, receive a realistic scene partial image that has been distributed rendered from the cloud devices 200, and configure a realistic scene image of a first viewpoint corresponding to the 3D virtual space interior content.

[0062] As a result, a realistic scene image of the first viewpoint can be provided to the user terminals 300, 400, and 500, and the first viewpoint can be expanded to multiple viewpoints by repeatedly executing pre-rendering. Furthermore, since the multiple viewpoints can be configured as omnidirectional point viewpoints corresponding to a 3D virtual space, it is possible to provide 720-degree omnidirectional virtual space interior content with realistic scene image processing by optimizing pre-rendering and improving cloud network performance.

[0063] Furthermore, the service providing apparatus 100 according to the embodiment of the present invention may provide an object conversion service in a realistic scene image, and may generate a plurality of object-converted realistic scene images in advance, and store and manage them in a database. For example, realistic scene image processing, such as changing furniture to other types in a specific virtual space interior content, may be easily provided by the pre-rendering process.

[0064] However, as mentioned above, in order to generate a realistic scene image with object conversion, a recalculation process corresponding to the entire image is required, which causes a problem of a very large amount of calculation.In addition, when only a simple object part is replaced, a problem occurs in that a sense of strangeness is generated due to an afterimage of the surrounding image caused by the existing object, resulting in a decrease in the sense of reality.

[0065] Therefore, the service providing device 100 according to an embodiment of the present invention determines a partial transformation boundary area corresponding to the range of influence due to object transformation for a first object before transformation and a second object after transformation, performs only a re-rendering process of a realistic scene image corresponding to the partial transformation boundary area, and combines the re-rendered scene image portion with the remaining existing scene image portion to generate a realistic scene image in which the first object is transformed into the second object, thereby providing an object transformation process that minimizes the amount of calculation in the recalculation process while preventing a sense of strangeness.

[0066] In addition, the service providing device 100 according to an embodiment of the present invention can provide each user terminal 300, 400, 500 with a market platform service that allows interior vendors to sell their products using pre-rendered three-dimensional virtual space interior content.

[0067] Here, the pre-rendered 3D virtual space interior content may be composed of one or more realistic scene images that are realistically rendered. The realistic scene images can replace expensive interior photos taken by photography professionals using high-performance cameras in photo studios equipped with set sites, etc., with image data that is low-cost and efficiently calculated. Therefore, it is possible to provide a market platform that can improve image quality by using realistic images that are photo-rendered to 4K or higher while reducing the labor costs of photography work.

[0068] For this purpose, the content creator terminal 400 may be a user terminal that creates the above-mentioned three-dimensional virtual space interior content and requests the service providing device 100 to perform realistic distributed rendering processing of the scene image projected to the first viewpoint, and the service providing device 100 can create realistic scene image content based on distributed rendering, match it with the creator information of the content creator terminal 400, and store and register it in a database.

[0069] In addition, the interior business operator terminal 500 may be a user terminal of a business operator that provides interior products and services, and may generate an order interface including product information to be sold by using realistic scene image content registered in the service providing device 100, and may request registration of the generated order interface in the service providing device 100. The order interface requested to be registered may be registered in an interior related market platform interface provided by the service providing device 100.

[0070] For example, product information to be sold may include an interior construction product, and the realistic scene image content may be provided as a construction sample image of the interior construction product. In order to generate an order interface, the service providing device 100 may provide an order interface authoring service including the construction sample image to the interior business operator terminal 500, and may register interior product information based on authoring data input from the interior business operator terminal 500 in an interior market platform interface.

[0071] Thus, the service providing apparatus 100 can provide interior product information including the realistic scene image content to one or more consumer terminals 300 connected to the market platform interface. The service providing apparatus 100 can collect order information input through an order interface corresponding to the interior product information in the consumer terminal 300 and perform payment processing.

[0072] Through this process, the service providing device 100 enables the interior business terminal 500 to generate an order interface including interior product information at low cost and with high quality using realistic scene images constructed from various content creator terminals 400, and receives order information from the consumer terminal 300 for such an order interface and processes payments, thereby providing an interior market platform more efficiently and at low cost.

[0073] In addition, creator information of the content creator terminal 400 can be used to calculate a reward corresponding to the realistic scene image. For example, when the inquiry and payment process for the interior product information is completed or the product is registered in the market platform interface, the service providing device 100 can calculate a reward for use of the realistic scene image and pay or provide the reward according to the creator information.

[0074] The detailed configuration of each device for achieving this will be described in more detail with reference to FIG.

[0075] 2, the service providing apparatus 100 includes a communication unit 105, an input unit 110, a style information analysis unit 120, a layout generation processing unit 130, a control unit 140, an interface output unit 150, a space and interior rendering unit 160, a service providing unit 170, and a storage unit 180. The components shown in FIG. 2 are not essential, and a terminal having more or fewer components may be implemented.

[0076] First, the communication unit 105 may include one or more modules that enable wired / wireless communication between the service providing device 100 and a rendering service network, or between the service providing device 100 and a network in which the user terminals 300, 400, and 500 are located.

[0077] For example, the communication unit 105 may include a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module. The mobile communication module transmits and receives wireless signals to and from at least one of a server device, a base station, an external terminal, and a server on a mobile communication network. The wireless Internet module means a module for wireless Internet connection, and may be built into or externally attached to the service providing device 100. As wireless Internet technologies, Wireless LAN (WLAN) (Wi-Fi), Wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed ​​Downlink Packet Access (HSDPA), and the like can be used.

[0078] A short-range communication module is a module for short-range communication. Short-range communication technologies that can be used include Bluetooth (registered trademark), RFID (Radio Frequency Identification), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc.

[0079] The location information module is a module for acquiring the location of a terminal, and a representative example thereof is a Global Position System (GPS) module.

[0080] Further, for example, the communication unit 105 can receive completed indoor structure information and interior layout information from the user terminal 300, 400, 500, or provide indoor structure information or interior layout information registered in correspondence with user information to the user terminal 300, 400, 500. Here, the interior layout information may include interior layout information obtained from video information input from the user terminal 300, 400, 500, or interior layout automation information processed by the service providing device 100.

[0081] The input unit 110 can receive and process input data for controlling user operations input from the user terminals 300, 400, and 500.

[0082] The style information analysis unit 120 analyzes the user's style information and transmits the analyzed style information to the layout generation processing unit 130. To this end, the style information analysis unit 120 may include a feature analysis unit 121.

[0083] First, the style information analysis unit 120 may receive style-related information corresponding to a user through the input unit 110 , and the input style-related information may be transferred to the feature analysis unit 121 .

[0084] More specifically, the style-related information may represent user-preferred interior information input by the user, and the style information analysis unit 120 may analyze the user-preferred interior information to calculate user style information to be transmitted to the layout generation processing unit 130.

[0085] Here, the style-related information may include interior image information that the user wants to construct in a similar form as a specific element representing the user's preferred interior information, or may include user style pattern information that the user directly selects and inputs.

[0086] For example, a user may input specific video or image information in order to apply a space interior layout similar to a specific video or image of a space interior to his / her own indoor structure information, or may input interior photo or video information viewed through a social networking service or link information of that social networking service as the style-related information.

[0087] Also, for example, a user can input preferred style information for an interior to be automatically arranged in his / her own indoor structural information as the style-related information. For example, a user can input various style information such as the size, arrangement, and matching style of furniture, and the size, form, number, and type of space through the user terminal 300, 400, 500, and the input unit 110 can receive the information.

[0088] The feature analysis unit 121 may analyze the style-related information to acquire user style information, and the acquired style information may be transmitted to the layout generation processing unit 130. Here, the user style information may include feature variable information for a layout generation iteration process of the layout generation processing unit 130.

[0089] More specifically, for example, the feature analysis unit 121 can perform a process of calculating feature variables for calculating an interior cost function based on the style information of the user.

[0090] The interior cost function is devised to determine the optimal space and interior layout in the layout generation processing unit 130, and may be used to evaluate the degree of realistic arrangement of the interior depending on the feature variables of the interior object set corresponding to the room structure information.

[0091] That is, the layout generation processing unit 130 can iteratively perform interior cost function calculations based on feature variable information to calculate an optimized space and interior layout, and the feature analysis unit 121 can analyze style information corresponding to the image information, etc., obtain feature variable information corresponding to the user's style information, and provide it to the layout generation processing unit 130.

[0092] As a result, the style information analyzed by the feature analysis unit 121 is used to calculate a spatial layout design function of the layout generation processing unit 130, and the layout generation processing unit 130 can determine the spatial layout design function for modifying the interior cost function.

[0093] For example, the layout x may include one or more sets of interior feature variables, which may correspond to, for example, room structures, walls, corners, windows, doors, and respective furniture object elements, and each element may be assigned a corresponding size, shape, type, position, and rotation value as a respective feature variable.

[0094] In addition, the space utilization rate analysis unit 123 may process the space utilization rate analysis for each layout. The space utilization rate analysis may take into consideration factors such as the margin of space, the density, and the proximity between spaces according to a movement path, and the space utilization rate analysis unit 123 may process a function of calculating the utilization rate of a specific layout when the layout is input and outputting the calculated utilization rate to the layout generation processing unit 130.

[0095] Furthermore, the space usage rate analysis unit 123 may be included as one element of the style information analysis unit 120. For example, the style information analyzed by the style information analysis unit 120 may also include space usage rate information, and thus, an allowable iteration threshold of space usage rate may be set differently for each user style.

[0096] Through such an iterative process, optimal interior layout automation information may be determined, and the determined interior layout automation information may be transmitted to the spatial and interior rendering unit 160.

[0097] Meanwhile, the rendering unit 160 can perform realistic scene image rendering processing for 3D virtual space interior content created directly by the user or by applying the interior layout automation information to indoor structure information, and the rendered space and interior data can be output to the user terminal 300, 400, 500 via the interface output unit 150.

[0098] In particular, the rendering unit 160 according to an embodiment of the present invention may configure distributed processing data optimized for realistic distributed rendering processing of a scene image projected to a first viewpoint corresponding to a 3D virtual space interior content provided to the user terminals 300, 400, and 500, transmit the configured distributed processing data to one or more cloud devices 200 connected to a rendering service network, receive a realistic scene partial image that has been distributed rendered from the cloud devices 200, and configure a realistic scene image of a first viewpoint corresponding to the 3D virtual space interior content. A more specific configuration will be described later with reference to Figures 9 to 15.

[0099] In addition, the rendering unit 160 according to an embodiment of the present invention determines a partial transformation boundary area corresponding to the range of influence due to object transformation, corresponding to a first object before transformation and a second object after transformation, performs only a re-rendering process of a realistic scene image corresponding to the partial transformation boundary area, and combines the re-rendered scene image portion with the remaining existing scene image portion to generate a realistic scene image in which the first object is transformed into the second object, thereby providing an object transformation process that minimizes the amount of calculation in the recalculation process while preventing the occurrence of a sense of strangeness, and a more specific configuration will be described later with reference to Figures 16 to 20.

[0100] Furthermore, the service providing unit 170 provides service functions such as space interior experience, interior editing, furniture tagging, and provision of furniture information and purchasing information based on the interior layout automation information.

[0101] Furthermore, the service providing unit 170 may include a market platform interface module for processing market platform services and order information, and may include a virtual space interior content creation module for supporting the creation and registration of realistic scene image content to be used in the market platform interface module.

[0102] For example, the service providing unit 170 uses a virtual space interior content creation module to enable the content creator terminal 400 to create realistic scene image content including furniture information used in the interior layout and purchase links, and can obtain creator information and register it in the database of the storage unit 180 for matching.

[0103] In addition, for example, the service providing unit 170 may output a tagging interface for one or more pieces of furniture information included in a video image in which interior layout automation information is rendered to the user terminal 300, 400, 500 via the interface output unit 150, and process a service that provides the furniture information and a purchase link according to a user input corresponding to the tagging interface.

[0104] This allows users to not only receive automated interior layout services, but also check detailed information and purchasing information for furniture that can be directly applied to their own interior spaces.

[0105] The interface output unit 150 provides the above-mentioned interface through the user terminal 300, 400, 500 to generate output related to vision, hearing, touch, etc. The user terminal 300, 400, 500 may include a display unit, an audio output module, an alarm unit, a haptic module, etc., and the interface output unit 150 can output data for controlling the display unit, the audio output module, the alarm unit, the haptic module, etc. to the user terminal 300, 400, 500.

[0106] The display unit of the user terminal 300, 400, 500 displays (outputs) information provided from the service providing device 100. For example, when the user terminal 300, 400, 500 is in an indoor simulation mode, it displays a user interface (UI) or a graphical user interface (GUI) related to the indoor simulation and floor plan. A user interface for generating indoor structural information according to an embodiment of the present invention may be displayed on the interface screen.

[0107] The display unit may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, and a 3D display.

[0108] The storage unit 180 can store a program for the operation of the control unit 140, and can also temporarily store input / output data.

[0109] The storage unit 180 may include at least one of the following types of storage media: flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), magnetic memory, magnetic disk, and optical disk. The service providing apparatus 100 may also operate in association with a web storage that performs the storage function of the storage unit 180 on the Internet.

[0110] The control unit 140 typically controls the overall operation of the terminal, and may store indoor structural information processed by interior automation in the storage unit 180 in response to user input information received from the user terminal 300, 400, 500, or process rendered data to be transmitted to the user terminal 300, 400, 500 via the communication unit 105.

[0111] For example, the three-dimensional furniture object data, the three-dimensional space interior data, and the indoor structure information processed by the automated interior design process generated by the user of the user terminal 300, 400, 500 may be matched to the user account information of the service providing device 100 and stored and managed in the cloud device 200 or the service providing device 100.

[0112] FIG. 3 is a block diagram for explaining the service providing unit according to the embodiment of the present invention in more detail.

[0113] Referring to FIG. 3, the service providing unit 170 according to an embodiment of the present invention includes a user information registration unit 1701, a realistic scene image content registration unit 1703, a market platform interface providing unit 1705, an order information processing unit 1707, and a reward providing unit 1709.

[0114] The user information registration unit 1701 can receive input of user information of the consumer terminal 300, the content creator terminal 400, and the interior business terminal 500, and can pre-store and register the information in the storage unit 180.

[0115] In addition, the realistic scene image content registration unit 1703 can process distributed rendering based on virtual space content data created by one or more user terminals in response to a request from the content creator terminal 400, to create one or more realistic scene image contents, and can match the one or more realistic scene image contents with creator information to store and register them in the database of the storage unit 180.

[0116] Furthermore, the market platform interface providing unit 1705 can provide an order interface authoring service using the realistic scene image to the interior business operator terminal 500, and can register interior product information based on authoring data input from the interior business operator terminal 500 in the interior market platform interface. The registered product information can be shared with one or more consumer terminals 300.

[0117] Thus, the market platform interface providing unit 1705 can provide the interior product information to the consumer terminal 300 via the interior market platform interface. Here, the interior product information may include the realistic scene image content described above.

[0118] In addition, the order information processing unit 1707 checks the order information input from the consumer terminal 300 and processes the payment. The order information processing unit 1707 may include one or more order payment modules (not shown) for supporting the order information and payment processing of the consumer terminal 300, and the payment information may be transmitted to the reward providing unit 1709.

[0119] In addition, the reward providing unit 1709 may provide or pay a predetermined ratio or amount of rewards corresponding to creator information of the realistic scene image applied to the interior product information to an account corresponding to the creator information.

[0120] Moreover, the predetermined percentage or amount of the reward may be determined in a variety of manners.

[0121] For example, the predetermined ratio or amount of the reward may be determined based on evaluation information of the realistic scene image collected through the interior market platform interface in response to the interior product information. Examples of the evaluation information include the number of inquiries, a rating value, the number of likes, etc.

[0122] In addition, the reward providing unit 1709 can receive a content usage fee from the interior business terminal and transmit it to a user account corresponding to the creator information when the interior product information is registered in the interior market platform interface, in addition to a reward for order payment.

[0123] Through such processing, a realistic interior scene image can be easily constructed based on the construction of each user's three-dimensional indoor space data, and a market platform interface can be provided based on the constructed realistic scene image content, thereby making it possible to easily generate an ordering interface for interior product information based on a competitive and realistic interior scene image without requiring excessive manpower (human resources).

[0124] In addition, by registering information about the creators of such realistic interior scene image content, it will be possible to charge a usage fee to interior design businesses or provide rewards by setting rewards, thereby increasing the participation of content creators and revitalizing market platform services.

[0125] FIG. 4 is a flowchart for explaining in more detail the service providing method according to the embodiment of the present invention.

[0126] Referring to FIG. 4, a service providing device 100 according to an embodiment of the present invention processes distributed cloud rendering based on 3D virtual space interior information created by one or more user terminals 300, 400, 500 to create realistic interior scene image content corresponding to one or more viewpoints (S1101).

[0127] Then, the service providing apparatus 100 matches the realistic scene image content with the creator information and registers it in the database of the storage unit 180 (S1103).

[0128] Next, the service providing device 100 provides an order interface authoring tool using realistic scene image content to the interior business operator terminal via the market platform interface (S1105).

[0129] Here, the order interface authoring tool may include an interface that allows the interior business operator terminal 500 to index and select product information registered in the market platform and corresponding realistic scene image content.

[0130] As described above, since the realistic scene image content may be mapped with tag information corresponding to the interior product or style arranged in the indoor space, the order interface authoring tool may provide a function of indexing one or more realistic scene image contents corresponding to the product information inputted by the interior business terminal 500 using the tag information and arranging the realistic scene image contents on the order interface. For example, when the interior construction product information inputted from the interior business terminal 500 includes a specific interior product or style information, the realistic scene image content including the specific interior product or style information as tag information may be indexed and provided through the order interface.

[0131] Next, the service providing device 100 registers the interior product information in the market platform interface in accordance with the order interface authoring data input from the interior business operator terminal (S1107).

[0132] Thereafter, the service providing apparatus 100 provides realistic scene image content through an order interface for interior product information output from the consumer terminal 300 connected to the market platform (S1109).

[0133] Here, the realistic scene image content may include tag information as described above, and the consumer terminal 300 can check each tag information and detailed quotation contents of the interior product information and input corresponding order information into the order interface.

[0134] Next, the service providing device 100 performs payment processing for the order information input from the consumer terminal 300 (S1111), and provides a predetermined ratio or amount of reward to the user terminal 400 of the content creator based on the payment information (S1113).

[0135] FIG. 5 is a diagram for explaining a market platform interface based on a realistic scene image according to an embodiment of the present invention.

[0136] As shown in FIG. 5A, a content creator terminal 400 can generate one or more realistic scene image contents in a distributed rendering manner based on three-dimensional virtual space interior data according to an embodiment of the present invention.

[0137] As shown in FIG. 5B, the constructed realistic scene image content can be processed as interior product information in the interior business terminal 500 and provided through an order interface.

[0138] Also, according to an embodiment of the present invention, the order interface may be a general payment order interface or may include an order interface for interior design and construction products, as shown in FIG. 5(B).

[0139] When an order or consultation application corresponding to the order interface is confirmed, the service providing device 100 may provide a reward corresponding to the creator information of the content creator terminal 400, and the ratio or amount of the reward may be determined according to at least one of the number of visitors, the number of likes, the evaluation score, the number of favorites, the order history information, or the consultation history information corresponding to the order interface.

[0140] 6 to 8 illustrate examples of indoor structure information interfaces provided by a service providing device and output from a user terminal by executing a method according to an embodiment of the present invention.

[0141] 6, the service providing apparatus 100 according to the embodiment of the present invention may provide an interior automation mode corresponding to the user's indoor structural information to the user terminal 300, 400, 500 through the interface output unit 150. The user may input desired style photo or video information as style related information, set a preferred style pattern, set a specific preferred furniture, or set and input that any recommended style is provided without separate setting through the input unit of the user terminal 300, 400, 500, and the input information of the user terminal 300, 400, 500 may be provided to the input unit 110 of the service providing apparatus 100. Then, the user may start the style analysis of the style information analysis unit 120 and the layout generation process of the layout generation processing unit 130 according to the embodiment of the present invention by inputting an automatic arrangement button.

[0142] Next, referring to FIG. 7, FIG. 7 is a diagram for explaining a layout, a layout automation result interface generated by an embodiment of the present invention, and shows that an indoor structure interface in which the spatial layout and interior are automatically arranged is rendered and output to the user terminal 300, 400, 500 via the interface output unit 160.

[0143] As shown in Fig. 7, the user can check the list of arranged products, furniture information, and purchase information, and can select to save or share the room structure information processed by the interior automation, or can request automation processing again with another style. In this way, since the interior layout automation processing of the room structure is possible according to various user style inputs, the user can intuitively and conveniently create space and interior design information without having to perform separate detailed design or ask a professional for work.

[0144] FIG. 8 is an exemplary diagram of a virtual space interior display including a tag interface according to an embodiment of the present invention.

[0145] As shown in Fig. 8, the service providing apparatus 100 according to another embodiment of the present invention may output a space and layout interface 101 rendered as a virtual space to the user terminals 300, 400, and 500 through the interface output unit 150, and may output the above-mentioned interface points to the space and layout interface. In Fig. 5, the interface points 101 are displayed as circles arranged on the object, but they may be output in various other forms such as a separate icon image, a rectangle, a triangle, a three-dimensional object, etc.

[0146] In particular, interface points according to embodiments of the present invention can be positioned in an optimized position so that objects exposed in the user's field of view are not overlapped but are not superimposed, allowing the user to easily select the interior object they desire without being stressed by excessive object information identification.

[0147] In addition, when a user performs a pointing input such as a touch or a virtual touch corresponding to the interface point 101 through the user terminal 300, 400, 500, the tag interface 103 may be output. The tag interface 103 may be linked to various service functions such as object information, related content information, and purchase information provided by the service providing unit 170. In addition, the service providing unit 170 may collect user selection input information and use it for future user statistical analysis, provision of recommended interiors, and the like.

[0148] FIG. 9 is a block diagram showing a more detailed view of the spatial and interior rendering unit according to an embodiment of the present invention, and FIGS. 10 and 11 are diagrams illustrating realistic scene rendered images according to an embodiment of the present invention.

[0149] As described above, the rendering unit 160 according to an embodiment of the present invention can perform distributed rendering of virtual space interior content provided to the user terminals 300, 400, and 500 into realistic scene images using a cloud service network configured by the cloud device 200, and can construct a realistic scene image database corresponding to each viewpoint in the storage unit 180 from the distributed rendered partial rendering images.

[0150] The rendering unit 160 can provide the user terminals 300, 400, and 500 with realistic scene images of 3D virtual space interior content corresponding to each viewpoint in response to a request from the control unit 140, the service providing unit 170, or the user terminals 300, 400, and 500.

[0151] Here, the 3D virtual space interior content may include furniture content pre-constructed in relation to the interior, indoor space interior content created by a user, or indoor space interior content constructed automatically. The realistic scene image processing may include a rendering distribution process based on global illumination as described above, and the rendering unit 160 may perform a data optimization process to enable efficient processing of computing resources in the rendering distribution process based on global illumination.

[0152] In addition, the rendering unit 160 may perform an object conversion process to convert one or more first objects included in a realistic scene image into a second object upon request of the user terminal 300, 400, 500, and may thereby render the object-converted realistic scene image and provide it to the user terminal 300, 400, 500.

[0153] More specifically, referring to FIG. 9, the rendering unit 160 according to an embodiment of the present invention includes a geometric information optimization unit 1601, a texel information optimization unit 1602, a transmission packet processing unit 1603, a realistic scene image construction unit 1604, and an object transformation image reconstruction unit 1605.

[0154] The geometric information optimization unit 1601 can optimize the geometric data of a scene image projected to a first viewpoint in accordance with the 3D virtual space interior.

[0155] In order to optimize geometric data, the geometric information optimization unit 1601 according to the embodiment of the present invention indexes the geometric data to be optimized, configures geometric data that can be processed as meta information from the indexed geometric data with an index of the meta information, configures a geometric buffer including at least a portion of the indexed geometric data and the index of the meta information, and transmits the same to the transmission packet processing unit 1603.

[0156] Then, the transmission packet processor 1603 packetizes the geometric data corresponding to the geometric buffer and the intra-buffer index, and transmits the packetized data to one or more cloud devices 200.

[0157] Typically, model data in a 3D graphic application can be mainly described as geometric data, and when examining the pattern of the geometric data, it can be seen that the ratio of data generated by vertices such as vertex, normal, and face accounts for about 45% to 95% of the total, which is much larger than the data generated by other commands. Therefore, it can be seen that the geometric data in the transmission packet that is requested to perform distributed processing on the cloud device 200 has an average overlap rate of 35% to 61%.

[0158] As a result, as a method for reducing network traffic required for distributed processing using the cloud device 200, the geometric information optimization unit 1601 according to an embodiment of the present invention processes meta information index mapping corresponding to geometric data including vertex information that is similar to the data requested for distribution, and transmits only the meta information index, thereby reducing the overall network bandwidth for building a realistic scene image rendering process as a cloud service.

[0159] For example, the meta information index of the geometric data may include index information of the geometric data transmitted in advance, and at least one of position information, rotation information, and scale information index corresponding to the index information.

[0160] This allows the cloud device 200 to distribute realistic rendering processes such as ray tracing based on global illumination using the geometric data and meta-information index, thereby reducing the network bandwidth required for this.

[0161] On the other hand, the texel information optimizer 1602 can handle the optimization of texture pixel data (texel data) obtained by projecting a three-dimensional object rendered by geometric data onto a two-dimensional realistic scene image.

[0162] More specifically, in order to optimize texture data, the texel information optimization unit 1602 configures a Z-buffer corresponding to the texture data to be optimized, resizes the texture data according to a texture ratio configured in the Z-buffer, obtains texel information and memory area information to be used for rendering, and configures a texture buffer by indexing the texture data to be resized according to the memory area information and the texel information.

[0163] The texture buffer configured in this manner can be transmitted to the transmission packet processing unit 1603, and the transmission packet processing unit 1603 can packetize the texture buffer including index information of the texture data to be resized and a texture data partial rendering request including the texture data to be resized, and transmit the packetized request to the cloud device 200.

[0164] Here, the Z-buffer is a method of managing image depth coordinates in 3D graphics, and may refer to a depth buffer in which depth information (z-coordinate) of resized and configured pixels is stored when 3D data is rendered into a 2D scene image. Such a buffer may be aligned to each corresponding screen pixel element based on the 2D coordinates (xy), and if another object needs to be rendered in the same pixel, the Z-buffer may be used to compare the depth of the current pixel and the newly drawn pixel to see which is closer to the viewer.

[0165] Such a Z-buffer construction process utilizes various technical elements well known in the field of graphics processing, and with the Z-buffer construction, resize information for the texel information to be rendered and memory information to be used for rendering are obtained in advance.

[0166] As a result, the texel information optimization unit 1602 according to an embodiment of the present invention can configure a texture buffer including texture data to be resized by a Z-buffer configuration process, index information of the texture data to be resized, and memory area information corresponding to the texture data to be resized, in order to reduce the duplication rate of data transmitted to the cloud device 200 and to reduce the capacity of transmission packets and increase bandwidth efficiency, and transmit the texture buffer to the transmission packet processing unit 1603.

[0167] The texture buffer may include meta information mapped to index information of texture data, and the meta information may include main texel information and representative color information, where the representative color information may include color information representing an overall color of texture data requested for partial rendering, and the main texel information may include texture information assigned corresponding to a main object in a 3D virtual space to be substantially rendered.

[0168] In this way, with the texture buffer configuration required for distributed rendering, the cloud device 200 performs realistic scene image rendering for each texel corresponding to the main texel area when constructing the rendering data, and for the remaining areas, it is possible to efficiently process data by collectively processing realistic scene image rendering using representative color information.

[0169] In addition, the texture buffer configuration of the texel information optimization unit 1602 allows the texture data contained in the transmission packet to be resized and indexed based on the Z-buffer configuration process to reduce the transmission packet capacity and reduce overlapping utilization, thereby reducing network bandwidth and utilization and enabling efficient distributed processing of realistic scene images.

[0170] Meanwhile, the realistic scene image constructing unit 1604 receives partial scene images rendered in each cloud device 200 based on data transmitted from the transmission packet processing unit 1603 to the cloud device 200, constructs a realistic scene image corresponding to the first viewpoint by combining and constructing the received partial scene images, stores and manages the same using the storage unit 140, and provides a pre-constructed realistic scene image in response to a request from the user terminals 300, 400, and 500. As described above, the first viewpoint can be extended to multiple viewpoints, and the realistic scene image according to the embodiment of the present invention may be provided as multiple realistic scene image contents in the form of an omnidirectional (720 degrees) or 360-degree realistic scene image of a specific object.

[0171] The object transformation image reconstruction unit (1605) determines a partial transformation boundary area corresponding to the range of influence caused by the object transformation, corresponding to the first object before transformation and the second object after transformation, and performs only a re-rendering process of a realistic scene image corresponding to the partial transformation boundary area, and combines the re-rendered scene image portion with the remaining existing scene image portion to generate a realistic scene image in which the first object is transformed into the second object, thereby providing an object transformation process that minimizes the amount of calculation in the recalculation process while preventing the occurrence of a foreign texture.

[0172] More specifically, the object transformation image reconstruction unit 1605 may determine a first object to be transformed of the virtual space interior content corresponding to the first realistic scene image, and the first object may be exemplified as a furniture object to which a tag interface is mapped.

[0173] In addition, the object transformed image reconstruction unit 1605 may set a first boundary area corresponding to the first object before transformation and a second boundary area corresponding to the second object after transformation, and after merging the first boundary area and the second boundary area, may determine a partial transformed boundary area using convex hull algorithms, and the object transformed image reconstruction unit 1605 may reconstruct an object transformed image through a re-rendering process corresponding to the partial transformed boundary area.

[0174] Here, the re-rendering process may be performed by the object conversion image reconstruction unit 1605 of the service providing device 100, but preferably, it may be requested and processed in a distributed manner by one or more cloud devices 200 via the aforementioned geometric information optimization unit 1601 and texel information optimization unit 1602 and transmission packet processing unit 1603.

[0175] More specifically, the object conversion image reconstruction unit 1605 may acquire margin setting information for setting a first boundary area and a second boundary area, the margin setting information of the first boundary area may correspond to a range of a surrounding area affected by an existing first object, and the margin setting information of the second boundary area may correspond to a range of a surrounding area affected by a replaced second object. Each boundary area may have various shapes, but a rectangle is preferable for improving processing efficiency.

[0176] In addition, the object conversion image reconstruction unit 1605 can determine a merged area by merging the first boundary area and the second boundary area. Here, when the first boundary area and the second boundary area are simply overlapped, the merged area may not be formed in a connected form as a whole.

[0177] Thereby, the object transformed image reconstruction unit 1605 can apply a convex hull algorithm to determine a merged structure including one or more first intersection points formed by the intersection of the first boundary area and the second boundary area, and a partial transformed boundary area including the merged structure and the intersection points can be determined.

[0178] Thus, the partial transformation boundary area may be an area obtained by simply combining the first boundary area and the second boundary area, or may be an area formed by merging the first boundary area and the second boundary area using a convex hull algorithm. Also, the object transformation image reconstructing unit 1605 may generate distributed rendering request data using the partial transformation boundary area and second object information exchanged therewith, and transmit the distributed rendering request data to one or more cloud devices 200.

[0179] Thus, the area of ​​re-rendering due to the particular first object selected and the second object replaced may be minimized, and the amount of processing may be reduced while bandwidth efficiency and network utilization may be increased.

[0180] FIG. 10 is a diagram illustrating an example of a realistic scene image processing corresponding to an interior of an indoor space structure as a virtual space interior content of the rendering unit 160 according to an embodiment of the present invention.

[0181] As shown in the upper part of FIG. 10, the user terminal 300, 400, 500 or the service providing apparatus 100 may set the first viewpoint information and the global illumination information in advance.

[0182] In addition, the virtual space interior information can be composed of photographed realistic scene images, as shown in the lower part of Figure 7, through distributed rendering processing based on the cloud device 200 of the rendering unit 160 corresponding to the set lighting information and viewpoint information, and can be provided to the user terminals 300, 400, and 500.

[0183] FIG. 11 is a diagram illustrating an example of a realistic scene image processing corresponding to furniture interior information as virtual space interior content of the rendering unit 160 according to an embodiment of the present invention.

[0184] As shown on the left side of FIG. 11, the user terminal 300, 400, 500 or the service providing device 100 may set furniture information to be rendered in advance.

[0185] In addition, virtual space interior information including furniture information can be composed of photographed realistic scene images as shown on the right side of Figure 11 by distributed rendering processing based on the cloud device 200 of the rendering unit 160, and provided to the user terminals 300, 400, and 500.

[0186] 12 to 14 are flowcharts for explaining in more detail the operation of the rendering unit according to the embodiment of the present invention.

[0187] First, FIG. 12 is a first flowchart for explaining the operation of the rendering unit 160 of the service providing apparatus 100 according to an embodiment of the present invention, in which the service providing apparatus 100 initializes a geometry buffer by determining a geometry data optimization process of a scene image projected to a first viewpoint corresponding to a 3D virtual space interior (S101).

[0188] Next, the service providing device 100 indexes the geometric data (eg, vertex data) to be optimized (S103), and determines whether meta-information corresponding to the geometric data needs to be processed (S105).

[0189] Here, whether or not to process the meta information may be determined based on whether or not there is identical or similar geometric data contained in the geometric buffer, whether the bandwidth is reduced, whether the compression rate is increased or decreased, etc. If there is no identical or similar geometric data, the service providing device 100 inserts the geometric data and index information corresponding to the geometric data into the geometric buffer without performing meta information processing (S107), and packetizes the geometric buffer and the geometric data corresponding to the index in the buffer and transmits them to one or more cloud devices (S109).

[0190] On the other hand, when meta information processing is required, the service providing device 100 configures meta information (position information, rotation information, scale information) of the geometric data into a meta information index and inserts it into the geometric buffer (S111), and packetizes the geometric buffer and the geometric data corresponding to the meta information index in the buffer and transmits them to one or more cloud devices (S113).

[0191] Thereafter, the service providing device 100 receives realistic scene partial images that have been partially rendered using the geometric buffer from a plurality of cloud devices 200, and constructs a realistic scene image corresponding to the 3D virtual space interior content (S115).

[0192] Also, Figure 13 is a second flowchart illustrating the operation of the rendering unit 160 of the service providing device 100 according to an embodiment of the present invention, in which the service providing device 100 initializes a texture buffer in response to a decision to optimize texture data of a scene image projected to a first viewpoint in accordance with a 3D virtual space interior (S201).

[0193] Next, the service providing device 100 configures a Z-buffer corresponding to the texture data to be optimized (S203).

[0194] Thereafter, the service providing device 100 resizes the texture data according to the ratio configured in the Z-buffer, and obtains texel information and memory area information to be used for rendering (S05).

[0195] Next, the service providing device 100 indexes the texture data to be resized based on the memory area information and the texel information and inserts the indexed texture data into the texture buffer (S207).

[0196] Thereafter, the service providing device 100 packetizes the texture buffer including the index information of the texture data to be resized and transmits the packetized texture buffer to the cloud device 200 (209).

[0197] Then, the service providing apparatus 100 receives the partially rendered realistic scene partial image using the texture buffer, and constructs a realistic scene image corresponding to the 3D virtual space interior content (S211).

[0198] Meanwhile, FIG. 14 is a flowchart illustrating the operation of the cloud device 200 according to the embodiment of the present invention.

[0199] Referring to FIG. 14, the cloud device 200 receives packet data for distributed rendering from the service providing device 100, which is a master device (S301).

[0200] Next, the cloud device 200 first obtains the geometric data and the meta information index from the packet data, and performs vertex shader processing and rasterization processing (S303).

[0201] Next, the cloud device 200 obtains the index information of the texture data resized based on the Z-buffer and the texture data from the packet data, and allocates memory for applying the fragment shader (S305).

[0202] The cloud device 200 then applies a fragment shader corresponding to the rasterized data to determine rasterized pixel values ​​to construct a partially rendered realistic scene image (S307).

[0203] Then, the cloud device 200 transmits the partially rendered realistic scene image to the service providing device 100, which is the master device (S309).

[0204] Here, the cloud device 200 can perform various global illumination processes to provide realistic effects in the shading process of each step. The global illumination method is preferably a ray tracing method that traces light rays backwards, but methods such as path tracing, photon mapping, and radiosity may also be added.

[0205] FIG. 15 is a diagram illustrating a transmission packet structure configured by the rendering unit 160 according to an embodiment of the present invention.

[0206] FIG. 15A shows the data structure before optimization, in which geometric data such as Vector3f and texture data such as X, Y, and Z can exist overlapping throughout the original three-dimensional data.

[0207] As a result, the rendering unit 160 according to an embodiment of the present invention performs indexing of geometric meta information by the geometric information optimization unit 1601, and indexes texel information and memory information based on the Z-buffer by the texel information optimization unit 1602, thereby constructing optimized transmission packet data as shown in FIG. 12(B).

[0208] Such data optimization processing by the service providing device 100 enables realistic scene data configuration based on a cloud service network, improving the quality of realistic scene images provided to the user terminals 300, 400, 500, shortening processing time, reducing network bandwidth, and improving overall service efficiency.

[0209] 16 to 20 are diagrams for explaining in more detail the object conversion operation of the rendering unit according to the embodiment of the present invention.

[0210] First, referring to FIG. 16, the object transformation image reconstructing unit (1605) sets a transformation object of a virtual space interior content corresponding to a first realistic scene image (S401).

[0211] Next, the object transformed image reconstructing unit 1605 sets a first boundary area corresponding to the first object before transformation (S403).

[0212] Thereafter, the object transformed image reconstructing unit 1605 sets a second boundary area corresponding to the transformed second object (S405).

[0213] Next, the object transformed image reconstruction unit 1605 merges the first boundary region and the second boundary region, and then determines a partial transformed boundary region by a convex hull algorithm.

[0214] Thereafter, the object transformed image reconstruction unit 1605 performs a re-rendering process corresponding to the partial transformed boundary area (S409), and combines the re-rendered scene image portion with the remaining existing image portion of the first realistic scene image to generate a transformed realistic scene image (S411).

[0215] Next, the object transformed image reconstructing unit 1605 stores and manages the transformed realistic scene image as a second realistic scene image transformed into a second object for the first object (S413).

[0216] Then, the object conversion image reconstruction unit 1605 provides a conversion service using the pre-converted second realistic scene image to the user terminal 300, 400, 500 via the service providing unit 170 in response to a request to exchange objects in the image (S415).

[0217] 17, boundary areas for changing a first object 13 before conversion into a second object 12 after conversion are shown. Referring to FIG 17, the first boundary area 13 and the second boundary area 14 may be determined differently depending on the form or shape of each of the objects 11 and 12.

[0218] 18, the object conversion image reconstructing unit 1605 according to the embodiment of the present invention may form a merged region 15 by merging the first boundary region 13 and the second boundary region 14. In the embodiment of FIG.

[0219] By forming such a merged region 15, it is possible to set an object range that has a substantial influence when constructing a realistic scene image.

[0220] However, since the object range is preferably a polygon, it is preferable that the range be set by a merged region 15 of convex hull regions for forming the polygon.

[0221] As shown in Fig. 19, the convex hull region can mean a convex polygon region that includes all the remaining nodes when some of the points (nodes) that make up the polygon are connected. There are various general algorithms available for determining the convex hull region, including Graham's scan, which can be executed in O(n) time by arranging the nodes.

[0222] This method constructs a list that sorts the edges of the nodes in clockwise or counterclockwise order, and while indexing each node sequentially in a clockwise or counterclockwise direction, it determines whether or not the node constitutes a convex hull depending on whether it is contained inside the convex hull region.

[0223] Thus, FIG. 19 shows that the determined merged region 15 is determined according to a convex hull algorithm.

[0224] Also, the object transformed image reconstructing unit 1605 may determine the merged region 15 as a partial transformed boundary region. The object transformed image reconstructing unit 1605 may reconstruct a realistic scene image that has been object transformed by a re-rendering process corresponding to the partial transformed boundary region without performing separate whole image rendering.

[0225] FIG. 20 is a diagram showing an example of an interface screen of the user terminal 300, 400, 500 after the re-rendering process of the object transformation image reconstructing unit 1605 according to an embodiment of the present invention.

[0226] As shown in FIG. 20(A), a user of a user terminal 300, 400, 500 can select a first object 11 to be exchanged on a realistic scene image-rendered virtual space interior image, and the service providing device 100 can determine the corresponding first boundary area 13 to be a rectangle.

[0227] 20(B), the user can select the second object information to be exchanged. For example, the second object 12 may be an exchangeable furniture interior such as a chair or a sofa, and related three-dimensional object information may be stored in advance in the storage unit 140.

[0228] Thereafter, when an exchange confirmation input is received as shown in FIG. 20(C), the service providing device 100 processes only the re-rendering corresponding to the partial transformation boundary area 15 as shown in FIG. 20(E) of the first image on which realistic scene image rendering has been performed as shown in FIG. 20(D), and can output to the user terminal 300, 400, 500 a second realistic scene image including the pre-constructed second object 12 merged with the remaining area that has not been re-rendered.

[0229] With this processing, even when an object is changed, highly complex rendering such as global illumination rendering for each object transformation is partially processed and merged without being reprocessed entirely, thereby improving efficiency, and it is possible to configure partial transformation boundary areas that do not reduce the sense of heterogeneity and realism, thereby providing a natural object transformation service processing.

[0230] FIG. 21 is a diagram for illustrating an outline of the entire system according to the second embodiment of the present invention.

[0231] Referring to FIG. 21, the overall system according to the second embodiment of the present invention includes a service providing device, one or more cloud devices 200, a consumer terminal 300, and a furniture sales service terminal 500, and may optionally include a furniture content creator terminal 400, or the furniture sales service terminal 500 may perform the functions of the furniture content creator terminal 400.

[0232] First, the consumer terminal 300, furniture content creator terminal 400, and furniture sales service terminal 500 described in this specification can be collectively referred to as user terminals 300, 400, and 500 based on their general functions. First, these general functions will be described, and the operation of each terminal will be omitted as it is the same as that described in FIG. 1.

[0233] In addition, the furniture sales service terminal 500 may be a user terminal of a business providing a furniture sales service, and may create and register realistic scene image content corresponding to furniture items in the service providing apparatus 100, generate an order interface including furniture product information to be sold, and request the service providing apparatus 100 to register the generated order interface. The order interface requested to be registered may be registered in a furniture sales market platform interface provided by the service providing apparatus 100.

[0234] Here, the furniture product information for sale may include one or more realistic scene image contents corresponding to the furniture items, and the realistic scene image contents may include a plurality of realistic scene images respectively rendered according to a plurality of viewing angles corresponding to the three-dimensional furniture data, and thus, the service providing device 100 may combine the plurality of realistic scene images according to the plurality of viewing angles to construct the realistic scene image contents corresponding to the furniture items.

[0235] In addition, for example, the realistic scene image content may be constructed by converting a specific furniture object area of ​​a virtual space interior content acquired from one or more user terminals 300, 400, 500 into a realistic scene image corresponding to the furniture item.

[0236] Furthermore, when the order interface based on this is registered in the furniture sales market interface, the service providing device 100 may pay the furniture content creator and the creator of the virtual space interior content a usage fee or a reward equivalent to the usage fee.

[0237] For example, the service providing apparatus 100 may provide a predetermined ratio or amount of rewards to the user terminal account that provided the virtual space interior content by inputting order information of an order interface corresponding to the furniture product information. Here, the predetermined ratio or amount of rewards may be determined according to evaluation information of the realistic scene image collected through the furniture sales market platform interface corresponding to the furniture product information.

[0238] Thus, the service providing apparatus 100 can provide furniture product information including the realistic scene image content to one or more consumer terminals 300 connected to the market platform interface.

[0239] In addition, the service providing device 100 can collect order information input through an order interface corresponding to the furniture product information in the consumer terminal 300 and perform payment processing.

[0240] Through this process, the service providing device 100 enables the furniture sales service terminal 500 to generate an order interface including furniture product information at low cost and with high quality using realistic scene images corresponding to furniture items configured from various furniture content creator terminals 400 or furniture sales service terminals 500, and receives order information from the consumer terminal 300 for such an order interface and performs payment processing, thereby providing a furniture sales market platform more efficiently and at low cost.

[0241] The detailed configuration of each device for implementing the second embodiment will be described in more detail with reference to FIG.

[0242] 22, the service providing apparatus 100 includes a communication unit 105, an input unit 110, a style information analysis unit 120, a layout generation processing unit 130, a control unit 140, an interface output unit 150, a space and interior rendering unit 160, a service providing unit 170, and a storage unit 180. The components shown in FIG. 22 are not essential, and a terminal having more or fewer components may be implemented.

[0243] This is generally similar to that shown in FIG. 2 described above, so a description of parts that operate in a similar manner will be omitted.

[0244] The service providing unit 170 may include a market platform interface module for processing furniture sales market platform services and order information, and may include a virtual space interior content creation module for supporting the creation and registration of realistic scene image content for each furniture item used in the furniture sales market platform interface module.

[0245] For example, the service providing unit 170 enables the content creator terminal 400 to create realistic scene image content including furniture information used in the interior layout and a purchase link using a virtual space interior content creation module, and can obtain creator and seller information and register it in the database of the storage unit 180 for matching.

[0246] In addition, for example, the service providing unit 170 may output a tagging interface for one or more pieces of furniture information included in a video image in which interior layout automation information is rendered to the user terminal 300, 400, 500 via the interface output unit 150, and process a service that provides the furniture information and a purchase link according to a user input corresponding to the tagging interface.

[0247] This allows users to not only receive automated interior layout services, but also directly check detailed information and purchasing information for furniture to be applied to their own interior spaces.

[0248] FIG. 23 is a block diagram for explaining in more detail the service providing unit according to the second embodiment of the present invention.

[0249] 23, the service providing unit 170 according to the embodiment of the present invention includes a user information registration unit 1701, a realistic scene image content registration unit 1703, a market platform interface providing unit 1705, an order information processing unit 1707, and a reward providing unit 1709.

[0250] The user information registration unit 1701 can receive input of user information of the consumer terminal 300, the furniture content creator terminal 400, and the furniture sales service terminal 500, and can pre-store and register the information in the storage unit 180.

[0251] Also, the furniture production data processing unit 1702 can receive furniture item data input from the furniture content creator terminal 400 or the furniture sales service terminal 500 and configure it as three-dimensional virtual space data. Here, the furniture item data may be three-dimensional data or may include a plurality of image data, and the three-dimensional virtual space data may include three-dimensional contour coordinates and texture information of the furniture items.

[0252] In addition, the realistic scene image content registration unit 1703 can process distributed rendering based on the furniture item data in response to a request from the furniture sales service terminal 500 to create one or more realistic scene image contents, and can match the one or more realistic scene image contents with creator and seller information to store and register them in the database of the storage unit 180.

[0253] In addition, the market platform interface providing unit 1705 can provide a furniture sales interface authoring service using the realistic scene image to the furniture sales service terminal 500, and can register furniture product information based on authoring data input from the furniture sales service terminal 500 in the furniture sales market platform interface. The registered product information can be shared with one or more consumer terminals 300.

[0254] Thus, the market platform interface providing unit 1705 can provide the furniture product information to the consumer terminal 300 through the furniture sales market platform interface. Here, the furniture product information may include the realistic scene image content described above.

[0255] In addition, the order information processing unit 1707 checks the order information and processes the payment input from the consumer terminal 300. The order information processing unit 1707 may include one or more order payment modules (not shown) for supporting the order information and payment processing of the consumer terminal 300, and the payment information may be transmitted to the reward providing unit 1709.

[0256] In addition, when the realistic scene image applied to the furniture product information includes virtual space interior content, the reward providing unit 1709 may provide or pay a predetermined ratio or amount of rewards corresponding to the creator information of the virtual space interior content to an account corresponding to the creator information.

[0257] Additionally, the predetermined ratio or amount of the reward may be determined in a variety of ways.

[0258] For example, the predetermined ratio or amount of the reward may be determined according to evaluation information of the realistic scene image collected through the furniture sales market platform interface in response to the furniture product information, such as the number of inquiries, the score, the number of likes, etc.

[0259] In addition, the reward providing unit 1709 can receive not only rewards for order payments, but also content usage fees from the furniture sales service terminal when the furniture product information is registered in the furniture sales market platform interface, and transmit the fees to a user account corresponding to the creator information.

[0260] Through such processing, a realistic interior scene image based on three-dimensional furniture item data can be easily constructed, and a furniture sales market platform interface based on the constructed realistic scene image content can be provided, thereby making it possible to easily generate an ordering interface for furniture product information based on competitively realistic furniture item scene images without excessive manpower (human resources).

[0261] In addition, by registering and managing such realistic scene image content and related creator information, it becomes possible to charge a usage fee to furniture sellers or provide rewards by setting rewards, thereby increasing the participation of content creators and revitalizing market platform services.

[0262] FIG. 24 is a flowchart for explaining in more detail the service providing method according to the second embodiment of the present invention.

[0263] Referring to FIG. 24, the service providing device 100 according to an embodiment of the present invention processes distributed cloud rendering based on 3D furniture data created by a seller terminal to create realistic interior scene image content corresponding to one or more viewpoints (S1101).

[0264] The service providing device 100 then matches the realistic scene image content with the creator and seller information and registers it in the database of the storage unit 180 (S1103).

[0265] Next, the service providing apparatus 100 provides an order interface authoring tool using realistic scene image content to the furniture sales service terminal 500 via the market platform interface (S1105).

[0266] Here, the order interface authoring tool may include an interface that allows the furniture sales service terminal 500 to index and select product information registered in the furniture sales market platform and corresponding realistic scene image content.

[0267] Next, the service providing device 100 registers the interior product information in the market platform interface in accordance with the order interface authoring data input from the furniture sales service terminal 500 (S1107).

[0268] Thereafter, the service providing apparatus 100 provides realistic scene image content through an order interface for interior product information output from the consumer terminal 300 connected to the market platform (S1109).

[0269] Here, the realistic scene image content may include a plurality of realistic scene images corresponding to a plurality of viewing angles, and the consumer terminal 300 can check the detailed form and interior suitability of the furniture product information according to each viewing angle, and input the corresponding order information into the order interface.

[0270] Next, the service providing device 100 performs a payment process for the order information input from the consumer terminal 300 (S1111).

[0271] If the realistic scene image content includes virtual space interior content created by another user terminal, the service providing device 100 may provide a predetermined ratio or amount of reward to the user terminal of the furniture content creator.

[0272] FIG. 25 is a diagram for explaining a market platform interface based on a realistic scene image according to the second embodiment of the present invention.

[0273] As shown in FIG. 25(A), a furniture sales service terminal 500 or a furniture content creator terminal 400 can input furniture item data according to an embodiment of the present invention in an image upload manner through a furniture item production interface provided by the service providing device 100, and can construct furniture data based on a three-dimensional image using a three-dimensional furniture data template as shown in FIG. 25(B).

[0274] 25C, the space and interior rendering unit 160 of the service providing apparatus 100 may generate realistic scene image content for each viewpoint direction by a distributed rendering process of the realistic scene image. Here, the viewpoint angle may be subdivided to a degree that allows rotation of 720 degrees, and as a result, the distributed rendering data of the realistic scene image may be used as rotatable 3D object data to be rendered on an augmented reality or virtual reality display.

[0275] Meanwhile, as shown in FIG. 25(D), the constructed realistic scene image content may be processed as furniture product information in the furniture sales service terminal 500 and provided via an order interface.

[0276] In addition, according to an embodiment of the present invention, the order interface may be provided with not only realistic scene image content of the furniture item itself, but also realistic scene image content combined with the surrounding virtual space interior content, which may be rendered using an object conversion method or the like and output to the order interface.

[0277] 26 to 30 are diagrams for explaining the system and operation according to the third embodiment of the present invention.

[0278] FIG. 26 is a diagram for illustrating an outline of the entire system according to the third embodiment of the present invention.

[0279] 26, the overall system according to the third embodiment of the present invention includes a service providing device 100, one or more cloud devices 200, a consumer terminal 300, a content creator terminal 400, and a real estate agent terminal 500.

[0280] First, the consumer terminal 300, content creator terminal 400 and real estate business terminal 500 described in this specification can be collectively referred to as user terminals 300, 400 and 500 based on their general functions. Since such general functions and the operation of each terminal have been described in detail in FIG. 1, the description thereof will be omitted.

[0281] The real estate business terminal 500 may be a user terminal of a business providing interior products and services, and may generate an intermediation interface including product information to be sold by using realistic scene image content registered in the service providing device 100, and may request the service providing device 100 to register the generated intermediation interface. The intermediation interface requested to be registered may be registered in an interior related market platform interface provided by the service providing device 100.

[0282] For example, product information to be sold may include an interior construction product, and the realistic scene image content may be provided as a construction sample image of the interior construction product. In order to generate an intermediation interface, the service providing device 100 may provide an intermediation interface authoring service including the construction sample image to the real estate business operator terminal 500, and may register real estate product information based on the authoring data input from the real estate business operator terminal 500 in the real estate market platform interface.

[0283] Thus, the service providing apparatus 100 can provide real estate product information including the realistic scene image content to one or more consumer terminals 300 connected to the market platform interface. The service providing apparatus 100 can collect real estate brokerage request information input through a real estate brokerage interface corresponding to the real estate product information in the consumer terminal 300 and perform brokerage processing.

[0284] Through this process, the service providing device 100 enables the real estate business terminal 500 to generate an intermediation interface including real estate product information at low cost and with high quality using realistic scene images constructed from various content creator terminals 400, and receives intermediation request information from the consumer terminal 300 for such an intermediation interface and performs payment processing, thereby providing a real estate market platform more efficiently and at low cost.

[0285] In addition, creator information of the content creator terminal 400 can be used to calculate a reward corresponding to the realistic scene image. For example, when the inquiry and payment process for the real estate product information is completed or the real estate product information is registered in the market platform interface, the service providing device 100 can calculate a reward for the use of the realistic scene image and pay or provide the reward according to the creator information.

[0286] The detailed configuration of each device for achieving this will be described in more detail with reference to FIG.

[0287] 27, the service providing apparatus 100 includes a communication unit 105, an input unit 110, a style information analysis unit 120, a layout generation processing unit 130, a control unit 140, an interface output unit 150, a space and interior rendering unit 160, a service providing unit 170, and a storage unit 180. The components shown in FIG. 27 are not essential, and a terminal having more or fewer components may be implemented. Also, since the overall system is similar to the configuration of FIG. 2, a description of the same functional components as those described above will be omitted.

[0288] The service providing unit 170 may include a market platform interface module for processing market platform services and intermediation request information, and may include a virtual space interior content creation module for supporting the creation and registration of realistic scene image content to be used in the market platform interface module.

[0289] For example, the service providing unit 170 can use a virtual space interior content creation module to enable the content creator terminal 400 to create realistic scene image content including furniture information used in the interior layout and a purchase link, and can obtain creator information and register it in the database of the storage unit 180 for matching.

[0290] In addition, for example, the service providing unit 170 may output a tagging interface for one or more pieces of furniture information included in a video image in which interior layout automation information is rendered to the user terminal 300, 400, 500 via the interface output unit 150, and process a service that provides the furniture information and a purchase link according to a user input corresponding to the tagging interface.

[0291] This allows users to not only receive automated interior layout services, but also directly check detailed information and purchasing information for furniture to be applied to their own interior spaces.

[0292] FIG. 28 is a block diagram for explaining the service providing unit according to the embodiment of the present invention in more detail.

[0293] 28, the service providing unit 170 according to an embodiment of the present invention includes a user information registration unit 1701, a realistic scene image content registration unit 1703, a market platform interface providing unit 1705, an intermediary order information processing unit 1707, and a reward providing unit 1709.

[0294] The user information registration unit 1701 can receive input of user information of the consumer terminal 300, the content creator terminal 400, and the real estate agent terminal 500, and can pre-save and register the information in the storage unit 180.

[0295] In addition, the realistic scene image content registration unit 1703 can process distributed rendering based on virtual space content data created by one or more user terminals in response to a request from the content creator terminal 400, to create one or more realistic scene image contents, and can match the one or more realistic scene image contents with creator information to store and register them in the database of the storage unit 180.

[0296] In addition, the market platform interface providing unit 1705 can provide an intermediary interface authoring service using the realistic scene image to the real estate business operator terminal 500, and can register real estate product information based on the authoring data input from the real estate business operator terminal 500 in the real estate market platform interface. The registered product information can be shared with one or more consumer terminals 300.

[0297] Thus, the market platform interface providing unit 1705 can provide the real estate product information to the consumer terminal 300 through the real estate market platform interface. Here, the real estate product information may include the realistic scene image content described above.

[0298] In addition, the brokerage order information processing unit 1707 checks brokerage request information and processes related information input from the consumer terminal 300. The brokerage order information processing unit 1707 may include one or more brokerage modules (not shown) for supporting real estate transaction brokerage information corresponding to the brokerage request of the consumer terminal 300 and related interior manufacturer recommendation processing, and the like, and the brokerage information may be transmitted to a reward providing unit 1709.

[0299] In addition, the reward providing unit 1709 may provide or pay a predetermined ratio or amount of reward corresponding to the creator information of the realistic scene image applied to the real estate product information according to the intermediation information to an account corresponding to the creator information.

[0300] Additionally, the predetermined ratio or amount of the reward may be determined in a variety of ways.

[0301] For example, the predetermined ratio or amount of the reward may be determined according to evaluation information of the realistic scene image collected through the real estate market platform interface in response to the real estate product information, such as the number of inquiries, a rating value, the number of likes, etc.

[0302] In addition, the reward providing unit 1709 can receive a content usage fee from the real estate business operator terminal 500 and transmit it to a user account corresponding to the creator information when the real estate product information is registered in the real estate market platform interface, in addition to providing rewards for real estate brokerage information.

[0303] Through such processing, a realistic interior scene image based on the construction of each user's three-dimensional indoor space data can be easily constructed, and a market platform interface based on the constructed realistic scene image content can be provided, thereby making it possible to easily generate an intermediary interface for real estate product information based on a competitive realistic interior scene image without requiring excessive manpower (human resources).

[0304] In addition, by registering information about the creators of such realistic interior scene image content, it will be possible to charge a usage fee to real estate businesses or provide rewards through reward settings, thereby increasing the participation of content creators and revitalizing market platform services.

[0305] FIG. 29 is a flowchart for explaining in more detail the service providing method according to the embodiment of the present invention.

[0306] Referring to FIG. 29, a service providing device 100 according to an embodiment of the present invention processes distributed cloud rendering based on 3D virtual space interior information created by one or more user terminals 300, 400, 500 to create realistic interior scene image content corresponding to one or more viewpoints (S1101).

[0307] Then, the service providing apparatus 100 matches the realistic scene image content with the creator information and registers it in the database of the storage unit 180 (S1103).

[0308] Next, the service providing apparatus 100 provides an intermediary interface authoring tool using realistic scene image content to the real estate agent terminal via the market platform interface (S1105).

[0309] Here, the intermediary interface authoring tool may include an interface that allows the real estate business operator terminal 500 to index and select product information registered in the market platform and corresponding realistic scene image content.

[0310] As described above, since the realistic scene image content may be mapped with tag information corresponding to the interior products or styles arranged in the indoor space, the intermediation interface authoring tool may provide a function of indexing one or more realistic scene image contents corresponding to the product information inputted by the real estate business terminal 500 using the tag information and arranging the realistic scene image contents on the intermediation interface. For example, when the interior construction product information inputted from the real estate business terminal 500 includes specific interior product or style information, realistic scene image contents including the specific interior product or style information as tag information may be indexed and provided through the intermediation interface.

[0311] Next, the service providing apparatus 100 registers the real estate product information in the market platform interface in accordance with the intermediation interface authoring data input from the real estate business operator terminal (S1107).

[0312] Thereafter, the service providing apparatus 100 provides realistic scene image content through an intermediary interface of real estate product information output from the consumer terminal 300 connected to the market platform (S1109).

[0313] Here, the realistic scene image content may include tag information as described above, and the consumer terminal 300 can check each tag information and detailed contents of the real estate product information and input corresponding intermediation request information into the intermediation interface.

[0314] Next, the service providing device 100 performs intermediation processing of the intermediation request information input from the consumer terminal 300 (S1111), and provides a predetermined ratio or amount of reward to the user terminal 400 of the content creator based on the intermediation information (S1113).

[0315] FIG. 30 is a diagram for explaining a real estate market platform interface based on a realistic scene image according to an embodiment of the present invention.

[0316] As shown in FIG. 30(A), the content creator terminal 400 can create one or more realistic scene image contents corresponding to the indoor spaces of various real estate in a distributed rendering manner based on the three-dimensional virtual space interior data according to an embodiment of the present invention.

[0317] As shown in FIG. 30B, the constructed realistic scene image content can be processed as real estate product information in the real estate business operator terminal 500 and provided via an intermediary interface.

[0318] For example, according to an embodiment of the present invention, the brokerage interface may be a general real estate brokerage interface, or may include a real estate brokerage interface including recommended interiors and interior manufacturer recommended information, as shown in FIG. 30(B).

[0319] More specifically, for example, an interior design business operator can use his / her own unique information to register a realistic scene image portfolio in the service providing device 100. In addition, when requested condition information is included in the intermediation request information input from the consumer terminal 300, the recommended interior and interior design manufacturer recommended information can be provided to the intermediation interface together with realistic scene image content corresponding to the requested condition information.

[0320] In the consumer terminal 300, the consumer can select a desired interior manufacturer or a recommended interior, and can receive realistic scene images corresponding to the interior design of the interior design company. Along with a request for real estate brokerage to the real estate company terminal 500, the consumer can also request the selected interior design company to carry out the interior design and construction.

[0321] In addition, the service providing device 100 can determine a recommended interior design business by considering the priority order corresponding to the required condition information of the intermediation request information, and provide a portfolio based on realistic scene image content of the determined business. The required condition information includes, for example, an interior design object, an interior design type, an address, a building name, a construction cost, and a construction period.

[0322] In addition, when a mediation request or consultation application corresponding to the mediation interface is confirmed, the service providing device 100 may provide a reward to the creator account of the content creator terminal 400 corresponding to the realistic scene image provided from the mediation interface, and the ratio or amount of the reward may be determined according to at least one of the number of visitors, number of likes, rating points, number of favorites, mediation performance information, or consultation performance information corresponding to the mediation interface.

[0323] 31 to 34 are diagrams for explaining the system and operation according to the fourth embodiment of the present invention.

[0324] FIG. 31 is a diagram for illustrating an outline of the entire system according to the fourth embodiment of the present invention.

[0325] Referring to FIG. 31, the overall system according to the fourth embodiment of the present invention includes a service providing device, one or more cloud devices 200, a consumer terminal 300, a content creator terminal 400, and a pre-order interior business terminal 500.

[0326] First, the consumer terminal 300, the content creator terminal 400, and the pre-order interior business terminal 500 described in this specification can be collectively referred to as user terminals 300, 400, and 500 based on their general functions. Since such general functions are disclosed in the same manner as in FIG. 2, the description thereof will be omitted.

[0327] The advance order interior business terminal 500 may be a user terminal of a business providing interior products and services, and may generate an advance order interface including product information to be sold by using realistic scene image content registered in the service providing device 100, and may request the service providing device 100 to register the generated advance order interface. The advance order interface requested to be registered may be registered in an interior-related market platform interface provided by the service providing device 100.

[0328] For example, the product information to be sold may include an interior construction product, and the realistic scene image content may be provided as a construction sample image of the interior construction product. In order to generate a reservation order interface, the service providing device 100 may provide a reservation order interface authoring service including the construction sample image to the reservation order interior business terminal 500, and may register reservation order interior product information based on authoring data input from the reservation order interior business terminal 500 in the interior reservation order market platform interface.

[0329] Thus, the service providing apparatus 100 can provide pre-order interior product information including the realistic scene image content to one or more consumer terminals 300 connected to the market platform interface. The service providing apparatus 100 can collect order information input through a pre-order interface corresponding to the pre-order interior product information in the consumer terminal 300 and perform payment processing.

[0330] Through this process, the service providing device 100 enables the pre-order interior business terminal 500 to generate a pre-order interface including pre-order interior product information at low cost and with high quality using realistic scene images constructed from various content creator terminals 400, and receives order information from the consumer terminal 300 for such a pre-order interface and performs payment processing, thereby providing an interior pre-order market platform more efficiently and at low cost.

[0331] In addition, the creator information of the content creator terminal 400 can be used to calculate a reward corresponding to the realistic scene image. For example, when the inquiry and payment process for the pre-order interior product information is completed or the product is registered in the market platform interface, the service providing apparatus 100 can calculate a reward for use of the realistic scene image and pay or provide the reward according to the creator information.

[0332] Furthermore, the content creator terminal 400 may be the same as the advance order interior business terminal 500. For example, the advance order interior business terminal 500 may create sample furniture or interiors that it designs and constructs by itself as separate 3D virtual space content data, process realistic scene image rendering, and register the result in the interior advance order market platform. In this case, the content creator terminal 400 may be replaced with the advance order interior business terminal 500.

[0333] The detailed configuration of each device for achieving this will be described in more detail with reference to FIG.

[0334] 32, the service providing apparatus 100 includes a communication unit 105, an input unit 110, a style information analysis unit 120, a layout generation processing unit 130, a control unit 140, an interface output unit 150, a space and interior rendering unit 160, a service providing unit 170, and a storage unit 180. The components shown in FIG. 32 are not essential, and a terminal having more or fewer components may be implemented. Also, since the configuration is similar to that of FIG. 2, a description of the same components will be omitted.

[0335] The service providing unit 170 may include a market platform interface module for pre-order market platform services and processing of order information, and may include a virtual space interior content creation module for supporting the creation and registration of realistic scene image content to be used in the market platform interface module.

[0336] For example, the service providing unit 170 can use a virtual space interior content creation module to enable the content creator terminal 400 to create realistic scene image content including furniture information used in the interior layout and a purchase link, and can obtain creator information and register it in the database of the storage unit 180 for matching.

[0337] In addition, for example, the service providing unit 170 may output a tagging interface for one or more pieces of furniture information included in a video image in which interior layout automation information is rendered to the user terminal 300, 400, 500 via the interface output unit 150, and process a service that provides the furniture information and a purchase link according to a user input corresponding to the tagging interface.

[0338] This allows users to not only receive automated interior layout services, but also directly check detailed information and purchasing information for furniture to be applied to their own interior spaces.

[0339] FIG. 33 is a block diagram for explaining the service providing unit according to the embodiment of the present invention in more detail.

[0340] 33, the service providing unit 170 according to the embodiment of the present invention includes a user information registration unit 1701, a realistic scene image content registration unit 1703, a market platform interface providing unit 1705, an order information processing unit 1707, and a reward providing unit 1709.

[0341] The user information registration unit 1701 can receive the input of user information of the consumer terminal 300, the content creator terminal 400, and the advance order interior business terminal 500, and can pre-save and register the information in the storage unit 180.

[0342] In addition, the realistic scene image content registration unit 1703 can process distributed rendering based on virtual space content data created by one or more user terminals in response to a request from the content creator terminal 400, to create one or more realistic scene image contents, and can match the one or more realistic scene image contents with creator information to store and register them in the database of the storage unit 180.

[0343] In addition, the market platform interface providing unit 1705 can provide a pre-order interface authoring service using the realistic scene image to the pre-order interior business terminal 500, and can register pre-order interior product information based on authoring data input from the pre-order interior business terminal 500 in the interior pre-order market platform interface. The registered product information can be shared with one or more consumer terminals 300.

[0344] Thus, the market platform interface providing unit 1705 can provide the pre-order interior product information to the consumer terminal 300 through the interior pre-order market platform interface. Here, the pre-order interior product information may include the realistic scene image content described above.

[0345] In addition, the order information processing unit 1707 checks the order information and processes the payment input from the consumer terminal 300. The order information processing unit 1707 may include one or more order payment modules (not shown) for supporting the order information and payment processing of the consumer terminal 300, and the payment information may be transmitted to the reward providing unit 1709.

[0346] In addition, the reward providing unit 1709 may provide or pay a predetermined ratio or amount of rewards corresponding to the creator information of the realistic scene image applied to the pre-order interior product information to an account corresponding to the creator information.

[0347] Additionally, the predetermined ratio or amount of the reward may be determined in a variety of ways.

[0348] For example, the predetermined ratio or amount of the reward may be determined according to evaluation information of the realistic scene image collected through the interior pre-order market platform interface in response to the pre-order interior product information, such as the number of inquiries, the score value, the number of likes, etc.

[0349] In addition, the reward providing unit 1709 can receive not only rewards for order settlement, but also a content usage fee from the pre-order interior business terminal and transmit it to a user account corresponding to the creator information when the pre-order interior product information is registered in the interior pre-order market platform interface.

[0350] Also, for example, the interior pre-order market platform interface may include a crowdfunding market platform interface, and the predetermined ratio or amount may be determined by the reward providing unit 1709 based on the crowdfunding performance information.

[0351] For example, according to an embodiment of the present invention, the reward provider 1709 may be configured to provide a reward only when crowdfunding reaches the target amount. In this case, the ratio or amount of reward provided corresponding to the creator information of the content creator terminal 400 may be variable depending on the funding result. For example, the reward may be provided to a user account corresponding to the content creator information only when funding is successful or a certain ratio or more of the target amount is achieved.

[0352] Through such processing, a realistic interior scene image based on the construction of each user's three-dimensional indoor space data can be easily constructed, and a pre-order market platform interface based on the constructed realistic scene image content can be provided, thereby making it possible to easily generate a pre-order interface for pre-order interior product information based on a competitive realistic interior scene image without excessive manpower (human resources).

[0353] In addition, by registering information about the creators of such realistic interior scene image content, it will be possible to charge a usage fee to pre-order interior businesses or provide rewards through reward setting, thereby increasing the participation of content creators and revitalizing market platform services.

[0354] FIG. 34 is a flowchart for explaining in more detail the service providing method according to the embodiment of the present invention.

[0355] Referring to FIG. 34, a service providing device 100 according to an embodiment of the present invention processes distributed cloud rendering based on 3D virtual space interior information created by one or more user terminals 300, 400, 500 to create realistic interior scene image content corresponding to one or more viewpoints (S1101).

[0356] Then, the service providing apparatus 100 matches the realistic scene image content with the creator information and registers it in the database of the storage unit 180 (S1103).

[0357] Next, the service providing device 100 provides a pre-order interface authoring tool using realistic scene image content to the pre-order interior business terminal via the market platform interface (S1105).

[0358] Here, the pre-order interface authoring tool may include an interface that allows the pre-order interior business terminal 500 to index and select product information registered in the market platform and corresponding realistic scene image content.

[0359] As described above, since the realistic scene image content may be mapped with tag information corresponding to the interior product or style arranged in the indoor space, the pre-order interface authoring tool may provide a function of indexing one or more realistic scene image contents corresponding to the product information inputted by the pre-order interior business terminal 500 using the tag information and arranging the realistic scene image contents on the pre-order interface. For example, when the interior construction product information inputted from the pre-order interior business terminal 500 includes a specific interior product or style information, the realistic scene image content including the specific interior product or style information as tag information may be indexed and provided through the pre-order interface.

[0360] Next, the service providing device 100 registers the advance order interior product information in the market platform interface in accordance with the advance order interface authoring data input from the advance order interior business terminal (S1107).

[0361] Thereafter, the service providing apparatus 100 provides realistic scene image content through a reservation order interface for reservation order interior product information output from the consumer terminal 300 connected to the market platform (S1109).

[0362] Here, the realistic scene image content may include tag information as described above, and the consumer terminal 300 can check each tag information and detailed estimate contents of the pre-order interior product information and input corresponding order information into the pre-order interface.

[0363] Next, the service providing device 100 performs payment processing for the order information input from the consumer terminal 300 (S1111), and provides a predetermined ratio or amount of reward to the user terminal 400 of the content creator based on the payment information (S1113).

[0364] FIG. 35 is a diagram for explaining a market platform interface based on a realistic scene image according to an embodiment of the present invention.

[0365] As shown in FIG. 35(A), the content creator terminal 400 can create one or more realistic scene image contents in a distributed rendering manner based on the three-dimensional virtual space interior data according to an embodiment of the present invention.

[0366] As shown in FIG. 35B, the constructed realistic scene image content can be processed as pre-order interior product information in the pre-order interior business terminal 500 and provided via a pre-order interface.

[0367] Also, according to an embodiment of the present invention, the pre-order interface may be a general payment pre-order interface, or may include a pre-order interface for interior design and construction products, as shown in FIG. 35(B).

[0368] Also, as shown in FIG. 35(B), the pre-order interface according to the embodiment of the present invention may include a crowdfunding-type pre-order interface. The funding-type pre-order interface may include interior product information that is provided only when crowdfunding is completed up to the target amount. In this case, the reward provided corresponding to the creator information of the content creator terminal 400 may also be variable according to the funding results. For example, the reward may be provided to the user account corresponding to the content creator information only when funding is successful or a certain percentage or more of the target amount is achieved.

[0369] When an order or consultation application corresponding to the reservation order interface is confirmed, the service providing device 100 may provide a reward corresponding to the creator information of the content creator terminal 400, and the ratio or amount of the reward may be determined according to at least one of the number of visitors, the number of likes, the evaluation score, the number of favorites, the order history information, or the consultation history information corresponding to the reservation order interface.

[0370] The above-described method according to the present invention may be created as a program for execution on a computer and stored in a computer-readable recording medium. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also include those embodied in the form of a carrier wave (e.g., transmission via the Internet).

[0371] The computer-readable recording medium may be distributed among computer systems connected via a network, so that the computer-readable code may be stored and executed in a distributed manner.Functional programs, codes, and code segments for implementing the above method may be easily construed by a programmer skilled in the art to which the present invention pertains.

[0372] Although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above. It goes without saying that various modifications can be made by a person having ordinary knowledge in the technical field to which the invention pertains without departing from the gist of the present invention as claimed in the claims, and such modifications should not be understood individually from the technical ideas and prospects of the present invention.

Claims

1. A method for operating a service providing device, comprising: Processing distributed rendering based on the virtual space content data created by one or more user terminals to construct one or more realistic scene image contents; registering the one or more realistic scene image contents in a database by matching the content with creator information; providing an order interface authoring service using the realistic scene image to an interior business terminal; and registering interior product information based on the authoring data input from the interior business operator terminal in an interior market platform interface; The step of constructing one or more realistic scene image contents includes: A step of constructing distributed processing data optimized for a distributed rendering process including a shading process based on global illumination of a realistic scene image projected to a first viewpoint in response to a three-dimensional virtual space content provided to a user terminal; transmitting the configured distributed processing data to one or more cloud devices connected to a rendering service network; receiving a distributed rendered realistic scene partial image from the cloud device and constructing a realistic scene image of a first viewpoint corresponding to the three-dimensional virtual space content; The step of configuring the distributed processing data includes: Index the geometric data to be optimized, If similar geometric data including vertex information already exists among the data requested for distribution, a meta information index mapping process is performed and only the meta information index is transmitted. A method of operating a service providing device.

2. providing the interior product information to a consumer terminal via the interior market platform interface; and providing a predetermined ratio or amount of rewards corresponding to creator information of the realistic scene image applied to the interior product information through payment processing of the order information input from the consumer terminal. A method for operating the service providing device according to claim 1.

3. The predetermined ratio or amount of the reward is: According to evaluation information of the realistic scene image collected through the interior market platform interface in response to the interior product information, A method for operating the service providing device according to claim 2.

4. If the interior product information is registered in the interior market platform interface, the content usage fee is received from the interior business terminal, and the content usage fee is transmitted to a user account corresponding to the creator information. A method for operating the service providing device according to claim 2.

5. The interior market platform interface includes an interior design and construction market platform interface; The predetermined ratio or amount of the reward is determined based on order record information or consultation record information corresponding to the interior design construction. A method for operating the service providing device according to claim 2.

6. The step of constructing one or more realistic scene image contents includes: setting a transformation object in the virtual space content corresponding to the first realistic scene image; determining a partial transformation boundary area corresponding to a range of influence caused by object transformation, corresponding to a first object before transformation and a second object after transformation by setting a transformation object; re-rendering a realistic scene image corresponding to the partial transformed boundary region; and combining the re-rendered realistic scene image portion with a remaining portion of the first realistic scene image excluding the partial transformation boundary region to construct a second realistic scene image in which the first object is transformed into the second object. A method for operating the service providing device according to claim 1.

7. In the service providing device, a space and interior rendering unit that processes distributed rendering based on virtual space content data created by one or more user terminals to construct one or more realistic scene image contents; a service providing unit for matching the one or more realistic scene image contents with creator information and registering the matching information in a database; The service providing unit includes: a virtual space interior content creation module for providing an order interface authoring service using the realistic scene image to an interior business terminal; a market platform interface module that registers interior product information based on the authoring data input from the interior business terminal in an interior market platform interface; The spatial and interior rendering unit includes: Configuring distributed processing data optimized for distributed rendering processing including a shading process based on global illumination of a realistic scene image projected to a first viewpoint in response to a three-dimensional virtual space content provided to the user terminal; Sending the configured distributed processing data to one or more cloud devices connected to a rendering service network; receiving a distributedly rendered realistic scene partial image from the cloud device, and constructing a realistic scene image of a first viewpoint corresponding to the three-dimensional virtual space content; The spatial and interior rendering unit includes: Index the geometric data to be optimized, If similar geometric data including vertex information already exists among the data requested for distribution, a meta information index mapping process is performed and only the meta information index is transmitted. Service providing device.

8. The service providing unit includes: a market platform interface providing unit for providing the interior product information to a consumer terminal via the interior market platform interface; and a reward providing unit that provides a predetermined ratio or amount of rewards corresponding to creator information of the realistic scene image applied to the interior product information according to a payment process of the order information input from the consumer terminal. The service providing device according to claim 7.

9. The predetermined ratio or amount of the reward is: According to evaluation information of the realistic scene image collected through the interior market platform interface in response to the interior product information, The service providing device according to claim 8.

10. The reward providing unit: If the interior product information is registered in the interior market platform interface, receive a content usage fee from the interior business terminal and transmit it to a user account corresponding to the creator information; The service providing device according to claim 8.

11. The interior market platform interface includes an interior design and construction market platform interface; The predetermined ratio or amount of the reward is determined based on order record information or consultation record information corresponding to the interior design construction. The service providing device according to claim 8.

12. The spatial and interior rendering unit includes: an object transformation image reconstructing unit for setting a transformation object in the virtual space content corresponding to a first realistic scene image, determining a partial transformation boundary area corresponding to an influence range caused by the object transformation in correspondence with the first object before transformation and the second object after transformation by the transformation object setting, performing a re-rendering process of the realistic scene image corresponding to the partial transformation boundary area, and combining the re-rendered realistic scene image part with a remaining part of the first realistic scene image excluding the partial transformation boundary area to construct a second realistic scene image in which the first object is transformed into the second object; The service providing device according to claim 7.

13. The rendering unit is Processing the distributed rendering based on the three-dimensional furniture data to construct one or more realistic scene image contents corresponding to the furniture items for sale; the service providing unit provides a furniture sales interface authoring service using the realistic scene image content to the furniture seller terminal, and registers furniture product information based on the authoring data input from the furniture seller terminal in a furniture sales market platform interface; The service providing device according to claim 7.

14. The service providing unit includes: a virtual space interior content creation module for providing an intermediary interface authoring service using the realistic scene image to a real estate business terminal; A real estate brokerage market platform interface module that registers real estate product information based on the authoring data input from the real estate business terminal into a real estate market platform interface. The service providing device according to claim 7.

15. The service providing unit includes: a virtual space interior content creation module for providing a pre-order interface authoring service using the realistic scene image to a pre-order interior business terminal; and a reservation order market platform interface module that registers reservation order interior product information based on the authoring data input from the reservation order interior business terminal in an interior reservation order market platform interface. The service providing device according to claim 7.

16. A computer-readable recording medium having a program recorded thereon for causing a computer to execute the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • 3D cloud design-based household industry service platform

    CN107169247A

  • Information service system for interior of wallpaper, and method for simulation interior of wallpaper

    KR1020140146685A

  • On line goods selling and advertisement system and method using information of goods provided by information provider

    KR1020190027262A

  • Integrated space information management platform using virtual reality video and operation method thereof

    KR1020200034468A