Three-dimensional space reconstruction home service delivery system and method based on virtual reality

Abstract

The invention provides a system and a method for providing home service based on three-dimensional space reconstruction of virtual reality, and more specifically, through a home three-dimensional space including furniture, decoration props and kitchen supplies (tableware, cups, bowls, spoon sets and the like), a virtual reality space is utilized in advance to organize the space before articles are purchased, and the virtual reality space is utilized in advance to provide the home service for the three-dimensional space reconstruction of the furniture, the decoration props and the kitchen supplies. In this way, the consumer can indirectly experience, select and purchase, so that the satisfaction degree is improved, and a three-dimensional space and home service method based on virtual reality is provided. According to the home decoration three-dimensional space including furniture, decoration props and kitchen supplies, the virtual reality space is utilized in advance to organize the space and enable consumers to indirectly experience, select and purchase the articles before the articles are purchased, the satisfaction degree can be improved, and under the conditions of satisfaction degree evaluation and actual purchase, the user experience is improved. Transactions may also be activated by appending compensation.

Description

Technical Field

[0001] The present invention relates to a system and method for providing home services through three-dimensional space reconstruction based on virtual reality. More specifically, through a three-dimensional home space including furniture, decorative items, and kitchen supplies (tableware, cups, bowls, spoon sets, etc.), virtual reality space is used to organize the space in advance before purchasing items. In this way, consumers can indirectly experience, choose, and purchase, thereby improving satisfaction, and providing a three-dimensional space and home service system based on virtual reality. Background Art

[0002] Provides a variety of technologies for traditional homes.

[0003] First, Korean Patent Application No. 10-2018-0158682, "BUYERS AND SELLERS BROKERAGE SYSTEM FOR IMAGE-BASED FURNITURE OR INTERIOR GOODS," is a technology concept that allows nearby sellers to provide quote information for products with high logistics costs based on the characteristics of furniture, thereby reducing the time and cost required for transportation and improving the satisfaction of buyers and sellers.

[0004] In addition, the Korean patent application application number 10-2011-0016357 "THE FRANCHISE SYSTEM FORMANUFACTURING, SALING, DISTRIBITION OF FURNITURE THROUGH INTERNET" is about the manufacturing, sales and distribution intermediary system of customized furniture in the form of franchising through the Internet, and more specifically, the customization and sales process through the Internet, and the sales and distribution intermediary system of customized furniture through the Internet.

[0005] In addition, the Korean patent application application number 10-2012-0152795 "The one-stop integrating system to marketing and display of furniture by that educationtraining and the furniture making education training via online on demand byuser" refers to the one-stop integration system to marketing and display of furniture by that educationtraining and the furniture making education training via online on demand byuser, and the online training system between users and terminal managers through the network.

[0006] In addition, the Korean patent application application number 10-2003-0065995 "Business system between furniture producer and seller and method therefor on internet" is about a business system between furniture producers and sellers on the Internet and its method, which aims to help furniture manufacturers and furniture sellers to handle ordering, settlement and delivery business.

[0007] However, the limitation of these traditional technologies is that by focusing on household items, that is, the circulation of units, etc., through the three-dimensional space of household operations including furniture, decoration props, and kitchen supplies (tableware, cups, bowls, spoon sets, etc.), virtual reality space must be used in advance to organize the space before purchasing items, and consumers can indirectly experience it, which cannot improve satisfaction before selection and purchase.

[0008] Prior art literature

[0009] Patent Literature

[0010] Patent Document 1: Korean Patent Application No. 10-2018-0158682, “BUYERS AND SELLERS BROKERAGE SYSTEM FOR IMAGE-BASED FURNITURE OR INTERIOR GOODS”

[0011] Patent Document 2: Korean Patent Application No. 10-2011-0016357, "FRANCHISE SYSTEM FORMANUFACTURING, SALING, AND DISTRIBITION OF FURNITURE THROUGH INTERNET"

[0012] Patent Document 3: Korean Patent Application No. 10-2012-0152795, "A one-stop integrating system for marketing and displaying furniture by that education training and the furniture making education training via online on demand by users"

[0013] Patent Document 4: Korean Patent Application No. 10-2003-0065995 "Business system between furniture producer and seller and method therefor on internet" Summary of the Invention

[0014] Problems to be solved by the invention

[0015] The present invention aims to solve the above-mentioned problems. It aims to use virtual reality space to organize the three-dimensional space of the home, including furniture, decorative items, and kitchen supplies (tableware, cups, bowls, spoon sets, etc.) in advance before purchasing items. Through the three-dimensional space reorganization based on virtual reality, consumers can indirectly experience, select and purchase, thereby improving satisfaction, and providing a home service system and method.

[0016] Furthermore, the present invention aims to provide a three-dimensional space reconstruction home service providing system based on virtual reality and a method thereof so as to activate transactions through additional compensation in case of satisfaction evaluation and actual purchase.

[0017] However, the objects of the present invention are not limited to the above objects, and other objects not mentioned can be clearly understood to the parties from the following description.

[0018] Means used to solve problems

[0019] To achieve the above objectives, according to an embodiment of the present invention, a system for providing home services through virtual reality-based three-dimensional space reconstruction includes a terminal identification number (IMEI) of each smart terminal 100, a device identification number of a VR terminal 100a connected to each smart terminal 100 via near-field wireless communication, and household product categories of interest to users operating at least one or more smart terminals 100, household product categories, household product category information, and home information. Upon receiving the included user information, an information collection module 321 stores the information on a user-by-user basis in a database 330. Furthermore, upon receiving an indirect experience request from each home business unit within a designated home business category, a smart terminal 100 storing user-by-user information accesses the designated virtual space through the database 330 storing designated virtual space information generated by a virtual space provision terminal 500 via the network 200, uses the smart terminal 100's smart terminal ID and password, and then provides an indirect experience request to each home business unit via module 323. This is characterized by the inclusion of a module 323.

[0020] At this time, the information collection module 321 stores household device information (including shape, color, length, volume, weight, and material) in at least one way, and the household device information (including shape, color, length, weight, and material) of each household device (including tableware, cups, bowls, and spoon sets) contains at least one metadata in the household device 330 database, and information of each household device (including 400 terminal identifiers).

[0021] In addition, the present invention also provides a virtual space module 322, which allows the use of the member ID and password of each virtual space providing terminal 500 to access the database 330 to view the information of each user unit information and each home sales unit information; through three-dimensional space reconstruction based on virtual reality, a home service providing system can be provided, which is characterized by including more.

[0022] To achieve the above-mentioned objectives, according to an embodiment of the present invention, a method for providing home services through virtual reality-based three-dimensional space reconstruction comprises: a home service providing server 300, connected to each smart terminal 100 via a network 200, receiving the terminal identification number (IMEI) of each smart terminal 100, connecting to the device identification number 100 of each smart terminal 100 via near-field wireless communication, and at least one or more user categories of the smart terminal 100, including household items, household items, household items, household items, household items, household items, household items, household items, etc. After receiving user information containing information (including photographic information or measured information), the user information is stored in a database 330 on a user-by-user basis; and after receiving an indirect experience request from each home management unit in the home management category designated by the smart terminal 100 through the stored user unit information, the home management service providing server 300 stores the designated virtual space information generated by the virtual space providing terminal 500 in the database 330 via the network 200, and the designated information is accessed by the smart terminal 100, and the access rights to the virtual space are designated in a second step; the method is characterized by including:

[0023] In the first step, the home service server 300 stores the home service unit information (shape, color, length, volume, weight, and material) for each home service unit (furniture includes tables and chairs; interior decoration includes picture frames and ornaments; kitchen supplies include tableware, cups, bowls, and spoon sets) corresponding to the home service category provided by each home service terminal 400 (at least 400 units are stored in the database). A home service provision method can be provided by using virtual reality-based three-dimensional space reconstruction characterized by this feature.

[0024] Effects of the Invention

[0025] According to an embodiment of the present invention, a system and method for providing home services through three-dimensional space reconstruction based on virtual reality is to use virtual reality space to organize the home three-dimensional space including furniture, decoration props, and kitchen supplies (tableware, cups, bowls, spoon sets, etc.) in advance before purchasing items, so that consumers can indirectly experience, make choices, and purchase, thereby improving satisfaction.

[0026] Furthermore, according to other embodiments of the present invention, a system and method for providing home services through three-dimensional space reconstruction based on virtual reality can activate transactions through additional compensation when the transactions are carried out through satisfaction evaluation and actual purchase. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 11 is a diagram showing a home service providing system 1 through three-dimensional space reconstruction based on virtual reality according to an embodiment of the present invention.

[0028] Figure 2 1 is a block diagram illustrating components of the home service providing server 300 in the home service providing system 1 through three-dimensional space reconstruction based on virtual reality according to an embodiment of the present invention.

[0029] Figure 3 4 is a flowchart of a method for providing home services through three-dimensional space reconstruction based on virtual reality according to an embodiment of the present invention.

[0030] Description of Reference Numerals

[0031] 1: A system for providing home services through 3D space reconstruction based on virtual reality

[0032] 100: Smart Terminal

[0033] 100a: VR terminal

[0034] 200: Network

[0035] 300: Home Service Delivery Server

[0036] 310: Transceiver Department

[0037] 320: Controller

[0038] 321: Information collection module

[0039] 322: Virtual Space Delivery Module

[0040] 323: Indirect experience provision module

[0041] 324: Satisfaction Delivery Module

[0042] 330: Database

[0043] 400: Home sales terminal

[0044] 500: Virtual space provides terminal DETAILED DESCRIPTION

[0045] Hereinafter, the detailed description of the preferred embodiment of the present invention will be described with reference to the accompanying drawings. When describing the present invention, if it is considered that the detailed description of the related functions or components may unnecessarily obscure the gist of the present invention, its detailed description will be omitted.

[0046] In this specification, if a component “transmits” data or a signal to another component, the component may directly transmit the data or signal to the other component or at least may transmit the data or signal to the other component through the other component.

[0047] Figure 1 FIG is a diagram showing a home service providing system 1 through three-dimensional space reconstruction based on virtual reality according to an embodiment of the present invention. Figure 1 As shown, through three-dimensional space reconstruction based on virtual reality, the home service providing system 1 can include multiple smart terminals 100, multiple VR terminals 100a, a network 200, a home service providing server 300, multiple home service providing terminals 400, and multiple virtual space providing terminals 500.

[0048] Network 200 is a high-speed backbone network of a large-scale communication network that can provide high-capacity, long-distance voice and data services. It can be a next-generation wired or wireless network that provides the Internet or high-speed multimedia services. If network 200 is a mobile communication network, it can be a synchronous mobile communication network or an asynchronous mobile communication network. As an example of an asynchronous mobile communication network, a WCDMA (Wideband Code Division Multiple Access) communication network can be cited. In this case, although not shown in the figure, network 200 may include a radio network controller (RNC). On the other hand, although a WCDMA network is used as an example, it can also be a next-generation communication network such as 3G LTE network, 5G network, or other IP-based IP network. Network 200 is responsible for transmitting signals and data between multiple smart terminals 100, multiple VR terminals 100a, home service provider servers 300, multiple home service provider terminals 400, multiple virtual space provider terminals 500, and other systems.

[0049] Figure 2 FIG. 1 is a block diagram showing components of the home service providing server 300 in the home service providing system 1 through three-dimensional space reconstruction based on virtual reality according to an embodiment of the present invention. Figure 2 As shown, the home service providing server 300 includes a transceiver 310, a control terminal 320 and a database 330. The control terminal 320 may include an information collection module 321, a virtual space providing module 322, an indirect experience providing module 323 and a satisfaction providing module 324.

[0050] The information collection module 321 can store information such as the terminal identification number (IMEI) of each smart terminal 100, the device identification number of the VR terminal 100a connected through short-range wireless communication, the home decoration categories (furniture, decoration supplies, kitchen supplies, ...) that users who operate at least one or more smart terminals 100 are interested in and their user area information, and the home decoration space category 330 (photography studio or photography studio) in the user database through the network 200.

[0051] In addition, the information collection module 321 can store the home decoration unit information (shape, color, length, volume, weight, material, etc.) in the metadata of the home decoration terminal 400, at least in one way and in more than one way, including the home decoration unit information of the home decoration unit (furniture such as tables, chairs, etc., small decorative items such as photo frames, ornaments, etc.), and kitchen supplies such as tableware, cups, utensils, spoon sets, etc.

[0052] The virtual space providing module 322 allows access on the database 330 using the member ID and password of each virtual space providing terminal 500 to view information of each user unit information and each home business unit information.

[0053] In addition, the virtual space providing module 322 can sort and provide each virtual space providing terminal 500 in descending order of the number of interests in the family providing category of the user unit information, so as to select at least one family providing category for the virtual space provided by each virtual space providing terminal 500, and store the selected family providing category in each virtual space providing category according to the database identifier 330 of each virtual space providing terminal 500.

[0054] Thereafter, the virtual space providing module 322 may control the sender 310 to provide a virtual space tool for the home providing category selected by each virtual space providing terminal 500 , or send a command made through a home virtual space application pre-provided on each virtual space providing terminal 500 through the network 200 .

[0055] Therefore, each virtual space providing terminal 500 specifies a virtual space "virtual space 322" for each home processing unit by capturing a measured graphic that matches the home processing unit information (shape, color, length, volume, weight, material, etc.) of each home processing unit in the home processing category you want to create, or by inputting measured values and the component information (shape, color, length, volume, weight, material, etc.) of the virtual space. The virtual space 322 is then provided via the network. The "specified virtual space" can be stored in the database 330, and each home device has at least one virtual space.

[0056] After the indirect experience providing module 323 receives the indirect experience request of each home business unit in the home business category specified by itself through the smart terminal 100, it can access the database 330 storing the specified virtual space information generated by the virtual space providing terminal 500 through the network 200, and access the virtual space information of the specified home business unit through the smart ID and password of the smart terminal 100, and then select the specified virtual space.

[0057] Afterwards, the indirect experience providing module 323 may convert the two-dimensional image corresponding to the designated virtual space information into a three-dimensional image.

[0058] That is, the indirect experience providing module 323 determines m (m is a natural number greater than 2) focus positions and the number of focus points for the two-dimensional video corresponding to the specified virtual space information. If m focus positions and m multiple focus two-dimensional videos corresponding to the number of seconds are generated, the m focus distances of the m focus two-dimensional videos can be calculated.

[0059] Thereafter, the indirect experience providing module 323 may calculate L (L is a natural number greater than or equal to 2) depth values inversely proportional to the calculated m focus distances, and synthesize multiple focus 2D videos according to the L depth values.

[0060] The indirect experience providing module 323 can then review the zero-time-difference video, the negative-time-difference video, and the positive-time-difference video in the m multi-focus two-dimensional videos. Based on the time-difference angle of at least one or more negative-time-difference videos in the confirmed zero-time-difference video, the module can check the time-difference direction of the negative-time-difference video. Furthermore, based on the time-difference information of at least one or more positive-time-difference videos in the confirmed positive-time-difference video, the module can check the positive-time-difference information in the positive-time-difference video. A second-eye image (e.g., the left-eye image) can be generated in the same manner as the first-eye image (e.g., the right-eye image) with the negative-time-difference video.

[0061] In addition, the indirect experience providing module 323 provides the generated first and second eye image data as each smart terminal 100, and outputs it to the VR terminal 100a of the HMD through the smart terminal 100 and short-range wireless communication. As a further work, additional information of the three-dimensional image in the synthesized state of the first and second eye image data can be generated on the VR terminal 100a and output to the smart terminal 100 through the VR terminal 100.

[0062] To this end, the additional video information may be AI information, and the indirect experience providing module 323 may be additional video information of each home unit information (shape, color, length, volume, weight, material, etc.) based on big data, as well as additional video information of the component unit information (shape, color, length, volume, weight, material, etc.) of the virtual space that matches the each home unit information (shape, color, length, volume, weight, material, etc.).

[0063] That is to say, the indirect experience providing module 323 is to further realize the additional video information of the three-dimensional video in the synthesis state of the video data of the first and second schemes based on big data on the VR terminal 100a, and can add the constituent units of the virtual space to the three-dimensional video, as well as the video of the two arms when the user touches the arms of each home decoration unit, and then generate a video according to the units of the virtual space constituted by the two arms in the three-dimensional video, and a video of the touch direction according to the touch speed of each home decoration unit.

[0064] To this end, the indirect experience providing module 323 will dispersely store the various component units and each home management unit that constitute the virtual space in each DCSDB on the big data-based database 330, match each component unit and each home management unit, and analyze the touch direction and touch speed formed on one or more arms of the dispersedly stored component units of collected data and at least one home management unit, as well as the unit's weight, length, color, image-based touch algorithm, etc.

[0065] For example, the machine learning algorithm used by the indirect experience providing module 323 may be one of a decision tree (DT) classification algorithm, a random forest classification algorithm, and a support vector machine (SVM) classification algorithm.

[0066] The indirect experience providing module 323 analyzes the collected data stored in the DCSDB in a dispersed manner, but the components of the distributed stored collected data and the touch direction and speed of the hand formed by at least one or more arms in the home appliance when touching, as well as the information of each unit (shape, color, length, volume, weight, material, etc.), are analyzed, and at least one feature information (shape, length, volume, weight, material, etc.) is obtained from the weather information (200 components) received from the server according to the user's geographic information. Other feature information is extracted and the extracted feature information is reflected intactly. For the extracted feature information, at least one of a plurality of machine learning algorithms can be used for learning, and state change information is generated based on the learning results.

[0067] In order to improve the accuracy of the feature information and state change information provided by the indirect experience providing module 323, a combined structure composed of multiple complementary machine learning algorithms can be adopted.

[0068] The decision tree classification algorithm uses tree-structured learning to generate results. This method makes the results easy to interpret and understand, processes data quickly, and can derive rules based on a navigation tree. RF can be used to improve the low classification accuracy of DTs. The random forest classification algorithm combines the results of joint learning from multiple DTs. While more difficult to understand than DTs, the results can be more accurate. Support Vector Machines (SVMs) can be used to improve the overload that can result from DT or RF learning. The SVM classification algorithm uses a plane to classify data belonging to different categories. It generally has high accuracy and is structurally less sensitive to overfitting.

[0069] The satisfaction providing module 324 uses the smart terminal 100 to evaluate the satisfaction of the 3D video home experience on the network 200 as the satisfaction level for the first to nth stages (n is a natural number greater than or equal to 2). Based on the evaluated satisfaction levels, the module provides satisfaction information according to a preset ratio 330 to the home service providing terminal 400 and the virtual space providing terminal 500 that provide the 3D video information. Based on the preset satisfaction level 330, the module obtains the accumulated satisfaction compensation from the smart terminal database. The module controls the transceiver unit 310 to relay the usage fee payments of each smart terminal 100 to the financial institution server via the network 200.

[0070] Furthermore, the satisfaction providing module 324 logs in to the social chat tool server (not in the city) through the passenger network 200 of the smart terminal 100 operating the home shopping experience, and uses the home shopping virtual space application as a basis. After the virtual experience, when paying through the smart terminal 100 at a physical store operated by the home shopping providing terminal 400, the registration information of the smart chat tool 100 and the social information posted by acquaintances through the smart chat tool 100 are used. After being retrieved on the social chat tool server, the retrieved location information (physical store) and the satisfaction level of the first to nth stages (n is a natural number greater than 2) of the home sales unit where the purchase was made can be extracted, and then the satisfaction level is analyzed to determine whether it exceeds the satisfaction level of the preset stage.

[0071] Thereafter, the satisfaction providing module 324 may store the compensation information of the accumulated satisfaction evaluated on the database 330 so as to provide a preset additional ratio of compensation to the home providing terminal 400 and the virtual space providing terminal 500 for providing the three-dimensional image information when the satisfaction exceeds a preset level, and provide the operating expenses paid to the operating organization through the home operating terminal 400 by the offline payment provided by the store of the home providing terminal 400. The transceiver unit 310 may be controlled.

[0072] Figure 3FIG is a flow chart of a method for providing home services through three-dimensional space reconstruction based on virtual reality according to an embodiment of the present invention. Figure 3 As shown, the method for providing home services through three-dimensional space reorganization based on virtual reality includes an information collection process S11, a virtual space providing process S12, an indirect experience providing process S13 and a satisfaction providing process S14, but since the processes are the same as or similar to those performed by the above-mentioned information collection module 321, virtual space providing module 322, indirect experience providing module 323 and satisfaction providing module 324, please omit the description.

[0073] The present invention can also be implemented in a computer-readable recording medium as computer-readable codes. The computer-readable recording medium includes all types of recording devices that store data readable by a computer system.

[0074] Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, etc. and also include recording media implemented in the form of carrier waves (such as transmission via the Internet).

[0075] In addition, computer-readable recording media are distributed among network-connected computer systems, and computer-readable codes can be stored and executed in a distributed manner. Functional programs, codes, and code segments that implement the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.

[0076] As described above, the present list and drawings illustrate preferred embodiments of the present invention. Although certain terms are used, these are generally used to facilitate explanation of the technical content of the present invention and to aid understanding of the invention, and are not intended to limit the scope of the present invention. In addition to the embodiments described herein, other variations based on the technical principles of the present invention are also possible, as will be apparent to those skilled in the art.

Claims

1. A three-dimensional space reconstruction home service delivery system based on virtual reality, characterized in that: The virtual reality-based three-dimensional space reconstruction family service delivery system includes: an information collection module (321) that collects, through the network (200), the terminal identification number (IMEI) of each smart terminal (100), the device identification number of the VR terminal (100a) connected to each smart terminal (100) through short-range wireless communication, user information of home decoration (including furniture, decoration supplies, kitchen supplies) that a user operating at least one or more smart terminals (100) is interested in, grid user area information, and home decoration category space information (including photogrammetry room information), and then stores the information in a database (330); and The indirect experience providing module (323) receives an indirect experience request for each home business unit in the home business category specified by itself through the smart terminal (100) storing the user unit information, accesses the specified virtual space through the smart terminal ID and password of the smart terminal (100) through the database (330) storing the specified virtual space information generated by the virtual space providing terminal (500) through the network (200), and then provides the indirect experience request for each home business unit through the module.

2. The virtual reality-based three-dimensional space reconstruction home service delivery system according to claim 1, characterized in that: In the information collection module (321), the home decoration unit information (including shape, color, length, volume, weight, and material) is provided by each home decoration terminal (400) through the terminal identification number (including at least one type of home decoration unit information), and the home decoration unit information of the home decoration unit (including furniture tables, chairs, and decorative pieces, including photo frames and ornaments, and kitchen supplies) is formed through the database (330) provided by the home decoration, and the metadata of the home decoration unit identification number includes at least one or more types of home decoration unit information.

3. The virtual reality-based three-dimensional space reconstruction home service delivery system according to claim 1, characterized in that: The virtual reality-based three-dimensional space reconstruction home service delivery system also includes a virtual space providing module (322), which allows access to the database (330) using the member ID and password of each virtual space providing terminal (500) to view information about each user unit information and each home business unit information.

4. A method for delivering home services based on three-dimensional space reconstruction of virtual reality, characterized in that: The virtual reality-based three-dimensional space reconstruction family service delivery method includes: In the first step, the home service providing server (300) stores the terminal identification number (IMEI) of each smart terminal (100), the device identification number of each smart terminal (100) and the VR terminal (100a) connected via short-range wireless communication, the home service category (including furniture, interior decoration, kitchen supplies) that the user who operates at least one or more smart terminals (100) is interested in, the user area information thereof, and the home information (330) in the user information database (1) by user space category through the network (200); and In the second step, after receiving the indirect experience request of each housekeeping unit in the housekeeping category designated by itself through the smart terminal (100) stored as user unit information, the housekeeping service providing server (300) stores the information of the designated virtual space generated by the virtual space providing terminal (500) on the database (330) through the network (200), and passes the access rights of the smart terminal (100) and the second stage access rights of the smart space.

5. The method for delivering home services based on three-dimensional space reconstruction using virtual reality according to claim 4, characterized in that: In the first step, the home service providing server (300) stores the home service unit information (including shape, color, length, volume, weight, material) of the home service unit (including tables, chairs, decorative items, photo frames, ornaments, kitchen supplies, including tableware, cups, utensils, spoon sets) provided on each home service providing terminal (400) in the home service providing database in at least one or more ways, and the identification information of each home service providing terminal (400).

Images