A method and system for customizing RV interior based on mixed reality technology

Abstract

The present invention provides a method or system for customizing the interior decoration of a motorhome based on mixed reality technology, which includes: S1: starting the mixed reality client system; S2: scanning and detecting the space environment, and uploading the environment information to the cloud server; S3: requesting to build a virtual three-dimensional scene in the real environment; S4: the mixed reality server determines whether it is suitable to accommodate the virtual three-dimensional scene; S5: the client displays the virtual three-dimensional scene in the real space; S6: the user understands the specific operation through the guidance of the mixed reality client; S7: the user inputs information according to the guidance, the system generates a preference selection gene, and the system recommends a basic motorhome model; S8: the user selects the basic model and clicks a button to browse the motorhome exterior; S9: the user customizes the model in a personalized way in combination with the gene coding. The present invention allows users to participate in the customization of the scheme through real-time interactive operations, and finally generates a customization list for the enterprise to produce.

Description

Technical Field

[0001] The present invention relates to the field of RV interior customization, and in particular to a RV interior customization method and system based on mixed reality technology. Background Art

[0002] The sales volume of RVs is increasing day by day, which also exposes a problem that needs to be solved urgently, that is, the existing RV production and sales model does not match the personalized needs of users, which easily leads to a decline in user satisfaction and directly affects the sales volume of RVs. First, the RV industry generally adopts the model of production before sales, and users have little choice; second, the existing RV interior presentation methods such as web pages and picture albums are backward and cannot bring users an immersive experience, causing users to place orders without a clear understanding of the product, which easily leads to a mismatch between user needs and product features; third, the personalized needs of users are difficult to be fully reflected in the design stage, and the product return rate is too high. It is necessary to build a complete customization process and system, optimize the interactive presentation method of RV customization, and improve user participation.

[0003] With the development of mixed reality technology and human-computer interaction technology, immersive and personalized customization of RV interiors has become possible. Mixed reality technology introduces virtual scene information into the real environment, and builds an interactive feedback information loop between the real world, the virtual world and the user to enhance the realism of the user experience. This technology has not yet been applied in the RV field. With the immersiveness and natural real-time interactivity of mixed reality technology, it can bring users a better customization experience, improve user participation, reduce the cost of RV customization, and improve the efficiency and customization effect of RV customization. Summary of the invention

[0004] In view of the shortcomings in the prior art, the present invention provides a method and system for RV interior customization based on mixed reality technology, which allows users to participate in solution customization through real-time interactive operations, and finally generates a customization list for enterprises to produce.

[0005] The present invention achieves the above technical objectives through the following technical means.

[0006] A method for customizing interior decoration of a motorhome based on mixed reality technology, comprising the following steps:

[0007] S1: Use the mixed reality device to start the mixed reality client system;

[0008] S2: Use the mixed reality client to scan and detect the spatial environment, and upload the environmental information to the cloud server; S3: The user requests to build a virtual three-dimensional scene in the real environment through the mixed reality client;

[0009] S4: The mixed reality server calculates and analyzes the real space information to determine whether it is suitable for accommodating the virtual three-dimensional scene;

[0010] S5: The client displays the virtual 3D scene in the real space, realizing the integration of virtual space and real space;

[0011] S6: The user understands the specific operations through the guidance of the mixed reality client;

[0012] S7: The user inputs information according to the guidance, the system generates a preference selection gene, and the system recommends a basic RV model according to the preference selection gene;

[0013] S8: After the user selects the base model, he clicks a button to browse the RV exterior;

[0014] S9: Users enter the interior space through the prompt panel and customize the model in combination with genetic coding;

[0015] S10: After the customization is completed, the customization list is output for the enterprise to use.

[0016] Furthermore, the step S2 specifically includes: using the infrared camera and depth of field camera of the mixed reality device and the SLAM algorithm to scan the space, extracting spatial features using spatial point mapping, performing scene positioning, and uploading environmental information to the cloud server.

[0017] Furthermore, the step S5 specifically includes: the client reads the interactive interface, scene model, RV model, RV interior and interior components through the cloud, and places the models in the space according to the coding order; wherein the interactive interface is designed and produced by Figma, the virtual RV model, the interior model, and the component model are 1:1 models built based on the prototype, and are designed and produced by 3Dmax.

[0018] Furthermore, the coding includes content coding and position coding. The content coding encodes the cooking area, rest area, leisure area, and washing area of ​​the interior components from A to D, and encodes the components in the area in the manner of A-1Y, A-2X1, and A-2Z1, wherein Y indicates that the component does not support customization; X indicates that the component supports replacement customization, and the number after X indicates the style number of the customized component; Z indicates that the component supports complete personalized customization, and the number after Z indicates the customizable dimension; the position coding sets the user's head to the original position, i.e. (0.0.0), and different components set their positions in space according to the XYZ coding method; and then the content coding and the position coding are generated into a binary coding format.

[0019] Furthermore, step S8 is specifically as follows: after the user selects a car model, the car model selected by the user is restored one-to-one based on the three-dimensional digital model system. The user wears a mixed reality device to feel the car model status in the fusion space of real and virtual; at the same time, the overall body color and partial exterior parts can be changed through gesture operations.

[0020] Furthermore, in step S7, the user inputs information including population, usage duration, car purchase budget, car purchase preference, and usage mileage according to the guidance, and the system screens the user input information in combination with expert interviews, questionnaires, and hierarchical analysis to form a preference selection gene.

[0021] Furthermore, the gene encoding in step S9 includes adaptive genes and personalized genes. The adaptive genes are constructed based on the factors affecting the RV interior design, and the system provides users with different RV interior layouts based on the adaptive genes; the personalized genes include the scale and attributes of the components of the interior components, specifically including the brand, style, color and material of the interior components.

[0022] Furthermore, the combination of gene coding to customize the model mainly includes: for adaptive genes, users use voice or gestures to operate interior parts, and by clicking, a corresponding menu will pop up to allow users to change the layout and style of the interior; for personalized genes, basic parameters of interior parts are changed through gestures such as clicking and sliding, and the interior shape is modified to achieve the purpose of customization. For example, the simple and fresh style of the RV interior and the layout suitable for four people to travel at the same time are determined through adaptive genes, and then specific parts of the RV, such as beds and seats, are further customized through personalized genes.

[0023] A RV interior customization system based on mixed reality technology, comprising: a HoloLens2 mobile device, a space determination system and a RV customization process framework unit, wherein the HoloLens2 mobile device, the space determination system and the RV customization process framework unit are connected via wireless network communication;

[0024] The space determination system is used to determine whether the real space supports the placement of the model. The space determination system collects the length, width and height of common RVs on the market and constructs the space standard for the placement of the model through calculation;

[0025] The RV customization process framework unit is used to construct the RV interior customization process, and the RV interior customization process is constructed by using preference selection genes, adaptability genes and personalized genes.

[0026] Furthermore, the HoloLens2 mobile device is used to construct a HoloLens2 interactive interface in unity 3D. During the RV interior customization process, the user performs three-dimensional interactive control on the HoloLens2 interactive interface.

[0027] Beneficial effects of the present invention:

[0028] The RV interior customization method and system based on mixed reality technology provided by the present invention are designed for personalized customization of RV interiors, use mixed reality mobile devices for image acquisition and spatial positioning, and combine the three-dimensional modeling software 3Dmax with the interactive prototype design software Figma, integrate unity 3D and visual studio for system development, which can significantly improve the user experience of the product immersion, customization participation, and customization efficiency. The present invention designs interactive prototypes through the interactive prototype design software Figma, and builds an interactive interface in the virtual space through visual studio. The interactive interface mainly uses natural interaction to achieve efficient operation between man and machine, specifically including the zooming in and out of the model through the grasping of both hands, and the selection of the interface by clicking on the interface. During the customization process, the user can open the historical data display interface and the case interface as needed to view the customization history and the customization cases for reference, so as to improve the customization effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 It is a flow chart of a method for customizing interior decoration of a motorhome based on mixed reality technology of a mixed reality device in an embodiment of the present invention;

[0030] Figure 2 This is a flow chart of the program customization principle of the RV interior customization method based on mixed reality technology in the implementation case of the present invention. DETAILED DESCRIPTION

[0031] In order to make the above-mentioned purpose, features and advantages of the present invention more obvious and easy to understand, the specific implementation of the present invention is described in detail below in conjunction with the accompanying drawings. In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without violating the connotation of the present invention, so the present invention is not limited by the specific implementation disclosed below.

[0032] See also Figure 1 and Figure 2 According to an embodiment of the present invention, a method for customizing interior decoration of a motorhome based on mixed reality technology comprises the following steps:

[0033] S1: Use the mixed reality device to start the mixed reality client system;

[0034] S2: Use the mixed reality client to scan and detect the spatial environment and upload the environmental information to the cloud server;

[0035] S3: The user requests to build a virtual 3D scene in the real environment through the mixed reality client;

[0036] S4: The mixed reality server calculates and analyzes the real space information to determine whether it is suitable for accommodating the virtual three-dimensional model scene;

[0037] S5: The client displays the virtual 3D scene in the real space, realizing the integration of virtual space and real space;

[0038] S6: The user understands the specific operations through the guidance of the mixed reality client;

[0039] S7: The user inputs information according to the guidance, the system generates a preference selection gene, and the system recommends a basic RV model according to the preference selection gene;

[0040] S8: After the user selects the base model, he clicks a button to browse the RV exterior;

[0041] S9: Users enter the interior space through the prompt panel and customize the model in combination with genetic coding;

[0042] S10: After the customization is completed, the customization list is output for the enterprise to use.

[0043] Step S1 specifically includes: the user wears the mixed reality device, adjusts the device to a comfortable size, performs a preliminary scan of the usage scenario, and opens the RV interior customization program. According to the cases presented in the program, the user practices the interactive gestures involved in the mixed reality technology, including grabbing, sliding, pinch-to-zoom, and voice commands.

[0044] Step S2 is specifically as follows: using the infrared camera and depth of field camera of the mixed reality device and the SLAM algorithm to scan the space, using spatial point mapping to extract spatial features, performing scene positioning, and uploading environmental information to the cloud server.

[0045] Step S4 specifically includes: matching the real space information scanned by the device with the space determination system in the cloud to determine whether the scanned space meets the placement requirements of the virtual three-dimensional scene. If it meets the requirements, the virtual three-dimensional scene starts to be loaded from the server; if it does not meet the requirements, it is necessary to find a new space for scanning.

[0046] According to whether the model placement is supported, in the interior customization of the RV, the RV model is presented in a 1:1 manner. The RV itself is large in size and has certain requirements for space. A space determination system is set up in the cloud. The system collects the length, width and height of common RVs on the market and constructs the space standard for model placement through calculation. By comparing the data of the real space with the data of the cloud determination system, it is helpful to carry out the later customization work.

[0047] Step S5 is specifically as follows: reading the interactive interface, scene model, RV model, RV interior and interior components through the cloud, and placing the models in the space according to the coding order; wherein the interactive interface is designed and produced by Figma, the virtual RV model, interior model and component model are 1:1 models built based on the prototype, and are designed and produced by 3Dmax.

[0048] The coding is used to locate the model in space, and specifically includes content coding and position coding. The content coding encodes the cooking area, rest area, leisure area, and washing area of ​​the interior components from A to D, and encodes the components in the area in the manner of A-1Y, A-2X1, and A-2Z1, where Y indicates that the component does not support customization; X indicates that the component supports replacement customization, and the number after X indicates the style number of the customized component; Z indicates that the component supports full customization, and the number after Z indicates the customizable dimension, which is generally a parameter in three directions, and each direction also sets the degree of customization and parameters; the position coding summarizes the position of the real space through the three directions of XYZ, which is conducive to the placement of virtual components in three-dimensional space. The position coding sets the user's head to the original position, i.e. (0.0.0), and different components set their positions in space according to the XYZ coding method to facilitate placement and avoid errors. This coding unifies the position unit as M. Then the content code and the position code are combined to generate a binary code format of “01000001 00000010 01011010 00110001.(00110000.00110000.00110000)”.

[0049] Step S6 specifically includes: the user understands and customizes the gesture interaction mode that needs to be mastered according to the guidance, so as to facilitate the subsequent interactive operations.

[0050] The preference selection gene in step S7 specifically includes collecting the influencing factors of users' purchase of RVs from five dimensions: population, usage time, car purchase budget, car purchase preference, and usage mileage; then, the influencing factors are screened through expert interviews, questionnaires, hierarchical analysis, etc. to form the preference selection gene; then, questions are generated from five dimensions based on user characteristics for users to answer; finally, the system recommends models that meet the needs of users based on the needs reflected by the users' answers to the questions.

[0051] Step S8 is specifically as follows: after the user selects a car model, the car model selected by the user is restored one-to-one based on the three-dimensional digital model system. The user wears a mixed reality device to feel the car model status in the fusion space of real and virtual; at the same time, the overall body color and partial exterior parts can be changed through gesture operations.

[0052] The gene encoding in step S9 includes adaptive genes and personalized genes. The adaptive genes are interior design factors. The system provides users with different RV interior layouts based on the adaptive genes. The personalized genes are brands, colors, materials, and styles.

[0053] According to the adaptive gene, it is constructed based on the factors affecting the interior design of RVs. RV interior design involves multi-level knowledge. Through data mining algorithms, the interior design factors are refined in combination with NVIVO coding, and divided into N+1 influencing factors. The interior design influencing factors and their weights are determined by combining professional designers, ordinary users, and professional users to create basic interior models. It mainly includes: building new component models through modeling software, creating new materials and colors through unity, and users can change the style, color and material of the interior according to their own needs through voice or gestures to generate different RV interior layouts and interior design styles. For adaptive genes, users use voice or gestures to change the interior layout and style of RVs. Clicking will pop up the corresponding menu. Users can change the interior layout and style of RVs according to their own needs and in combination with the provided adaptive genes. The adaptive genes are changed by voice and gestures to achieve the customization of the interior layout and style of RVs. For example, users change the interior layout and style of RVs through voice commands, which mainly includes using the MRTK development tool to set the corresponding voice commands, and each voice command corresponds to a different RV interior layout and style;

[0054] According to the personalized gene, it mainly includes the scale and other attributes of the components of the interior parts, among which the components involved mainly include brand, color, material, and style. First, encode the components to form a personalized gene coding model of the components. If the seat of the RV is a customizable component of the leisure area, its code is C-2X4, C is the area; C is the leisure area; 2 is the serial number of the location; X indicates that the component supports customization; 4 is the number of component parameters that support customization. For personalized genes, users can select the components of the RV interior parts in a targeted manner, and change the parameters of the interior parts through gestures such as sliding and clicking until satisfactory results are generated. For example, the seats in the interior are composed of seat style, color, and material. Users can choose the color of the seat and generate their own color scheme by sliding to modify the RGB color value of the seat.

[0055] Users observe the final interior customization effect in the virtual interior space. That is, the system displays the exterior of the vehicle model selected by the user, the overall interior effect, the interior component effect, the configuration list and the price list. The user makes a comprehensive judgment and makes modifications and adjustments until a satisfactory customization plan is generated.

[0056] Step S10 specifically includes: uploading the customized data on the mixed reality device to the cloud for the manufacturer to extract, the user to retain, the manufacturer to download the customized list, and arrange order tracking, pre-customization confirmation, production, etc.

[0057] According to an embodiment of the present invention, a motorhome interior customization system based on mixed reality technology includes: a HoloLens2 mobile device, a space determination system and a motorhome customization process framework unit, and the HoloLens2 mobile device, the space determination system and the motorhome customization process framework unit are connected via wireless network communication.

[0058] The mixed reality device HoloLens2 uses mixed reality technology to provide users with an efficient and immersive interior customization environment. The HoloLens2 mobile device is used to build a Hololens2 interactive interface in unity 3D. During the RV interior customization process, the user performs stereoscopic interactive control on the HoloLens2 interactive interface.

[0059] The space determination system is used to determine whether the real space supports the placement of the model. The space determination system collects the length, width and height of common RVs on the market and constructs the space standard for the placement of the model through calculation;

[0060] The RV customization process framework makes good use of selection genes, adaptability genes and personalization genes to construct the RV interior customization process.

[0061] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. A method for customizing RV interiors based on mixed reality technology, characterized in that: The following steps are involved: S1: Use the mixed reality device to open the mixed reality client system; S2: Use the mixed reality client to scan and detect the spatial environment and upload the environmental information to the cloud server; S3: The user requests to build a virtual 3D scene in the real environment through the mixed reality client; S4: The cloud server calculates and analyzes the real space information to determine whether it is suitable for accommodating the virtual three-dimensional scene; S5: The client displays the virtual 3D scene in the real space, realizing the integration of virtual space and real space; S6: The user understands the specific operations through the guidance of the mixed reality client; S7: The user inputs information according to the guidance, the system generates a preference selection gene, and the system recommends a basic RV model according to the preference selection gene; S8: After the user selects the base model, he clicks a button to browse the RV exterior; S9: Users enter the interior space through the prompt panel and customize the model in combination with genetic coding; The gene encoding includes adaptive genes and personalized genes. The adaptive genes are constructed based on the factors affecting the RV interior design. The system provides users with different RV interior layouts based on the adaptive genes. The personalized genes include the scale and attributes of the components of the interior components, including the brand, style, color and material of the interior components. The personalized customization of the model by combining gene coding includes: for adaptive genes, users use voice or gestures to operate interior parts, and by clicking, a corresponding menu will pop up to allow users to change the layout and style of the interior; for personalized genes, by clicking and sliding to change the basic parameters of the interior parts, modify the shape of the interior parts, and achieve the purpose of customization; S10: After the customization is completed, the customization list is output for the enterprise to use.

2. The RV interior customization method based on mixed reality technology according to claim 1 is characterized in that: The step S2 specifically includes: using the infrared camera and depth of field camera of the mixed reality device and the SLAM algorithm to scan the space, extracting spatial features using spatial point mapping, performing scene positioning, and uploading environmental information to the cloud server.

3. The RV interior customization method based on mixed reality technology according to claim 1 is characterized in that: The step S5 specifically includes: reading the interactive interface, scene model, RV model, RV interior and interior components through the cloud server, and placing the models into the space according to the coding order; wherein the interactive interface is designed and produced by Figma; the virtual RV model, interior model and component model are 1:1 models built based on the prototype, and are designed and produced by 3Dmax.

4. The RV interior customization method based on mixed reality technology according to claim 3 is characterized in that: The coding includes content coding and position coding. The content coding encodes the cooking area, rest area, leisure area and washing area of ​​the interior components from A to D, and encodes the components in the area in the manner of A-1Y, A-2X1 and A-2Z1, wherein Y indicates that the component does not support customization; X indicates that the component supports replacement customization, and the number after X indicates the style number of the customized component; Z indicates that the component supports complete personalized customization, and the number after Z indicates the customizable dimension; the position coding sets the user's head to the original position (0.0.0), and different components set their positions in space according to the XYZ coding method; and then the content coding and the position coding are generated into a binary coding format.

5. The RV interior customization method based on mixed reality technology according to claim 1 is characterized in that: The step S8 is specifically as follows: after the user selects a car model, the car model selected by the user is restored one-to-one based on the three-dimensional digital model system. The user wears a mixed reality device to feel the car model status in the fusion space of real and virtual; at the same time, the overall car body color and partial exterior parts can be changed through gesture operations.

6. The RV interior customization method based on mixed reality technology according to claim 1 is characterized in that: In step S7, the user inputs information including population, usage duration, car purchase budget, car purchase preference, and usage mileage according to the guidance. The system screens the user input information in combination with expert interviews, questionnaires, and hierarchical analysis to form a preference selection gene.

7. A system for executing the RV interior customization method based on mixed reality technology as claimed in claim 1, characterized in that: include: HoloLens2 mobile device, space determination system and RV customization process framework unit, wherein the HoloLens2 mobile device, space determination system and RV customization process framework unit are connected through wireless network communication; the HoloLens2 mobile device is used to construct a HoloLens2 interactive interface in unity 3D, and during the RV interior customization process, the user performs stereoscopic interactive control on the HoloLens2 interactive interface; The space determination system is used to determine whether the real space supports the placement of the model. The space determination system collects the length, width and height of common RVs on the market and constructs the space standard for the placement of the model through calculation; The RV customization process framework unit is used to construct the RV interior customization process.

Images