A home display method and device based on mixed reality enhancement technology

Abstract

The application discloses a kind of based on mixed reality enhancement technology's home display method, comprising the following steps: S1, installation space position locator: in the house that has completed hard installation, place a certain amount of space position locator, and the position of space position locator is placed in home placement position;The application also proposes a kind of based on mixed reality enhancement technology's home display equipment, including multiple space position locators and VR glasses, the space position locator includes installation shell.The application is placed in corresponding position by setting corresponding equipment and is demarcated, so as to facilitate the use of VR head-mounted display equipment with infrared camera in the real environment that has completed hard installation to carry out home display, and it is convenient to change according to the demand of user, and user can obtain better space sense and real sense, complete the collocation selection of whole house home under better display effect, reach the goal that design effect maximum limit is close to actual effect.

Description

Technical Field

[0001] This invention relates to the field of home display technology, and in particular to a home display method and device based on mixed reality augmented technology. Background Technology

[0002] Decoration refers to a set of construction and design plans carried out in a certain area and scope, including water and electricity construction, walls, floors, ceilings, landscaping, etc., formed according to certain design concepts and aesthetic rules.

[0003] From small details like furniture placement and door orientation to larger aspects like custom-made room accessories and lighting fixtures, everything reflects interior design. Interior design differs from decoration; decoration is the artistic processing of everyday items or living environments. It enhances aesthetic appeal, improves functionality, economic value, and social benefits, and adheres to environmental protection design principles. Perfect decoration should be closely integrated with the function of the object, adapt to manufacturing processes, utilize the properties of materials, and possess excellent artistic effects.

[0004] Home decoration can be divided into two main categories: hard decoration and soft decoration. Hard decoration refers to fixed and immovable decorative elements added to the surface or interior of a building to meet the structural, layout, functional, and aesthetic needs of the house, in addition to the necessary infrastructure. These include floor tiles, floorboards, wallpaper, and paint. Soft decoration design, with its concept of customized living, has shifted the focus of home furnishings and lifestyle. Customized living in soft decoration emphasizes not only external aesthetics such as color and style but also internal functionality such as comfort and structure, and greater convenience. Home furnishing displays, on the other hand, primarily aim to allow residents and users to adjust the style and placement of furniture according to their own needs.

[0005] When designers and users are arranging and matching interior furniture, they can only use spatial imagination or present it in the form of 2D drawings, 3D renderings or animations. This results in a poor sense of space and a poor real experience for designers and users. The design effect and the actual display effect are likely to have a large gap, and the final effect cannot be achieved well. Therefore, it needs to be improved. Summary of the Invention

[0006] The purpose of this invention is to address the shortcomings of existing technologies where designers and users can only rely on spatial imagination or display their interior furnishings through 2D drawings, 3D renderings, or animations. This results in poor spatial awareness and a lack of realistic experience for designers and users, leading to significant discrepancies between the design and the actual display, and ultimately failing to achieve a satisfactory final effect. Therefore, this invention proposes a home furnishing display method and device based on mixed reality augmented technology.

[0007] To achieve the above objectives, the present invention adopts the following technical solution:

[0008] A home furnishing display method based on mixed reality augmented technology includes the following steps:

[0009] S1. Install spatial location locators: Place a certain number of spatial location locators in the house where the hard decoration has been completed, and place the spatial location locators in the positions where the furniture is placed;

[0010] S2, Spatial location information of marker points: After the infrared camera on the head-mounted display identifies the infrared pulse signal on the locator, the built-in SLAM algorithm will obtain accurate spatial location information of the marker points.

[0011] S3. Placement and scaling of furniture modeling: Set a theoretically 100mm overlap point at the center of the bottom surface of the furniture model for display. After placing the model near the locator in the mixed reality augmented image, the program will automatically scale the model proportionally so that the theoretically 100mm overlap point at the center of the bottom surface of the model coincides with the actual 100mm mark point on the locator in the image. This achieves the same visual effect of the furniture model in the mixed reality image as the naked-eye visual effect of the real furniture in the same placement position.

[0012] S4. Model Position Adjustment: If the model overlaps with the actual object in the mixed reality image, the spatial locator can be moved directly, and the overlapping model in the mixed reality image will move accordingly.

[0013] S5. Modeling Visual Effects: Users can wear head-mounted displays to enter the house, gaining a better sense of space and realism. They can view the home furnishings with better display effects and easily make changes, completing the matching of the whole house's furniture according to their preferences.

[0014] The present invention also proposes a home display device based on mixed reality augmented technology, including multiple spatial positioning devices and VR glasses. The spatial positioning device includes a mounting shell, and the lower end of the mounting shell is detachably connected to a mounting frame via a base plate. A power supply component is installed on the upper end of the mounting frame, and the power supply component is connected to the mounting shell. Infrared pulse signal lights are fixed on both sides of the mounting frame. Through holes are opened on both sides of the upper end of the mounting shell, and two infrared pulse signal lights correspond to two through holes respectively.

[0015] Preferably, in order to enable the infrared pulse signal lights to operate stably, the power supply component includes a battery mounting box fixed to the middle of the upper end of the mounting bracket. An opening is provided in the middle of the upper end of the mounting housing. A battery is installed inside the battery mounting box, and the battery corresponds to the opening. The battery is electrically connected to two infrared pulse signal lights.

[0016] Preferably, to ensure the connection is secure, the lower end of the mounting shell abuts against a base plate, two bolts are provided through the base plate, two through holes are provided on the mounting bracket, and threaded tubes are fixed on both sides of the top of the mounting shell. The two bolts pass through the two through holes and are screwed into the two threaded tubes.

[0017] Preferably, in order to facilitate snap-fit ​​and improve connection efficiency, a square frame is fixed to the upper end of the base plate, and the square frame is located inside the mounting shell.

[0018] Preferably, in order to provide a cushioning effect during movement, a pad is fixed to the lower end of the mounting bracket, and the lower end of the pad abuts against the base plate.

[0019] Preferably, in order to accurately calibrate the distance and facilitate the control of the furniture model's extension and retraction, the distance between two infrared pulse signal lights on the same mounting bracket is 100mm.

[0020] The beneficial effects of this invention are:

[0021] 1. The components such as the base plate, mounting bracket, and mounting shell facilitate quick and easy assembly, and the battery and battery box facilitate easy disassembly and replacement, ensuring continuous operation.

[0022] 2. By placing the locator horizontally on the ground, if the model overlaps with the actual object in the mixed reality image, the spatial locator can be moved directly, and the overlapping model in the mixed reality image will move accordingly; it can be placed in a specified position as needed.

[0023] 3. After the infrared pulse signal on the locator is identified by the infrared camera on the head-mounted display device, the built-in SLAM algorithm will obtain accurate spatial position information of the marker point. At the same time, a coincidence point with a theoretical spacing of 100mm is set at the center of the bottom surface of the furniture model for display. After the model is placed near the locator in the mixed reality augmented image, the program will automatically scale the model proportionally to achieve the same naked-eye visual effect as the furniture model in the mixed reality image when it is placed in the same position.

[0024] In summary, this invention, by setting up corresponding equipment that can be placed in appropriate locations for calibration, facilitates the use of VR headsets with infrared cameras to showcase home furnishings in completed real-world environments. Furthermore, it allows for easy replacement according to user needs, providing users with a better sense of space and realism. This results in a more comprehensive selection of home furnishings, achieving the goal of maximizing the resemblance between the design and the actual product. Attached Figure Description

[0025] Figure 1This is a structural diagram of a mounting frame for a home display device based on mixed reality augmented technology proposed in this invention;

[0026] Figure 2 This is a structural diagram of the mounting shell of a home display device based on mixed reality augmented technology proposed in this invention;

[0027] Figure 3 This is a structural diagram of the mounting shell and base plate of a home display device based on mixed reality augmented technology proposed in this invention;

[0028] Figure 4 This is a structural diagram of a mounting frame and base plate for a home display device based on mixed reality augmented technology proposed in this invention;

[0029] Figure 5 This is a front view of VR glasses for a home display device based on mixed reality augmented technology proposed in this invention;

[0030] Figure 6 This is a flowchart illustrating the steps of a home display method based on mixed reality augmented technology proposed in this invention.

[0031] In the diagram: 1 Infrared pulse signal light, 2 Battery mounting box, 3 Mounting bracket, 4 Connecting threaded tube, 5 Opening, 6 Through hole, 7 Mounting shell, 8 Square frame, 9 Base plate, 10 VR glasses, 11 Battery, 12 Through hole, 13 Spacer, 14 Bolt. Detailed Implementation

[0032] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments.

[0033] Reference Figure 6 A home furnishing display method based on mixed reality augmented technology includes the following steps:

[0034] S1. Install spatial positioning devices: Place a certain number of spatial positioning devices in the house where the hard decoration has been completed, and place the spatial positioning devices in the furniture placement positions. In the house where the hard decoration has been completed, such as the floor paving, wall painting or wallpapering, and ceiling lights, etc., according to the design, place the spatial positioning devices in the furniture placement positions to facilitate setting the style of the furniture to be placed here as needed, and at the same time, the furniture placement position can be changed as needed. It can be viewed through VR glasses to achieve the same naked-eye visual effect as the furniture modeling visual effect in the mixed reality image and the actual furniture in the same placement position.

[0035] S2, Spatial Position Information of Marker Points: After the infrared camera on the head-mounted display identifies the infrared pulse signal on the locator, the built-in SLAM algorithm will obtain accurate spatial position information of the marker point. Using a VR head-mounted display with an infrared camera (Inside-out tracking and positioning) to showcase home furnishings in a real-world environment with completed hard decoration, users can obtain a better sense of space and realism, and complete the matching and selection of the whole house furniture under better display effect. After the locator is placed horizontally on the ground, the two infrared pulse signal lights 1 on the locator will operate. After the infrared camera on the head-mounted display identifies the infrared pulse signal on the locator, the built-in SLAM algorithm will obtain accurate spatial position information of the marker point.

[0036] S3. Furniture Modeling Placement and Scaling: Set a theoretically 100mm overlap point at the center of the bottom surface of the furniture model for display. After placing the model near the locator in the mixed reality augmented image, the program will automatically scale the model proportionally so that the theoretically 100mm overlap point at the center of the bottom surface of the model coincides with the actual 100mm mark point on the locator in the image. This ensures that the visual effect of the furniture model in the mixed reality image is consistent with the naked-eye visual effect of the actual furniture in the same placement position. This allows for better setting of furniture models and facilitates staff understanding.

[0037] S4. Model Position Adjustment: If the model overlaps with the actual object in the mixed reality image, the spatial locator can be moved directly, and the overlapping model in the mixed reality image will move accordingly, making it easy to quickly adjust the position of the home model.

[0038] S5. Modeling Visual Effects: Users can wear head-mounted displays to enter the house, gaining a better sense of space and realism. They can view the home furnishings with better display effects and easily make changes, completing the matching of the whole house's furniture according to their preferences.

[0039] Reference Figure 1-5A home display device based on mixed reality augmented technology includes multiple spatial positioning locators and VR glasses 10, and existing VR headsets, such as the commonly available OCULUS. In quest2, when using the built-in "perspective" mode in mixed reality augmented reality, the existing built-in SLAM algorithm cannot convert machine vision images into accurate spatial data. For example, after placing the modeled sofa in the image, it is difficult to place the model in the accurate position in the mixed reality image without corresponding spatial information. Furthermore, the size of the model is difficult to accurately match the spatial size in the image. After the infrared camera on the head-mounted display identifies the infrared pulse signal on the locator, the built-in SLAM algorithm will obtain accurate spatial position information of the marker points. At the same time, a theoretically 100mm overlap point is set at the center of the bottom surface of the furniture model. After placing the model near the locator in the mixed reality augmented image, the program will automatically scale the model proportionally so that the theoretically 100mm overlap point at the center of the bottom surface of the model coincides with the actual 100mm overlap point on the locator in the image. This can effectively improve the positioning accuracy and achieve the same naked-eye visual effect as the furniture model in the mixed reality image when placed in the same position as the actual furniture.

[0040] Reference Figure 1-5 The spatial positioning device includes a mounting shell 7. The lower end of the mounting shell 7 is detachably connected to a mounting bracket 3 via a base plate 9. A power supply component is installed on the upper end of the mounting bracket 3. The power supply component is connected to the mounting shell 7 and can provide energy for the operation of the infrared pulse signal lamp 1. Infrared pulse signal lamps 1 are fixed on both sides of the mounting bracket 3. Through holes 6 are opened on both sides of the upper end of the mounting shell 7. Two infrared pulse signal lamps 1 correspond to two through holes 6 respectively. The distance between the two infrared pulse signal lamps 1 on the same mounting bracket 3 is 100mm, which can achieve good positioning. At the same time, the two infrared pulse signal lamps 1 can effectively improve the positioning accuracy.

[0041] Reference Figure 1-5 The power supply component includes a battery mounting box 2 fixed in the middle of the upper part of the mounting bracket 3. An opening 5 is provided in the middle of the upper part of the mounting shell 7. A battery 11 is installed in the battery mounting box 2. The battery 11 corresponds to the opening 5. The battery 11 is electrically connected to two infrared pulse signal lamps 1, which can ensure the stable operation of the infrared pulse signal lamps 1. The battery 11 is easy to replace, which can ensure the battery life during use.

[0042] Reference Figure 1-5The lower end of the mounting shell 7 abuts against the base plate 9. Two bolts 14 are installed through the base plate 9. Two through holes 12 are opened on the mounting bracket 3. Connecting threaded tubes 4 are fixed on both sides of the top inside the mounting shell 7. The two bolts 14 pass through the two through holes 12 and are screwed into the two connecting threaded tubes 4. A square frame 8 is fixed to the upper end of the base plate 9. The square frame 8 is located inside the mounting shell 7. A pad 13 is fixed to the lower end of the mounting bracket 3. The lower end of the pad 13 abuts against the base plate 9, which can ensure the firmness of the connection and facilitate quick snap-fit. During installation, the infrared pulse signal lamp 1 and the through hole 6 are aligned, the battery 11 and the opening 5 are aligned, and the square frame 8 on the base plate 9 and the inner groove of the mounting shell 7 are aligned, which can ensure the stability of the contact between the base plate 9 and the mounting shell 7. At the same time, the bolts 14 can pass through the mounting bracket 3 and be screwed into the corresponding connecting threaded tubes 4 to ensure the firmness of the connection.

[0043] In this invention, a certain number of spatial positioning devices are placed inside a house with completed hard furnishings, and these devices are positioned where the furniture is placed. After the infrared camera on the head-mounted display identifies the infrared pulse signals on the positioning devices, the built-in SLAM algorithm obtains accurate spatial position information of the marker points. A theoretically 100mm overlap point is set at the center of the bottom surface of the furniture model used for display. After the model is placed near the positioning devices in the mixed reality augmented image, the program automatically scales the model proportionally, ensuring that the theoretically 100mm overlap point at the center of the model's bottom surface coincides with the actual 100mm spacing marker points on the positioning devices in the image. This achieves the visual effect of the furniture model in the mixed reality image being in the same placement position as the actual furniture. The naked-eye visual effect is consistent. If the model overlaps with the actual object in the mixed reality image, the spatial locator can be moved directly, and the overlapping model in the mixed reality image will move accordingly. Users can wear head-mounted displays to enter the house and obtain a better sense of space and realism. They can view the home furnishings with better display effects and easily change them to complete the matching of the whole house according to their preferences. After a period of use, the base plate 9, mounting bracket 3 and mounting shell 7 can be separated by turning bolt 14. The staff can remove the battery 11 from the battery mounting box 2, replace it with a new battery 11 and connect and fix it with bolt 14. The battery 11 can provide power for the operation of the infrared pulse signal light 1, which is convenient for its normal operation.

[0044] The above description is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any equivalent substitutions or modifications made by those skilled in the art within the scope of the technology disclosed in the present invention, based on the technical solution and inventive concept of the present invention, should be covered within the scope of protection of the present invention.

Claims

1. A home display device based on mixed reality augmented technology, characterized in that: The device includes multiple spatial positioning devices and VR glasses (10). The spatial positioning device includes a mounting shell (7). The lower end of the mounting shell (7) is detachably connected to a mounting frame (3) via a base plate (9). A power supply component is installed on the upper end of the mounting frame (3). The power supply component is connected to the mounting shell (7). Infrared pulse signal lamps (1) are fixed on both sides of the mounting frame (3). Through holes (6) are opened on both sides of the upper end of the mounting shell (7). Two infrared pulse signal lamps (1) correspond to two through holes (6) respectively. A home furnishing display method based on mixed reality augmented technology includes the following steps: S1. Install spatial location locators: Place a certain number of spatial location locators in the house where the hard decoration has been completed, and place the spatial location locators in the positions where the furniture is placed. S2, Spatial location information of marker points: After the infrared camera on the head-mounted display identifies the infrared pulse signal on the locator, the built-in SLAM algorithm will obtain accurate spatial location information of the marker points. S3. Placement and scaling of furniture modeling: Set a theoretically 100mm overlap point at the center of the bottom surface of the furniture model for display. After placing the model near the locator in the mixed reality augmented image, the program will automatically scale the model proportionally so that the theoretically 100mm overlap point at the center of the bottom surface of the model coincides with the actual 100mm mark point on the locator in the image. This achieves the same visual effect of the furniture model in the mixed reality image as the naked-eye visual effect of the real furniture in the same placement position. S4. Model Position Adjustment: If the model overlaps with the actual object in the mixed reality image, the spatial locator can be moved directly, and the overlapping model in the mixed reality image will move accordingly. S5. Modeling Visual Effects: Users can wear head-mounted displays to enter the house, gaining a better sense of space and realism. They can view the home furnishings with better display effects and easily make changes, completing the matching of the whole house's furniture according to their preferences.

2. The home display device based on mixed reality augmented technology according to claim 1, characterized in that: The power supply assembly includes a battery mounting box (2) fixed in the middle of the upper end of the mounting bracket (3). An opening (5) is provided in the middle of the upper end of the mounting shell (7). A battery (11) is installed in the battery mounting box (2). The battery (11) corresponds to the opening (5). The battery (11) is electrically connected to two infrared pulse signal lamps (1).

3. A home display device based on mixed reality augmented technology according to claim 1, characterized in that: The lower end of the mounting shell (7) abuts against the base plate (9), and two bolts (14) are provided through the base plate (9). Two through holes (12) are provided on the mounting bracket (3). Connecting threaded tubes (4) are fixed on both sides of the top inside the mounting shell (7). The two bolts (14) pass through the two through holes (12) and are screwed into the two connecting threaded tubes (4).

4. A home display device based on mixed reality augmented technology according to claim 1, characterized in that: A square frame (8) is fixed to the upper end of the base plate (9), and the square frame (8) is located inside the mounting shell (7).

5. A home display device based on mixed reality augmented technology according to claim 1, characterized in that: The lower end of the mounting bracket (3) is fixed with a pad (13), and the lower end of the pad (13) abuts against the base plate (9).

6. A home display device based on mixed reality augmented technology according to claim 1, characterized in that: The distance between the two infrared pulse signal lamps (1) on the same mounting bracket (3) is 100mm.

Images