Decoration design entity interaction device, interaction method, system, medium and program product

Abstract

This invention discloses a physical interactive device, method, system, medium, and program product for interior design. The method includes: constructing a coordinate mapping relationship between a physical operation area and a virtual 3D scene; then using an image acquisition unit to identify the marking information and spatial information of physical modules placed on the physical operation area; based on the coordinate mapping relationship, mapping the identified physical furniture modules into digital furniture models in the virtual 3D scene in real time, and updating the virtual camera viewpoint corresponding to the viewpoint module in the virtual 3D scene in real time; when the viewpoint module is detected to remain stationary within a preset time period, determining the target perspective viewpoint based on the current spatial information of the viewpoint module, and generating a scene rendering. This invention uses physical modules as the interactive medium for design layout, lowering the threshold for non-professional users to participate in interior design, realizing intuitive integrated linkage between furniture layout adjustment, viewpoint selection, and rendering generation, and improving the efficiency of interior design.

Description

Technical Field

[0001] This invention relates to the field of digital interactive technology, and in particular to physical interactive devices, interactive methods, systems, media and program products for interior design. Background Technology

[0002] With the development of digital interior design, current interior furnishing layouts and renderings typically rely on digital interaction methods such as mice, keyboards, touchscreens, or head-mounted devices. Furniture selection, placement, rotation, perspective switching, and rendering generation are completed within two-dimensional interfaces or 3D modeling software. While this approach can express spatial plans, it often presents challenges for ordinary users, non-professional design participants, or scenarios requiring rapid discussion of plans. These challenges include high operational barriers, lack of intuitive interaction, and limited efficiency in adjusting plans.

[0003] In existing technologies, one type of solution is a purely digital furniture placement system based on computer-aided design software. Users need to drag and drop models, adjust coordinates, rotate angles, and control the viewing angle through the software interface before rendering or using image generation tools to output renderings. This type of technology has the following shortcomings: 1. It requires users to have a certain level of software operation skills, resulting in a high learning cost; 2. Furniture layout adjustment and viewing angle selection often belong to different operation logics, leading to a fragmented interaction process; 3. There is a lack of a natural and coherent physical interaction process between the layout result and the rendering perspective, which is not conducive to design communication and rapid iteration. Another type of solution is a spatial display system based on augmented reality or visual recognition. It uses cameras to identify objects or markers in the real space and overlays digital models onto the screen or mobile terminal. Although this type of solution improves the integration of virtual and real elements, it mostly relies on screen clicks, mobile device scanning, or head-mounted device observation, making it difficult to create a low-threshold interactive experience suitable for desktop collaborative discussions. In addition, existing systems often only focus on model placement or spatial browsing, lacking an integrated linkage mechanism from physical placement and spatial roaming to automatic generation of renderings.

[0004] In summary, the following technical problems exist in existing interior design interaction methods: 1. Existing software-interface-based furniture placement and view control methods are complex to operate and lack intuitive interaction, making it difficult for ordinary users to quickly participate in adjusting interior design schemes; 2. Existing visual recognition or augmented reality-based interaction systems typically only achieve model recognition or virtual display, lacking a continuous and integrated interactive process from furniture layout and spatial roaming to rendering generation; 3. In existing technologies, coordinate mapping, view switching, and rendering generation between physical operations and digital scenes are usually separated, making it difficult to achieve low latency, real-time linkage, and natural interaction; 4. During the view selection process, if there is a lack of stability confirmation mechanism, the rendering process can be erroneously triggered due to the user's brief movement or misplacement of the view module; 5. Existing systems usually require users to switch to external interfaces or other software to view the rendering results, resulting in poor interaction continuity.

[0005] Therefore, existing technologies still lack an interactive device and method for interior design to achieve more intuitive, efficient, and low-threshold generation and display of interior design solutions. Summary of the Invention

[0006] In view of this, embodiments of the present invention provide physical interactive devices, interactive methods, systems, media and program products for interior design, which at least partially solve the problems existing in the prior art.

[0007] Other features and advantages of the invention will become apparent from the following detailed description, or may be learned in part by practice of the invention.

[0008] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0009] According to a first aspect of the present invention, a physical interactive device for interior design is provided, the physical interactive device including a physical operation area, an image acquisition unit, and a physical module;

[0010] The physical operation area is used for users to place the physical modules;

[0011] The image acquisition unit is used to identify visual recognition marks on the entity module, which includes a physical furniture module and a viewing angle module.

[0012] Furthermore, the physical interaction device also includes an interaction box and a transparent control panel;

[0013] The image acquisition unit is located at the bottom of the interactive box;

[0014] The transparent operation panel is positioned above the image acquisition unit, and the upper surface of the transparent operation panel forms a physical operation area for the user to place the physical module.

[0015] According to a second aspect of the present invention, an interactive method for interior design is provided, the method comprising:

[0016] Based on the above-mentioned physical interactive device for interior design, a coordinate mapping relationship is constructed between the physical operation area and the virtual three-dimensional scene;

[0017] Using the image acquisition unit, the marking information and spatial information of the entity modules placed on the entity operation area are identified;

[0018] Based on the coordinate mapping relationship, the identified physical furniture modules are mapped in real time to digital furniture models in the virtual 3D scene;

[0019] Based on the coordinate mapping relationship, the virtual camera viewpoint synchronized with the pose of the viewpoint module is updated in real time in the virtual 3D scene using the identified viewpoint module.

[0020] When the perspective module is detected to remain stationary for a preset period of time, the target perspective angle is determined based on the current spatial information of the perspective module.

[0021] Based on the target perspective, a scene rendering is generated.

[0022] Furthermore, constructing the coordinate mapping relationship between the entity's operational area and the virtual 3D scene includes:

[0023] A calibration mark is set at a preset position in the physical operation area;

[0024] The pixel coordinates of the calibration mark are identified by the image acquisition unit;

[0025] The pixel coordinates of the calibration mark are mapped to the perspective transformation matrix of the virtual 3D scene coordinate system;

[0026] After all calibration marks have reached a stable state within a preset stable time period, the coordinate mapping relationship is determined according to the perspective transformation matrix.

[0027] Furthermore, based on the coordinate mapping relationship, the identified physical furniture modules are mapped in real time to digital furniture models in a virtual 3D scene, including:

[0028] Based on the identified physical furniture module's tagging information, the corresponding digital furniture model is determined, whereby the tagging information includes the module ID corresponding to the physical module;

[0029] Based on the coordinate mapping relationship and the spatial information of the identified physical furniture modules, the digital furniture model is placed in the corresponding position and orientation in the virtual three-dimensional scene, where the spatial information includes coordinate information and orientation information.

[0030] The virtual 3D scene containing the digital furniture model is updated in real time on the user display interface.

[0031] Furthermore, based on the target perspective, a scene rendering is generated, including:

[0032] Switch the current virtual 3D scene from the preview environment to the rendering environment;

[0033] Based on the target perspective, obtain a screenshot of the current perspective in the rendering environment;

[0034] Based on the current view screenshot and the prompt words, the prompt words are generated and displayed, where the prompt words are either user-input prompt words or preset prompt words.

[0035] Furthermore, the method also includes:

[0036] When the scene rendering is in the display state, determine whether the view module on the entity operation area has been removed;

[0037] If the view module on the entity operation area is not removed, the display state of the scene rendering will be maintained.

[0038] If the view module on the entity operation area is removed, the display state of the scene rendering ends, and the current virtual 3D scene is switched to the preview environment.

[0039] According to a third aspect of the present invention, an interactive system for interior design is provided, the system comprising:

[0040] The coordinate mapping relationship construction module is used to construct the coordinate mapping relationship between the entity operation area and the virtual three-dimensional scene based on the above-described decoration design entity interaction device.

[0041] The visual recognition processing module is used to identify the marking information and spatial information of the entity module placed on the entity operation area using the image acquisition unit;

[0042] The digital scene interaction module is used to map the identified physical furniture module into a digital furniture model in a virtual 3D scene in real time according to the coordinate mapping relationship; and to update the virtual camera view synchronized with the pose of the view module in real time in the virtual 3D scene according to the identified view module.

[0043] The rendering generation module is used to determine the target perspective view based on the current spatial information of the perspective module when it is detected that the perspective module remains stationary within a preset time period; and to generate a scene rendering based on the target perspective view.

[0044] According to a fourth aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, wherein when executed by a processor, the computer program implements the steps of the interior design interactive method as described in any of the preceding claims.

[0045] According to a fifth aspect of the present invention, a computer program product is provided, the computer program product comprising a computing program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to implement the steps of an interactive decoration design method as described in any of the preceding claims.

[0046] The interior design physical interaction device, method, system, medium, and program products provided in this invention lower the barrier to entry for interior design interaction by linking manually operable physical furniture modules with a virtual 3D scene in real time. This allows users to adjust interior furnishing schemes through natural placement, movement, and rotation without directly operating complex software interfaces. By setting up a character / camera module, this invention unifies furniture layout interaction and human-viewpoint roaming interaction into a single physical operation system, achieving a continuous interactive process from "scheme placement" to "spatial experience" and then to "rendering of renderings," solving the problem of fragmented layout adjustment, viewpoint selection, and rendering output in existing technologies. This invention establishes a mapping relationship between physical desktop coordinates and virtual scene coordinates through four-corner point calibration marks and uses a perspective transformation matrix to perform coordinate transformation on the module positions, ensuring that the actual position of the physical module on the transparent operation board can be accurately mapped to the corresponding position in the Unity virtual 3D scene, thus guaranteeing the accuracy and repeatability of virtual-real linkage. Furthermore, this invention uses a countdown confirmation mechanism based on a static state to trigger the generation process only after the viewpoint module has remained stable, reducing false triggers and improving the consistency between the final rendering result and the user's target viewpoint. This invention also ensures operational visibility during the layout phase and scene integrity and image quality during the generation phase through an automatic switching mechanism between the preview and rendering environments. Furthermore, by overlaying the results within the Unity interface, it reduces software jumps and improves interactive continuity. Therefore, this invention forms a continuous interactive closed loop of "entity placement—real-time preview—stability confirmation—automatic generation—interface feedback," solving the problems of fragmented interaction, high false trigger rates, and insufficient feedback efficiency in existing technologies. Attached Figure Description

[0047] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are merely exemplary, and those skilled in the art can derive other embodiments based on the provided drawings without creative effort.

[0048] Figure 1 This is a schematic diagram of the structure of a physical interactive device for interior design provided in an embodiment of the present invention;

[0049] Figure 2 A flowchart illustrating an interactive method for interior design provided in an embodiment of the present invention;

[0050] Figure 3 This is a schematic diagram of the structure of an interactive decoration design system provided in an embodiment of the present invention;

[0051] Figure 4 This is a flowchart illustrating an interactive method for interior design provided in an embodiment of the present invention. Detailed Implementation

[0052] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0053] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0054] Figure 1 The diagram shows a structural schematic of an interactive physical device for interior design provided by an embodiment of the present invention.

[0055] like Figure 1As shown, the physical interaction device includes a physical operation area 1, an image acquisition unit 2, and several physical modules 3. The physical operation area 1 is used for users to place the physical modules 3. The image acquisition unit 2 is used to identify visual recognition marks on the physical modules 3. Each physical module 3 includes a physical furniture module and a perspective module. The perspective module represents a switching between a human perspective and a camera perspective. Each physical module has an ArUco code mark at its bottom for visual recognition, and different modules are distinguished by different module IDs. The physical furniture module is used to represent different furniture categories, and the human / camera perspective module is used to trigger human perspective roaming and rendering processes.

[0056] Optionally, in addition to furniture and perspective modules, the physical modules may further include lighting, material, and scene style modules to achieve richer spatial control functions.

[0057] Alternatively, visual identification markers may also be QR codes, AprilTags, or other identifiable markers.

[0058] Specifically, the physical interaction device also includes an interaction box and a transparent operation panel. The image acquisition unit 2 is located at the bottom of the interaction box, and the transparent operation panel is located above the image acquisition unit 2. The upper surface of the transparent operation panel forms a physical operation area 3 for the user to place physical modules. The image acquisition unit 2 acquires image information of the physical modules 3 above the transparent operation panel through a camera.

[0059] Figure 2 The figure shows a flowchart of an interactive method for interior design according to an embodiment of the present invention.

[0060] like Figure 2 As shown, the interior design interaction method according to an embodiment of the present invention may include steps S100, S200, S300, S400, S500 and S600.

[0061] In step S100, based on the above-mentioned decoration design entity interaction device, a coordinate mapping relationship between the entity operation area and the virtual three-dimensional scene is constructed.

[0062] Specifically, the above steps include:

[0063] First, calibration marks are set at preset positions (four corner points) in the physical operation area. The pixel coordinates of the four calibration marks are identified by the image acquisition unit, and the pixel coordinates of the calibration marks are mapped to world coordinates of the virtual three-dimensional scene coordinate system to construct a perspective transformation matrix.

[0064] Once all calibration marks have stabilized within a preset time period, the perspective transformation matrix is ​​saved to determine the coordinate mapping relationship. Subsequently, the coordinates of the center point of the physical module are accurately converted into the X and Z coordinates in the virtual scene, thereby achieving a stable correspondence between the physical desktop and the digital space.

[0065] The preferred virtual 3D scene is a virtual space program built on the Unity engine, which pre-stores the correspondence between entity module IDs and digital furniture models. It can also be implemented by other real-time 3D engines.

[0066] The embodiments of the present invention achieve a stable correspondence between the physical operation area and the virtual scene through a four-corner calibration and coordinate mapping mechanism, thereby improving the accuracy of virtual-real linkage.

[0067] Next, in step S200, the image acquisition unit is used to identify the marking information and spatial information of the entity module placed on the entity operation area.

[0068] Specifically, the above steps include:

[0069] The image acquisition unit is used to identify the ArUco code ID corresponding to each entity module, and the spatial information of the corresponding entity module in the entity operation area is calculated (the X-coordinate of the module in the virtual scene, the Z-coordinate of the module in the virtual scene, and the rotation angle of the module).

[0070] It should be noted that the viewpoint module and the physical furniture module use the same type of ArUco code for identification, but are distinguished by different module IDs. The unified visual mark recognition mechanism adopted in this embodiment of the invention is beneficial for system expansion and modular implementation.

[0071] In step S300, the identified physical furniture modules are mapped in real time to digital furniture models in the virtual 3D scene according to the coordinate mapping relationship.

[0072] Specifically, the above steps include:

[0073] Based on the identified markings of the physical furniture modules, the corresponding digital furniture models are determined. Then, according to the coordinate mapping relationship and the spatial information of the identified physical furniture modules, the digital furniture models are placed in the corresponding positions and orientations within the virtual 3D scene. The current interior furnishing layout is then displayed to the user on the user's interface using an isometric or top-down auxiliary perspective. Users can adjust the furniture layout in the virtual space in real time by moving and rotating the physical furniture modules, achieving a real-time preview that integrates virtual and real elements.

[0074] Next, in step S400, based on the coordinate mapping relationship, the virtual camera viewpoint synchronized with the pose of the viewpoint module is updated in real time in the virtual 3D scene using the identified viewpoint module.

[0075] In step S500, when the perspective module is detected to remain stationary within a preset time period, the target perspective angle is determined based on the current spatial information of the perspective module.

[0076] Specifically, the above steps include:

[0077] When the viewpoint (person / camera) module is detected to be present and stationary, the countdown confirmation phase begins. If the module is detected to be moving or rotating during the countdown, the countdown is reset. Once the module has been stably in place for a preset duration, the rendering generation phase begins, and the target perspective viewpoint is determined based on the position and orientation of the viewpoint module.

[0078] This invention implements rendering perspective selection through a character / camera module, unifying layout design and spatial experience into the same interactive system. Through a countdown confirmation mechanism based on static judgment, it effectively reduces false triggering of perspective and improves the consistency between rendering output and user intent.

[0079] Finally, in step S600, a scene rendering is generated based on the target perspective.

[0080] Specifically, the above steps include:

[0081] First, switch the current virtual 3D scene from the preview environment to the rendering environment and wait for the environment to load and the lighting to stabilize. The preview environment is used in the real-time editing stage, making it easy for users to observe the overall layout. The rendering environment is used in the rendering stage, providing a more complete spatial representation, such as a top model, complete interior enclosure, and scene resources that are more suitable for rendering.

[0082] Based on the aforementioned target perspective, a screenshot of the current perspective in the rendering environment is captured using RenderTexture.

[0083] The current view screenshot and prompt words are sent together to the image generation interface. The interface uses various replacement image generation, text-to-image, image editing, or multimodal generation models. The prompt words are either user-input prompt words or preset prompt words.

[0084] It receives the image generation result and converts it into a displayable image texture to obtain a scene effect image. The generated scene effect image is then overlaid and displayed on the Unity interface. After the user removes the view module or the preset display time is reached, it returns to the real-time editing state.

[0085] It should be noted that, in addition to overlay display, the results can also be displayed in the form of partial display, split-screen display, or overlay comparison display.

[0086] In this embodiment, the generated scene rendering is not displayed as a separate pop-up window, but rather overlaid on the Unity scene as an interface overlay, thereby reducing software jumps and improving the continuity of interaction.

[0087] The aforementioned state control method enables the system to resist accidental triggering based on stable attitude determination, preventing users from accidentally triggering rendering before determining the viewing angle.

[0088] Preferably, one or more of the following can be further input: material reference image, style reference image, and furniture reference image, to generate a rendering that better matches the target style.

[0089] Furthermore, when the scene rendering is in display mode, it is determined whether the view module on the entity operation area has been removed. If the view module on the entity operation area has not been removed, the scene rendering is maintained in display mode; if the view module on the entity operation area has been removed, the scene rendering display mode is ended, and the current virtual 3D scene is switched to the preview environment. This embodiment of the invention balances layout editing efficiency and rendering quality through an automatic switching mechanism between the preview and rendering environments.

[0090] Figure 4 The diagram shows a flowchart illustrating an interactive method for interior design provided by an embodiment of the present invention.

[0091] In this embodiment, both the furniture layout stage and the character perspective preview stage are displayed in real time. The total time from when the user determines the rendering perspective and keeps it stable to when the result is generated and displayed on the interactive interface is usually 15-20 seconds. Therefore, this invention has both real-time layout response and short-term feedback capability of rendering, and is suitable for scenarios where interior design schemes are quickly refined, displayed and communicated.

[0092] This invention uses physical furniture modules as the interactive medium for furniture layout design, which is more intuitive than traditional mouse and keyboard or touch screen operation methods. It lowers the threshold for non-professional users to participate in interior design and realizes the integrated linkage of furniture layout adjustment, perspective roaming selection and rendering generation. Users can continuously complete the entire process from scheme conception to visual expression in a single interactive process, which effectively improves the efficiency of design communication.

[0093] In addition, embodiments of the present invention also provide an interactive system for interior design. Figure 3 This diagram illustrates the structure of an interactive interior design system according to an embodiment of the present invention. The system includes:

[0094] The coordinate mapping relationship construction module is used to construct the coordinate mapping relationship between the physical operation area and the virtual three-dimensional scene based on the above-mentioned decoration design physical interactive device.

[0095] The visual recognition processing module is used to identify the marking information and spatial information of entity modules placed on the entity operation area using the image acquisition unit;

[0096] The digital scene interaction module is used to map the identified physical furniture modules into digital furniture models in the virtual 3D scene in real time according to the coordinate mapping relationship; and to update the virtual camera view synchronized with the pose of the view module in the virtual 3D scene in real time according to the coordinate mapping relationship and the identified view module.

[0097] The rendering generation module is used to determine the target perspective view based on the current spatial information of the perspective module when the view module is detected to remain stationary within a preset time period; and to generate a scene rendering based on the target perspective view.

[0098] In addition, embodiments of the present invention also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of an interactive decoration design method as described above.

[0099] In addition, this embodiment of the invention also provides a computer program product, which includes computer program instructions that, when executed by a processor, implement the steps of the interior design interaction method described above.

[0100] Addressing the technical issues existing in current interior design interaction methods:

[0101] This invention reduces the barrier to entry for interior design by linking manually operable physical furniture modules with a virtual 3D scene in real time, allowing users to adjust interior furnishing schemes through natural placement, movement, and rotation without having to directly operate a complex software interface.

[0102] This invention, through the establishment of a character / camera module, unifies furniture layout interaction and human perspective roaming interaction into a single entity operation system, realizing a continuous interactive process from "plan placement" to "spatial experience" and then to "rendering of renderings," thus solving the problem of the separation between layout adjustment, perspective selection, and rendering output in the prior art.

[0103] This invention establishes a mapping relationship between the coordinates of the physical desktop and the coordinates of the virtual scene by using four corner point calibration marks, and uses a perspective transformation matrix to perform coordinate transformation on the module position, so that the actual position of the physical module on the transparent operation board can be accurately mapped to the corresponding position in the Unity virtual 3D scene, thereby ensuring the accuracy and repeatability of virtual-real linkage.

[0104] The embodiments of the present invention further employ a countdown confirmation mechanism based on a static state, which triggers the generation process only after the view module has remained stable, thereby reducing false triggers and improving the consistency between the final rendering result and the user's target view.

[0105] This invention also ensures operational visibility during the layout stage and scene integrity and image quality during the generation stage through an automatic switching mechanism between the preview environment and the rendering environment; and reduces software jumps and improves interactive continuity by overlaying the display results within the Unity interface.

[0106] Therefore, this invention forms a continuous interactive closed loop of "entity placement - real-time preview - stable confirmation - automatic generation - interface display", which solves the problems of fragmented interaction, high false trigger rate and insufficient feedback efficiency in the prior art.

[0107] In this embodiment of the invention, the processor can be an integrated circuit chip with signal processing capabilities. The processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in this embodiment of the invention. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in this embodiment of the invention can be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The processor reads information from the storage medium and, in conjunction with its hardware, completes the steps of the above methods. The storage medium can be memory, for example, volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM).The storage media described in the embodiments of this invention are intended to include, but are not limited to, these and any other suitable types of memory. Those skilled in the art will recognize that the functions described in the above examples can be implemented using a combination of hardware and software. When applied software, the corresponding functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transmission of computer programs from one place to another. Storage media can be any available medium accessible to general-purpose or special-purpose computers. Although the invention has been described in detail above with general description and specific embodiments, modifications or improvements can be made to it, which will be apparent to those skilled in the art. Therefore, such modifications or improvements made without departing from the spirit of the invention are all within the scope of protection claimed by the invention.

[0108] The above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention in any way. Any simple modifications, equivalent changes, or alterations made by those skilled in the art using the disclosed technical content shall fall within the protection scope of the present invention.

Claims

1. A physical interactive device for interior design, characterized in that, The physical interaction device includes a physical operation area, an image acquisition unit, and a physical module; The physical operation area is used for users to place the physical modules; The image acquisition unit is used to identify visual recognition marks on the entity module, which includes a physical furniture module and a viewing angle module.

2. The physical interactive device for interior design according to claim 1, characterized in that, The physical interaction device also includes an interaction box and a transparent control panel; The image acquisition unit is located at the bottom of the interactive box; The transparent operation panel is positioned above the image acquisition unit, and the upper surface of the transparent operation panel forms a physical operation area for the user to place the physical module.

3. An interactive method for interior design, characterized in that, The method includes: Based on the physical interactive device for interior design as described in claim 1, a coordinate mapping relationship is constructed between the physical operation area and the virtual three-dimensional scene; Using the image acquisition unit, the marking information and spatial information of the entity modules placed on the entity operation area are identified; Based on the coordinate mapping relationship, the identified physical furniture modules are mapped in real time to digital furniture models in the virtual 3D scene; Based on the coordinate mapping relationship, the virtual camera viewpoint synchronized with the pose of the viewpoint module is updated in real time in the virtual 3D scene using the identified viewpoint module. When the perspective module is detected to remain stationary for a preset period of time, the target perspective angle is determined based on the current spatial information of the perspective module. Based on the target perspective, a scene rendering is generated.

4. The interior design interaction method according to claim 3, characterized in that, Constructing the coordinate mapping relationship between the entity's operational area and the virtual 3D scene includes: A calibration mark is set at a preset position in the physical operation area; The pixel coordinates of the calibration mark are identified by the image acquisition unit; The pixel coordinates of the calibration mark are mapped to the perspective transformation matrix of the virtual 3D scene coordinate system; After all calibration marks have reached a stable state within a preset stable time period, the coordinate mapping relationship is determined according to the perspective transformation matrix.

5. The interior design interaction method according to claim 3, characterized in that, Based on the coordinate mapping relationship, the identified physical furniture modules are mapped in real time to digital furniture models in a virtual 3D scene, including: Based on the identified physical furniture module's tagging information, the corresponding digital furniture model is determined, whereby the tagging information includes the module ID corresponding to the physical module; Based on the coordinate mapping relationship and the spatial information of the identified physical furniture modules, the digital furniture model is placed in the corresponding position and orientation in the virtual three-dimensional scene, where the spatial information includes coordinate information and orientation information. The virtual 3D scene containing the digital furniture model is updated in real time on the user display interface.

6. The interior design interaction method according to claim 3, characterized in that, Based on the target perspective, a scene rendering is generated, including: Switch the current virtual 3D scene from the preview environment to the rendering environment; Based on the target perspective, obtain a screenshot of the current perspective in the rendering environment; Based on the current view screenshot and the prompt words, the prompt words are generated and displayed, where the prompt words are either user-input prompt words or preset prompt words.

7. The interior design interaction method according to claim 3, characterized in that, The method further includes: When the scene rendering is in the display state, determine whether the view module on the entity operation area has been removed; If the view module on the entity operation area is not removed, the display state of the scene rendering will be maintained. If the view module on the entity operation area is removed, the display state of the scene rendering ends, and the current virtual 3D scene is switched to the preview environment.

8. An interactive system for interior design, characterized in that, The system includes: A coordinate mapping relationship construction module is used to construct a coordinate mapping relationship between the entity operation area and the virtual three-dimensional scene based on the decoration design entity interaction device as described in claim 1. The visual recognition processing module is used to identify the marking information and spatial information of the entity module placed on the entity operation area using the image acquisition unit; The digital scene interaction module is used to map the identified physical furniture module into a digital furniture model in a virtual 3D scene in real time according to the coordinate mapping relationship; and to update the virtual camera view synchronized with the pose of the view module in real time in the virtual 3D scene according to the identified view module. The rendering generation module is used to determine the target perspective view based on the current spatial information of the perspective module when it is detected that the perspective module remains stationary within a preset time period; and to generate a scene rendering based on the target perspective view.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of an interactive decoration design method as described in any one of claims 3 to 7.

10. A computer program product, characterized in that, The computer program product includes computer program instructions that, when executed by a processor, implement the steps of an interactive decoration design method as described in any one of claims 3 to 7.

Images