An immersive indoor three-dimensional design method supporting multi-person online collaboration

Abstract

This invention relates to the field of interior 3D design technology, and particularly to an immersive interior 3D design method supporting multi-user online collaboration. For interior 3D design components, the method categorizes them hierarchically according to functional zones, individual components, and attributes to construct a spatial topology model containing spatial topological relationships and dependency constraints. Based on this model, it divides the system into region-level, component-level, and attribute-level minimum locking units. User behavior features collected by the interactive terminal are used to predict operational intentions, and a set of minimum locking units required for the target operation is generated. Mutually exclusive locking is executed using independent rules. By monitoring the idle time of locked units, permissions are released when a locked unit times out. The status and permissions of all locked units are synchronized to the collaborative terminal to achieve online collaborative design. This invention effectively avoids chain locking and operation blocking, ensuring the freedom of multi-user concurrent editing and the security of mutually exclusive operations.

Description

Technical Field

[0001] This invention relates to the field of interior 3D design technology, and in particular to an immersive interior 3D design method that supports multi-user online collaboration. Background Technology

[0002] Existing solutions for multi-user online collaborative interior 3D design generally adopt traditional coarse-grained object locking mechanisms, using entire components or entire functional areas as single locking units for global mutual exclusion locking. In practical applications, this can easily lead to a chain of locking phenomena across large areas of the interior design space, causing other collaborators to experience editing waits and operational blockages. This not only disrupts the smoothness of immersive spatial navigation and the closed loop of continuous design interaction, but also makes it difficult to achieve an effective balance between the operational freedom of multi-user concurrent editing and the mutual exclusion security of design object operations, greatly affecting the smoothness of multi-user collaborative design and the overall user experience.

[0003] Therefore, it is necessary to propose an immersive 3D interior design method that supports multi-user online collaboration to solve the above problems. Summary of the Invention

[0004] The purpose of this invention is to provide an immersive 3D interior design method that supports multi-user online collaboration, in order to solve the problem that a single locking unit can easily cause a chain of locking in a large area of ​​the interior design space, which in turn causes other collaborators to experience editing wait and operation blockage.

[0005] To achieve the above objectives, the present invention provides the following technical solution: An immersive 3D interior design method supporting multi-user online collaboration includes the following steps: For components in interior 3D design, they are hierarchically classified according to functional zoning, individual components, and component attributes. By constructing spatial topological relationships and dependency constraints between components, a spatial topological model of interior 3D design is obtained. Based on the spatial topology model, the smallest locking unit is divided into region-level, component-level, and attribute-level units; Through an immersive interactive terminal, the virtual space coordinates, gaze focus range, and gesture operation trajectory of each online collaborative user are collected, and behavioral features are extracted to predict the components to be edited and the attributes to be adjusted, thereby generating the user's operation intention. Based on the operational intent and component topology, a set of minimum locking units required to cover the target operation is generated by matching the minimum locking units, and the set of minimum locking units is mutually exclusive locked. Monitor the duration of user activity within the minimum locked unit set and compare it with a preset idle threshold. When the duration exceeds the idle threshold, automatically unlock the minimum locked unit. The occupancy status and editable permissions of all the smallest locked units are synchronized to the user's online collaborative terminal in real time, and visual identifiers are used to distinguish between locked areas and freely editable areas, so as to realize multi-person online 3D interior design.

[0006] Preferably, spatial topological relationships between components are established based on the partition boundaries of the components, and the spatial topological relationships include spatial inclusion relationships, spatial adjacency relationships, and spatial dependency relationships; Based on the design of the interior components, dependency and constraint relationships are established between the components, including rigid dependency constraints, spatial constraints, and linkage constraints.

[0007] Preferably, the step of dividing the smallest locking unit into region-level, component-level, and attribute-level categories includes: Based on the boundaries of functional zoning in the spatial topology model, the component space is divided into the smallest locking units at the region level. Based on the component units in the spatial topology model, the component units are broken down into the smallest locking units at the component level; Editable parameters based on the properties of spatial topology model components are broken down into the smallest lockable units at the property level.

[0008] Preferably, the step of extracting behavioral features using virtual spatial coordinates, gaze focus range, and gesture operation trajectory includes: The user's virtual space coordinates, gaze focus range, and gesture operation trajectory are obtained through the user's online collaborative terminal; The collected data is analyzed to obtain spatial dwelling approach features, gaze anchoring features, gesture pointing features, and gesture semantic features. After fusing the features, behavioral features are obtained.

[0009] Preferably, the step of generating the minimum set of locking units required for the matching to cover the target operation includes: By analyzing the user's operation intent, the components to be edited and the attributes to be adjusted are determined, and the target operation level is obtained; Based on the target operation level, match the smallest locking unit at the corresponding attribute level, component level, or region level; After matching is completed, based on the spatial topological associations and dependency constraints of the components, the minimum locking units required for the target operation are supplemented to generate a set of minimum locking units that cover the target operation.

[0010] Preferably, the step of performing mutual exclusion locking on the minimum locking unit set includes: The locking status of each smallest locking unit in the set of smallest locking units is verified; According to the independent locking rules, independent mutual exclusion locking is performed on the smallest locking units at the region level, component level, and attribute level within the smallest locking unit set, and the locking status is synchronized to the online collaborative terminal.

[0011] Preferably, the independent locking rules include: when locking the smallest locking unit at the region level, not associating it with the smallest locking unit of the subordinate components of the region; when locking the smallest locking unit at the component level, not associating it with the smallest locking unit of the region to which it belongs; and when locking the smallest locking unit at the attribute level, not associating it with the smallest locking unit of the component to which it belongs.

[0012] Preferably, the step of automatically unlocking the smallest locking unit includes: For each minimum locking unit in the minimum locking unit set, the idle time of operation is monitored independently, and the idle time of each minimum locking unit is compared with the idle threshold. If the idle time exceeds the idle threshold, the locking permission of the corresponding smallest locking unit is released; Synchronize the unlock status to the online collaborative terminal.

[0013] The technical effects and advantages of the present invention in the above technical solution are as follows: This invention constructs a spatial topology model with spatial topological associations and dependency constraints, and divides it into minimum locking units at the region, component, and attribute levels. Combined with user behavior features collected from interactive terminals, it predicts operational intentions, generates a set of minimum locking units that only cover the target operation, and executes mutual exclusion locking according to independent rules. Simultaneously, it monitors the idle time of each locking unit, automatically unlocking timed-out units, and synchronizing the status of all locking units to the collaborative terminal in real time for visual differentiation. This solves the problems of large-scale chain locking, editing wait, and operation blocking caused by global mutual exclusion locking in existing technologies. It effectively balances the operational freedom and operational mutual exclusion security of multi-user concurrent editing, improving the efficiency of multi-user online indoor 3D collaborative design. Attached Figure Description

[0014] Figure 1 This is a flowchart of an immersive 3D interior design method that supports multi-user online collaboration, according to the present invention. Detailed Implementation

[0015] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0016] like Figure 1 As shown, this embodiment provides an immersive 3D interior design method that supports multi-user online collaboration, including the following steps: S1: For components in interior 3D design, classify them hierarchically according to functional zoning, individual components, and component attributes. By constructing spatial topological relationships and dependency constraints between components, obtain the spatial topological model of interior 3D design. S2: Based on the spatial topology model, the smallest locking unit is divided into region-level, component-level, and attribute-level units; S3: Through an immersive interactive terminal, collect the virtual space coordinates, gaze focus range, and gesture operation trajectory of each online collaborative user, and extract behavioral features to predict the user's editable components and adjustable attributes, and generate the user's operation intention; S4: Based on the operation intention and component topology, generate a set of minimum locking units required to cover the target operation, and perform mutual exclusion locking on the set of minimum locking units; S5: Monitor the duration of user activity within the minimum locked unit set and compare it with a preset idle threshold. When the duration exceeds the idle threshold, automatically release the locking permission of the minimum locked unit. S6: The occupancy status and editable permissions of all the smallest locked units are synchronized to the user's online collaborative terminal in real time, and visual identifiers are used to distinguish between locked areas and freely editable areas, so as to realize multi-person online 3D interior design.

[0017] This invention targets interior 3D design components, classifying them hierarchically according to functional zones, individual components, and component attributes. It constructs an interior 3D design spatial topology model that includes spatial topological associations and dependency constraints. Based on this model, it divides the space into three levels of minimum locking units: region-level, component-level, and attribute-level. These minimum locking units are used to break down the editing and control objects of the interior 3D design into independently lockable, non-nested minimum execution units. These include region-level minimum locking units, component-level minimum locking units, and attribute-level minimum locking units. A region-level minimum locking unit is the smallest independent spatial unit broken down according to functional zones, such as a single living room or bedroom; when locked, it is not associated with any of its subordinate components. A component-level minimum locking unit breaks down a single component into its smallest independent component unit, such as a single door; when locked, it is not associated with its region. An attribute-level minimum locking unit is the smallest independent attribute unit broken down according to the editable parameters of the component, such as the location, size, and material of a door; when locked, it is not associated with its subordinate component. When dividing the minimum locking units at each level, the user's virtual space coordinates, gaze focus range, and gesture operation trajectory are collected through an immersive interactive terminal. Spatial dwell proximity, gaze anchoring, gesture pointing, and gesture semantic features are extracted to predict the user's editable components and adjustable attributes and generate operation intentions. Based on the operation intentions and component topology relationships, the minimum locking unit set required for the target operation is matched and generated. According to the independent locking rules, independent mutual exclusion locking is performed on the minimum locking units at each level in the set, without associating with upper and lower level units during the locking process. During the locking process, for each smallest locked unit within the set, its idle time is monitored. Only units that exceed the preset idle threshold are automatically unlocked. The occupancy status and editable permissions of all smallest locked units are synchronized to the online collaborative terminal in real time. The locked area and the free editing area are distinguished by visual identifiers, thereby avoiding large-scale chain locking, editing waiting and operation blocking problems. This balances the freedom of multi-user concurrent editing with the security of operation mutual exclusion, ensuring the smooth operation of immersive indoor 3D collaborative design.

[0018] In one embodiment of the present invention, a spatial topological association between components is established based on the partition boundaries of the components. The spatial topological association includes spatial inclusion relationship, spatial adjacency relationship and spatial dependency relationship. Based on the design of the interior components, dependency and constraint relationships are established between the components, including rigid dependency constraints, spatial constraints, and linkage constraints.

[0019] In this embodiment of the invention, spatial topological associations are constructed to represent the spatial layout relationships between components, and dependency constraints are established to limit the editing rules and linkage logic of components, thereby improving the rationality and accuracy of collaborative design. Regarding spatial inclusion relationships, the system compares the three-dimensional coordinates of components with the functional zone boundaries to determine whether a component falls within a certain zone and sets it accordingly. This determines the spatial affiliation of the component. For spatial adjacency relationships, the system detects the edge contact state of the component's bounding box to determine spatial adjacency relationships and identify the spatial layout associations of the components. For spatial subordination relationships, the system matches the installation position of the component with the carrier to set the spatial subordination relationship. For example, doors and windows are subordinate to walls, and lighting fixtures are subordinate to ceilings. By marking components that cannot be edited independently without a carrier, such as doors and windows that must be attached to walls, rigid attachment constraints are set. Spatial constraints refer to the constraints that limit the position and size of components to the spatial range. They set the range of movement and scaling of components through the floor plan boundaries, circulation width, etc. For example, furniture placement cannot exceed the room boundary. Linkage constraints refer to the constraints that trigger the synchronous change of other components when one component is modified. For example, modifying the wall size will link the constraints of door and window positions.

[0020] In one embodiment of the present invention, the step of dividing the smallest locking unit into region-level, component-level, and attribute-level components includes: S21: Based on the boundary of the functional partition of the spatial topology model, the component space is divided into the smallest locking unit at the region level; S22: Based on the component unit in the spatial topology model, the component unit is broken down into the smallest locking unit at the component level; S23: Editable parameters based on the properties of spatial topology model components, which break down the parameters into the smallest lockable units at the property level.

[0021] In this embodiment of the invention, as shown in steps S21 to S23 above, by traversing the boundaries and three-dimensional spatial coordinate ranges of the preset functional zones such as living room, bedroom, kitchen, and bathroom in the spatial topology model, the independent functional spaces that cannot be further divided are used as the dividing criteria to divide the overall interior design space into multiple non-overlapping and mutually independent areas. At the same time, through topological indexing, spatial correspondence markers between area-level units and internal components are established, without establishing hierarchical binding relationships. For individual components such as walls, doors, windows, furniture, lighting fixtures, and decorative parts within the spatial topology model, the components in each functional zone are divided into mutually independent component-level units, and the component-level units are also marked using topological indexing. The regional-level units do not form a subordinate locking relationship; for the editable parameters of component attributes, the parameters are broken down into attribute-level units. Specifically, using the independently adjustable editable parameters such as the position, size, rotation angle, material, color, and lighting parameters of each component, the parameters of each component are broken down into mutually independent attribute-level units. The component-level units to which the attribute-level units belong are marked by topological indexes, without being associated with the overall higher-level components. This invention refines the editing and control objects of interior 3D design into the smallest independent control units in three dimensions: space, object, and parameter. This makes the three-level smallest locking units independent of each other and not nested, which is different from the traditional overall locking design.

[0022] In one embodiment of the present invention, the step of extracting behavioral features using virtual spatial coordinates, gaze focus range, and gesture operation trajectory includes: S31: Obtain the user's virtual space coordinates, gaze focus range, and gesture operation trajectory through the user's online collaborative terminal; S32: Analyze the collected data to obtain spatial dwelling approach features, gaze anchoring features, gesture pointing features, and gesture semantic features. After fusing the features, obtain the behavioral features.

[0023] In this embodiment of the invention, as shown in steps S31 to S32 above, the VR / AR head-mounted display device in the user's online collaborative terminal obtains the user's three-dimensional coordinate position in the indoor three-dimensional virtual space in real time, the eye-tracking collects the focus point and coverage area of ​​the gaze, and the gesture motion controller captures the user's hand movement trajectory, posture changes and operation action data to complete the data collection of virtual space coordinates, gaze focus area and gesture operation trajectory. The collected raw sensor data is subjected to noise reduction and filtering to remove invalid interference information such as virtual space drift, hand tremors, and random gaze drift. Based on the relative distance and dwell time between the user's virtual space coordinates and the 3D component, spatial dwell approach features are obtained. Based on the matching degree between the gaze focus point and the component bounding box and the duration of continuous anchoring, gaze anchoring features are obtained. Based on the relative positional relationship between the pointing direction of the hand movement trajectory and the component surface, gesture pointing features are obtained. Based on the matching relationship between the gesture posture and the preset editing action, gesture semantic features are obtained. The features are normalized and fused to form behavioral features that can be used to predict the user's editable component and adjustable attributes.

[0024] In one embodiment of the present invention, the step of matching to generate the minimum set of locking units required for the target operation includes: S41: By parsing the user's operation intent, determine the component to be edited and the attribute to be adjusted, and obtain the target operation level; S42: Based on the target operation level, match the smallest locking unit at the corresponding attribute level, component level, or region level; S43: After matching is completed, based on the component space topology association and dependency constraint relationship, supplement the minimum locking unit required for the target operation to generate the minimum locking unit set covering the target operation.

[0025] The step of performing mutual exclusion locking on the minimum locking unit set includes: S44: Verify the locking status of each minimum locking unit in the set of minimum locking units; S45: According to the independent locking rules, perform independent mutual exclusion locking on the smallest locking units at the region level, component level, and attribute level within the smallest locking unit set, and synchronize the locking status to the online collaborative terminal.

[0026] The independent locking rules include: when locking the smallest locking unit at the region level, not associating it with the smallest locking unit of the components under the region; when locking the smallest locking unit at the component level, not associating it with the smallest locking unit of the region to which it belongs; and when locking the smallest locking unit at the attribute level, not associating it with the smallest locking unit of the component to which it belongs.

[0027] In this embodiment of the invention, as shown in steps S41 to S45 above, the user's operational intent generated by behavioral feature prediction is analyzed to obtain the component to be edited and the attribute to be adjusted. Specifically, the fused behavioral features are spatially matched with the component information in the spatial topology model. Based on spatial dwelling proximity features, line-of-sight anchoring features, and gesture pointing features, the matching degree score between the user and each component is calculated. The component with the highest score is determined as the component to be edited. Based on the mapping relationship between gesture semantic features and preset editing actions, the parameter adjustment type corresponding to the user's current gesture is identified to determine the attribute to be adjusted. After determining the component to be edited and the attribute to be adjusted, the level to which the current target operation belongs is determined according to the type of the component to be edited, the dimension of the attribute to be adjusted, and the spatial topology association relationship. If it is a single parameter adjustment, it is determined to be at the attribute level; if it is a whole component editing, it is determined to be at the component level; if it is a spatial area planning, it is determined to be at the area level, thus obtaining the target operation level. Based on the established target operation hierarchy, matching is performed within the predefined minimum locking units at the region, component, and attribute levels. When the target operation is attribute adjustment, the corresponding attribute-level minimum locking unit is matched; when the target operation is component editing, the corresponding component-level minimum locking unit is matched; and when the target operation is spatial planning, the corresponding region-level minimum locking unit is matched. After matching, based on the spatial topological associations and dependency constraints between components, only the necessary minimum locking units for the current target operation are supplemented. That is, based on spatial adjacency and spatial subordination, spatially bound related units are supplemented; based on rigid dependency and linkage constraints, edit-dependent related units are supplemented. The supplemented units are deduplicated, ultimately generating a minimum locking unit set that only covers the target operation and has the smallest possible scope.

[0028] In one embodiment of the present invention, the step of automatically unlocking the locking permission of the smallest locking unit includes: S51: For each minimum locking unit in the minimum locking unit set, monitor the idle time of operation independently, and compare the idle time of each minimum locking unit with the idle threshold. S52: If the idle time exceeds the idle threshold, release the locking permission of the corresponding smallest locking unit; S53: Synchronize the unlock status to the online collaborative terminal.

[0029] In this embodiment of the invention, regarding the setting of idle thresholds, specifically, based on the interactive characteristics of indoor 3D collaborative design, users' regular operating habits, and the needs of multi-user concurrent collaboration, a basic idle threshold adapted to the global editing scenario is preset. Then, according to the editing frequency and usage logic of the three levels of minimum locking units (region level, component level, and attribute level), differentiated idle thresholds are configured for different levels of units. Among them, the minimum locking unit at the attribute level is set with a lower threshold due to its high editing frequency, followed by the component level, and the region level is set with a higher threshold due to its low editing frequency. The thresholds are adaptively fine-tuned in combination with the current number of online collaborators and the scene operation density. Finally, the configured idle thresholds at all levels are stored in the system parameter library and called when monitoring the idle time of the locking unit to achieve the adaptation of the thresholds with the collaborative scene and the locking unit level. It should be noted that, for setting the idle threshold, multiple sets of sample data are collected by those skilled in the art, and a corresponding preset ratio coefficient is set for each set of sample data. Based on the set preset ratio coefficient and the collected sample data, the calculated threshold is filtered to obtain the threshold. The size of the coefficient is a specific value obtained by quantifying each parameter to facilitate subsequent comparison. The size of the coefficient depends on the amount of sample data and the preset proportional coefficient initially set by those skilled in the art for each set of sample data; as long as it does not affect the proportional relationship between the parameter and the quantified value.

[0030] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the claimed invention. The scope of protection claimed by the appended claims and their equivalents is defined.

Claims

1. An immersive 3D interior design method supporting multi-user online collaboration, characterized in that, Includes the following steps: For components in interior 3D design, they are hierarchically classified according to functional zoning, individual components, and component attributes. By constructing spatial topological relationships and dependency constraints between components, a spatial topological model of interior 3D design is obtained. Based on the spatial topology model, the smallest locking unit is divided into region-level, component-level, and attribute-level units; Through an immersive interactive terminal, the virtual space coordinates, gaze focus range, and gesture operation trajectory of each online collaborative user are collected, and behavioral features are extracted to predict the components to be edited and the attributes to be adjusted, thereby generating the user's operation intention. Based on the operational intent and component topology, a set of minimum locking units required to cover the target operation is generated by matching the minimum locking units, and the set of minimum locking units is mutually exclusive locked. Monitor the duration of user activity within the minimum locked unit set and compare it with a preset idle threshold. When the duration exceeds the idle threshold, automatically unlock the minimum locked unit. The occupancy status and editable permissions of all the smallest locked units are synchronized to the user's online collaborative terminal in real time, and visual identifiers are used to distinguish between locked areas and freely editable areas, so as to realize multi-person online 3D interior design.

2. The immersive indoor 3D design method supporting multi-user online collaboration as described in claim 1, characterized in that: Based on the partition boundaries of the components, establish spatial topological relationships between the components, including spatial inclusion relationships, spatial adjacency relationships, and spatial dependency relationships; Based on the design of the interior components, dependency and constraint relationships are established between the components, including rigid dependency constraints, spatial constraints, and linkage constraints.

3. The immersive indoor 3D design method supporting multi-user online collaboration as described in claim 1, characterized in that, The step of dividing the smallest locking unit into region-level, component-level, and attribute-level categories includes: Based on the boundaries of functional zoning in the spatial topology model, the component space is divided into the smallest locking units at the region level. Based on the component units in the spatial topology model, the component units are broken down into the smallest locking units at the component level; Editable parameters based on the properties of spatial topology model components are broken down into the smallest lockable units at the property level.

4. The immersive indoor 3D design method supporting multi-user online collaboration as described in claim 1, characterized in that, The steps for extracting behavioral features using virtual spatial coordinates, gaze focus range, and gesture operation trajectory include: The user's virtual space coordinates, gaze focus range, and gesture operation trajectory are obtained through the user's online collaborative terminal; The collected data is analyzed to obtain spatial dwelling approach features, gaze anchoring features, gesture pointing features, and gesture semantic features. After fusing the features, behavioral features are obtained.

5. The immersive indoor 3D design method supporting multi-user online collaboration as described in claim 1, characterized in that, The step of generating the minimum set of locking units required for the target operation through matching includes: By analyzing the user's operation intent, the components to be edited and the attributes to be adjusted are determined, and the target operation level is obtained; Based on the target operation level, match the smallest locking unit at the corresponding attribute level, component level, or region level; After matching is completed, based on the spatial topological associations and dependency constraints of the components, the minimum locking units required for the target operation are supplemented to generate a set of minimum locking units that cover the target operation.

6. The immersive indoor 3D design method supporting multi-user online collaboration as described in claim 1, characterized in that, The step of performing mutual exclusion locking on the minimum locking unit set includes: The locking status of each smallest locking unit in the set of smallest locking units is verified; According to the independent locking rules, independent mutual exclusion locking is performed on the smallest locking units at the region level, component level, and attribute level within the smallest locking unit set, and the locking status is synchronized to the online collaborative terminal.

7. The immersive indoor 3D design method supporting multi-user online collaboration as described in claim 6, characterized in that: The independent locking rule includes, when locking the smallest locking unit at the region level, not associating the smallest locking unit of subordinate components within that region; When locking the smallest locking unit at the component level, the smallest locking unit of the corresponding region is not associated. When locking the smallest locking unit at the attribute level, the smallest locking unit of the component to which it belongs is not associated.

8. The immersive indoor 3D design method supporting multi-user online collaboration according to claim 1, characterized in that, The step of automatically unlocking the smallest locking unit includes: For each minimum locking unit in the minimum locking unit set, the idle time of operation is monitored independently, and the idle time of each minimum locking unit is compared with the idle threshold. If the idle time exceeds the idle threshold, the locking permission of the corresponding smallest locking unit is released; Synchronize the unlock status to the online collaborative terminal.

Images