Method for analyzing building space design by using VR (virtual reality) to collect fixation points

Abstract

The invention discloses a method for analyzing building space design by using VR to collect fixation points, a three-dimensional model matched with a real building space is established, a VR scene is established, when experimenters visit in the VR scene, the fixation sight lines of the experimenters are collected through VR equipment, the intersection points of the fixation sight lines and the VR scene are calculated, and the interaction points of the fixation sight lines and the VR scene are calculated. According to the method, the observation points of the experimenters on the interior landscape of the building are obtained, the observation duration is counted, finally, the observation points of all the experimenters and the corresponding observation duration are mapped and visualized, a visual visualization result is obtained, and the building space design can be evaluated accurately, clearly and visually. According to the method, stability and consistency of the space coordinate system are guaranteed in the analysis process, the collected fixation point is matched with the building space, the fixation point also corresponds to the building space, and the association between the analysis result and the building space is more visual.

Description

Technical Field

[0001] The present invention relates to the technical field of architectural space design evaluation, and in particular to a method for analyzing architectural space design by collecting gaze points using VR. Background Art

[0002] In the traditional architectural design process, the judgment of spatial experience mainly relies on the personal experience of the architect, and the result is often different from the actual experience of the users of the built space. Architectural ergonomics aims to establish the correlation between human factor measurement data and the quality of architectural space. By collecting and analyzing the human factor data of people experiencing space in the building, the quality of architectural space can be objectively and quantitatively evaluated.

[0003] The distribution of gaze points and gaze duration when people are touring in an architectural space reflects their attention to different interfaces and landmarks in the room during the tour. By superimposing and analyzing the gaze points and gaze duration of a large number of subjects, it can reflect the attention attraction and visual guidance of interior design elements on the subjects, test whether the architectural space design and interior environment design are consistent with the design expectations, and assist in the design optimization of interior furnishings, guide signs, etc.

[0004] As virtual reality technology matures, VR scenes can be built during the design phase, allowing people to experience unbuilt spaces in advance through VR devices. In this process, combined with eye tracking technology, eye tracking devices are used to track and record the user's eye movement data, and the user's gaze point coordinates are calculated in real time based on the eye movement data to obtain detailed behavioral data.

[0005] At present, most of the studies using eye tracking technology in the field of architectural design focus on two-dimensional images, such as a single rendering or a video. Such studies visualize and analyze the data by superimposing the gaze point data on the two-dimensional image. The main solution is to superimpose the gaze point data on the two-dimensional image and use the Gaussian blur algorithm to draw a saliency map. However, such methods do not directly map the gaze point to the actual observed object, so researchers usually need to judge the specific object that the subject is paying attention to through observation and analysis, or use deep learning technology to identify elements in the image to assist data analysis, and designers need to convert the gaze point analysis results based on the two-dimensional image into three-dimensional space to guide the optimization of spatial design.

[0006] The above application methods mainly have the problem that the application scenarios are not intuitive and the analysis results are not accurate. In addition, there are defects that the application is greatly affected by human factors and is heavily dependent on analysts, which makes it impossible to meet the quantitative analysis requirements in actual application. The present invention provides a method for analyzing architectural space design by using VR to collect gaze points to solve the above problems. Summary of the invention

[0007] The present invention provides a method for analyzing architectural space design by collecting gaze points using VR, adopting a three-dimensional model identical to a real architectural structure and clearly marking the gaze points, thereby achieving intuitive and quantitative analysis.

[0008] The technical solution adopted by the present invention to solve the above technical problems is: A method for analyzing architectural space design by collecting gaze points using VR, comprising the following steps: S1, build models and VR scenes: build a 3D model of the building, and then perform lightweight processing on the 3D model to ensure rendering efficiency and visual quality; import the processed 3D model, and then adjust the parameters, visual elements and interior layout to form the required VR scene; S2, conduct VR tour: set the starting point of the VR tour, define the VR navigation range, configure the data recording program, and then the experimenter conducts the VR tour and records the original data of the tour through the VR device. The original data includes the gaze point coordinate data and the corresponding timestamp data; S3, importing raw data: importing raw data into the data processing model, creating raw fixation points with the x, y, z coordinate data of the raw trajectory points, converting the timestamp data corresponding to the raw fixation points, and calculating the time difference as the raw fixation duration of the raw fixation points; S4, raw data screening: set a threshold, and filter out the raw fixation points that do not meet the requirements according to the set threshold to obtain stable data, which includes stable fixation points and stable fixation duration; S5, data export: process the stable data of each experimenter according to the operation of S4, and write the stable data into the data table after processing; S6, data import: read the stable data of all experimenters, determine the center point of the stable fixation point, and calculate the total duration of stable fixation; S7, data visualization: Draw a visualization sphere based on the gaze duration. Draw the sphere with the center point of the stable gaze point as the center and the relevant data of the total duration of the stable gaze duration as the radius, and assign color to the sphere according to the color value mapped by the relevant data of the total duration of the stable gaze duration to achieve data visualization.

[0009] Furthermore, in step S2, the operation of determining the gaze point is as follows: The center coordinates of the virtual camera representing the VR device and the direction vector of the virtual camera's front direction relative to the world coordinate system are extracted frame by frame. Then, the direction vector of the human eye's line of sight captured by the eye tracking sensor relative to the virtual camera coordinate system is extracted. The addition of the above two direction vectors is the direction vector of the human eye's line of sight relative to the world coordinate system. The direction vector of the gaze direction is determined. Taking the camera center point as the starting point, a ray is drawn along the gaze direction. The first intersection of the ray and the architectural visual model is the gaze point.

[0010] Furthermore, in step S4, the saccade gaze points in the original gaze points are screened out, and the specific screening operation is: The original fixation points were grouped with a distance of 300 mm as the threshold, and the total fixation duration corresponding to each group of fixation points was superimposed. The fixation points with a total fixation duration of less than 500 ms were grouped and removed as a whole.

[0011] Furthermore, in step S6, the specific operation of determining the center point of the stable gaze point is as follows: taking the distance of 300 mm as the threshold, the stable gaze points of all the experimenters are grouped into F groups, and the x, y, and z coordinates of all the stable gaze points in the group are superimposed and the average value is calculated. The average value of the x, y, and z coordinates is the center point P of each group of stable gaze points. f The x, y, and z coordinates of When calculating the total duration of stable fixation, the stable fixation duration corresponding to each group of stable fixation points is grouped in the same way, and all stable fixation durations in the group are superimposed to obtain the total duration of stable fixation duration in each group, t f .

[0012] Furthermore, in step S7, the radius R of the visualized sphere is f The calculation formula is: K is the coefficient, which is determined according to the proportion of building space.

[0013] Further, in step S7, the total duration of each group of stable fixation duration t f The color value mapped by the numerical value is the color of the visualization sphere.

[0014] The beneficial effects of the present invention are as follows: VR modeling is based on real architectural space, and eye movement data is used to calculate the user's gaze point coordinates in real time. These gaze points are imported into the 3D model space for direct analysis and visualization in the 3D environment. The gaze points are clearly marked, and after calculation, the gaze duration is clearly marked with a visual sphere, achieving quantitative analysis of architectural space design and enabling direct comparison. The stability and consistency of the spatial coordinate system are ensured during the analysis process. The collected fixation points match the architectural space, and the fixation points also correspond to the architectural space, making the relationship between the analysis results and the architectural space more intuitive. It can superimpose data from multiple people for comprehensive analysis, making the results more accurate. Data superposition and analysis can be achieved without complicated settings, and it is not affected by human factors and can achieve accurate quantitative analysis without relying on analysts. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a schematic diagram of the process steps of the present invention; Figure 2 This is a schematic diagram of the original gaze point distribution of the present invention; Figure 3 This is a schematic diagram of the stable gaze point distribution of the present invention; Figure 4 It is a top view schematic diagram of the architectural space after visualization processing of the present invention; Figure 5 This is a schematic diagram of architectural space gaze after visualization processing of the present invention. DETAILED DESCRIPTION

[0016] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings of the specification. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0017] In the description of the present invention, it should be understood that the terms "center", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship are based on the orientation or position relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention.

[0018] like Figures 1 to 5As shown, a method for analyzing architectural space design by collecting gaze points using VR is proposed. A three-dimensional model matching the real architectural structure is established, and a VR scene is built. When the experimenter is touring in the VR scene, the gaze line of the experimenter is collected through the VR device, and the intersection of the gaze line and the VR scene is calculated to obtain the experimenter's gaze point on the internal landscape of the building, and the gaze duration is counted. Finally, the gaze points and corresponding gaze durations of all the experimenters are mapped and visualized to obtain intuitive visualization results, which can accurately, clearly and intuitively evaluate the architectural space design.

[0019] The implementation principle of the present invention is to first build a VR tour scene based on a real architectural design plan. After the experimenter conducts a VR tour, the VR equipment can collect the gaze points and gaze duration that match the real architectural space, aggregate and group the gaze points, count the total gaze duration in groups, and convert the corresponding data into a visualization, thereby forming a visualization picture, and realizing an intuitive visualization quantitative evaluation of the architectural space. The method adopted by the present invention is to directly place the gaze points on a three-dimensional model that matches the real architectural structure. The determination of the gaze points is accurate and accurate. Compared with the existing spatial analysis through two-dimensional pictures, it has the advantages of accurate data collection, no need for multiple conversions, and no need for manual analysis. The final visualization result is directly displayed on the three-dimensional model, and is displayed in proportion according to the total gaze duration, so that the architectural space design can be evaluated at a glance.

[0020] like Figure 1 As shown, a specific implementation method of a method for analyzing architectural space design by using VR to collect gaze points is as follows.

[0021] S1, build models and VR scenes: build a 3D model of the building, and then perform lightweight processing on the 3D model to ensure the smoothness of the picture in the VR scene, improve rendering efficiency and ensure visual quality, with "visibility" as the judgment standard. The specific operation is to remove all parts of the model that are not visible in the final VR experience in the modeling software, and for objects with smooth surfaces, convert them into multiple continuous planes, such as converting a cylinder into a polygonal column; Build a VR scene, import the processed 3D model into the modeling software, adjust the material parameters of the model according to the architectural design plan, and arrange elements such as lighting, tables and chairs, furniture, and plant decorations. At the same time, set the ambient lighting parameters to optimize the realism and immersion of the scene, and finally build the required VR scene.

[0022] S2, conduct VR tour: set the starting point of the VR tour, define the VR navigation range according to the expected tourable area in the VR scene, configure the data recording program, and then the experimenter conducts the VR tour. While conducting the tour, the original data of the experimenter's tour is recorded frame by frame through the VR device. After the tour, the data is saved and exported through the VR device. The original data includes the gaze point coordinate data and the corresponding timestamp data.

[0023] The gaze point is determined in the following way: the center coordinates of the virtual camera representing the VR device and the direction vector of the virtual camera's front direction relative to the world coordinate system are extracted frame by frame, and then the direction vector of the human eye's line of sight captured by the eye tracking sensor relative to the virtual camera coordinate system is extracted. The two direction vectors are added together to obtain the direction vector of the human eye's line of sight relative to the world coordinate system. The direction vector of the gaze direction is determined, and a ray is drawn along the gaze direction with the camera center point as the starting point. The first intersection of the ray and the architectural visual model is the gaze point, and the timestamp of this gaze point is recorded at the same time.

[0024] like Figure 2 As shown, S3, raw data import: import the raw data into the data processing model, create the original fixation point with the x, y, z coordinate data of the original trajectory point, convert the timestamp data corresponding to the original fixation point, uniformly convert it to milliseconds, and calculate the time difference between each frame and the previous frame, which is used as the original fixation duration of the original fixation point.

[0025] like Figure 3 As shown, S4, raw data screening: since the entire process of human observation is continuous, in addition to relatively stable gazes, there are also aimless observations such as glances. It is necessary to screen out the non-gaze process and leave only the gaze process. Since the gaze duration in the glance process is extremely short and the glance process is fast, the spacing between the gaze points is also large. The glance process can be screened out by setting the screening conditions of the gaze point distance and the gaze duration. The screening operation is to group the original gaze points by setting the distance threshold, and screen out the original gaze points that do not meet the requirements to obtain stable data. The stable data includes stable gaze points and stable gaze duration.

[0026] The original fixation points that are in the scanning state are filtered out. The specific filtering operation is to group the original fixation points with a distance threshold of 300 mm, calculate the total fixation duration corresponding to each group of fixation points, and group the fixation points with a total fixation duration of less than 500 ms and delete the entire group, leaving only the fixation points with a certain fixation duration.

[0027] S5, data export: process the stable data of each experimenter according to the operation of S4, write the stable data into the data table after processing, and carry out the next step of visual analysis.

[0028] S6, data import: read the stable data of all experimenters, determine the center point of the stable fixation point, and calculate the total duration of stable fixation.

[0029] The original gaze point data is large and scattered. Visual conversion based on the original gaze point data will make the results too scattered and impossible to compare intuitively. The original gaze points are grouped to determine stable gaze points, and the visual conversion is performed based on the stable gaze point data. The stable gaze points are more concentrated and have a longer total gaze duration, so they can be compared intuitively after the visual conversion.

[0030] The specific operation of determining the center point of the stable gaze point is as follows: taking 300 mm as the threshold, the stable gaze points of all the experimenters are grouped into F groups, and the x, y, and z coordinates of all the stable gaze points in the group are superimposed and the average value is calculated. The average value of the x, y, and z coordinates is the center point P of each group of stable gaze points. f The x, y, and z coordinates of When calculating the total duration of stable fixation, the stable fixation duration corresponding to each group of stable fixation points is grouped in the same way, and all stable fixation durations in the group are superimposed to obtain the total duration of stable fixation duration in each group, t f .

[0031] like Figure 4 , 5 As shown in S7, data visualization: Draw a visualization sphere based on the fixation duration, with the center point of the stable fixation point as the center, and the total duration of the stable fixation duration as the radius to draw the sphere, and the total duration of each group of stable fixation duration t f The color value mapped to the numerical value is the color of the visualization sphere to achieve data visualization.

[0032] Visualize the radius R of the sphere f The calculation formula is: K is the coefficient, which is determined according to the proportion of building space.

[0033] The present invention maintains the consistency of the spatial coordinate system throughout the entire data analysis process, and the collected gaze points match the actual architectural space while maintaining a direct connection, so that the visualization results also correspond to the actual architectural space, and ultimately the analysis results can be intuitively displayed on the architectural space. The direct connection between the gaze points and the architectural space is maintained throughout the entire process, ensuring the reliability of the collected data and the accuracy of the visualization analysis results.

[0034] It is obvious to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential features of the present invention. Therefore, the embodiments should be regarded as exemplary and non-limiting from any point of view, and the scope of the present invention is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention, and any reference numerals in the claims should not be regarded as limiting the claims involved.

Claims

1. A method for analyzing architectural space design by using VR to collect gaze points, characterized in that: The following steps are involved: S1, build models and VR scenes: build a 3D model of the building, and then perform lightweight processing on the 3D model to ensure rendering efficiency and visual quality; import the processed 3D model, and then adjust the parameters, visual elements and interior layout to form the required VR scene; S2, conduct VR tour: set the starting point of the VR tour, define the VR navigation range, configure the data recording program, and then the experimenter conducts the VR tour and records the original data of the tour through the VR device. The original data includes the gaze point coordinate data and the corresponding timestamp data; S3, importing raw data: importing raw data into the data processing model, creating raw fixation points with the x, y, z coordinate data of the raw trajectory points, converting the timestamp data corresponding to the raw fixation points, and calculating the time difference as the raw fixation duration of the raw fixation points; S4, raw data screening: set a threshold, and filter out the raw fixation points that do not meet the requirements according to the set threshold to obtain stable data, which includes stable fixation points and stable fixation duration; S5, data export: process the stable data of each experimenter according to the operation of S4, and write the stable data into the data table after processing; S6, data import: read the stable data of all experimenters, determine the center point of the stable fixation point, and calculate the total duration of stable fixation; S7, data visualization: Draw a visualization sphere based on the gaze duration. Draw the sphere with the center point of the stable gaze point as the center and the relevant data of the total duration of the stable gaze duration as the radius, and assign color to the sphere according to the color value mapped by the relevant data of the total duration of the stable gaze duration to achieve data visualization.

2. According to claim 1, a method for analyzing architectural space design by using VR to collect gaze points is characterized in that: In step S2, the operation of determining the gaze point is as follows: The center coordinates of the virtual camera representing the VR device and the direction vector of the virtual camera's front direction relative to the world coordinate system are extracted frame by frame. Then, the direction vector of the human eye's line of sight captured by the eye tracking sensor relative to the virtual camera coordinate system is extracted. The addition of the above two direction vectors is the direction vector of the human eye's line of sight relative to the world coordinate system. The direction vector of the gaze direction is determined. Taking the camera center point as the starting point, a ray is drawn along the gaze direction. The first intersection of the ray and the architectural visual model is the gaze point.

3. The method for analyzing architectural space design by using VR to collect gaze points according to claim 1 is characterized in that: In step S4, the saccade gaze points in the original gaze points that are in the saccade state are screened out, and the specific screening operation is: The original fixation points were grouped with a distance of 300 mm as the threshold, and the total fixation duration corresponding to each group of fixation points was superimposed. The fixation points with a total fixation duration of less than 500 ms were grouped and removed as a whole.

4. The method for analyzing architectural space design by using VR to collect gaze points according to claim 1 is characterized by: In step S6, the specific operation of determining the center point of the stable gaze point is as follows: taking 300 mm as the threshold, the stable gaze points of all the experimenters are grouped into F groups, and the x, y, and z coordinates of all the stable gaze points in the group are superimposed and the average value is calculated. The average value of the x, y, and z coordinates is the center point P of each group of stable gaze points. f The x, y, and z coordinates of When calculating the total duration of stable fixation, the stable fixation duration corresponding to each group of stable fixation points is grouped in the same way, and all stable fixation durations in the group are superimposed to obtain the total duration of stable fixation duration in each group, t f .

5. The method for analyzing architectural space design by using VR to collect gaze points according to claim 4 is characterized by: In step S7, the radius R of the visualized sphere is f The calculation formula is: K is the coefficient, which is determined according to the proportion of building space.

6. The method for analyzing architectural space design by using VR to collect gaze points according to claim 4 is characterized by: In step S7, the total duration of each group of stable fixation duration t f The color value mapped by the numerical value is the color of the visualization sphere.

Images