Three-dimensional space information acquisition system for AR (Augmented Reality) scene construction

Abstract

The utility model relates to the technical field of space information acquisition devices, and discloses a three-dimensional space information acquisition system for AR (Augmented Reality) scene building, which comprises scanning equipment, a data acquisition device, a data processing device, a data processing device and a data processing device, and is characterized in that the scanning equipment is used for scanning a real scene and acquiring scene information; the analysis equipment is used for analyzing the scanning information matched with the real scene to obtain complete space information, and the analysis equipment is connected with the scanning equipment and is used for receiving the scanning information; and the interaction device is used for completing information interaction between the person and the AR scene. According to the acquisition system, the scanning equipment is used for comprehensively scanning a real scene, and under the guidance of the mixed control system of the analysis equipment, the information in the whole real scene is completely scanned to obtain all information in the scene, so that accurate scene information is provided for subsequently developing an AR virtual scene, the construction of the AR scene is accelerated, and the development efficiency of the AR virtual scene is improved. And the constructed AR scene can be subjected to man-machine interaction action through the AR interaction equipment.

Description

Technical Field

[0001] The utility model relates to the technical field of spatial information acquisition devices, in particular to a three-dimensional spatial information acquisition system for building AR augmented reality scenes. Background Art

[0002] AR augmented reality scene design and production refers to superimposing virtual information or objects on the real world, and then capturing images of the real world through a camera to merge the virtual information with the real world, thereby achieving a new interactive visual experience of virtual-reality fusion.

[0003] The "real" experience of the fusion of virtual and real requires that virtual information or objects be placed in the correct position in the real world, and must not overlap or misalign with real-world objects. First, it is necessary to collect spatial information of real-world scenes to generate spatial data and spatial maps. Fast, complete and accurate spatial information collection is the basis for the perfect superposition of virtual information or objects into real scenes. Secondly, a visual scene editor is also an essential tool for building AR augmented reality scenes. In the scene editor, virtual information or objects can be placed in the expected position. Finally, wear AR glasses to view virtual information or objects in actual locations in the real world for a hyper-real experience.

[0004] In the prior art, the name disclosed in the application number: CN202020263464.2 is: AR glasses system, wherein the AR glasses include: an information acquisition device for collecting environmental information of the environment; a display device; a bridge chip, including an I2C port and a USB port, the I2C port is respectively connected to the information acquisition device and the display device signal, and the bridge chip is used to realize the mutual conversion of I2C data signals and USB data signals; a control terminal is connected to the USB port signal, and is used to control the operation of the information acquisition device and the display device; the information acquisition device includes: an image acquisition device, which is connected to the I2C port signal; a sensor device, which is connected to the I2C port signal.

[0005] However, the AR acquisition devices mentioned in the prior art cannot fully scan the actual real scene, and the scanned information cannot provide convenience for AR scene editing. In addition, the limitations of the head-mounted scanning scene are limited to the user's height, which is not conducive to the entire scanning of the actual scene. Therefore, the integrity of the scanned information is poor. Utility Model Content

[0006] The purpose of the utility model is to provide a three-dimensional space information acquisition system for building AR augmented reality scenes to solve the problems in the prior art.

[0007] The purpose of the utility model can be achieved through the following technical solutions:

[0008] A three-dimensional space information acquisition system for building an AR augmented reality scene, the acquisition system comprising:

[0009] A scanning device, wherein the scanning device is used to scan a real scene and obtain scene information;

[0010] An analysis device, the analysis device is used to analyze the scan information matching the real scene to obtain complete spatial information, and the analysis device is connected to the scanning device to receive the scan information;

[0011] An interactive device is used to complete the interactive information between people and AR scenes.

[0012] Furthermore, the scanning device is at least one of a camera, a mobile phone, a tablet, and a sensor, and the scanning device is used to scan the actual site to collect visual feature points therein to generate point cloud data, and to identify the site space and object contours to generate a 3D floor plan and a simplified model of the furnishings.

[0013] Furthermore, the scanning device further comprises:

[0014] Laser radar, which is used to measure the depth information of an object;

[0015] An inertial measurement unit is used to measure the posture and position information of an object.

[0016] Furthermore, the analysis device includes a computer for online editing of AR scenes.

[0017] Furthermore, the interactive device is one of AR glasses or AR handles, and the user interacts with the AR scene built online by the interactive device and the analysis device.

[0018] Furthermore, the analysis device is connected to the interaction device and is used to transmit the constructed AR scene to the interaction device.

[0019] Beneficial effects of the utility model:

[0020] 1. The acquisition system of the utility model uses a scanning device to comprehensively scan the real scene. Under the guidance of the mixed control system of the analysis device, the information in the entire real scene is completely scanned to obtain all the information in the scene, providing accurate scene information for the subsequent development of AR virtual scenes, accelerating the construction of AR scenes, and the constructed AR scenes can be used for human-computer interaction through AR interactive devices;

[0021] 2. The acquisition system of the utility model has a convenient acquisition process, improves the efficiency of information acquisition in real space, and has low requirements on the professionalism of personnel in the acquisition process. The collected data is complete and reliable, which provides convenience for AR scene construction. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The utility model is further described below in conjunction with the accompanying drawings.

[0023] Figure 1 It is a structural schematic diagram of the acquisition system of the utility model. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the utility model to clearly and completely describe the technical solutions in the embodiments of the utility model. Obviously, the described embodiments are only part of the embodiments of the utility model, not all of the embodiments. Based on the embodiments of the utility model, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the utility model.

[0025] A three-dimensional space information acquisition system for building AR augmented reality scenes, such as Figure 1 As shown, the acquisition system includes a scanning device, an analysis device and an interactive device. The scanning device is at least one of a camera, a mobile phone, a tablet, and a sensor. The scanning device is used to scan the actual site where the AR scene needs to be constructed, and the visual feature points therein are collected to generate point cloud data; the scanning device is used to identify the site space and the outline of objects to generate a 3D floor plan and a simplified model of the furnishings, and the simplified model information includes the outline shape and size of the object.

[0026] The analysis equipment includes a computer, which uses the mixed-space system in the computer to match the spatial point cloud data generated after the collection is completed with the 3D floor plan to obtain complete spatial information quickly and accurately.

[0027] In this embodiment, the mixed space system is a cross-platform development system based on the web, which develops an AR application platform, on which materials can be edited and solutions can be maintained.

[0028] The mixer outputs a cjb or glb file that includes the dimensions of every identifiable component in the room, such as a wall or cabinet, and the type of furniture detected.

[0029] Then, in the mixed space system on the computer, based on the complete real space information obtained, the AR scene to be arranged is edited, and each object and character in the AR scene is edited, that is, virtual information or objects are placed, and the AR scene information is saved.

[0030] The data edited by the computer is then transmitted to the interactive device, which is at least one of AR glasses and AR handles. During this process, the user can use the interactive device to interact with the AR scene built based on the real scene. This method can quickly build the AR scene without the need to use professional development software such as Unity to edit the content of the point cloud data, and does not require professional developers, which simplifies the operation of AR scene construction and reduces the difficulty of AR scene construction.

[0031] The mixed control system can provide users with scanning guidance. Users use the visual feedback in the scanning device to demonstrate the scanning status and progress, and visually display all identifiable objects in the real scene.

[0032] The scanning equipment includes:

[0033] 1. Use the spatial positioning of the SLAM system to obtain point clouds and process point cloud data: The SLAM system uses a variety of sensors, such as cameras, lidar, inertial measurement units (IMUs), etc., to obtain environmental information of real scenes. These sensors provide information about the position and direction of the device in three-dimensional space, as well as the depth and feature points of the surrounding environment; the SLAM system extracts feature points in the environment, such as edges and corners, by analyzing sensor data. These feature points can be used to identify and track targets in the environment; the SLAM system estimates the movement of the device relative to the previous position by analyzing changes in sensor data, and performs motion estimation, which can be achieved by matching feature points and using IMU data. The SLAM system uses sensor data and motion estimation information to dynamically build a map of the environment. The map is usually a three-dimensional model containing environmental structure and feature point information. The SLAM system determines the current position and direction of the device by comparing the actual sensor data with the previously built map, thereby achieving positioning.

[0034] Second, using the LiDAR (Light Detection and Ranging) sensor of iOS devices to generate apartment layouts is achieved by using LiDAR technology for depth perception and 3D reconstruction. The working principle is as follows:

[0035] The LiDAR sensor on the iOS device emits a laser beam and then measures the time it takes for the laser beam to be reflected back by the surface of an object to obtain the distance information of the object; based on the laser ranging data, the LiDAR sensor scans the image and transmits it to the cloud, which then generates a depth map through algorithm calculation and processing. The depth map represents the distance from each pixel in the scene to the camera; the depth map can be used to generate the coordinates of a set of three-dimensional points to form a point cloud, which represents the position of each surface in the scene; based on the point cloud data, three-dimensional reconstruction can be performed to present objects, walls and other structures in the scene in the form of a three-dimensional model; by processing the point cloud data, planes in the scene, such as floors, walls, etc., can be identified and extracted, which is particularly useful for generating floor plans because it allows the boundaries and structures of the room to be identified; by fusing the depth information with the device's camera image, a three-dimensional scene with texture and color can be created to make it closer to the real world; the generated three-dimensional model is manually post-processed and optimized to remove noise, smooth the surface, and ensure the accuracy and usability of the model.

[0036] 3. A point cloud is a data set consisting of a large number of three-dimensional points. Each point contains coordinates in space and possible other information, and is point cloud data of a scene obtained by a lidar, depth camera or other sensor. The floor plan data of a house or building is usually stored in a computer in the form of CAD files, BIM (Building Information Modeling) data or other formats. These data include detailed information such as the structure, walls, doors and windows of the room. Ensure that the point cloud data and floor plan data use the same coordinate system, which involves converting one of the data sets so that the two are aligned in the same coordinate space.

[0037] The methods for fusing point cloud and apartment data include the following:

[0038] Projection method: Project the point cloud data onto the apartment data, and map the point cloud data onto the apartment surface through nearest neighbor or interpolation methods.

[0039] Voxel Grid: Convert both point cloud data and floor plan data into voxel grids and then merge them. This method creates a grid in space and adjusts the values ​​of the grid based on the contribution of point cloud data and floor plan data.

[0040] Depth map fusion: The point cloud data and apartment data are converted into depth maps respectively, and then a new depth map is synthesized by fusing the depth information, thereby fusing the information of the two. The fused data is visualized for users to view.

[0041] The beneficial effects of this embodiment are as follows:

[0042] It adopts multi-dimensional and integrated spatial data collection to provide data technology for the visual web version of AR space editing tools. Combined with 3D floor plan information, it can quickly complete the content editing of AR scenes only in the web tool, no longer relying on professional software and developers such as Unity, and improving the efficiency of AR scene construction.

[0043] The above shows and describes the basic principle, main features and advantages of the utility model. Those skilled in the art should understand that the utility model is not limited by the above embodiments, and the above embodiments and descriptions are only for explaining the principle of the utility model. Without departing from the spirit and scope of the utility model, the utility model may have various changes and improvements, and these changes and improvements fall within the scope of the utility model to be protected.

Claims

1. A three-dimensional space information acquisition system for building AR augmented reality scenes, characterized in that: The acquisition system includes: A scanning device, wherein the scanning device is used to scan a real scene and obtain scene information; An analysis device, the analysis device is used to analyze the scan information matching the real scene to obtain complete spatial information, and the analysis device is connected to the scanning device to receive the scan information; An interactive device is used to complete the interactive information between people and AR scenes.

2. A three-dimensional space information acquisition system for building an AR augmented reality scene according to claim 1, characterized in that: The scanning device is at least one of a camera, a mobile phone, a tablet, and a sensor. The scanning device is used to scan the actual site and collect visual feature points therein to generate point cloud data, and to identify the site space and object contours to generate a 3D floor plan and a simplified model of the furnishings.

3. A three-dimensional space information acquisition system for building an AR augmented reality scene according to claim 2, characterized in that: The scanning device also includes: Laser radar, which is used to measure the depth information of an object; An inertial measurement unit is used to measure the posture and position information of an object.

4. A three-dimensional space information acquisition system for building an AR augmented reality scene according to claim 1, characterized in that: The analysis device includes a computer for online editing of AR scenes.

5. The three-dimensional space information acquisition system for building an AR augmented reality scene according to claim 1, characterized in that: The interactive device is one of AR glasses or AR handles, and the user interacts with the AR scene built online by the interactive device and the analysis device.

6. A three-dimensional space information acquisition system for building an AR augmented reality scene according to claim 5, characterized in that: The analysis device is connected to the interaction device and is used to transmit the constructed AR scene to the interaction device.

Images