Indoor area dynamic measurement method and device based on depth camera

Through the depth camera, automated indoor area measurement without manual intervention is realized, the time-consuming and labor-intensive manual measurement in the prior art is solved, and the accuracy and efficiency of measurement are improved.

CN119022830APending Publication Date: 2024-11-26GUANGDONG MECHANICAL & ELECTRICAL COLLEGE
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411395923.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-08
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing indoor area measurement methods require manual intervention, are time-consuming and error-prone, and lack of automated solutions.

Method used

Depth cameras are used to obtain depth data, mapped into three-dimensional coordinate point cloud data, and the indoor area is automatically calculated through object recognition and calculation algorithms, realizing automated measurement without manual intervention.

Benefits of technology

It realizes automated indoor area measurement without manual tools, improves measurement accuracy and efficiency, and saves time and labor costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119022830A_ABST
    Figure CN119022830A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of computer vision, and particularly relates to an indoor area dynamic measurement method and device based on a depth camera, and the method comprises the steps: obtaining first depth data shot indoors by the depth camera at a current time period; mapping the first depth data to a three-dimensional coordinate to obtain point cloud data; performing object identification on the point cloud data to obtain target point cloud data representing the same target object; calculating the distance value between the target objects and the surface area corresponding to the target objects according to the target point cloud data; calculating the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects; and acquiring second depth data shot by the depth camera indoors in the next time period, and updating the indoor area according to the second depth data. Therefore, compared with an existing measurement method, the method does not need to use any manual measurement tool, achieves the automatic measurement of the indoor area, and saves the time and manpower cost.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of computer vision technology, and in particular relates to a method and device for dynamic measurement of indoor area based on a depth camera. Background Art

[0002] Dynamic measurement of indoor area is crucial for many applications, including architectural design, indoor navigation, and virtual reality. Existing methods for measuring indoor area typically require manual measurement using tools such as tape measures or laser rangefinders. This approach is time-consuming, labor-intensive, and error-prone. Therefore, an automated indoor area measurement method without manual intervention is needed. Summary of the Invention

[0003] The embodiments of the present application provide a method and device for dynamic indoor area measurement based on a depth camera, which can realize automatic indoor area measurement without human intervention.

[0004] In a first aspect, an embodiment of the present application provides a method for dynamic measurement of indoor area based on a depth camera, comprising: Acquire first depth data captured by the depth camera indoors during a current time period; wherein the first depth data represents the distance from the depth point to the photographed object; Mapping the first depth data to three-dimensional coordinates to obtain point cloud data; Performing object recognition on the point cloud data to obtain target point cloud data representing the same target object; Calculating the distance between the target objects and the surface area corresponding to the target objects according to the target point cloud data; Calculating the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects; Acquire second depth data captured by the depth camera indoors in a next time period, and update the indoor area according to the second depth data.

[0005] In a possible implementation of the first aspect, after obtaining first depth data captured by the depth camera indoors during a current time period, the method further includes: Get the depth camera's position data for indoor shooting in the current time period; The first depth data is corrected using the pose data.

[0006] In a possible implementation of the first aspect, after obtaining first depth data captured by the depth camera indoors during a current time period, the method further includes: The first depth data is preprocessed using a preset noise removal algorithm.

[0007] In a possible implementation of the first aspect, performing object recognition on the point cloud data to obtain target point cloud data representing the same target object includes: Extracting a first feature map corresponding to the point cloud data through a preset feature extraction network; Dividing the first feature map into multiple feature regions through a preset context integration network, and performing a pooling operation in each feature region to obtain a second feature map; Performing a deconvolution operation on the second feature map through a preset upsampling network to obtain a third feature map; Performing a classification operation on the third feature map according to a preset classification network to obtain a category label corresponding to the point cloud data; The point cloud data with the same category label are used as target point cloud data representing the same target object.

[0008] In a possible implementation of the first aspect, performing a classification operation on the third feature map according to a preset classification network to obtain a category label corresponding to the point cloud data includes: The category label corresponding to the point cloud data is determined according to the following formula: ; in, Indicates the category label corresponding to the point cloud data, represents the classification operation of the preset classification network, Represents the deconvolution operation corresponding to the preset upsampling network, Indicates that the preset context integration network performs The pooling operation of feature regions, Represents the extraction operation corresponding to the preset feature extraction network, Indicates the first feature map The size of the feature area, Represents the point cloud data input to the preset feature extraction network.

[0009] In a possible implementation of the first aspect, calculating the distance value between the target objects and the surface area corresponding to the target objects according to the target point cloud data includes: Performing surface reconstruction on target point cloud data representing the same target object to obtain a three-dimensional object model of the target object; Based on a preset area calculation algorithm, determining the surface area corresponding to the target object according to the three-dimensional model of the target object; Based on a preset distance calculation algorithm, the distance value between the target objects is determined according to the three-dimensional model of the target objects.

[0010] In a possible implementation of the first aspect, calculating the indoor area according to the distance between the target objects and the surface areas corresponding to the target objects includes: Based on a preset division rule, the indoor space is divided into a plurality of indoor sub-areas according to the distance values ​​between the target objects and the surface areas corresponding to the target objects, and the area corresponding to the indoor sub-areas is calculated; For each adjacent indoor sub-region, calculating the overlapping area between the adjacent indoor sub-regions; The indoor area is determined according to the overlapping area between the adjacent indoor sub-areas and the area corresponding to the indoor sub-areas.

[0011] In a second aspect, an embodiment of the present application provides a device for dynamically measuring indoor areas based on a depth camera, comprising: An acquisition module, configured to acquire first depth data captured indoors by a depth camera during a current time period; wherein the first depth data represents a distance from a depth point to a photographed object; A mapping module, configured to map the first depth data to three-dimensional coordinates to obtain point cloud data; an identification module, configured to perform object recognition on the point cloud data to obtain target point cloud data representing the same target object; A first calculation module is used to calculate the distance value between the target objects and the surface area corresponding to the target objects according to the target point cloud data; A second calculation module is used to calculate the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects; The updating module is configured to obtain second depth data captured by the depth camera indoors during a next time period, and update the indoor area according to the second depth data.

[0012] In a third aspect, an embodiment of the present application provides a terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the first aspect above when executing the computer program.

[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in the first aspect above is implemented.

[0014] Compared with the prior art, the embodiments of the present application have the following beneficial effects: The embodiment of the present application obtains point cloud data by acquiring depth data from a depth camera and mapping it to three-dimensional coordinates. Then, by performing object recognition on the point cloud data, target point cloud data of the same target object can be extracted. Based on the target point cloud data, the distance value between the target objects and the surface area corresponding to the target object can be calculated. Through these calculation results, an estimate of the indoor area can be obtained, and in subsequent time periods, by acquiring new depth data, the measurement results of the indoor area can be updated in real time. It can be seen that compared with the existing measurement method, the embodiment of the present application does not require the use of any manual measuring tools, such as a tape measure or a laser rangefinder, and realizes automated indoor area measurement, saving time and labor costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0016] Figure 1 is a schematic flow chart of a method for dynamic indoor area measurement based on a depth camera provided in an embodiment of the present application; Figure 2 This is a structural block diagram of an indoor area dynamic measurement device based on a depth camera provided in an embodiment of the present application; Figure 3 It is a structural diagram of the terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0017] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.

[0018] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or collections thereof.

[0019] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0020] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.

[0021] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0022] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0023] The technical solutions of the embodiments of this application are introduced below.

[0024] See also Figure 1 , which is a schematic flow chart of a method for dynamic indoor area measurement based on a depth camera provided in an embodiment of the present application. As an example and not a limitation, the method can be applied to a terminal device, and the method includes the following steps: Step S101: Acquire first depth data captured indoors by a depth camera in a current time period.

[0025] The first depth data represents the distance from the depth point to the photographed object.

[0026] Exemplarily, the depth camera can be a laser depth camera, which is a camera that uses lidar technology for depth perception. It uses a laser beam transmitter to emit a laser beam and then receives the return signal of the laser beam through a receiver to measure the distance between the object and the camera.

[0027] In an optional implementation, after obtaining first depth data captured indoors by the depth camera during the current time period, the method further includes: Get the depth camera's position data for indoor shooting in the current time period; The first depth data is corrected using the pose data.

[0028] Exemplarily, the posture data includes position data and attitude data. Obtaining the posture data of the depth camera when shooting indoors in the current time period includes: using the GPS positioning system to obtain the position data of the depth camera in the geographic coordinate system; using the inertial measurement unit set by the depth camera to obtain the attitude data of the depth camera.

[0029] Exemplarily, correcting the first depth data using the posture data includes: calculating the internal parameters of the depth camera by calibrating parameters such as the focal length and principal point coordinates of the depth camera; based on the posture data, calculating the posture of the depth camera in the world coordinate system as the external parameters of the depth camera through conversion between the camera and the world coordinate system; performing a reprojection operation according to the internal and external parameters of the depth camera to correspond each pixel in the depth data to the corresponding world coordinates, thereby correcting the first depth data.

[0030] In an optional implementation, after obtaining first depth data captured indoors by the depth camera during the current time period, the method further includes: The first depth data is preprocessed using a preset noise removal algorithm.

[0031] The preset noise removal algorithm may be mean filtering, median filtering or Gaussian filtering.

[0032] It is understandable that the use of a preset noise removal algorithm can effectively reduce noise interference in the depth camera data in the preprocessing stage, and improve the precision and accuracy of subsequent object recognition and area measurement.

[0033] Step S102: Map the first depth data to three-dimensional coordinates to obtain point cloud data.

[0034] Exemplarily, according to the camera projection model corresponding to the depth camera, the pixel points in the first depth data are projected from the pixel coordinate system to the three-dimensional coordinate system (ie, the world coordinate system) to obtain point cloud data. Step S103 : performing object recognition on the point cloud data to obtain target point cloud data representing the same target object.

[0035] Among them, target objects refer to indoor walls, doors, windows, pillars, tables, chairs and other objects.

[0036] Exemplarily, object recognition may be performed on the point cloud data using a preset object recognition model to obtain target point cloud data representing the same target object.

[0037] Among them, the preset object recognition model includes a preset feature extraction network, a preset context integration network, a preset upsampling network and a preset classification network.

[0038] The preset feature extraction network can be a convolutional neural network, which is used to extract high-level semantic features from the input point cloud data to form a first feature map; the preset context integration network is used to use multi-scale feature information to divide the first feature map into multiple regions of different sizes, and perform pooling operations (such as maximum pooling) in each region to obtain a second feature map, thereby capturing context information at multiple scales; the preset upsampling network is used to restore the second feature map of the pooling operation to the same resolution as the original input point cloud data through a deconvolution operation. After the resolution is restored, the object segmentation results in the point cloud data can be more accurately predicted; the preset classification network can be a fully connected layer, which is used to classify the second feature map and generate the final object segmentation result.

[0039] In a specific application, object recognition is performed on the point cloud data to obtain target point cloud data representing the same target object, including: Extracting a first feature map corresponding to the point cloud data through a preset feature extraction network; Dividing the first feature map into multiple feature regions through a preset context integration network, and performing a pooling operation in each feature region to obtain a second feature map; Performing a deconvolution operation on the second feature map through a preset upsampling network to obtain a third feature map; Performing a classification operation on the third feature map according to a preset classification network to obtain a category label corresponding to the point cloud data; The point cloud data with the same category label are used as target point cloud data representing the same target object.

[0040] Exemplarily, performing a classification operation on the third feature map according to a preset classification network to obtain a category label corresponding to the point cloud data includes: The category label corresponding to the point cloud data is determined according to the following formula: ; in, Indicates the category label corresponding to the point cloud data, represents the classification operation of the preset classification network, Represents the deconvolution operation corresponding to the preset upsampling network, Indicates that the preset context integration network performs The pooling operation of feature regions, Represents the extraction operation corresponding to the preset feature extraction network, Indicates the first feature map The size of the feature area, Represents the point cloud data input to the preset feature extraction network.

[0041] In an embodiment of the present application, a preset feature extraction network can be used to extract high-level semantic features from point cloud data, which helps to accurately capture the feature information of the target object and improve the accuracy of object recognition; the preset context integration network can utilize multi-scale feature information to divide the first feature map into multiple regions of different sizes and perform pooling operations to capture contextual information at different scales, so as to more comprehensively understand the target object in the point cloud data and improve the robustness of recognition; the preset upsampling network performs a deconvolution operation on the second feature map obtained by the pooling operation, which can restore the resolution of the feature map, more accurately predict the object segmentation results in the point cloud data, and improve the accuracy of object segmentation; the preset classification network uses a fully connected layer to perform a classification operation on the third feature map, which can obtain the category label corresponding to the point cloud data.

[0042] Step S104 : calculating the distance between the target objects and the surface areas corresponding to the target objects based on the target point cloud data.

[0043] In a specific application, calculating the distance value between the target objects and the surface area corresponding to the target objects based on the target point cloud data includes: Performing surface reconstruction on target point cloud data representing the same target object to obtain a three-dimensional object model of the target object; Based on a preset area calculation algorithm, determining the surface area corresponding to the target object according to the three-dimensional model of the target object; Based on a preset distance calculation algorithm, the distance value between the target objects is determined according to the three-dimensional model of the target objects.

[0044] Exemplarily, surface reconstruction is performed on target point cloud data representing the same target object to obtain a three-dimensional object model of the target object, including: using a Poisson reconstruction algorithm to surface reconstruct the target point cloud data representing the same target object to obtain a three-dimensional object model of the target object composed of a triangular mesh.

[0045] Exemplarily, based on a preset area calculation algorithm, the surface area corresponding to the target object is determined according to the three-dimensional model of the target object, including: using Heron's formula or vector cross multiplication to calculate the area of ​​each triangle, and summing the areas of all triangles to obtain the surface area of ​​the target object.

[0046] Exemplarily, based on a preset distance calculation algorithm, the distance value between the target objects is determined according to the three-dimensional model of the target object, including: calculating the normal vector of the three-dimensional model of the target object according to the three-dimensional coordinates of the target point cloud data in the three-dimensional model of the target object; based on the normal vector of the three-dimensional model of the target object, calculating the model distance value between the three-dimensional models of each target object according to a nearest neighbor search algorithm or a distance transformation method; and using the distance value between the three-dimensional models of the target objects as the distance value between the target objects.

[0047] Step S105 : calculating the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects.

[0048] In a specific application, calculating the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects includes: Based on a preset division rule, the indoor space is divided into a plurality of indoor sub-areas according to the distance values ​​between the target objects and the surface areas corresponding to the target objects, and the area corresponding to the indoor sub-areas is calculated; For each adjacent indoor sub-region, calculating the overlapping area between the adjacent indoor sub-regions; The indoor area is determined according to the overlapping area between the adjacent indoor sub-areas and the area corresponding to the indoor sub-areas.

[0049] Exemplarily, based on preset division rules, the indoor space is divided into multiple indoor sub-areas according to the distance values ​​between the target objects and the surface areas corresponding to the target objects, including: the indoor space can be divided into different indoor sub-areas according to predetermined rules, for example, the space can be divided according to the position and shape of objects such as walls, doors, windows, and pillars.

[0050] Exemplarily, calculating the area corresponding to the indoor sub-region includes calculating the area corresponding to the indoor sub-region according to a polygon area calculation formula, such as Green's theorem or Shoelace formula.

[0051] Exemplarily, for each adjacent indoor sub-region, the area of ​​the overlapping region between the adjacent indoor sub-regions is calculated, including: processing and aligning the point cloud data of the two regions to ensure that they are in the same coordinate system, then converting the point cloud data into a grid representation using voxel calculation or other methods, and finally, calculating the overlapping area on the grid representation. The area of ​​the overlapping region can be obtained by calculating the number of voxels of the intersection between the grids or the area between the voxels.

[0052] Step S106: Acquire second depth data captured by the depth camera indoors during the next time period, and update the indoor area according to the second depth data.

[0053] It is understandable that after the second depth data is collected in the next time period, the above process from step 101 to step S105 is repeated, and the indoor area previously measured based on the first depth data is updated based on the latest indoor area.

[0054] The embodiment of the present application can obtain point cloud data by acquiring depth data from a depth camera and mapping it to three-dimensional coordinates. Then, by performing object recognition on the point cloud data, target point cloud data of the same target object can be extracted. Based on the target point cloud data, the distance value between the target objects and the surface area corresponding to the target object can be calculated. Through these calculation results, an estimate of the indoor area can be obtained, and in subsequent time periods, by acquiring new depth data, the measurement results of the indoor area can be updated in real time. It can be seen that compared with the existing measurement method, the embodiment of the present application does not require the use of any manual measuring tools, such as a tape measure or a laser rangefinder, and realizes automated indoor area measurement, saving time and labor costs.

[0055] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0056] Corresponding to the indoor area dynamic measurement method based on the depth camera described in the above embodiment, Figure 2 A structural block diagram of an indoor area dynamic measurement device based on a depth camera provided in an embodiment of the present application is shown. For ease of explanation, only the parts related to the embodiment of the present application are shown.

[0057] Reference Figure 2 , the device comprises: An acquisition module 21 is configured to acquire first depth data captured indoors by a depth camera during a current time period; wherein the first depth data represents a distance from a depth point to a photographed object; A mapping module 22, configured to map the first depth data to three-dimensional coordinates to obtain point cloud data; The recognition module 23 is used to perform object recognition on the point cloud data to obtain target point cloud data representing the same target object; A first calculation module 24 is configured to calculate the distance between the target objects and the surface area corresponding to the target objects based on the target point cloud data; A second calculation module 25 is configured to calculate the indoor area based on the distance between the target objects and the surface area corresponding to the target objects; The updating module 26 is configured to obtain second depth data captured by the depth camera indoors during a next time period, and update the indoor area according to the second depth data.

[0058] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of this application. Their specific functions and technical effects can be found in the method embodiment section and will not be repeated here.

[0059] Figure 3 This is a schematic diagram of the structure of the terminal device provided in the embodiment of the present application. Figure 3 As shown, the terminal device 3 of this embodiment includes: at least one processor 30, a memory 31, and a computer program 32 stored in the memory 31 and executable on the at least one processor 30. When the processor 30 executes the computer program 32, the steps in any of the above-mentioned method embodiments are implemented.

[0060] The terminal device 3 can be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The terminal device may include, but is not limited to, a processor 30 and a memory 31. Those skilled in the art will understand that Figure 3 It is only an example of terminal device 3 and does not constitute a limitation on terminal device 3. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output devices, network access devices, etc.

[0061] The processor 30 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. A general-purpose processor may be a microprocessor or any conventional processor.

[0062] In some embodiments, the memory 31 may be an internal storage unit of the terminal device 3, such as a hard drive or memory of the terminal device 3. In other embodiments, the memory 31 may also be an external storage device of the terminal device 3, such as a plug-in hard drive, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. equipped on the terminal device 3. Furthermore, the memory 31 may include both an internal storage unit of the terminal device 3 and an external storage device. The memory 31 is used to store an operating system, application programs, a boot loader, data, and other programs, such as the program code of the computer program. The memory 31 may also be used to temporarily store data that has been output or is about to be output.

[0063] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0064] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned various method embodiments can be implemented.

[0065] If the integrated unit is implemented as a software functional unit and sold or used as a standalone product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process steps in the above-mentioned method embodiments by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When executed by a processor, the computer program can implement the steps of each of the above-mentioned method embodiments. The computer program includes computer program code, which can be in source code form, object code form, executable file, or some intermediate form. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a terminal device, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signals, telecommunication signals, and software distribution media. Examples include USB flash drives, removable hard drives, magnetic disks, or optical disks. In some jurisdictions, based on legislation and patent practice, computer-readable media cannot be electric carrier signals or telecommunication signals.

[0066] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0067] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0068] In the embodiments provided in this application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0069] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0070] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.

Claims

1. A method for dynamic measurement of indoor area based on a depth camera, characterized in that: include: Acquire first depth data captured by the depth camera indoors during a current time period; wherein the first depth data represents the distance from the depth point to the photographed object; Mapping the first depth data to three-dimensional coordinates to obtain point cloud data; Performing object recognition on the point cloud data to obtain target point cloud data representing the same target object; Calculating the distance between the target objects and the surface area corresponding to the target objects according to the target point cloud data; Calculating the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects; Acquire second depth data captured by the depth camera indoors in a next time period, and update the indoor area according to the second depth data.

2. The method for dynamic indoor area measurement based on a depth camera according to claim 1, wherein: After obtaining the first depth data captured by the depth camera indoors during the current time period, the method further includes: Get the depth camera's position data for indoor shooting in the current time period; The first depth data is corrected using the pose data.

3. The method for dynamic indoor area measurement based on a depth camera according to claim 1, wherein: After obtaining the first depth data captured by the depth camera indoors during the current time period, the method further includes: The first depth data is preprocessed using a preset noise removal algorithm.

4. The method for dynamic indoor area measurement based on a depth camera according to claim 1, wherein: Performing object recognition on the point cloud data to obtain target point cloud data representing the same target object includes: Extracting a first feature map corresponding to the point cloud data through a preset feature extraction network; Dividing the first feature map into multiple feature regions through a preset context integration network, and performing a pooling operation in each feature region to obtain a second feature map; Performing a deconvolution operation on the second feature map through a preset upsampling network to obtain a third feature map; Performing a classification operation on the third feature map according to a preset classification network to obtain a category label corresponding to the point cloud data; The point cloud data with the same category label are used as target point cloud data representing the same target object.

5. The method for dynamic indoor area measurement based on a depth camera according to claim 4, wherein: Performing a classification operation on the third feature map according to a preset classification network to obtain a category label corresponding to the point cloud data includes: The category label corresponding to the point cloud data is determined according to the following formula: ; in, Indicates the category label corresponding to the point cloud data, represents the classification operation of the preset classification network, Represents the deconvolution operation corresponding to the preset upsampling network, Indicates that the preset context integration network performs The pooling operation of feature regions, Represents the extraction operation corresponding to the preset feature extraction network, Indicates the first feature map The size of the feature area, Represents the point cloud data input to the preset feature extraction network.

6. The method for dynamic indoor area measurement based on a depth camera according to claim 1, wherein: Calculating the distance between the target objects and the surface area corresponding to the target objects according to the target point cloud data includes: Performing surface reconstruction on target point cloud data representing the same target object to obtain a three-dimensional object model of the target object; Based on a preset area calculation algorithm, determining the surface area corresponding to the target object according to the three-dimensional model of the target object; Based on a preset distance calculation algorithm, the distance value between the target objects is determined according to the three-dimensional model of the target objects.

7. The method for dynamic indoor area measurement based on a depth camera according to claim 6, wherein: Calculating the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects includes: Based on a preset division rule, the indoor space is divided into a plurality of indoor sub-areas according to the distance values ​​between the target objects and the surface areas corresponding to the target objects, and the area corresponding to the indoor sub-areas is calculated; For each adjacent indoor sub-region, calculating the overlapping area between the adjacent indoor sub-regions; The indoor area is determined according to the overlapping area between the adjacent indoor sub-areas and the area corresponding to the indoor sub-areas.

8. A dynamic indoor area measurement device based on a depth camera, characterized in that: include: An acquisition module, configured to acquire first depth data captured by the depth camera indoors during a current time period; wherein the first depth data represents a distance from a depth point to a photographed object; A mapping module, configured to map the first depth data to three-dimensional coordinates to obtain point cloud data; an identification module, configured to perform object recognition on the point cloud data to obtain target point cloud data representing the same target object; A first calculation module is used to calculate the distance value between the target objects and the surface area corresponding to the target objects according to the target point cloud data; A second calculation module is used to calculate the indoor area according to the distance value between the target objects and the surface area corresponding to the target objects; The updating module is configured to obtain second depth data captured by the depth camera indoors during a next time period, and update the indoor area according to the second depth data.

9. A terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.