Scene model modeling method and device based on point cloud density and medium

Abstract

The invention provides a scene model modeling method and device based on point cloud density and a medium, and the method comprises the steps: responding to a plurality of received modeling pictures of a modeling object, and carrying out the modeling processing of the plurality of modeling pictures, so as to obtain an initial model corresponding to the modeling object; performing region division on the initial model to obtain a plurality of model regions; determining a target model area from the plurality of model areas according to the number of the plurality of model point clouds included in each model area; and deleting the model point cloud included in each target model region corresponding to the initial model to obtain a target model corresponding to the modeling object, so that the obtained target model can more accurately represent the features of the modeling object.

Description

Background Art

[0002] When modeling an object or scene, it is necessary to construct a model of the modeling object based on the collected real-life photos of the modeling object. When taking real-life photos of the modeling object, it is inevitable that objects that are close to the modeling object but do not belong to the modeling object will also be photographed. Or when taking photos, if there are objects on the modeling object that do not need to be modeled, the objects will also be photographed in the photos. Although the photographed pictures will be processed before modeling the modeling object to remove abnormal feature points on the modeling object, the processed pictures may have light and shadow problems, or improper processing, resulting in incomplete processing of abnormal feature points. At this time, if modeling is performed based on the pictures, the obtained model will also have corresponding abnormal points, resulting in too low quality of the obtained model. Summary of the invention

[0003] In view of the above technical problems, the technical solution adopted by the present invention is:

[0004] According to one aspect of the present application, a scene modeling method based on point cloud density is provided, comprising the following steps:

[0005] Step S100: in response to receiving a plurality of modeling pictures of a modeling object, performing modeling processing on the plurality of modeling pictures to obtain an initial model corresponding to the modeling object;

[0006] Step S200, dividing the initial model into regions to obtain a plurality of model regions; each model region includes a plurality of model point clouds of the initial model; and each model region corresponds to an equal spatial volume;

[0007] Step S300, determining a target model region from a plurality of model regions according to the number of model point clouds included in each model region;

[0008] Step S400: Delete the model point cloud included in each target model area corresponding to the initial model to obtain the target model corresponding to the modeling object.

[0009] In an exemplary embodiment of the present application, step S100 includes:

[0010] Step S110: determining a number of modeling picture groups according to the shooting time of each modeling picture; each modeling picture group includes a number of modeling pictures;

[0011] Step S120: determining a plurality of adjusted modeling pictures from the plurality of modeling pictures according to the clarity of the plurality of modeling pictures included in each modeling picture group;

[0012] Step S130: Obtain the number of adjusted modeling pictures included in each modeling picture group, and obtain a list of adjusted modeling picture numbers C = (C1, C2, ..., C j ,...,C m ); wherein j = 1, 2, ..., m; m is the number of the modeling picture groups; C j is the number of adjusted modeling pictures included in the j-th modeling picture group;

[0013] Step S140: If C j is the number of modeling pictures included in the j-th modeling picture group, the j-th modeling picture group is determined as the first modeling picture group; otherwise, the j-th modeling picture group is determined as the second modeling picture group;

[0014] Step S150: determining the modeling picture with the highest definition in the first modeling picture group as the target modeling picture;

[0015] Step S160: deleting the adjusted modeling pictures included in the second modeling picture group, and determining the remaining modeling pictures as target modeling pictures;

[0016] Step S170: performing model matching on key features of modeling objects contained in a plurality of target modeling pictures according to a preset feature matching algorithm, so as to establish an association relationship between each target modeling picture and the modeling object;

[0017] Step S180: Generate an initial model corresponding to the modeling object according to the association relationship between each target modeling picture and the modeling object.

[0018] In an exemplary embodiment of the present application, step S110 includes:

[0019] Step S111: sort the modeling pictures according to the ascending order of the shooting time of each modeling picture to obtain a picture identification list A=(A1, A2, ..., A i ,...,A n ), where i = 1, 2, ..., n, and n is the number of modeling images. A i is the image identifier corresponding to the i-th modeling image after sorting;

[0020] Step S112, traverse the picture identification list A in sequence, if A i The shooting time of the corresponding modeling picture and A i+1 If the shooting time of the corresponding modeling pictures is within the same preset shooting period, then A i The corresponding modeling pictures and A i+1 The corresponding modeling pictures are determined to be in the same modeling picture group to obtain a plurality of modeling picture groups; each modeling picture group includes a plurality of modeling pictures.

[0021] In an exemplary embodiment of the present application, step S120 includes:

[0022] Step S121: Obtain the definition of several modeling pictures included in each modeling picture group, and obtain a picture definition list set B = (B1, B2, ..., B j ,...,B m );B j =(B j1 ,B j2 ,...,B jk ,...,B jp(j) ), where j = 1, 2, ..., m, and m is the number of modeling picture groups; B j is the picture definition list corresponding to the j-th modeling picture group; k = 1, 2, ..., p(j); p(j) is the number of modeling pictures included in the j-th modeling picture group; B jk is the definition of the kth modeling picture included in the jth modeling picture group;

[0023] Step S122, traverse the picture definition list set B, if B jk <B0, then B jk The corresponding modeling picture is determined as the adjusted modeling picture, wherein B0 is a preset picture clarity threshold.

[0024] In an exemplary embodiment of the present application, step S200 includes:

[0025] Step S210, simulating the model point cloud of the initial model to obtain a target volume value of the model area;

[0026] Step S220, determining the target side length of each model area according to the target volume value of the model area;

[0027] Step S230: According to each model region, the initial model is divided into regions so that any part of the initial model is located in one model region.

[0028] In an exemplary embodiment of the present application, step S210 includes:

[0029] Step S211, obtaining the initial volume value of the model area;

[0030] Step S212, determining the initial side length of the model area according to the initial volume value of the model area;

[0031] Step S213, dividing the initial model into regions according to the initial side lengths of the model regions, so as to obtain the point cloud density of the initial model corresponding to each model region;

[0032] Step S214: if the point cloud density corresponding to any model area is less than D0, the model area is determined as the initial model area; wherein D0 is a preset processing density threshold;

[0033] Step S215: Obtain the number of model point clouds included in each initial model area, and obtain a model point cloud number list E=(E1, E2, ..., E c ,...,E d ), where c = 1, 2, ..., d, d is the number of initial model regions, E c is the number of model point clouds included in the cth initial model area;

[0034] Step S216: If e1≤(∑ d c＝1 E c ) / t≤e2, the initial volume value is determined as the target volume value; wherein t is the total number of model point clouds of the initial model; e1 is the preset first point cloud processing ratio threshold; e2 is the preset second point cloud processing ratio threshold; 0<e1<e2<1.

[0035] In an exemplary embodiment of the present application, step S216 further includes:

[0036] Step S217: If (∑ d c＝1 E c ) / t<e1, the ratio of the initial volume value to the preset volume coefficient is determined as the initial volume value, and step S212 is executed; wherein the volume coefficient is greater than 1;

[0037] Step S218: If (∑ d c＝1 E c ) / t>e2, the product of the initial volume value and the preset volume coefficient is determined as the initial volume value, and step S212 is executed.

[0038] In an exemplary embodiment of the present application, step S300 includes:

[0039] Step S310: Determine the point cloud density corresponding to each model area according to the number of model point clouds included in each model area, and obtain a point cloud density list D = (D1, D2, ..., D a ,...,D b ), where a=1,2,...,b; b is the number of model regions; D a is the point cloud density corresponding to the a-th model area;

[0040] Step S320: If D a<D0, the ath model area is determined as the target model area; wherein D0 is the preset processing density threshold.

[0041] According to one aspect of the present application, a non-transitory computer-readable storage medium is provided, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the aforementioned point cloud density-based scene modeling method.

[0042] According to one aspect of the present application, an electronic device is provided, including a processor and the aforementioned non-transitory computer-readable storage medium.

[0043] The present invention has at least the following beneficial effects:

[0044] The scene modeling method based on point cloud density of the present invention obtains an initial model by modeling several modeling pictures of the modeling object, and divides the initial model into regions to obtain several model regions, and determines the target model region from the several model regions according to the number of model point clouds included in each model region. The target model region is represented as the region corresponding to the scattered points or abnormal points in the initial model, and the model point cloud included in each target model region corresponding to the initial model is deleted to obtain the target model corresponding to the modeling object, so as to delete the stray points and abnormal points that do not belong to the modeling object, so that the obtained target model can more accurately represent the characteristics of the modeling object. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0046] Figure 1 A flowchart of a scene modeling method based on point cloud density provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0048] like Figure 1 As shown, a scene modeling method based on point cloud density includes the following steps:

[0049] Step S100: in response to receiving a plurality of modeling pictures of a modeling object, performing modeling processing on the plurality of modeling pictures to obtain an initial model corresponding to the modeling object;

[0050] The modeling object is an object or scene that needs to be modeled, and the modeling picture is a real-life photo of the modeling object taken from various angles. The optimal embodiment is a 360° panoramic photo of the modeling object.

[0051] The modeling picture is processed so that an initial model corresponding to the modeling object is obtained according to the features of the modeling object in the modeling picture.

[0052] Since a modeling object needs to be modeled, a panoramic photo of the modeling object is required. Any position point of the modeling object is taken as the initial point, and an image acquisition device is used to uniformly circle the modeling object with the initial point as the starting point to obtain a full-body photo of the modeling object. Therefore, the number of modeling pictures must be multiple, and there must be photos of each angle of the modeling object. However, due to the large number of modeling pictures, if every modeling picture is used during modeling, the data processing amount will be too large, and the image acquisition device may take pictures that are too blurred due to external environmental reasons. If the lens of the image acquisition device captures a moving object near the modeling object when photographing the modeling object, the light and shadow or image of the moving object will also exist in the photographed picture. If the picture is also used as a standard picture for modeling, the established model will also have blurred points. Therefore, it is necessary to pre-process several modeling pictures to reduce the data processing amount of the modeling process and improve the modeling quality.

[0053] Wherein, step S100 includes steps S110 to S180:

[0054] Step S110, determining a plurality of modeling picture groups according to the shooting time of each modeling picture;

[0055] Each modeling picture group includes a plurality of modeling pictures.

[0056] Since the image acquisition device is uniformly moving around the modeling object to acquire images, the shooting angle of the modeling object changes uniformly, and the shooting frequency of the image acquisition device is determined according to its own frame rate. For example, if the frame rate is 30, the image acquisition device will acquire 30 pictures of the modeling object within one second. In order to ensure the clarity of the pictures of the modeling object, the rotation speed of the image acquisition device will not be too fast. Therefore, the angle of rotation of the image acquisition device within one second will not be too large. 30 pictures are continuously taken at a small rotation angle. If these 30 pictures are all selected as pictures required for modeling, the number of overall pictures required for modeling is too large. Therefore, by determining a number of modeling picture groups through the shooting time of each modeling picture, only pictures that meet the standards are selected from the modeling picture groups as pictures required for modeling, which will reduce the amount of picture data processing for modeling, and the feature difference between several modeling pictures in the same modeling picture group is not large. Therefore, deleting several modeling pictures that do not meet the standards from the same modeling picture group will not affect the final modeling process.

[0057] Further, step S110 includes step S111-step S112:

[0058] Step S111: sort the modeling pictures according to the ascending order of the shooting time of each modeling picture to obtain a picture identification list A=(A1, A2, ..., A i ,...,A n ), where i = 1, 2, ..., n, and n is the number of modeling images. A i is the image identifier corresponding to the i-th modeling image after sorting;

[0059] Step S112, traverse the picture identification list A in sequence, if A i The shooting time of the corresponding modeling picture and A i+1 If the shooting time of the corresponding modeling pictures is within the same preset shooting period, then A i The corresponding modeling pictures and A i+1 The corresponding modeling pictures are determined to be in the same modeling picture group to obtain a plurality of modeling picture groups.

[0060] The preset shooting period can be one second, that is, among the several modeling picture groups obtained, the modeling pictures in the first modeling picture group are all pictures collected by the image acquisition device within the first second, the modeling pictures in the second modeling picture group are all pictures collected by the image acquisition device within the second second, and so on, the modeling pictures in the last modeling picture group are all pictures collected by the image acquisition device within the last second.

[0061] Step S120: determining a plurality of adjusted modeling pictures from the plurality of modeling pictures according to the clarity of the plurality of modeling pictures included in each modeling picture group;

[0062] Further, step S120 includes step S121-step S122:

[0063] Step S121: Obtain the definition of several modeling pictures included in each modeling picture group, and obtain a picture definition list set B = (B1, B2, ..., B j ,...,B m );B j =(B j1 ,B j2 ,...,B jk ,...,B jp(j) ), where j = 1, 2, ..., m, and m is the number of modeling picture groups; B j is the picture definition list corresponding to the j-th modeling picture group; k = 1, 2, ..., p(j); p(j) is the number of modeling pictures included in the j-th modeling picture group; B jk is the definition of the kth modeling picture included in the jth modeling picture group;

[0064] Clarity can be obtained through existing image processing methods.

[0065] Step S122, traverse the picture definition list set B, if B jk <B0, then B jk The corresponding modeling picture is determined as the adjusted modeling picture, wherein B0 is a preset picture clarity threshold.

[0066] If the clarity of the modeling image is lower than a preset clarity threshold, it is determined as an adjusted modeling image, indicating that the modeling image is too blurry and needs to be removed and cannot be selected as the image required for modeling.

[0067] Step S130: Obtain the number of adjusted modeling pictures included in each modeling picture group, and obtain a list of adjusted modeling picture numbers C = (C1, C2, ..., C j ,...,C m ), where C j is the number of adjusted modeling pictures included in the j-th modeling picture group;

[0068] Step S140: If C j is the number of modeling pictures included in the j-th modeling picture group, the j-th modeling picture group is determined as the first modeling picture group; otherwise, the j-th modeling picture group is determined as the second modeling picture group;

[0069] Step S150: determining the modeling picture with the highest definition in the first modeling picture group as the target modeling picture;

[0070] Since the images in the first modeling picture group all have a clarity lower than a preset clarity threshold, they should be deleted in theory. However, if all the images in the first modeling picture group are deleted, then in the subsequent process of establishing the initial model corresponding to the modeling object, the establishment of the initial model may be affected due to the lack of images of the shooting period corresponding to the first modeling picture group. Since the distinction between several modeling pictures in the same modeling picture group is not large, the modeling picture with the highest clarity is selected from the first modeling picture group as the target modeling picture for subsequent model establishment.

[0071] Step S160: deleting the adjusted modeling pictures included in the second modeling picture group, and determining the remaining modeling pictures as target modeling pictures;

[0072] Step S170: performing model matching on key features of modeling objects contained in a plurality of target modeling pictures according to a preset feature matching algorithm, so as to establish an association relationship between each target modeling picture and the modeling object;

[0073] Step S180: Generate an initial model corresponding to the modeling object according to the association relationship between each target modeling picture and the modeling object.

[0074] The preset feature matching algorithm may adopt an existing feature matching algorithm, that is, an initial model of the modeling object is established through the features of the modeling object in the target modeling picture.

[0075] Step S200, dividing the initial model into regions to obtain a plurality of model regions;

[0076] Each model region includes a number of model point clouds of the initial model, and the space volume corresponding to each model region is equal.

[0077] After the initial model is established, in order to make the model more accurately express the characteristics of the modeling object, the initial model needs to be processed to remove stray points and abnormal points in the initial model.

[0078] Further, step S200 includes steps S210 to S230:

[0079] Step S210, simulating the model point cloud of the initial model to obtain a target volume value of the model area;

[0080] The model point cloud of the initial model is all the point clouds used to construct the initial model.

[0081] Further, step S210 includes steps S211 to S218:

[0082] Step S211, obtaining the initial volume value of the model area;

[0083] The initial volume value is a preset volume value, and the initial volume value of the model area is adjusted according to the model point cloud of the initial model.

[0084] Since the volumes and specifications of the initial models corresponding to different modeling objects are different, the total number of model point clouds that make up the modeling objects is also different. In order to more accurately remove the stray points existing in the initial models of the modeling objects, it is necessary to determine model areas of different volume specifications according to different modeling objects.

[0085] Step S212, determining the initial side length of the model area according to the initial volume value of the model area;

[0086] The model area can be set as a cube structure. After setting an initial volume value, taking the cube root can get the initial side length of the model area.

[0087] Step S213, dividing the initial model into regions according to the initial side lengths of the model regions, so as to obtain the point cloud density of the initial model corresponding to each model region;

[0088] After determining the initial side length of the model area, that is, determining the size of the model area, the initial model is divided into regions so that any part of the initial model falls within a model area and the size of all model areas corresponding to the initial model are equal.

[0089] Step S214: if the point cloud density corresponding to any model area is less than D0, the model area is determined as the initial model area; wherein D0 is a preset processing density threshold;

[0090] Step S215: Obtain the number of model point clouds included in each initial model area, and obtain a model point cloud number list E=(E1, E2, ..., E c ,...,E d ), where c = 1, 2, ..., d, d is the number of initial model regions, E c is the number of model point clouds included in the cth initial model area;

[0091] Step S216: If e1≤(∑ d c＝1 E c ) / t≤e2, the initial volume value is determined as the target volume value; wherein t is the total number of model point clouds of the initial model; e1 is the preset first point cloud processing ratio threshold; e2 is the preset second point cloud processing ratio threshold; 0<e1<e2<1;

[0092] In order to make the processed amount of the model point cloud of the initial model (that is, the number of deleted model point clouds) within a reasonable range, that is, it is necessary to remove some stray points of the initial model, but not to remove most of the body points belonging to the initial model, it is necessary to set two point cloud processing ratio thresholds, such as setting e1 to 10% and e2 to 20%, which means that only when the ratio of the processed amount of the initial model to the total amount of the model point cloud of the initial model is between 0.1 and 0.2, the point cloud processing of the initial model is considered reasonable, and the delineation specifications of the model area at this time are accurate.

[0093] Step S217: If (∑ d c＝1 E c ) / t<e1, the ratio of the initial volume value to the preset volume coefficient is determined as the initial volume value, and step S212 is executed; wherein the volume coefficient is greater than 1;

[0094] Step S218: If (∑ d c＝1 E c ) / t>e2, the product of the initial volume value and the preset volume coefficient is determined as the initial volume value, and step S212 is executed.

[0095] If the ratio of the processed volume of the initial model to the total amount of the model point cloud of the initial model is within the range between e1 and e2, it means that the model area determined at this time meets the point cloud processing conditions, and it is determined as the target volume value.

[0096] If the ratio is less than e1, it means that the processed volume of the initial model is small, and only a small part of the point cloud is deleted as stray points, which does not meet the minimum deletion standard. The processed volume is related to the point cloud density in the model area. When the point cloud density in the model area is less than the preset density threshold, the point cloud in the model area will be processed. Since the model area will cover the initial model, the larger the volume of the model area, the fewer model areas corresponding to the initial model, and the greater the density of the model point cloud included in each model area. Therefore, when the ratio is less than e1, it means that the volume of the model area determined at this time is too large, and it needs to be reduced. The ratio of the current initial volume value to the preset volume coefficient is re-determined as the initial volume value, and the processing volume verification is performed again (return to step S212) until the volume of the determined model area meets the point cloud processing conditions.

[0097] On the contrary, if the ratio is greater than e2, it means that the volume of the model area determined at this time is too small and needs to be expanded. The product of the current initial volume value and the preset volume coefficient is determined as the new initial volume value, and the processing volume verification is performed again.

[0098] Step S220, determining the target side length of each model area according to the target volume value of the model area;

[0099] Step S230: According to each model region, the initial model is divided into regions so that any part of the initial model is located in one model region.

[0100] Step S300, determining a target model region from a plurality of model regions according to the number of model point clouds included in each model region;

[0101] Further, step S300 includes step S310-step S320:

[0102] Step S310: Determine the point cloud density corresponding to each model area according to the number of model point clouds included in each model area, and obtain a point cloud density list D = (D1, D2, ..., D a ,...,D b ), where a=1,2,...,b; b is the number of model regions; D a is the point cloud density corresponding to the a-th model area;

[0103] Step S320: If D a <D0, the ath model area is determined as the target model area; wherein D0 is the preset processing density threshold.

[0104] Step S400: Delete the model point cloud included in each target model area corresponding to the initial model to obtain the target model corresponding to the modeling object.

[0105] The scene modeling method based on point cloud density of the present invention obtains an initial model by modeling several modeling pictures of the modeling object, and divides the initial model into regions to obtain several model regions. According to the number of model point clouds included in each model region, a target model region is determined from the several model regions. The target model region is represented as the region corresponding to the scattered points or abnormal points in the initial model. The model point cloud included in each target model region corresponding to the initial model is deleted to obtain the target model corresponding to the modeling object, so that the obtained target model can more accurately represent the characteristics of the modeling object.

[0106] An embodiment of the present invention further provides a computer program product, which includes program code. When the program product is run on an electronic device, the program code is used to enable the electronic device to execute the steps of the method according to various exemplary embodiments of the present invention described above in this specification.

[0107] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0108] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0109] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0110] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0111] The electronic device according to this embodiment of the present invention is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0112] The electronic device is presented in the form of a general-purpose computing device. The components of the electronic device may include, but are not limited to: the at least one processor mentioned above, the at least one storage device mentioned above, and a bus connecting different system components (including storage devices and processors).

[0113] The storage stores program codes, which can be executed by the processor, so that the processor executes the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification.

[0114] The memory may include readable media in the form of volatile memory, such as random access memory (RAM) and / or cache memory, and may further include read only memory (ROM).

[0115] The storage may also include a program / utility having a set (at least one) of program modules, such program modules including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include an implementation of a network environment.

[0116] The bus may represent one or more of several types of bus structures including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.

[0117] The electronic device may also communicate with one or more external devices (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device, and / or any device that enables the electronic device to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface. Furthermore, the electronic device may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter.

[0118] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0119] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0120] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0121] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0122] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0123] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0124] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0125] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0126] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A scene modeling method based on point cloud density, It is characterized in that The method comprises the following steps: Step S100: in response to receiving a plurality of modeling pictures of a modeling object, performing modeling processing on the plurality of modeling pictures to obtain an initial model corresponding to the modeling object; Step S200, dividing the initial model into regions to obtain a plurality of model regions; each of the model regions includes a plurality of model point clouds of the initial model; and the spatial volume corresponding to each of the model regions is equal; Step S300, determining a target model region from a plurality of the model regions according to the number of model point clouds included in each of the model regions; Step S400: deleting the model point cloud included in each target model area corresponding to the initial model to obtain the target model corresponding to the modeling object.

2. The method according to claim 1, It is characterized in that The step S100 includes: Step S110: determining a plurality of modeling picture groups according to the shooting time of each of the modeling pictures; each of the modeling picture groups includes a plurality of modeling pictures; Step S120: determining a plurality of adjusted modeling pictures from the plurality of modeling pictures according to the clarity of the plurality of modeling pictures included in each of the modeling picture groups; Step S130: Obtain the number of adjusted modeling pictures included in each of the modeling picture groups, and obtain a list of adjusted modeling picture numbers C=(C 1 ,C 2 ,...,C j ,...,C m ); wherein j = 1, 2, ..., m; m is the number of the modeling picture groups; C j is the number of adjusted modeling pictures included in the j-th modeling picture group; Step S140: If C j is the number of modeling pictures included in the j-th modeling picture group, the j-th modeling picture group is determined as the first modeling picture group; otherwise, the j-th modeling picture group is determined as the second modeling picture group; Step S150: determining the modeling picture with the highest definition in the first modeling picture group as the target modeling picture; Step S160: deleting the adjusted modeling pictures included in the second modeling picture group, and determining the remaining modeling pictures as target modeling pictures; Step S170: performing model matching on key features of the modeling objects contained in the target modeling pictures according to a preset feature matching algorithm, so as to establish an association relationship between each of the target modeling pictures and the modeling objects; Step S180: Generate an initial model corresponding to the modeling object according to the association relationship between each of the target modeling pictures and the modeling object.

3. The method according to claim 2, It is characterized in that The step S110 includes: Step S111: sort the modeling pictures according to the ascending order of the shooting time of each modeling picture to obtain a picture identification list A=(A 1 ,A 2 ,...,A i ,...,A n ); wherein i=1, 2, ..., n; n is the number of the modeling pictures; A i is the image identifier corresponding to the i-th modeling image after sorting; Step S112, traverse the picture identification list A in sequence, if A i The shooting time of the corresponding modeling picture and A i+1 If the shooting time of the corresponding modeling pictures is within the same preset shooting period, then A i The corresponding modeling pictures and A i+1 The corresponding modeling pictures are determined to be in the same modeling picture group to obtain a plurality of modeling picture groups; each of the modeling picture groups includes a plurality of modeling pictures.

4. The method according to claim 3, It is characterized in that The step S120 includes: Step S121: Obtain the definition of several modeling pictures included in each of the modeling picture groups, and obtain a picture definition list set B=(B 1 ,B 2 ,...,B j ,...,B m );B j =(B j1 ,B j2 ,...,B jk ,...,B jp(j) ), where B j is a picture definition list corresponding to the jth modeling picture group; k=1, 2, ..., p(j); p(j) is the number of modeling pictures included in the jth modeling picture group; B jk is the definition of the kth modeling picture included in the jth modeling picture group; Step S122, traverse the picture definition list set B, if B jk <B 0 , then B jk The corresponding modeling picture is determined as the adjusted modeling picture; among them, B 0 It is the preset image clarity threshold.

5. The method according to claim 1, It is characterized in that The step S200 includes: Step S210, simulating the model point cloud of the initial model to obtain a target volume value of the model area; Step S220, determining a target side length of each of the model regions according to the target volume value of the model region; Step S230: dividing the initial model into regions according to each of the model regions, so that any part of the initial model is located in one of the model regions.

6. The method according to claim 5, It is characterized in that The step S210 includes: Step S211, obtaining the initial volume value of the model area; Step S212, determining the initial side length of the model area according to the initial volume value of the model area; Step S213, dividing the initial model into regions according to the initial side lengths of the model regions, so as to obtain a point cloud density of the initial model corresponding to each of the model regions; Step S214: If the point cloud density corresponding to any of the model regions is less than D 0 , then the model region is determined as the initial model region; wherein, D 0 is the preset processing density threshold; Step S215: Obtain the number of model point clouds included in each of the initial model regions, and obtain a list of model point cloud numbers E=(E 1 ,E 2 ,...,E c ,...,E d ), wherein c = 1, 2, ..., d, d is the number of the initial model regions, E c is the number of model point clouds included in the cth initial model area; Step S216: If 1 ≤(∑ d c＝1 E c ) / t≤e 2 , the initial volume value is determined as the target volume value; wherein t is the total number of model point clouds of the initial model; e 1 is the preset first point cloud processing ratio threshold; 2 is the preset second point cloud processing ratio threshold; 0<e 1 <e 2 <1.

7. The method according to claim 6, It is characterized in that The step S216 further includes: Step S217: If (∑ d c＝1 E c ) / t<e 1 , the ratio of the initial volume value to the preset volume coefficient is determined as the initial volume value, and step S212 is executed; wherein the volume coefficient is greater than 1; Step S218: If (∑ d c＝1 E c ) / t>e 2 , the product of the initial volume value and the preset volume coefficient is determined as the initial volume value, and step S212 is executed.

8. The method according to claim 1, It is characterized in that The step S300 includes: Step S310: Determine the point cloud density corresponding to each of the model regions according to the number of model point clouds included in each of the model regions, and obtain a point cloud density list D=(D 1 ,D 2 ,...,D a ,...,D b ), wherein a=1, 2, ..., b, b is the number of the model regions; D a is the point cloud density corresponding to the a-th model area; Step S320: If D a <D 0 , then the a-th model region is determined as the target model region; wherein, D 0 is the preset processing density threshold.

9. A non-transitory computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium. It is characterized in that The at least one instruction or the at least one program is loaded and executed by the processor to implement the scene modeling method based on point cloud density as described in any one of claims 1-8.

10. An electronic device, It is characterized in that The invention comprises a processor and the non-transitory computer-readable storage medium as claimed in claim 9.

Images