House type determination method, device and system, electronic device and storage medium
Through panoramic image recognition and laser rangefinder measurement, three-dimensional and floor plan drawings are generated, which solves the problems of time-consuming, low efficiency and low accuracy of traditional house measurement methods, and achieves efficient and accurate house layout measurement and image rendering.
Patent Information
- Application Number
- CN202111428640.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-26
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2041-11-26
AI Technical Summary
Traditional house measurement methods are time-consuming and inefficient, with low measurement accuracy, and often have problems such as missed measurement, errors in measurement or inaccurate house angle identification.
By acquiring panoramic images, identifying structural elements, determining target acquisition points, measuring structural data using laser rangefinders, generating three-dimensional and plan floor plans, and rendering them in combination with panoramic images.
It improves the accuracy and efficiency of house measurement, reduces manual measurement errors, and can quickly generate accurate floor plans, suitable for use by various groups of people.
Smart Images

Figure CN114202613B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of surveying and mapping technology, and in particular to a method, device and system for determining a house type, an electronic device and a storage medium. Background Art
[0002] In the fields of building decoration, designers and engineers need to measure houses and draw accurate floor plans for decoration design, cost estimation, quotation, etc. The traditional house measurement method is to measure the house data one by one with a tape measure or a handheld distance meter, draw a sketch of the floor plan on site, mark all the measured house data on the sketch, and then redraw the floor plan in the design drawing software on the computer based on the data recorded on site.
[0003] The measurement methods in the related art, whether on-site measurement or house layout drawing, are very time-consuming, inefficient, and have low measurement accuracy. It is common for dimensional data to be missed or measured incorrectly, or for the angle of the house to not be a standard right angle but not be recognized and measured. Summary of the invention
[0004] In view of this, in order to solve the above-mentioned technical problems, embodiments of the present invention provide a method, device and system for determining a house type, an electronic device and a storage medium.
[0005] In a first aspect, an embodiment of the present invention provides a method for determining a house type, comprising:
[0006] Acquire a first image, where the first image is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house;
[0007] Determining a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested;
[0008] Measuring structural data of the target acquisition point;
[0009] A second image of the scene to be tested is generated according to the target collection points and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, and the floor plan includes a three-dimensional floor plan and a plane floor plan.
[0010] The three-dimensional floor plan is rendered in combination with the first image to obtain the third image, where the third image is a panoramic three-dimensional floor plan.
[0011] In a possible implementation manner, determining a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested, includes:
[0012] Identify the structural type of all structural elements in the first image and the shape and size data of each structural element by using a preset recognition algorithm;
[0013] According to the structure type and shape size data, a target acquisition point is determined for each structure element of the first image.
[0014] In a possible implementation manner, measuring the structural data of the target acquisition point includes:
[0015] Determine the total number and relative positions of target collection points;
[0016] According to the total number and relative position, the spatial position coordinate data of each target collection point is collected in sequence to obtain the structural data.
[0017] In a possible implementation manner, the spatial position coordinate data of each target collection point is collected in sequence according to the total number and relative position to obtain the structural data, including:
[0018] According to the relative position of the target collection point, the measurement angle of the preset laser rangefinder is adjusted to collect the spatial position coordinate data of the corresponding target collection point;
[0019] According to the total number of the target acquisition points, it is determined whether the spatial position coordinate data of all the target acquisition points have been acquired.
[0020] In a possible implementation, the method further includes:
[0021] The preset laser rangefinder is subjected to measurement and calibration, wherein the measurement and calibration includes origin angle calibration and panoramic view angle calibration.
[0022] In a possible implementation, the generating of the second image of the scene to be tested according to the target collection point and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, includes:
[0023] According to the spatial position coordinate data and the structural type corresponding to the target acquisition point, the three-dimensional floor plan of the house corresponding to the scene to be tested is calculated and drawn, and according to the spatial position coordinate data and the structural type corresponding to the target acquisition point, the plane floor plan corresponding to the scene to be tested is calculated and drawn.
[0024] In a second aspect, an embodiment of the present invention provides a device for determining a house type, comprising:
[0025] An image acquisition module, used to acquire a first image, wherein the first image is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house;
[0026] A target acquisition point determination module, used to determine a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested;
[0027] A measurement control module, used for measuring the structural data of the target acquisition point;
[0028] A floor plan generation module, used to generate a second image of the scene to be tested according to the target collection point and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, and the floor plan includes a three-dimensional floor plan and a plane floor plan;
[0029] A rendering module is used to perform image rendering on the three-dimensional floor plan in combination with the first image to obtain the third image, where the third image is a panoramic three-dimensional floor plan.
[0030] In a possible implementation manner, the target collection point determination module includes:
[0031] An identification unit, configured to identify the structural type of all structural elements in the first image and the shape and size data of each structural element by using a preset identification algorithm;
[0032] The first determining unit is used to determine a target acquisition point for each structural element of the first image according to the structural type and shape size data.
[0033] In a possible implementation, the measurement control module includes:
[0034] A second determination unit is used to determine the total number and relative positions of target collection points;
[0035] The acquisition unit is used to sequentially acquire the spatial position coordinate data of each target acquisition point according to the total number and relative position to obtain the structural data.
[0036] In a possible implementation, the acquisition unit includes:
[0037] The adjusting subunit is used to adjust the measurement angle of the preset laser rangefinder according to the relative position of the target collection point, so as to collect the spatial position coordinate data of the corresponding target collection point;
[0038] The determination subunit is used to determine whether the spatial position coordinate data of all target collection points have been collected according to the total number of the target collection points.
[0039] In a possible implementation, the device further includes:
[0040] The calibration module is used to perform measurement calibration on the preset laser rangefinder, wherein the measurement calibration includes origin angle calibration and panoramic view angle calibration.
[0041] In a possible implementation, the floor plan generation module includes:
[0042] The floor plan generation unit is used to calculate and draw a three-dimensional floor plan of the house corresponding to the scene to be tested according to the spatial position coordinate data and the structure type corresponding to the target collection point, and to calculate and draw a plane floor plan corresponding to the scene to be tested according to the spatial position coordinate data and the structure type corresponding to the target collection point.
[0043] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a processor and a memory, wherein the processor is used to execute a house type determination program stored in the memory to implement the house type determination method described in any one of the first aspects.
[0044] In a fourth aspect, an embodiment of the present invention provides a system, the system comprising a panoramic camera, a laser rangefinder and an electronic device, wherein:
[0045] The panoramic camera is used to capture a first image, which is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house, and transmit the first image to the electronic device;
[0046] The laser rangefinder is used to receive an instruction from the electronic device on measuring the structural data of the target acquisition point, and perform a measurement operation of the structural data of the target acquisition point;
[0047] The electronic device is used to perform the following steps:
[0048] Acquire a first image, where the first image is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house;
[0049] Determining a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested;
[0050] Measuring structural data of the target acquisition point;
[0051] A second image of the scene to be tested is generated according to the target collection points and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, including a three-dimensional floor plan and a plane floor plan.
[0052] The three-dimensional floor plan is rendered in combination with the first image to obtain the third image, where the third image is a panoramic three-dimensional floor plan.
[0053] In a fifth aspect, an embodiment of the present invention provides a storage medium, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the housing type determination method described in any one of the first aspects.
[0054] The technical solution provided by the embodiment of the present invention uses imaging technology and measurement technology to measure the physical space of a house. The measurement accuracy error is small, the operation is simple, and the floor plan can be automatically generated according to the measured structure and structural data, with high efficiency. In addition, by using the laser rangefinder method, the spatial three-dimensional coordinates of all key points in the house are accurately and comprehensively measured to construct the house type. All walls, beams, columns, doors and windows, water and electricity and other structures required for the floor plan can be accurately measured to form a complete floor plan. It is only necessary to fix a certain position in the house (for example, the center of the house), rotate the rangefinder, and measure a few points. All visible positions can be measured, and all required data can be quickly obtained without running around. Use recognition algorithms (such as AI visual recognition technology) to mark collection points (target collection points), and the measurement points (that is, the spatial position coordinate data of the target collection points) to calculate the rules for the structural dimensions of the house are preset in the algorithm, and the house measurement operation When measuring, one only needs to refer to the points marked on the panoramic photo for guidance, and the person measuring does not need to have an in-depth understanding of the measurement rules of the house structure. The threshold for personnel requirements is low, the operation is simple, and it is suitable for all kinds of people to use and can be widely promoted. The measurement data can directly generate a three-dimensional house type without manual drawing. The generated house type can be used directly, eliminating the workload of drawing the house type in the original house measurement process. The house type is generated on-site and can be seen intuitively, and the on-site comparison can be ensured to ensure that the house type measurement is accurate and no details are missed. The panoramic map is attached to the generated house type, and the house type is rendered to directly restore the appearance of the site, so that all the details of the site can be directly seen when the house type design is used later. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] Figure 1 A flow chart of an embodiment of a method for determining a house type provided by an embodiment of the present invention;
[0056] Figure 2 A block diagram of an embodiment of a device for determining a house type provided by an embodiment of the present invention;
[0057] Figure 3 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0058] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0059] In the process of determining the house type in the related art, the process is complicated and inefficient. Usually, manual measurement is performed with a tape measure or a laser rangefinder, which requires running around in the room and is slow. Moreover, the tape measure is inconvenient and prone to errors when measuring long distances or high roofs; handheld laser rangefinders are difficult to measure the dimensions of certain structures, such as columns, beams, and doors; surveyors need to hand-draw a rough floor plan on site first, and then measure and mark the data, which requires high capabilities of surveyors; floor plans cannot be generated on site, and need to be redrawn on the computer after returning, and the on-site sketch and computer-drawn floor plans are repeated twice, which is inefficient; since the complete floor plan is not generated on site, some data may be missed, and the surveyors may supplement the data based on memory when drawing, resulting in inaccurate floor plans; designers often need to combine on-site photos to recall the details of the situation on site when designing floor plans. Photos and floor plans are divided into different files, which is inconvenient to view, and it is difficult to match the location of photos and floor plans; in addition, taking a few single photos on site may not be comprehensive, and some areas may be missed.
[0060] In order to solve the problems in the related art, the present invention proposes a method for determining a house type.
[0061] The following is a further explanation of the housing type determination method provided by the present invention with reference to specific embodiments in conjunction with the accompanying drawings, and the embodiments do not constitute a limitation on the embodiments of the present invention.
[0062] Figure 1 The following is a flow chart of an embodiment of a method for determining a house type provided by an embodiment of the present invention. Figure 1 As shown, a method for determining a house type provided by an embodiment of the present invention is applied to an electronic device and may include the following steps:
[0063] Step 101 , obtaining a first image, wherein the first image is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of a house.
[0064] In an embodiment of the present invention, a panoramic camera can be used to capture a panoramic image of the scene to be tested (i.e., the physical space of the house to be tested) to obtain a first image. The panoramic camera can be connected to an electronic device (e.g., a computer) to transmit the first image to the electronic device so that the electronic device acquires the first image.
[0065] The physical space of a house may include structures composed of walls, windows, doors, stairs, floors, roofs, etc. In the embodiment of the present invention, the above-mentioned structures of the house are defined as structural elements. In order to obtain enough structural elements and truly restore the scene of the house, a panoramic camera is used in the embodiment of the present invention to collect images of the house / scene to be tested.
[0066] Step 102: determine a target acquisition point for each structural element, and the target acquisition point is used to draw the scene to be tested.
[0067] In some embodiments, the structural type of all structural elements in the first image and the shape and size data of each structural element can be identified by a preset recognition algorithm, and then the target acquisition point of each structural element is determined according to the structural type and shape and size data of each structural element. Exemplarily, the structural elements in the first image, such as walls, roofs, floors, doors, etc., are identified by an AI (Artificial Intelligence) algorithm model, and then the acquisition point of each structure to be measured is identified according to the identified structural type and shape and size.
[0068] In an embodiment of the present invention, the principle for selecting the target collection points is as follows: by measuring the spatial coordinate data of the target collection points, the corresponding structural elements can be generated on the floor plan; the preset recognition algorithm can be a recognition model obtained through machine learning training, and the training process and method can refer to the prior art. For the sake of brevity, the present invention will not be repeated here.
[0069] Step 103: measuring the structural data of the target acquisition point.
[0070] The structural data may be, for example, the spatial position coordinate data of any structural element.
[0071] In this example, since there are many structural elements, in order to avoid missing a structural element and complete the measurement and data collection of all structural elements, the total number and relative position of the target collection points can be determined first, and then the spatial position coordinate data of each target collection point can be collected in sequence according to the total number and relative position, so as to obtain the structural data of the target collection points of all structural elements. Exemplarily, all target collection point marks can be displayed on the first image, wherein the target collection points include the data of all structural elements such as roof height, wall, door, window, beam, column, water and electricity required for drawing the floor plan in the room to be measured, and the measurement guide of the pre-set laser rangefinder is formed through these target collection points.
[0072] Furthermore, the measurement angle of the pre-set laser rangefinder can be adjusted according to the relative position of the target collection point to collect the spatial position coordinate data of the corresponding target collection point, and determine whether the spatial position coordinate data of all target collection points have been collected according to the total number of target collection points. For example, there are a total of 10 target collection points, each target collection point is digitally marked, and the relative position of the target collection point is set. The collection angle of the laser rangefinder is adjusted according to the relative position, so as to guide the laser rangefinder to collect data for all target collection points in turn. The laser rangefinder in the embodiment of the present invention is a laser rangefinder with a function of measuring spatial coordinates.
[0073] In some embodiments, in order to improve the accuracy and scene adaptability of the laser rangefinder,
[0074] The pre-set laser rangefinder is measured and calibrated, wherein the measurement calibration includes the origin angle calibration and the panoramic view angle calibration. Exemplarily, after the laser rangefinder is calibrated, you can click to measure at the origin position, and then click at the same position on the panoramic view (first image) displayed on the screen to calibrate the laser ruler angle position and the panoramic view display angle to be consistent, and then perform data measurement: rotate the laser rangefinder, and the panoramic view displayed will rotate synchronously at the same time. According to the instructions marked on the panoramic view (first image), the laser points to the collection point position indicated by the panoramic view, and the spatial position coordinate data of the collection point is measured. According to the instructions, rotate one circle (or the number of collections is greater than or equal to the number of target collection points), that is, the spatial position coordinate data of each collection point to be measured is measured in sequence.
[0075] In order to facilitate the timeliness of data processing and data storage, in an embodiment of the present invention, the spatial position coordinates of each target collection point, such as (x, y, z), can be transmitted back in real time.
[0076] Step 104, generating a second image of the scene to be tested according to the target collection point and the structural data corresponding to each target collection point, wherein the second image is a floor plan of a house, and includes a three-dimensional floor plan and a plane floor plan.
[0077] In some embodiments, a three-dimensional floor plan of a house corresponding to the scene to be tested can be calculated and drawn based on the spatial position coordinate data and the structural type corresponding to the target acquisition point, and a flat floor plan corresponding to the scene to be tested can be calculated and drawn based on the spatial position coordinate data and the structural type corresponding to the target acquisition point.
[0078] Step 105, performing image rendering on the three-dimensional floor plan in combination with the first image to obtain a third image.
[0079] The third image is a panoramic three-dimensional floor plan.
[0080] Generally speaking, after all the target collection points in the house are measured, the size, coordinate position, etc. of each structural element are calculated according to the structural type of each structural element to which the target collection point belongs and the measured spatial position coordinate data, thereby generating a three-dimensional floor plan and a plane floor plan of the house. Furthermore, the photographed panoramic image (first image) is re-mapped onto the three-dimensional floor plan generated by the measurement to generate a three-dimensional floor plan with a panoramic image.
[0081] It is understandable that if the house has multiple spaces, move to the next room for measurement, repeat the above steps, complete the measurement of all rooms, and use a unified coordinate system to stitch all the measured room layouts into a complete floor plan. If two adjacent rooms share a wall, the distance between the two walls of the two adjacent rooms is calculated based on the coordinate information as the wall thickness. Other walls are the system default wall thickness.
[0082] In the embodiment of the present invention, a manual modification operation is provided, and the designer can manually input the data to be modified. For example, after the floor plan is generated, the wall thickness data can be manually modified.
[0083] In other embodiments, a floor plan saving function is provided for saving floor plans. Floor plans can be exported into multiple formats and can be saved locally or uploaded to the cloud. The saved floor plans can be directly opened with design software to design decoration plans, which facilitates the use and search of floor plans in the future.
[0084] In addition, the embodiment of the present invention also provides for adding scene information, so that the basic information of the scene to be measured can be associated with the later generated floor plan and / or the relevant data of the measured structural elements, etc., to facilitate data search and tracing. Exemplarily, before starting the measurement, a measurement plan is established, and the basic information of the measured house is entered, such as the address, community, house number, customer name, contact information, room type, and other information of the house.
[0085] The technical solution provided by the embodiment of the present invention uses imaging technology and measurement technology to measure the physical space of a house. The measurement accuracy error is small, the operation is simple, and the floor plan can be automatically generated according to the measured structure and structural data, with high efficiency. In addition, by using the laser rangefinder method, the spatial three-dimensional coordinates of all key points in the house are accurately and comprehensively measured to construct the house type. All walls, beams, columns, doors and windows, water and electricity and other structures required for the floor plan can be accurately measured to form a complete floor plan. It is only necessary to fix a certain position in the house (for example, the center of the house), rotate the rangefinder, and measure a few points. All visible positions can be measured, and all required data can be quickly obtained without running around. Use recognition algorithms (such as AI visual recognition technology) to mark collection points (target collection points), and the measurement points (that is, the spatial position coordinate data of the target collection points) to calculate the rules for the structural dimensions of the house are preset in the algorithm, and the house measurement operation When measuring, one only needs to refer to the points marked on the panoramic photo for guidance, and the person measuring does not need to have an in-depth understanding of the measurement rules of the house structure. The threshold for personnel requirements is low, the operation is simple, and it is suitable for all kinds of people to use and can be widely promoted. The measurement data can directly generate a three-dimensional house type without manual drawing. The generated house type can be used directly, eliminating the workload of drawing the house type in the original house measurement process. The house type is generated on-site and can be seen intuitively, and the on-site comparison can be ensured to ensure that the house type measurement is accurate and no details are missed. The panoramic map is attached to the generated house type, and the house type is rendered to directly restore the appearance of the site, so that all the details of the site can be directly seen when the house type design is used later.
[0086] The embodiment of the present invention also provides an apparatus embodiment corresponding to the aforementioned method embodiment. The technical implementation principle, logic, technical problem solved, and technical solution of the apparatus embodiment are the same as those of the method embodiment. For the sake of brevity, the specific implementation principle of the apparatus embodiment is not described in detail. The apparatus embodiment is described below in conjunction with the accompanying drawings.
[0087] Figure 2 The following is a block diagram of an embodiment of a device for determining a house type according to an embodiment of the present invention. Figure 2 As shown, a housing type determination device provided by an embodiment of the present invention may include: an image acquisition module 21, a target acquisition point determination module 22, a measurement control module 23, a housing type diagram generation module 24, and a rendering module 25. Among them:
[0088] The image acquisition module 21 may be used to acquire a first image, wherein the first image is a panoramic image and includes all structural elements of a scene to be measured, wherein the scene to be measured is a physical space of the house;
[0089] The target acquisition point determination module 22 may be used to determine a target acquisition point for each structural element, and the target acquisition point is used to draw the scene to be tested;
[0090] The measurement control module 23 can be used to measure the structural data of the target acquisition point;
[0091] The floor plan generation module 24 can be used to generate a second image of the scene to be tested according to the target collection points and the structural data corresponding to each target collection point, and the second image is a floor plan of the house, including a three-dimensional floor plan and a plane floor plan.
[0092] The rendering module 25 can be used to perform image rendering on the three-dimensional floor plan in combination with the first image to obtain the third image, where the third image is a panoramic three-dimensional floor plan.
[0093] In some embodiments, the target collection point determination module 22 may further include:
[0094] an identification unit (not shown in the figure), configured to identify the structural type of all structural elements in the first image and the shape and size data of each structural element by using a preset identification algorithm;
[0095] The first determining unit (not shown in the figure) is used to determine a target acquisition point for each structural element of the first image according to the structural type and shape size data.
[0096] In some embodiments, the measurement control module 23 may include:
[0097] A second determination unit (not shown in the figure) is used to determine the total number and relative positions of target collection points;
[0098] The acquisition unit (not shown in the figure) is used to sequentially acquire the spatial position coordinate data of each target acquisition point according to the total number and relative position to obtain the structural data.
[0099] Furthermore, the acquisition unit (not shown in the figure) may include:
[0100] An adjustment subunit (not shown in the figure) is used to adjust the measurement angle of the preset laser rangefinder according to the relative position of the target collection point to collect the spatial position coordinate data of the corresponding target collection point;
[0101] The determination subunit (not shown in the figure) is used to determine whether the spatial position coordinate data of all target collection points have been collected according to the total number of the target collection points.
[0102] In some embodiments, the device provided by the present invention may further include a calibration module (not shown in the figure), wherein the calibration module can be used to perform measurement calibration on the pre-set laser rangefinder, wherein the measurement calibration includes origin angle calibration and panoramic view angle calibration.
[0103] In some embodiments, the floor plan generation module 24 may include:
[0104] The floor plan generation unit (not shown in the figure) is used to calculate and draw a three-dimensional floor plan of the house corresponding to the scene to be tested based on the spatial position coordinate data and structure type corresponding to the target collection point, and to calculate and draw a flat floor plan corresponding to the scene to be tested based on the spatial position coordinate data and structure type corresponding to the target collection point.
[0105] The technical solution provided by the embodiment of the present invention uses imaging technology and measurement technology to measure the physical space of a house. The measurement accuracy error is small, the operation is simple, and the floor plan can be automatically generated according to the measured structure and structural data, with high efficiency. In addition, by using the method of a laser rangefinder, the spatial three-dimensional coordinates of all key points in the house are accurately and comprehensively measured to construct a floor plan. All walls, beams, columns, doors and windows, water and electricity, and other structures required for the floor plan can be accurately measured to form a complete floor plan. Moreover, it is only necessary to rotate the rangefinder and measure a few points in a fixed position in the house (for example, the center of the house). All visible positions can be measured, and all required data can be quickly obtained without running around. The recognition algorithm (for example, AI visual recognition technology) is used to mark the collection points (target collection points), and the measurement point positions (that is, the spatial position coordinate data of the target collection points) are used to calculate the rules for the structural dimensions of the house. The house measurement operation is preset in the algorithm. When measuring, one only needs to refer to the points marked on the panoramic photo for guidance, and the person measuring does not need to have an in-depth understanding of the measurement rules of the house structure. The threshold for personnel requirements is low, the operation is simple, and it is suitable for all kinds of people to use and can be widely promoted. The measurement data can directly generate a three-dimensional house type without manual drawing. The generated house type can be used directly, eliminating the workload of drawing the house type in the original house measurement process. The house type is generated on-site and can be seen intuitively, and the on-site comparison can be ensured to ensure that the house type measurement is accurate and no details are missed. The panoramic map is attached to the generated house type, and the house type is rendered to directly restore the appearance of the site, so that all the details of the site can be directly seen when the house type design is used later.
[0106] The present invention also provides a system for determining a house type, which may include a panoramic camera, a laser rangefinder and an electronic device, wherein the panoramic camera is used to capture a first image, which is a panoramic picture and includes all structural elements of a scene to be measured, and the scene to be measured is the physical space of the house, and the first image is transmitted to the electronic device; wherein the panoramic camera may include a conventional panoramic camera, a mobile phone, a tablet, an ordinary camera, a video camera and any type of photographic device that can synthesize a panoramic picture. The laser rangefinder is used to receive instructions from the electronic device regarding measuring the structural data of the target collection point, and to perform measurement operations on the structural data of the target collection point; wherein the laser rangefinder includes a rangefinder with a built-in sensor that can directly measure three-dimensional coordinates; and an external sensor, an ordinary rangefinder and a sensor assembly, which can combine data to obtain three-dimensional coordinates. The laser rangefinder measures and collects data in a manner that includes manual measurement, remote control rotation of the laser ruler, or program-set automatic measurement. The electronic device is used to perform such as Figure 1 Relevant steps of the relevant embodiments shown. In other embodiments, a bracket may also be included for supporting a panoramic camera, a laser rangefinder and / or an electronic device. When the measurement starts, the measuring equipment is fixedly set up in the middle of the house to be measured (the scene to be measured), wherein the whole set of equipment includes, for example, a panoramic camera, a laser rangefinder with a function of measuring spatial coordinates, an electronic device, and a bracket. It can be understood that the electronic device can be in the same space as the panoramic camera, etc., for example, it can be carried by the designer at the scene to be measured, or it can be set at a remote end, and communicate with the panoramic camera, laser rangefinder and other equipment through the network to obtain the data detected by the panoramic camera, laser rangefinder and the like.
[0107] Figure 3 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, Figure 3 The electronic device 300 shown includes: at least one processor 301, a memory 302, at least one network interface 304 and other user interfaces 303. The various components in the electronic device 300 are coupled together via a bus system 305. It is understood that the bus system 305 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 305 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 305 is not described in detail. Figure 3 Various buses are labeled as bus system 305 .
[0108] The user interface 303 may include a display, a keyboard or a pointing device (eg, a mouse, a trackball), a touch pad or a touch screen.
[0109] It can be understood that the memory 302 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (DRRAM). The memory 302 described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0110] In some implementations, the memory 302 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 3021 and an application program 3022 .
[0111] The operating system 3021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 3022 includes various application programs, such as a media player (MediaPlayer), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application 3022.
[0112] In the embodiment of the present invention, by calling the program or instruction stored in the memory 302, specifically, the program or instruction stored in the application 3022, the processor 301 is used to execute the method steps provided in each method embodiment, for example Figure 1 The steps of the relevant embodiment are shown.
[0113] The method disclosed in the above embodiment of the present invention can be applied to the processor 301, or implemented by the processor 301. The processor 301 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 301 or the instruction in the form of software. The above processor 301 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 302, and the processor 301 reads the information in the memory 302 and completes the steps of the above method in combination with its hardware.
[0114] It is understood that the embodiments described herein can be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application or a combination thereof.
[0115] For software implementation, the technology described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.
[0116] The electronic device provided in this embodiment may be Figure 3The electronic device shown in FIG. 1 may perform the following steps: Figure 1 All steps of the method for determining the house type in the Figure 1 For details, please refer to the technical effect of the method for determining the house type in Figure 1 For the sake of brevity, the relevant description is not repeated here.
[0117] The embodiment of the present invention also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.
[0118] When one or more programs in the storage medium can be executed by one or more processors, the above-mentioned method for determining the house type executed on the electronic device side can be implemented.
[0119] The processor is used to execute the house type determination program stored in the memory to implement the following house type determination method executed on the electronic device side: Figure 1 The steps of the relevant embodiment are shown.
[0120] The professionals should further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0121] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0122] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.
Claims
1. A method for determining a house type, It is characterized in that include: Acquire a first image, where the first image is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house; Determine a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested; Measuring structural data of the target acquisition point; Generate a second image of the scene to be tested according to the target collection point and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, and the floor plan includes a three-dimensional floor plan and a plane floor plan; Performing image rendering on the three-dimensional floor plan in combination with the first image to obtain a third image, wherein the third image is a panoramic three-dimensional floor plan; The step of determining a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested, includes: Identify the structural type of all structural elements in the first image and the shape and size data of each structural element by using a preset recognition algorithm; Determining a target acquisition point for each structural element of the first image according to the structural type and shape size data; The principle for selecting the target collection points is as follows: by measuring the spatial coordinate data of the target collection points, the corresponding structural elements can be generated on the floor plan.
2. The method according to claim 1, It is characterized in that The measuring the structural data of the target acquisition point includes: Determine the total number and relative positions of target collection points; According to the total number and relative position, the spatial position coordinate data of each target collection point is collected in sequence to obtain the structural data.
3. The method according to claim 2, It is characterized in that The step of sequentially collecting spatial position coordinate data of each target collection point according to the total number and relative position to obtain the structural data includes: According to the relative position of the target collection point, the measurement angle of the preset laser rangefinder is adjusted to collect the spatial position coordinate data of the corresponding target collection point; According to the total number of the target acquisition points, it is determined whether the spatial position coordinate data of all the target acquisition points have been acquired.
4. The method according to claim 3, It is characterized in that The method further comprises: The preset laser rangefinder is subjected to measurement and calibration, wherein the measurement and calibration includes origin angle calibration and panoramic view angle calibration.
5. The method according to claim 2, It is characterized in that The step of generating a second image of the scene to be tested according to the target collection point and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, comprises: According to the spatial position coordinate data and the structural type corresponding to the target acquisition point, the three-dimensional floor plan of the house corresponding to the scene to be tested is calculated and drawn, and according to the spatial position coordinate data and the structural type corresponding to the target acquisition point, the plane floor plan corresponding to the scene to be tested is calculated and drawn.
6. A device for determining a house type, It is characterized in that include: An image acquisition module, used to acquire a first image, wherein the first image is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house; A target acquisition point determination module, used to determine a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested; A measurement control module, used for measuring the structural data of the target acquisition point; A floor plan generation module, used to generate a second image of the scene to be tested according to the target collection point and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, and the floor plan includes a three-dimensional floor plan and a plane floor plan; A rendering module, used for performing image rendering on the three-dimensional floor plan in combination with the first image to obtain a third image, wherein the third image is a panoramic three-dimensional floor plan; wherein the target acquisition point is determined for each structural element, and the target acquisition point is used to draw the scene to be tested, including: Identify the structural type of all structural elements in the first image and the shape and size data of each structural element by using a preset recognition algorithm; Determining a target acquisition point for each structural element of the first image according to the structural type and shape size data; The principle for selecting the target collection points is as follows: by measuring the spatial coordinate data of the target collection points, the corresponding structural elements can be generated on the floor plan.
7. An electronic device, It is characterized in that include: A processor and a memory, wherein the processor is used to execute a house type determination program stored in the memory to implement the house type determination method according to any one of claims 1 to 5.
8. A system for determining house type, It is characterized in that The system includes a panoramic camera, a laser rangefinder and electronic equipment, wherein: The panoramic camera is used to capture a first image, which is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house, and transmit the first image to the electronic device; The laser rangefinder is used to receive an instruction from the electronic device regarding measuring the structural data of a target acquisition point, and execute a measurement operation of the structural data of the target acquisition point; The electronic device is used to perform the following steps: Acquire a first image, where the first image is a panoramic image and includes all structural elements of a scene to be measured, and the scene to be measured is a physical space of the house; Determine a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested; Measuring structural data of the target acquisition point; Generate a second image of the scene to be tested according to the target collection point and the structural data corresponding to each target collection point, wherein the second image is a floor plan of the house, and the floor plan includes a three-dimensional floor plan and a plane floor plan; Performing image rendering on the three-dimensional floor plan in combination with the first image to obtain a third image, wherein the third image is a panoramic three-dimensional floor plan; The step of determining a target acquisition point for each structural element, wherein the target acquisition point is used to draw the scene to be tested, includes: Identify the structural type of all structural elements in the first image and the shape and size data of each structural element by using a preset recognition algorithm; Determining a target acquisition point for each structural element of the first image according to the structural type and shape size data; The principle for selecting the target collection points is as follows: by measuring the spatial coordinate data of the target collection points, the corresponding structural elements can be generated on the floor plan.
9. A storage medium, It is characterized in that The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the housing type determination method according to any one of claims 1 to 5.
Citation Information
Patent Citations
A panoramic roaming method for online home furnishings
CN109461210A
Building method and building device of house type drawing and storage medium
CN111127655A