Three-dimensional model generation method, device and storage medium

Abstract

The present disclosure is about a three-dimensional model generation method, device and storage medium; wherein the method is applied to a mobile terminal, including: when capturing images of an object from different angles, emitting radar waves and detecting the echo of the radar waves; determining the feedback parameters collected at each acquisition angle according to the emission parameters of the radar waves and the echo parameters of the echoes; and constructing a three-dimensional model of the object according to the feedback parameters of each acquisition angle. In this way, the three-dimensional model of the object can be constructed during the shooting process through radar waves, enriching the application scenarios of the mobile terminal and improving the user experience.

Description

Technical Field

[0001] The present disclosure relates to the field of information processing, and in particular to a three-dimensional model generation method, device and storage medium. Background Art

[0002] With the popularity of mobile terminals, there are more and more scenarios for using mobile terminals. With the image acquisition function, mobile terminals can take pictures of objects anytime and anywhere, thus meeting the needs of various image-based applications. However, the image acquisition function of current mobile terminals can only capture flat images of objects, resulting in a relatively single usage scenario for mobile terminals in shooting and a low user experience. Summary of the invention

[0003] The present invention provides a three-dimensional model generation method, device and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, a three-dimensional model generation method is provided, which is applied to a mobile terminal, and the method includes:

[0005] When capturing images of an object from different angles, emitting radar waves and detecting echoes of the radar waves;

[0006] Determining feedback parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo;

[0007] A three-dimensional model of the object is constructed according to the feedback parameters of each acquisition angle.

[0008] Optionally, the feedback parameters include: distance parameters and profile parameters;

[0009] The step of determining the feedback parameters collected at each collection angle according to the emission parameters of the radar wave and the echo parameters of the echo includes:

[0010] Determining the distance parameters collected at each collection angle according to the emission parameters of the radar wave and the echo parameters of the echo;

[0011] Based on the multiple distance parameters, contour parameters of the object are determined.

[0012] Optionally, constructing the three-dimensional model of the object according to the feedback parameters of each acquisition angle includes:

[0013] Determining the three-dimensional structure of the object according to the profile parameters at each acquisition angle;

[0014] The surface texture of the three-dimensional structure is rendered based on the plane images at various acquisition angles to obtain a three-dimensional model of the object.

[0015] Optionally, the method further comprises:

[0016] Determining a collection trajectory when collecting images of the object;

[0017] The step of constructing the three-dimensional model of the object according to the feedback parameters of each acquisition angle further includes:

[0018] According to the acquisition trajectory, the feedback parameters of each acquisition angle are synthesized to obtain a three-dimensional model of the object.

[0019] Optionally, determining a collection trajectory when collecting images of the object includes:

[0020] A collection trajectory when collecting images of the object is determined based on the acceleration sensor.

[0021] According to a second aspect of an embodiment of the present disclosure, there is provided a three-dimensional model generating device, comprising:

[0022] A transceiver module, used to transmit radar waves and detect echoes of the radar waves when capturing images of an object from different angles;

[0023] A determination module, used to determine the feedback parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo;

[0024] A construction module is used to construct a three-dimensional model of the object according to the feedback parameters of each acquisition angle.

[0025] Optionally, the feedback parameters include: distance parameters and profile parameters;

[0026] The determining module comprises:

[0027] A distance determination module, used to determine the distance parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo;

[0028] The contour determination module is used to determine the contour parameters of the object based on the multiple distance parameters.

[0029] Optionally, the building block includes:

[0030] A structure determination module, used to determine the three-dimensional structure of the object according to the contour parameters at each acquisition angle;

[0031] A rendering module is used to perform surface texture rendering on the three-dimensional structure based on the plane images acquired at various angles to obtain a three-dimensional model of the object.

[0032] Optionally, the device further comprises:

[0033] A trajectory acquisition module, used to determine an acquisition trajectory when acquiring images of the object;

[0034] The building block further includes:

[0035] A synthesis module is used to synthesize the feedback parameters of each acquisition angle according to the acquisition trajectory to obtain a three-dimensional model of the object.

[0036] Optionally, the trajectory collection module includes:

[0037] The trajectory acquisition submodule is used to determine the acquisition trajectory when acquiring images of the object based on the acceleration sensor.

[0038] According to a third aspect of an embodiment of the present disclosure, there is provided a three-dimensional model generating device, comprising:

[0039] processor;

[0040] a memory for storing processor-executable instructions;

[0041] The processor is configured to: implement any one of the methods described in the first aspect above when executing the executable instructions stored in the memory.

[0042] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of the above-mentioned three-dimensional model generation device, the three-dimensional model generation device is enabled to execute any method described in the above-mentioned first aspect.

[0043] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0044] When capturing images of an object from different angles, by emitting radar waves and detecting the echoes of the radar waves, the feedback parameters collected at each acquisition angle can be determined based on the emission parameters and the echo parameters; and then the three-dimensional model of the object is constructed based on the feedback parameters obtained at each acquisition angle. In this way, by emitting radar waves during shooting, the three-dimensional model of the object is constructed using the feedback parameters fed back by the radar waves, which enriches the application scenarios of mobile terminals and allows users to directly obtain the three-dimensional model of the object by shooting, greatly improving the user's shooting experience.

[0045] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0047] Figure 1 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 1 .

[0048] Figure 2 is a schematic diagram of a mobile terminal equipped with a radar component according to an exemplary embodiment.

[0049] Figure 3 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 2 .

[0050] Figure 4 A schematic diagram of photographing an object and emitting radar waves at different acquisition angles.

[0051] Figure 5 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 3 .

[0052] Figure 6 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 4 .

[0053] Figure 7 The figure is a structural diagram of a three-dimensional model generating device according to an exemplary embodiment.

[0054] Figure 8 The invention is a block diagram of a 3D model generating device according to an exemplary embodiment. DETAILED DESCRIPTION

[0055] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0056] In real life, the three-dimensional model of an object plays an extremely important role in many scenarios. For example, in the sale of an object, if the user can see the three-dimensional model of the object, the user can understand the information of the object more intuitively, which is conducive to the user's choice. There are many ways to obtain the three-dimensional model of an object, but most of them are to directly measure the three-dimensional information of the object, and then depict the three-dimensional model of the object based on the obtained three-dimensional information, or to determine the three-dimensional model of the object through various parameters of the image acquisition device (for example, the focal length of the camera) combined with the parameters of the acquired plane image. None of these methods can establish a three-dimensional model of the object during shooting. If the three-dimensional model of the object is established during the shooting process, the three-dimensional information of the object can be intuitively seen during shooting, which increases the shooting experience.

[0057] In order to establish a three-dimensional model of an object during shooting and improve the shooting experience, the present disclosure provides a three-dimensional model generation method. Figure 1 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 1 ,like Figure 1 As shown, the method is used in a mobile terminal and comprises the following steps:

[0058] Step 101, when collecting images of an object from different angles, emitting radar waves and detecting echoes of the radar waves;

[0059] Step 102, determining feedback parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo;

[0060] Step 103: construct a three-dimensional model of the object according to the feedback parameters of each acquisition angle.

[0061] It should be noted that the mobile terminal is an electronic device with image acquisition and image display functions, such as a smart phone, a laptop, a tablet computer or a wearable electronic device, etc. The mobile terminal is equipped with an image acquisition component and an image display component; the image acquisition component includes: a camera and a camera, and the image display component includes: a display screen.

[0062] It should also be noted that, since the mobile terminal needs to transmit radar waves and receive echoes of the radar waves, a radar component needs to be installed on the mobile terminal. The radar component includes: a transmitter, a transmitting antenna, a receiver and a receiving antenna; here, the transmitting antenna and the receiving antenna can be the same antenna or different antennas. When the transmitting antenna and the receiving antenna are the same antenna, the antenna is connected to the transmitter and the receiver at the same time. When the transmitting antenna and the receiving antenna are different antennas, the transmitting antenna is connected to the transmitter and the receiving antenna is connected to the receiver. The transmitting antenna is used to transmit radar waves, and the receiving antenna is used to receive echoes.

[0063] Figure 2 is a schematic diagram of a mobile terminal with a radar component according to an exemplary embodiment. Figure 2 As shown, two radar components may be provided on the mobile terminal, such as a front radar component placed on the display screen of the mobile terminal and a rear radar component placed on the surface of the mobile terminal opposite to the display screen.

[0064] Here, in step 101, when capturing images of the object from different angles, emitting radar waves and detecting the echo of the radar waves may be: after the image capture component in the mobile terminal is turned on, based on the triggering of the shooting button of the image capture component, emitting radar waves and detecting the echo of the radar waves. It may also be: in the process of image capture, periodically emitting radar waves and detecting the echo of the radar waves. For the implementation method of periodically emitting radar waves and detecting the echo of the radar waves, the time of emitting radar waves closest to the time of triggering the shooting button of the image capture component may be first determined, and the feedback parameters collected at each acquisition angle may be determined based on the emission parameters and echo parameters corresponding to the determined time, thereby realizing the construction of a three-dimensional model of the object.

[0065] The three-dimensional model consists of a three-dimensional structure and surface texture features. The three-dimensional structure is used to characterize the three-dimensional spatial structural features of the object, which can be characterized by the three-dimensional coordinate information of the object; the surface texture features are generally obtained by a camera and reflect the color or material characteristics of the object.

[0066] The transmission parameters of the radar wave include: transmission angle, transmission time and transmission position, etc.; the echo parameters of the echo include: reception angle, reception time and reception position, etc. The transmission angle here refers to the radiation angle of the transmitting antenna of the radar component; the radar wave is effective only within the transmission angle. The transmission position refers to the current location of the mobile terminal.

[0067] The feedback parameters include: distance parameters or contour parameters. The distance parameter refers to the distance between the object and the mobile terminal. The contour parameters include: outer contour parameters; the outer contour parameters refer to the information contained in the outer edge lines of the object, which contain the general morphological features of an object. The outer contour parameters can be represented by the information of the outer surface of the object or points on the outer surface.

[0068] The acquisition angle may be any angle included in the rotation after selecting a reference direction on each horizontal plane and taking the reference direction as the starting point.

[0069] The feedback parameters collected at each collection angle are determined based on the transmission parameters of the radar wave and the echo parameters of the echo, including: based on the transmission time, receiving time and transmission rate of the radar wave collected at each collection angle, the specific distance between each surface or contour point of the object and the mobile terminal can be determined, that is, the distance parameters are obtained, and then the contour parameters of the object can be determined based on the distance parameters.

[0070] In some embodiments, the contour point may be: when there are multiple acquisition angles, the point included in the contour of the shape presented by the object at each acquisition angle. For example, for a cone object, in some acquisition directions, the shape presented is a triangle, and the contour point refers to the point included in the contour of the triangle in the acquisition direction.

[0071] It should be noted that when the object is a regular shape, after each shooting based on a collection angle, the distance between the surface of the object closest to the mobile terminal at the collection angle and the mobile terminal can be obtained. When the object is an irregular shape, since each collection angle will not correspond to a complete plane of the object, the distance between the contour point and the mobile terminal can be determined at this time. There are differences in the contour points corresponding to each collection angle. If the object is shot at different angles on the same horizontal plane, the distance between the point on the outer contour of the object on the same horizontal plane and the mobile terminal can be obtained. In this way, by changing the horizontal plane and the collection angle on the horizontal plane, the contour parameters of the entire object can be determined. For example, if the object is a cube, when shooting is performed in front of one face of the cube, the distance between the face and the mobile terminal can be determined. If shooting is performed at the diagonal position of the cube, since it will not correspond to a plane of the object, the distance between the object and the mobile terminal can be determined by the contour point; that is, in the cube, the point on the vertical side closest to the mobile cube is the contour point.

[0072] Furthermore, after obtaining the contour parameters, the three-dimensional structure of the object can be restored in combination with the acquisition angle. Here, knowing the three-dimensional structure of the object means determining the entire structure of the object. On this basis, if the surface texture of the three-dimensional structure is further rendered, the three-dimensional model of the object can be obtained.

[0073] In the disclosed embodiment, when capturing images of an object from different angles, by emitting radar waves and detecting the echoes of the radar waves, the feedback parameters collected at each acquisition angle can be determined based on the emission parameters and the echo parameters; and then a three-dimensional model of the object can be constructed based on the feedback parameters of each acquisition angle. In this way, by emitting radar waves during shooting, the parameters fed back by the radar waves can be used to construct a three-dimensional model of the object, enriching the application scenarios of the mobile terminal, and allowing the user to directly obtain the three-dimensional model of the object by shooting, greatly improving the shooting experience.

[0074] In some embodiments, the disclosed embodiments further provide a three-dimensional model generation method, wherein the feedback parameters include: distance parameters and contour parameters. That is, according to the emission parameters of the radar wave and the echo parameters of the echo, the distance parameters and contour parameters of the object collected at each collection angle can be determined.

[0075] As mentioned above, the distance parameter includes: a distance value, specifically, the distance between the object and the mobile terminal. The contour parameter includes: an outer contour parameter; the outer contour parameter refers to the information contained in the outer edge line of the object located on the radar wave transmission path, including the general morphological features of an object.

[0076] Based on the distance parameter and the contour parameter included in the feedback parameter, the embodiment of the present disclosure further provides a three-dimensional model generation method, Figure 3 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 2 ,like Figure 3 As shown, in the three-dimensional model generation method, the step 102 of determining the feedback parameters collected at each collection angle according to the emission parameters of the radar wave and the echo parameters of the echo includes:

[0077] Step 1021, determining the distance parameters collected at each collection angle according to the emission parameters of the radar wave and the echo parameters of the echo;

[0078] Step 1022: Determine the contour parameters of the object based on the multiple distance parameters.

[0079] Here, the method of obtaining the distance parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo may include: obtaining the time taken from the time when the radar wave is transmitted to the time when the echo is received; based on the time taken and the speed of light, obtaining the distance value of each surface or contour point of the object from the mobile terminal. The time taken can be determined by the time when the transmitter of the radar component transmits the radar wave and the time when the receiver of the radar component receives the echo. As described above, the contour point can be: when there are multiple collection angles, the point contained in the contour of the shape presented by the object at each collection angle.

[0080] Since the contour parameters include: outer contour parameters. In one embodiment, the outer contour parameters may be the coordinate values ​​of each point on the outer edge line of the object, and the approximate shape of the object may be determined based on the coordinate values ​​of each point. For example, assuming that the object is a car model, it may be determined that the car model is generally a cuboid based on the contour parameters of the car model.

[0081] Determining the contour parameters of the object based on the multiple distance parameters includes: determining the surface or contour point of the object corresponding to each distance parameter, and determining the contour parameters of the object based on the distance parameters corresponding to the multiple surfaces or contour points and the position of the mobile terminal. Here, since the distance parameter between the object and the mobile terminal is determined based on two points, one of the points can be determined as the location of the mobile terminal, specifically the location of the radar component in the mobile terminal, and the other point is the object. Since the object can be considered to be composed of a dot matrix, as the acquisition angle is different each time the object is photographed, it can be considered that there are differences in the reflection points of the radar wave of the object each time. Here, it should be noted that when the object is of a regular shape and is located in the positive direction of the object to emit radar waves, the reflection point can be considered to be any point on a reflection surface of the object, or all points.

[0082] In this way, after determining the surface or contour point corresponding to each distance parameter at each acquisition angle, the contour parameters of the object can be determined by combining the distance between the surface or contour point and the mobile terminal and the position parameter of the mobile terminal.

[0083] It should be noted that, assuming that the object is a regular shape, such as a cube, then by taking pictures at different angles, the distances between different faces of the cube and the mobile terminal can be obtained, and the length, width and height of the object can be determined by the distances measured at different angles; in this way, the outline of the object can be restored. Here, the distances between the different faces of the cube and the mobile terminal can be characterized by the distances between the central contour points on different faces of the cube and the mobile terminal. Assuming that the object is not a regular shape, such as a cone, then by taking pictures at different angles, the distances between different contour points and the mobile terminal can be obtained, and the thickness of the object in all directions can be determined by the distances at different angles; in this way, the outline of the object can also be restored.

[0084] Here, for irregular shapes, since the contour points corresponding to each acquisition angle are different, if the object is photographed at different angles on the same horizontal plane, the distance between the points on the outer contour of the object on the same horizontal plane and the mobile terminal can be obtained. In this way, the contour parameters of the entire object can be determined by changing the horizontal plane and the acquisition angle on the horizontal plane.

[0085] In the disclosed embodiment, by transmitting radar waves, the distance parameters of the object can be obtained based on the transmission parameters of the radar waves and the echo parameters of the echoes; and then the contour parameters of the object can be determined according to the distance parameters determined by multiple acquisition angles. In this way, the distance between each surface or contour point of the object and the mobile terminal can be obtained during the shooting process, and the contour of the object can be restored based on this distance. The collection of the object contour can be completed during the shooting process, which is convenient for users to understand the information of the object more clearly during shooting, which is conducive to improving the user experience.

[0086] Figure 4 The schematic diagram is for photographing an object at different acquisition angles and emitting radar waves, such as Figure 4 As shown, the operation of collecting images of an object from four collection angles is shown. Figure 4 In the example, the first acquisition angle may be directly to the left of the object, the second acquisition angle may be directly above the object, the third acquisition angle may be directly to the right of the object, and the fourth acquisition angle may be directly below the object. Here, by acquiring directly above the object, the distance between the upper plane of the object and the mobile terminal can be obtained. Correspondingly, by acquiring directly below the object, the distance between the lower plane of the object and the mobile terminal can be obtained. Then, based on the position of the mobile terminal and the distance from the mobile terminal on and below the object, the height of the object can be determined. Similarly, by acquiring from the left and right sides, the width of the object can be determined. By acquiring from the front and back sides, the length of the object can be determined.

[0087] In some embodiments, Figure 5 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 3 ,like Figure 5 As shown, the step 103 of constructing the three-dimensional model of the object according to the feedback parameters of each acquisition angle includes:

[0088] Step 1031, determining the three-dimensional structure of the object according to the contour parameters at each acquisition angle;

[0089] Step 1032: Render the surface texture of the three-dimensional structure based on the planar images acquired at various angles to obtain a three-dimensional model of the object.

[0090] Here, the three-dimensional structure of the object refers to the three-dimensional frame of the object without the surface texture. The determining the three-dimensional structure of the object according to the contour parameters of each acquisition angle includes: determining the outer contour information of the outer surface of the object according to the contour parameters of each acquisition angle, combining the contour information of each outer surface, and obtaining the three-dimensional structure of the object. The outer contour information of the outer surface includes: the position information of the outer edge contained in the outer surface. Taking the object as a cube as an example, the outer contour information of the outer surface is the position information of the four edges of each of the six outer surfaces of the cube.

[0091] The plane images of each acquisition angle can be directly acquired through the image acquisition component in the mobile terminal. The plane image is the image presented on the mobile terminal display screen when the image acquisition component is currently used for acquisition, reflecting the mapping set of points on the object under illumination at a certain acquisition angle. The plane image reflects the surface texture characteristics of the object. The surface texture characteristics are a kind of visual characteristics that reflect the structural organization and arrangement properties of the surface of the object.

[0092] Then, after obtaining the three-dimensional structure of the object, the surface texture of the three-dimensional structure is rendered from the plane images collected at various angles, so as to obtain a complete three-dimensional model of the object. The three-dimensional model is the three-dimensional structure information including the color and material information of the object.

[0093] In this way, after determining the overall frame of the object based on the contour parameters of each acquisition angle, the overall frame is subjected to surface texture rendering based on the texture features obtained in the plane image, and the three-dimensional model of the object can be obtained. This method of obtaining texture features based on plane images and obtaining three-dimensional structures based on radar waves can obtain the three-dimensional model of the object directly during shooting, which is convenient and fast.

[0094] In some embodiments, the method further comprises:

[0095] Step 104: determine a capture trajectory when capturing images of the object.

[0096] Here, the acquisition trajectory is composed of the acquisition orientation corresponding to the acquisition angle. That is, the acquisition orientation specifically refers to the acquisition angle of the image acquisition component of the mobile terminal at each position point. The position point refers to the current position of the mobile terminal, and each position point may correspond to an acquisition angle for acquiring the object. For example, the front of the object belongs to a position point, and the rear camera of the mobile terminal may be facing the object in front of it. At this time, the acquisition orientation is the front of the object.

[0097] In practical applications, determining the acquisition trajectory when acquiring images of the object may include: determining the acquisition time corresponding to each acquisition angle, and determining the acquisition trajectory when acquiring images of the object based on the order of the acquisition times. Figure 4 As shown, by moving the mobile terminal in time sequence and shooting one circle around the mobile terminal, a circular collection track can be obtained.

[0098] The step of constructing the three-dimensional model of the object according to the feedback parameters of each acquisition angle further includes:

[0099] According to the acquisition trajectory, the feedback parameters of each acquisition angle are synthesized to obtain a three-dimensional model of the object.

[0100] As described above, after determining the acquisition trajectory, the corresponding feedback parameters can be determined according to the sequence of the trajectory, and then the feedback parameters are synthesized to obtain a three-dimensional model of the object. For example, taking the object as a cube as an example, if the object is photographed directly in front of the six faces of the cube, the feedback parameters corresponding to each face can be obtained, and then the feedback parameters of the six faces are synthesized to obtain the cube. Here, still taking the object as a cube as an example, if a collection angle is added in addition to the collection angle directly in front of the six faces of the cube, the information of the collection angle can further supplement the information of the six faces, so as to achieve a more complete restoration of the three-dimensional model of the object.

[0101] Here, by collecting the trajectory and synthesizing the feedback parameters of each collection angle to obtain the three-dimensional model of the object, the feedback parameters are synthesized in the order of shooting, so that the three-dimensional model of the object can be obtained more accurately, reducing the inconvenience caused by blindly processing data and realizing a faster synthesis of the three-dimensional model of the object.

[0102] It should be noted that the determining of the acquisition trajectory when acquiring the image of the object includes:

[0103] A collection trajectory when collecting images of the object is determined based on the acceleration sensor.

[0104] Here, the acceleration sensor includes: a uniaxial acceleration sensor, a biaxial acceleration sensor or a triaxial acceleration sensor. The uniaxial acceleration sensor only collects acceleration in one direction, and the biaxial acceleration sensor collects acceleration in two directions. The triaxial acceleration sensor is used to collect acceleration in three directions of the mobile terminal, and the three directions include: left and right direction, front and back direction, and vertical direction. If the mobile terminal is used as the coordinate origin, the x-axis is used to represent the front and back direction, the y-axis is used to represent the left and right direction, and the z-axis is used to represent the vertical direction to establish a coordinate system; then, the accelerations in the three directions collected by the triaxial acceleration sensor include the acceleration of the x-axis, the acceleration of the y-axis, and the acceleration of the z-axis.

[0105] In daily life, the acquisition orientation of the captured image may be random, and if only the change of acceleration in a certain direction is analyzed, the accurate acquisition trajectory cannot be determined. Based on this, the embodiment of the present invention collects accelerations in multiple directions and jointly determines the acquisition trajectory through the accelerations in multiple directions.

[0106] Here, determining the acquisition trajectory of the object when acquiring images based on the acceleration sensor includes: determining the acceleration at each acquisition moment, and performing a double integration of the acceleration to determine the motion displacement of the object. In practical applications, since the displacement is equal to the product of velocity and time, and the ratio of velocity to time can determine the acceleration, the displacement can be obtained based on the acceleration acquired over a period of time.

[0107] Correspondingly, when the acceleration sensor is a three-axis acceleration sensor, the displacement of the object in each of the three directions can be determined according to the acceleration of the object in the three-dimensional space, and then the movement of the object in the three-dimensional space can be determined, that is, the acquisition trajectory is determined.

[0108] In the disclosed embodiment, the acceleration of the object is collected by the acceleration sensor, so that the collection trajectory can be determined based on the collected acceleration. In this way, by directly installing the acceleration sensor in the mobile terminal, the acceleration of the object at each collection point can be measured by the acceleration sensor, and the collection trajectory can be determined more conveniently, saving time for the subsequent construction of the three-dimensional model of the object.

[0109] Figure 6 A process of a three-dimensional model generation method according to an exemplary embodiment is shown Figure 4 ,like Figure 6As shown, when the mobile terminal is turned on and enters the shooting and modeling mode, the mobile terminal is moved, and radar waves are emitted during the movement to obtain echo parameters and plane images at different angles, so as to construct a three-dimensional model.

[0110] In the disclosed embodiment, when capturing images of an object from different angles, by emitting radar waves and detecting the echoes of the radar waves, the feedback parameters collected at each acquisition angle can be determined based on the emission parameters and the echo parameters; and then the three-dimensional model of the object is constructed based on the feedback parameters obtained at each acquisition angle. In this way, by emitting radar waves during shooting, the three-dimensional stereoscopic model of the object is constructed using the feedback parameters fed back by the radar waves, which enriches the application scenarios of the mobile terminal and allows the user to directly obtain the three-dimensional model of the object by shooting, greatly improving the user's shooting experience.

[0111] In order to establish a three-dimensional model of an object during shooting and improve the shooting experience, the embodiment of the present disclosure also provides a three-dimensional model generation device. Figure 7 is a structural diagram of a three-dimensional model generating device according to an exemplary embodiment. Figure 7 As shown, the three-dimensional model generating device 600 includes:

[0112] The transceiver module 601 is used to transmit radar waves and detect the echo of the radar waves when capturing images of an object from different angles;

[0113] A determination module 602 is used to determine the feedback parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo;

[0114] The construction module 603 is used to construct a three-dimensional model of the object according to the feedback parameters of each acquisition angle.

[0115] In some embodiments, the feedback parameters include: distance parameters and profile parameters;

[0116] The determining module comprises:

[0117] A distance determination module, used to determine the distance parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo;

[0118] The contour determination module is used to determine the contour parameters of the object based on the multiple distance parameters.

[0119] In some embodiments, the building blocks include:

[0120] A structure determination module, used to determine the three-dimensional structure of the object according to the contour parameters at each acquisition angle;

[0121] A rendering module is used to perform surface texture rendering on the three-dimensional structure based on the plane images acquired at various angles to obtain a three-dimensional model of the object.

[0122] In some embodiments, the apparatus further comprises:

[0123] A trajectory acquisition module, used to determine an acquisition trajectory when acquiring images of the object;

[0124] The building block further includes:

[0125] A synthesis module is used to synthesize the feedback parameters of each acquisition angle according to the acquisition trajectory to obtain a three-dimensional model of the object.

[0126] In some embodiments, the trajectory acquisition module includes:

[0127] The trajectory acquisition submodule is used to determine the acquisition trajectory when acquiring images of the object based on the acceleration sensor.

[0128] In the embodiment of the present invention, the acceleration of the object is collected by the acceleration sensor, so that the collection trajectory can be determined based on the collected acceleration. In this way, by directly installing the acceleration sensor in the mobile terminal, the acceleration of the object at each collection point can be measured by the acceleration sensor, and the collection trajectory can be determined more conveniently, saving time for the subsequent construction of the three-dimensional model of the object.

[0129] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0130] Figure 8 1 is a block diagram of a 3D model generation device 1800 according to an exemplary embodiment. For example, the device 1800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0131] Reference Figure 8 , the device 1800 may include one or more of the following components: a processing component 1802 , a memory 1804 , a power component 1806 , a multimedia component 1808 , an audio component 1810 , an input / output (I / O) interface 1812 , a sensor component 1814 , and a communication component 1816 .

[0132] The processing component 1802 generally controls the overall operation of the device 1800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1802 may include one or more processors 1820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 1802 may also include one or more modules to facilitate the interaction between the processing component 1802 and other components. For example, the processing component 1802 may include a multimedia module to facilitate the interaction between the multimedia component 1808 and the processing component 1802.

[0133] The memory 1804 is configured to store various types of data to support operations on the device 1800. Examples of such data include instructions for any application or method operating on the device 1800, contact data, phone book data, messages, pictures, videos, etc. The memory 1804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0134] The power component 1806 provides power to the various components of the device 1800. The power component 1806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 1800.

[0135] The multimedia component 1808 includes a screen that provides an output interface between the device 1800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1808 includes a front camera and / or a rear camera. When the device 1800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and / or the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0136] The audio component 1810 is configured to output and / or input audio signals. For example, the audio component 1810 includes a microphone (MIC), and when the device 1800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1804 or sent via the communication component 1816. In some embodiments, the audio component 1810 also includes a speaker for outputting audio signals.

[0137] I / O interface 1812 provides an interface between processing component 1802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0138] The sensor assembly 1814 includes one or more sensors for providing various aspects of the status assessment of the device 1800. For example, the sensor assembly 1814 can detect the open / closed state of the device 1800, the relative positioning of components, such as the display and keypad of the device 1800, the sensor assembly 1814 can also detect the position change of the device 1800 or a component of the device 1800, the presence or absence of user contact with the device 1800, the orientation or acceleration / deceleration of the device 1800, and the temperature change of the device 1800. The sensor assembly 1814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0139] The communication component 1816 is configured to facilitate wired or wireless communication between the device 1800 and other devices. The device 1800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology or other technologies.

[0140] In an exemplary embodiment, the device 1800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned methods.

[0141] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1804 including instructions, and the instructions can be executed by a processor 1820 of the device 1800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0142] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the above-mentioned three-dimensional model generation device, enables the above-mentioned three-dimensional model generation method to be executed.

[0143] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.

[0144] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A three-dimensional model generation method, characterized in that: Applied to a mobile terminal, the method comprises: transmitting radar waves to an object from different angles and detecting echoes of the radar waves; Determine the feedback parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo; the transmission parameters include: transmission angle, transmission time and transmission position, and the feedback parameters include: distance parameter and profile parameter; Constructing a three-dimensional model of the object according to the feedback parameters of each acquisition angle; Determining a collection trajectory when collecting images of the object; The step of constructing the three-dimensional model of the object according to the feedback parameters of each acquisition angle further includes: According to the acquisition trajectory, the feedback parameters of each acquisition angle are synthesized to obtain a three-dimensional model of the object.

2. The method according to claim 1, characterized in that The step of determining the feedback parameters collected at each collection angle according to the emission parameters of the radar wave and the echo parameters of the echo includes: Determining the distance parameters collected at each collection angle according to the emission parameters of the radar wave and the echo parameters of the echo; Based on the multiple distance parameters, contour parameters of the object are determined.

3. The method according to claim 2, characterized in that The constructing the three-dimensional model of the object according to the feedback parameters of each acquisition angle includes: Determining the three-dimensional structure of the object according to the profile parameters at each acquisition angle; The surface texture of the three-dimensional structure is rendered based on the plane images at various acquisition angles to obtain a three-dimensional model of the object.

4. The method according to claim 1, characterized in that The determining of a collection trajectory when collecting images of the object includes: A collection trajectory when collecting images of the object is determined based on the acceleration sensor.

5. A three-dimensional model generating device, characterized in that: The device comprises: A transceiver module, used to transmit radar waves and detect echoes of the radar waves when capturing images of an object from different angles; A determination module, used to determine the feedback parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo; the transmission parameters include: transmission angle, transmission time and transmission position, and the feedback parameters include: distance parameter and profile parameter; A construction module, used to construct a three-dimensional model of the object according to the feedback parameters of each acquisition angle; A trajectory acquisition module, used to determine an acquisition trajectory when acquiring images of the object; The building block further includes: A synthesis module is used to synthesize the feedback parameters of each acquisition angle according to the acquisition trajectory to obtain a three-dimensional model of the object.

6. The device according to claim 5, characterized in that The determining module comprises: A distance determination module, used to determine the distance parameters collected at each collection angle according to the transmission parameters of the radar wave and the echo parameters of the echo; The contour determination module is used to determine the contour parameters of the object based on the multiple distance parameters.

7. The device according to claim 6, characterized in that The building blocks include: A structure determination module, used to determine the three-dimensional structure of the object according to the contour parameters at each acquisition angle; A rendering module is used to perform surface texture rendering on the three-dimensional structure based on the plane images acquired at various angles to obtain a three-dimensional model of the object.

8. The device according to claim 5, characterized in that The trajectory acquisition module comprises: The trajectory acquisition submodule is used to determine the acquisition trajectory when acquiring images of the object based on the acceleration sensor.

9. A three-dimensional model generating device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method according to any one of claims 1 to 4 when executing the executable instructions stored in the memory.

10. A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a three-dimensional model generation device, the three-dimensional model generation device is enabled to perform the method according to any one of claims 1 to 4.

Images