Resource object three-dimensional model generation interaction method and device, display method and device

Abstract

The present application discloses a method and device for interactively generating a three-dimensional model based on a mobile terminal resource object, and a display method and device, comprising: in response to a request for generating a three-dimensional model of a resource object, displaying and generating a collection status interface with a three-dimensional collection area; in response to a selection adjustment status interface generated based on the collection status interface, adjusting the selection relationship between the displayed three-dimensional collection area and a target resource object; when the selection relationship in the selection adjustment status interface meets the collection operation requirements, generating a selection collection status interface according to the selection matching relationship determined between the three-dimensional collection area and the target resource object; performing multi-angle image collection on the three-dimensional collection area and the target resource object having the selection matching relationship in the selection collection status interface; and displaying the three-dimensional model generated according to the collection data of the multi-angle image collection in the three-dimensional model display interface; making the three-dimensional model establishment or generation process simple and the calculation amount small.

Description

Technical Field

[0001] This application relates to the field of computer application technology, and more specifically, to a method and apparatus for interactively generating a three-dimensional model based on a mobile terminal resource object, a method and apparatus for displaying a three-dimensional model based on a mobile terminal resource object, and a method and apparatus for establishing interactive relationships between three-dimensional models based on a mobile terminal resource object. This application also relates to a computer storage medium and an electronic device. Background Art

[0002] Three-dimensional reconstruction refers to the establishment of a mathematical model of three-dimensional objects suitable for computer representation and processing. It is the basis for processing, operating and analyzing the properties of three-dimensional objects in a computer environment, and is also a key technology for establishing virtual reality in computers to express the objective world.

[0003] With the continuous development of the Internet and computer application technology, objects in the real world are displayed in three-dimensional virtual form through electronic devices, making it easier for users to truly feel and observe the objects through electronic devices. Summary of the Invention

[0004] The present application provides an interactive method for generating a three-dimensional model based on a mobile terminal resource object, so as to solve the problems in the prior art of large amount of calculation and long modeling time for three-dimensional reconstruction.

[0005] The present application provides an interactive method for generating a three-dimensional model based on a mobile terminal resource object, comprising:

[0006] In response to a request for generating a three-dimensional model of a resource object, displaying a collection status interface with a generated three-dimensional collection area;

[0007] In response to a selection adjustment state interface generated based on the acquisition state interface, adjusting the selection relationship between the displayed three-dimensional acquisition area and the target resource object;

[0008] When the selection relationship in the selection adjustment state interface meets the acquisition operation requirements, generating a selection acquisition state interface based on the selection adjustment state interface according to the selection matching relationship determined between the three-dimensional acquisition area and the target resource object;

[0009] Performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selection matching relationship in the selection acquisition status interface;

[0010] The three-dimensional model generated based on the acquisition data of the multi-angle image acquisition is displayed in the three-dimensional model display interface.

[0011] In some embodiments, the displaying of a collection status interface with a generated three-dimensional collection area in response to a request to generate a three-dimensional model of a resource object includes:

[0012] In response to the three-dimensional model generation request, identifying a two-dimensional area where the target resource object is located in the acquisition status interface;

[0013] The three-dimensional acquisition area generated based on the two-dimensional area is displayed on the acquisition status interface.

[0014] In some embodiments, in response to the three-dimensional model generation request, identifying the two-dimensional area where the target resource object is located in the acquisition status interface includes:

[0015] In response to the three-dimensional model generation request, identifying a plane in the acquisition status interface for supporting the target resource object;

[0016] generating the two-dimensional region according to the plane;

[0017] The two-dimensional area is displayed on the acquisition status interface.

[0018] In some embodiments, in response to the selection adjustment state interface generated based on the acquisition state interface, adjusting the selection relationship between the displayed three-dimensional acquisition area and the target resource object includes:

[0019] Moving the three-dimensional acquisition area to the location of the target resource object; or moving the target resource object to the location of the three-dimensional acquisition area;

[0020] The range of the three-dimensional acquisition area is adjusted, and the target resource object is selected within the three-dimensional acquisition area.

[0021] In some embodiments, adjusting the range of the three-dimensional acquisition area to select the target resource object within the three-dimensional acquisition area includes:

[0022] In response to an adjustment operation on a parameter adjustment control in the acquisition status interface; or in response to an adjustment operation on a range of the three-dimensional acquisition area in the acquisition status interface, the target resource object is selected within the three-dimensional acquisition area.

[0023] In some embodiments, the performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selection matching relationship in the selection acquisition status interface includes:

[0024] Outputting multi-angle capture prompt information in response to triggering a capture operation in the capture state selection interface according to the selected matching relationship;

[0025] According to the multi-angle acquisition prompt information, multi-angle image acquisition is performed on the three-dimensional acquisition area and the target resource object having the selected matching relationship.

[0026] In some embodiments, performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selected matching relationship according to the multi-angle acquisition prompt information includes:

[0027] According to the multi-angle acquisition prompt information, taking the target resource object selected in the three-dimensional acquisition area in the acquisition selection interface as a reference object, the acquisition device is moved horizontally around the reference object to perform the multi-angle image acquisition;

[0028] or,

[0029] According to the multi-angle acquisition prompt information, with the acquisition device as a reference object, the target resource object is rotated in the horizontal direction to perform multi-angle image acquisition.

[0030] In some embodiments, displaying the three-dimensional model generated based on the acquisition data of the multi-angle image acquisition in the three-dimensional model display interface includes:

[0031] In response to a viewing angle operation on the three-dimensional model display interface, rotating the three-dimensional model to a position matching the viewing angle operation for display;

[0032] or,

[0033] In response to a viewing operation on the three-dimensional model display interface, the three-dimensional model is automatically rotated for display on the three-dimensional model display interface.

[0034] The present application also provides an interactive device for generating a three-dimensional model based on a mobile terminal resource object, comprising:

[0035] A first display unit is configured to display a collection status interface with a generated three-dimensional collection area in response to a three-dimensional model generation request of a resource object;

[0036] a first generating unit, configured to adjust a selection relationship between the displayed three-dimensional acquisition area and a target resource object in response to a selection adjustment state interface generated based on the acquisition state interface;

[0037] a second generating unit configured to generate a selection acquisition state interface based on the selection adjustment state interface according to the selection matching relationship determined between the three-dimensional acquisition area and the target resource object when the selection relationship in the selection adjustment state interface meets the acquisition operation requirement;

[0038] an acquisition unit, configured to perform multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selection matching relationship in the selection acquisition state interface;

[0039] The second display unit is used to display the three-dimensional model generated according to the acquisition data of the multi-angle image acquisition in a three-dimensional model display interface.

[0040] The present application also provides a method for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects, comprising:

[0041] Acquire multi-angle image data collected based on the matching relationship between the three-dimensional acquisition area and the target resource object;

[0042] Determine, based on the position data and posture data of the target resource object in the frame picture of the multi-angle image data, a collection distance between the target resource object and a collection device in the frame picture and a rotation angle of the target resource object in the frame picture;

[0043] Normalizing the acquisition distance and the rotation angle onto a spatial sphere;

[0044] A correspondence between the normalized frame image and the interactive operation is established.

[0045] The present application also provides a device for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects, which is characterized by comprising:

[0046] An acquisition unit, configured to acquire multi-angle image data acquired based on a matching relationship selected between a three-dimensional acquisition area and a target resource object;

[0047] a determining unit, configured to determine, based on the position data and posture data of the target resource object in a frame of the multi-angle image data, a collection distance between the target resource object and a collection device in the frame and a rotation angle of the target resource object in the frame;

[0048] a processing unit, configured to normalize the acquisition distance and the rotation angle in the frame image to a spatial sphere;

[0049] An establishing unit is used to establish an interactive correspondence between the normalized frame image and the interactive operation.

[0050] The present application also provides a computer storage medium for storing data generated by a network platform and a program for processing the data generated by the network platform;

[0051] When the program is read and executed by the processor, it executes the above-mentioned three-dimensional model generation interaction method based on mobile terminal resource objects; or executes the above-mentioned three-dimensional model interaction relationship establishment method based on mobile terminal resource objects.

[0052] The present application also provides an electronic device, comprising:

[0053] processor;

[0054] A memory for storing a program for processing data generated by a network platform. When the program is read and executed by the processor, it executes the above-mentioned method for generating an interactive three-dimensional model based on a mobile terminal resource object; or, it executes the above-mentioned method for establishing an interactive relationship of a three-dimensional model based on a mobile terminal resource object.

[0055] Compared with the prior art, this application has the following advantages:

[0056] This application provides an embodiment of an interactive method for generating a 3D model of a resource object. In this embodiment, a 3D model of a target resource object is created by creating a 3D acquisition area in a capture status interface, establishing a selection relationship between the 3D acquisition area and the target resource object, and fixing the selection matching relationship when the two match. Subsequently, multi-angle image acquisition is performed, and finally, the 3D model is displayed on a 3D model display interface. This makes the 3D model creation or generation process relatively simple and computationally efficient. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 This is a flowchart of an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application;

[0058] Figure 2 This is a schematic diagram of a two-dimensional area in a collection state interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application;

[0059] Figure 3 This is a schematic diagram of a three-dimensional area in a collection state interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application;

[0060] Figure 4 This is a schematic diagram of a selection and adjustment state interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application;

[0061] Figure 5 This is a schematic diagram of selecting a collection status interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application;

[0062] Figure 6 This is a schematic diagram of multi-angle image acquisition in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application;

[0063] Figure 7 This is a structural diagram of an embodiment of an interactive device for generating a three-dimensional model based on a mobile terminal resource object provided by the present application;

[0064] Figure 8 This is a flowchart of an embodiment of a method for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects provided by the present application;

[0065] Figure 9 This is a structural diagram of an embodiment of a device for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects provided by the present application;

[0066] Figure 10 It is a structural diagram of an electronic device embodiment provided by this application. DETAILED DESCRIPTION

[0067] The following description sets forth many specific details to facilitate a thorough understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the scope of the present application. Therefore, the present application is not limited to the specific implementations disclosed below.

[0068] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. Descriptive terms such as "a," "a," "a first," and "a second," etc., used in this application and the appended claims, are not intended to limit quantity or sequence, but are used to distinguish information of the same type from one another.

[0069] As described in the background technology section above, the concept behind the interactive method for generating a 3D model based on mobile terminal resource objects, as provided in this application, stems from the high cost, lengthy construction process, and lack of automation of existing 3D reconstruction technologies. Specifically, existing 3D reconstruction requires inferring the camera's position and pose in 3D space through complex feature point matching algorithms, followed by sparse point cloud reconstruction, followed by dense point cloud reconstruction through multi-view synthesis, and finally obtaining the 3D model. This process requires a significant amount of computation and a long modeling time.

[0070] In view of this, the present application provides a method for generating a three-dimensional model based on a mobile terminal resource object, such as Figure 1 As shown, Figure 1This is a flowchart of an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application. The method embodiment includes:

[0071] Step S101: In response to a request for generating a three-dimensional model of a resource object, displaying a collection status interface with a generated three-dimensional collection area;

[0072] The response to the resource object's 3D model generation request in step S101 may be a user's operation to generate a 3D model for the resource object for which the 3D model is to be generated. For example, this may be triggered by an operation on a 3D model generation control provided in the camera, or by an operation on a 3D model generation control for a resource object captured by the camera, resulting in a capture status interface displaying a generated 3D capture area on the camera's display screen. In this embodiment, the mobile terminal may be any electronic device such as a camera, a mobile phone, or a tablet, i.e., any electronic terminal device with a capture function.

[0073] The specific implementation process of step S101 can be combined with Figure 2 and Figure 3 As shown, Figure 2 This is a schematic diagram of a two-dimensional area in a collection state interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application. Figure 3 This is a schematic diagram of a three-dimensional area in a collection state interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by this application. The specific implementation process of step S101 may include:

[0074] Step S101 - 1 : In response to the three-dimensional model generation request, identify the two-dimensional area where the target resource object is located in the acquisition interface.

[0075] Step S101 - 2 : Displaying the three-dimensional acquisition area generated based on the two-dimensional area on the acquisition status interface.

[0076] The target resource object in step S101-1 may be an object such as a commodity or a house that needs to be displayed through an electronic device. Step S101-1 may be when entering the interactive interface for generating a three-dimensional model, first identifying the feature points in the acquisition interface, determining whether the feature points are on the same plane, and then determining the two-dimensional area where the target resource object is located, that is, the plane. Specifically, when there are at least two identified feature points on the same plane, the positional relationship between the plane and the target resource object may be further determined, and when the height direction of the target resource object is toward the plane, the plane is determined to be a two-dimensional area. Therefore, in this embodiment, step S101-1 may specifically include:

[0077] Step S101 - 11 : In response to the three-dimensional model generation request, identifying a plane in the acquisition status interface for supporting the target resource object;

[0078] Step S101-12: generating the two-dimensional region according to the plane;

[0079] Step S101 - 13 : Displaying the two-dimensional area on a collection interface.

[0080] It is understandable that when there is no plane supporting the target resource object in the acquisition status interface, a surface having a vertical relationship with the target resource object may be determined as the plane, such as the ground.

[0081] The step S101-2 generates a three-dimensional acquisition area based on the two-dimensional area, which can be understood as constructing a three-dimensional cube based on the two-dimensional area. Figure 3 As shown, the three-dimensional cube is output on the acquisition interface, thereby forming an acquisition status interface. That is, in this embodiment, the acquisition status interface can be generated after the three-dimensional cube is generated in the acquisition interface. The specific implementation process of step S101-2 in this embodiment may include:

[0082] Step S101-21: constructing the edge of a three-dimensional acquisition area along the height direction of the target resource object with the two-dimensional area as the bottom surface;

[0083] Step S101-22: connecting the vertices of the edges to generate the three-dimensional acquisition area;

[0084] Step S101 - 23 : determining the acquisition interface having the three-dimensional acquisition area generated therein as the acquisition status interface.

[0085] Step S102: in response to a selection adjustment state interface generated based on the acquisition state interface, adjusting the selection relationship between the displayed three-dimensional acquisition area and the target resource object;

[0086] Based on the step S101, the acquisition state interface can be understood as an interface for generating a 3D acquisition area based on the acquisition interface, that is, the 3D acquisition area is displayed in the acquisition state interface. The selection adjustment state interface can be an interface for adjusting the 3D acquisition area in the interface, such as Figure 4 As shown, Figure 4 This is a schematic diagram of selecting and adjusting the status interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application.

[0087] The purpose of step S102 is to adjust the three-dimensional acquisition area so that it can select the target resource object. The specific implementation process may include:

[0088] Step S102-1: moving the three-dimensional acquisition area to the location of the target resource object; or moving the target resource object to the location of the three-dimensional acquisition area;

[0089] Step S102 - 2 : adjusting the range of the three-dimensional acquisition area, and selecting the target resource object within the three-dimensional acquisition area.

[0090] The step S102-1 can achieve selection by moving the 3D acquisition area or by moving the target resource object, that is, the 3D acquisition area selects the target resource object, or the target resource object is moved to the 3D acquisition area.

[0091] In this embodiment, step S102-1 may be that the mobile acquisition device establishes a selection relationship between the three-dimensional acquisition area and the target resource object; for example: when the acquisition device is a camera, the three-dimensional acquisition area is displayed in the acquisition status interface of the camera, and the camera is moved so that the target resource object can be located in the three-dimensional acquisition area; or, the three-dimensional acquisition area can be moved by touch to the position of the target resource object displayed in the acquisition status interface.

[0092] The purpose of step S102-2 is to adjust the 3D acquisition area. The specific adjustment method may be to adjust the parameter adjustment control in the acquisition status interface; or to adjust the 3D acquisition area in the acquisition status interface. The specific implementation process may include:

[0093] Step S102-21: drag the three-dimensional acquisition area to adjust the selection relationship.

[0094] Specifically, the size of the 3D acquisition area is adjusted by adjusting the parameter adjustment controls displayed in the acquisition status interface. For example, the selection relationship of the 3D acquisition area can be adjusted by dragging at least one of the length, width, and height parameters of the 3D acquisition area. The length, width, and height can be adjusted by dragging the parameter adjustment controls displayed in the acquisition status interface, or by directly dragging the length, width, and height of the 3D acquisition area.

[0095] It is understandable that the two drag operations can be implemented in a mixed manner or separately. For example, the height can be adjusted through the height parameter adjustment control displayed in the acquisition status interface, and the length and / or width can be adjusted by directly dragging the lines corresponding to the three-dimensional acquisition area in the acquisition status interface. In some embodiments, the adjustment of the length, width, and height can be a single selection. For example, when the three-dimensional acquisition area is generated, one or two of the length, width, and height parameters are fixed. For example, at least one parameter or at least two parameters of the length, width, and height are automatically determined according to the target resource object. Therefore, when adjusting the selection relationship, at least one parameter of the length, width, and height can be used.

[0096] In this embodiment, the purpose of adjusting the size of the 3D acquisition area is to ensure that the target resource object can be selected within the 3D acquisition area. Of course, the selection of the target resource object within the 3D acquisition area can also be determined based on the requirements of the 3D model to be generated. This is not limited to selecting the entire structure of the target resource object within the 3D acquisition area; rather, the selection relationship can be adjusted based on the requirements of the 3D model to be generated. This embodiment uses the example of selecting the entire target resource object within the 3D acquisition area.

[0097] It will be appreciated that in this embodiment, the 3D acquisition area can be a 3D cube. Adjustments to the 3D acquisition area can be made based on the structural shape of the target resource object and are not limited to a fixed 3D cube. The area can be any irregular 3D shape. Adjustments can be made based on the user's needs, considering the target resource object's structure and the 3D model generation requirements. Of course, the 3D acquisition area can be generated as a specified or randomly generated structure and is not limited to a 3D cube.

[0098] Step S103: When the selection relationship in the selection adjustment state interface meets the acquisition operation requirements, a selection acquisition state interface is generated based on the selection adjustment state interface according to the selection matching relationship determined between the three-dimensional acquisition area and the target resource object.

[0099] like Figure 5 As shown, Figure 5 This is a schematic diagram of selecting the acquisition status interface in an embodiment of an interactive method for generating a three-dimensional model based on a mobile terminal resource object provided by the present application.

[0100] The purpose of step S103 is to generate a selection and acquisition state interface based on the selection and adjustment state interface when the target resource object is located within the range of the three-dimensional acquisition area.

[0101] In step S103, if the selection relationship in the selection adjustment state interface satisfies the acquisition operation requirements, a determination can be made based on whether the target resource object is located within the 3D acquisition area. The target resource object can be understood as the object for which a 3D model is to be generated, and can be a partial structure, the entire structure, or a component structure of the object. In this embodiment, the entire structure of the object is located within the 3D acquisition area, meeting the acquisition operation requirements. In this embodiment, whether the target resource object is within the 3D acquisition area can be determined by comparing the length, width, and height of the target resource object with those of the 3D acquisition area. If the length, width, and height of the target resource object are less than or equal to those of the 3D acquisition area, the selection relationship satisfies the acquisition operation requirements, and the selection relationship is determined as a selection matching relationship between the two. The selection matching relationship is fixed in the selection adjustment state interface, and the selection acquisition state interface is generated. That is, after the selection matching relationship is determined, movement of the acquisition device will not affect the selection matching relationship between the target resource object and the 3D acquisition area. In other words, once the selection matching relationship is determined, it is fixed in the selection adjustment state interface.

[0102] Step S104: performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having a fixed selection matching relationship in the selection acquisition status interface.

[0103] The purpose of step S104 is to perform multi-angle image acquisition on the target resource object. In this embodiment, multi-angle image acquisition refers to performing multi-angle image acquisition on the target resource object selected in the three-dimensional acquisition area.

[0104] like Figure 6 As shown, Figure 6 This is a schematic diagram of multi-angle image acquisition in an embodiment of an interactive method for generating a three-dimensional model of a mobile terminal resource object provided by the present application.

[0105] In this embodiment, the multi-angle image acquisition can be 360-degree acquisition in the horizontal direction or 360-degree acquisition in the vertical direction. The specific implementation process of step S104 may include:

[0106] Step S104-1: Based on the selected matching relationship, in response to triggering a capture operation in the selected capture state interface, output a multi-angle capture prompt. In this embodiment, the multi-angle capture prompt can be a voice prompt, such as "Please circle around the object to capture," or can be a capture guidance message output in the selected capture state interface, such as a dynamic arrow displayed to indicate the capture direction. The specific form of the multi-angle capture prompt is not limited, as long as it prompts the user to capture the target resource object.

[0107] Step S104 - 2 : performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selected matching relationship according to the multi-angle acquisition prompt information.

[0108] The specific implementation process of step S104-2 may include:

[0109] According to the multi-angle acquisition prompt information, taking the target resource object selected in the three-dimensional acquisition area in the acquisition status selection interface as a reference object, the acquisition device is moved horizontally around the reference object to perform the multi-angle image acquisition;

[0110] or;

[0111] According to the multi-angle acquisition prompt information, with the acquisition device as a reference object, the target resource object is rotated in the horizontal direction to perform multi-angle image acquisition.

[0112] The multi-angle image acquisition of the three-dimensional acquisition area and the target resource object having the selection matching relationship can be performed based on different reference objects. The above descriptions are respectively based on the target word object and the acquisition device as the reference object. In this embodiment, the three-dimensional model is mainly used to display the structure of the target resource object at different angles. Therefore, in this embodiment, multi-angle image acquisition can be mainly achieved by using the acquisition device around the target resource object. Since there is a fixed selection matching relationship between the three-dimensional acquisition area and the target resource object in the selection acquisition status interface, the target resource object will not leave the three-dimensional acquisition area during the multi-angle image acquisition process of the acquisition device around the target resource object, thereby making the acquisition process operation relatively simple.

[0113] In this embodiment, multi-angle acquisition can be achieved by triggering a shooting control of a camera.

[0114] It is understandable that the collection process may also be performed by having the collection device as a fixed party and the target resource object as a rotating party.

[0115] Step S105: Displaying the three-dimensional model generated based on the acquisition data of the multi-angle image acquisition in a three-dimensional model display interface.

[0116] The purpose of step S105 is to display the 3D model in the 3D model display interface. The 3D model display interface may be an interface for displaying the target resource object.

[0117] The specific implementation process of step S105 may include:

[0118] Step S105-a: In response to a viewing angle operation on the 3D model display interface, the 3D model is rotated to a position matching the viewing angle operation for display; the viewing angle operation may be a touch-slide operation on the 3D model display interface, for example, a single left slide or a single right slide, or a continuous left slide or a continuous right slide. The sliding direction corresponds to the rotation direction; a left slide rotates the 3D model clockwise to the corresponding angle for display, and a right slide rotates the 3D model counterclockwise to the corresponding angle for display.

[0119] or,

[0120] Step S105-b: In response to a viewing operation on the 3D model display interface, automatically rotating the 3D model for display on the 3D model display interface. The viewing operation may be a touch operation on a viewing control, such as clicking a touch button to automatically display the 3D model.

[0121] The above describes an embodiment of an interactive method for generating a 3D model of a resource object provided by this application. In this embodiment, a 3D model of a target resource object is established by creating a 3D acquisition area in the acquisition status interface, establishing a selection relationship between the 3D acquisition area and the target resource object, and fixing the selection matching relationship when the two match. Subsequently, multi-angle image acquisition is performed, and finally, the 3D model is displayed on the 3D model display interface. This makes the 3D model creation or generation process relatively simple and computationally efficient.

[0122] The above is a detailed description of an embodiment of a method for interactively generating a three-dimensional model of a resource object provided by this application. Corresponding to the embodiment of the method for interactively generating a three-dimensional model of a resource object provided above, this application also discloses an embodiment of an interactive device for generating a three-dimensional model of a resource object, please refer to Figure 7 Since the device embodiment is basically similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0123] like Figure 7 As shown, Figure 7: This is a structural diagram of an embodiment of an interactive device for generating a three-dimensional model based on a mobile terminal resource object provided by the present application, the device embodiment comprising:

[0124] The first display unit 701 is configured to display a collection status interface with a generated three-dimensional collection area in response to a three-dimensional model generation request of a resource object;

[0125] An adjusting unit 702 is configured to adjust the displayed selection relationship between the three-dimensional acquisition area and the target resource object in response to a selection adjustment state interface generated based on the acquisition state interface;

[0126] A generating unit 703 is configured to generate a selection acquisition state interface based on the selection adjustment state interface according to the selection matching relationship determined between the three-dimensional acquisition area and the target resource object when the selection relationship in the selection adjustment state interface meets the acquisition operation requirement;

[0127] The acquisition unit 704 is configured to perform multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selection matching relationship in the selection acquisition state interface;

[0128] The second display unit 705 is configured to display the three-dimensional model generated based on the acquisition data acquired from the multi-angle image acquisition in a three-dimensional model display interface.

[0129] The first display unit 701 includes: an identification subunit and a display subunit. The identification subunit is used to identify the two-dimensional area where the target resource object is located in the acquisition status interface in response to the three-dimensional model generation request; the display subunit is used to display the three-dimensional acquisition area generated based on the two-dimensional area on the acquisition status interface.

[0130] The identification subunit includes: a plane identification subunit, a two-dimensional generation subunit and an area display subunit; the plane identification subunit is used to identify the plane used to support the target resource object in the acquisition status interface in response to the three-dimensional model generation request; the two-dimensional generation subunit is used to generate the two-dimensional area based on the plane; the area display subunit is used to display the two-dimensional area on the acquisition status interface.

[0131] The adjusting unit 702 may include a moving subunit and an adjusting subunit.

[0132] The moving subunit is configured to move the three-dimensional acquisition area to the location of the target resource object; or to move the target resource object to the location of the three-dimensional acquisition area.

[0133] The adjusting subunit is configured to adjust the range of the three-dimensional acquisition area and select the target resource object within the three-dimensional acquisition area.

[0134] The adjustment subunit may be specifically configured to respond to an adjustment operation on a parameter adjustment control in the acquisition status interface; or, in response to a range adjustment operation on the three-dimensional acquisition area in the acquisition status interface, select the target resource object within the three-dimensional acquisition area.

[0135] The collection unit 704 may include: an output subunit and a collection subunit.

[0136] The output subunit is configured to output multi-angle acquisition prompt information in response to triggering the acquisition operation in the selected acquisition status interface according to the selected matching relationship;

[0137] The acquisition subunit is configured to perform multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selection matching relationship according to the multi-angle acquisition prompt information.

[0138] The acquisition subunit can be specifically used to perform the multi-angle image acquisition in the horizontal direction around the target resource object selected in the three-dimensional acquisition area in the selection acquisition interface as a reference object according to the multi-angle acquisition prompt information; or, according to the multi-angle acquisition prompt information, use the acquisition device as a reference object to rotate the target resource object in the horizontal direction for multi-angle image acquisition.

[0139] The second display unit 705 may include: a passive display subunit or an automatic display subunit; the passive display subunit is used to rotate the three-dimensional model to a position matching the viewing angle operation for display in response to the viewing operation of the three-dimensional model display interface; the automatic display subunit is used to automatically rotate the three-dimensional model for display in the three-dimensional model display interface in response to the viewing operation of the three-dimensional model display interface.

[0140] The above is a description of an embodiment of an interactive device for generating a three-dimensional model based on a mobile terminal resource object provided by this application. For the content of the above-mentioned device embodiment, please refer to the corresponding steps S101 to S105 in the above-mentioned method embodiment, which will not be repeated here.

[0141] Based on the above content, this application also provides a method for establishing a three-dimensional model interaction relationship based on mobile terminal resource objects, such as Figure 8 As shown, Figure 8 This is a flowchart of an embodiment of a method for establishing a three-dimensional model interactive relationship based on a mobile terminal resource object provided by the present application. The embodiment of the establishment method includes:

[0142] Step S801: Acquire multi-angle image data collected based on the matching relationship between the three-dimensional collection area and the target resource object.

[0143] The acquisition of multi-angle image data in step S801 may refer to the contents of steps S101 to S104 above, and will not be repeated here.

[0144] Step S802: Determine the acquisition distance between the target resource object and the acquisition device and the rotation angle of the target resource object in the frame according to the position data and posture data of the target resource object in the frame of the multi-angle image data.

[0145] The purpose of step S802 is to determine the acquisition distance and the rotation angle.

[0146] In this embodiment, the position and posture of the target resource object, as well as the position and posture of the acquisition device (in this embodiment, a camera or an electronic device with camera functionality), can be acquired through SLAM (simultaneous localization and mapping). SLAM can also be understood as visual spatial positioning. It is primarily used to solve the positioning and mapping problems of robots moving in unknown environments. SLAM can be applied to robot positioning and navigation, drones, VR / AR, and other fields.

[0147] In this embodiment, a first coordinate system xyz is established by obtaining the position data and posture data of the target resource object; a second coordinate system uvw is established by obtaining the position data and posture data of the camera, and a two-dimensional image coordinate system xy with a plane image in the acquisition state interface is acquired. The rigid body transformation matrix T of the first coordinate system and the second coordinate system, as well as the projection transformation matrix P of the second coordinate system to the two-dimensional image coordinate system are obtained by visual space positioning technology (SLAM). The angle between the z-axis direction of the first coordinate system and the Y-axis direction of the two-dimensional image coordinate system is calculated according to the matrix T and the matrix P, and the rotation angle of the target resource object in the current image frame image is obtained. The acquisition distance from the camera to the target resource object in the current image frame image can also be determined by the first coordinate system and the second coordinate system.

[0148] Step S803: normalizing the acquisition distance and the rotation angle onto a spatial sphere.

[0149] The specific implementation process of step S803 may include:

[0150] Step S803-1: performing position adjustment processing on the target resource object in the frame;

[0151] Step S803-2: determining an average value of the distance between the camera and the target resource object in the frame as a normalized reference value;

[0152] Step S803-3: determining whether the distance value between the camera and the target resource object is equal to the normalized reference value;

[0153] Step S803-4: If not, the frame is adjusted according to the ratio between the normalized reference value and the distance value, so that the distance between the camera and the target resource object in the frame in the multi-angle image data can be normalized to the spatial sphere.

[0154] Step S804: establishing a correspondence between the normalized frame image and the interactive operation.

[0155] The purpose of step S804 is to establish a correspondence between the frame and the interactive operation so that when the 3D model is displayed, it can be rotated in the corresponding direction according to the user's operation on the 3D model, thereby allowing the user to view the target resource object in all directions. Specifically, the correspondence established can be that if the user's interactive operation is to the left, the target resource object should be rotated clockwise when displayed, and the frame can be the next frame after the currently displayed frame is rotated clockwise. If the user's interactive operation is to the right, the target resource object should be rotated counterclockwise when displayed, and the frame can be the next frame after the currently displayed frame is rotated counterclockwise.

[0156] In this embodiment, the interactive operation may be a touch gesture of the user.

[0157] In this embodiment, the 360-degree horizontal rotation (from three o'clock to nine o'clock) is mainly taken as an example, but it is of course not limited to this. It can also be a 360-degree vertical rotation (from six o'clock to twelve o'clock), or a rotation from two o'clock to eight o'clock, or a rotation from five o'clock to eleven o'clock. The rotation method of the above three-dimensional model can be constructed according to user needs.

[0158] The above is a description of an embodiment of the method for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects provided by this application. The specific content can be combined with the content of the above-mentioned embodiment of the method for generating a three-dimensional model interactive relationship based on mobile terminal resource objects. The embodiment of the method for establishing a three-dimensional model interactive relationship is mainly described from the perspective of server-side processing, and the embodiment of the method for generating a three-dimensional model interactive relationship of resource objects is mainly described from the perspective of front-end display. Of course, it is not ruled out that the embodiment of the method for establishing a three-dimensional model interactive relationship can be completed by the front-end if the front-end has computing and processing capabilities.

[0159] The above is a description of an embodiment of a method for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects provided by the present application. It can be seen that in the embodiment of the interactive relationship establishment method, when establishing an interactive relationship between a three-dimensional model and a user, no large amount of calculation is required. It is only necessary to obtain the posture data of the target resource object and the posture data of the camera, and then normalize them to the interface on the spatial sphere, so as to ensure that during the interaction process, the distance between the target resource object and the camera in each frame is similar or the same.

[0160] The above is a detailed description of an embodiment of a method for establishing a three-dimensional model interaction relationship based on a mobile terminal resource object provided by this application. Corresponding to the embodiment of a method for establishing a three-dimensional model interaction relationship based on a mobile terminal resource object provided above, this application also discloses an embodiment of a device for establishing a three-dimensional model interaction relationship based on a mobile terminal resource object. Please refer to Figure 9 Since the device embodiment is basically similar to the method embodiment, the description is relatively simple. For relevant details, please refer to the partial description of the method embodiment. The device embodiment described below is only illustrative.

[0161] like Figure 9 As shown, Figure 9 This is a schematic diagram of a structure of an embodiment of a device for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects provided by the present application. The device embodiment includes:

[0162] An acquisition unit 901 is configured to acquire multi-angle image data acquired based on a matching relationship selected between a three-dimensional acquisition area and a target resource object;

[0163] a determining unit 902 configured to determine, based on the position data and posture data of the target resource object in a frame of the multi-angle image data, a collection distance between the target resource object and a collection device in the frame and a rotation angle of the target resource object in the frame;

[0164] The processing unit 903 is configured to normalize the acquisition distance and the rotation angle in the frame image to a spatial sphere;

[0165] The establishing unit 904 is configured to establish an interactive correspondence between the normalized frame image and the interactive operation.

[0166] The specific content of the above embodiment of the device for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects can be referred to the content of the above embodiment of the method for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects, and will not be described in detail here.

[0167] Based on the above content, the present application also provides a computer storage medium for storing data generated by a network platform and a program for processing the data generated by the network platform;

[0168] When the program is read and executed by the processor, the program executes the steps of the above-mentioned method for interactively generating a three-dimensional model of a resource object; or executes the steps of the above-mentioned method for establishing an interactive relationship of a three-dimensional model of a resource object.

[0169] Based on the above content, the present application also provides an electronic device, such as Figure 10 As shown, Figure 10 : is a schematic structural diagram of an electronic device embodiment provided by the present application, wherein the electronic device embodiment includes:

[0170] Processor 1001;

[0171] Memory 1002 is used to store a program for processing data generated by a network platform. When the program is read and executed by the processor, it executes the steps of the above-mentioned method for generating an interactive three-dimensional model of a resource object; or, it executes the steps of the above-mentioned method for establishing an interactive relationship of a three-dimensional model of a resource object.

[0172] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0173] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0174] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include non-transitory media such as modulated data signals and carrier waves.

[0175] 2. Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0176] Although the present application is disclosed as above with the preferred embodiments, it is not intended to limit the present application. Any person skilled in the art may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

Claims

1. A three-dimensional model generation interactive method based on mobile terminal resource objects, characterized in that: include: In response to a request for generating a three-dimensional model of a resource object, displaying a collection status interface with a generated three-dimensional collection area; In response to a selection adjustment state interface generated based on the acquisition state interface, an adjustment operation is performed on the displayed selection relationship between the three-dimensional acquisition area and the target resource object; When the selection relationship in the selection adjustment state interface meets the acquisition operation requirements, generating a selection acquisition state interface based on the selection adjustment state interface according to the selection matching relationship determined between the three-dimensional acquisition area and the target resource object; Performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selection matching relationship in the selection acquisition state interface; Displaying the three-dimensional model generated according to the acquisition data of the multi-angle image acquisition in a three-dimensional model display interface; The step of adjusting the selection relationship between the displayed three-dimensional acquisition area and the target resource object in response to the selection adjustment state interface generated based on the acquisition state interface includes: Moving the three-dimensional acquisition area to the position of the target resource object; or moving the target resource object to the position of the three-dimensional acquisition area; The range of the three-dimensional acquisition area is adjusted, and the target resource object is selected within the three-dimensional acquisition area.

2. The interactive method for generating a three-dimensional model based on a mobile terminal resource object according to claim 1, characterized in that: The step of displaying a collection state interface with a three-dimensional collection area in response to a three-dimensional model generation request of a resource object comprises: In response to the three-dimensional model generation request, identifying a two-dimensional area in the acquisition status interface where the target resource object is located; The three-dimensional acquisition area generated based on the two-dimensional area is displayed on the acquisition status interface.

3. The interactive method for generating a three-dimensional model based on a mobile terminal resource object according to claim 2, characterized in that: The step of identifying, in response to the three-dimensional model generation request, a two-dimensional area where the target resource object is located in the acquisition status interface includes: In response to the three-dimensional model generation request, identifying a plane in the acquisition status interface for supporting the target resource object; generating the two-dimensional region according to the plane; The two-dimensional area is displayed on the acquisition status interface.

4. The interactive method for generating a three-dimensional model based on a mobile terminal resource object according to claim 1, characterized in that: The adjusting the range of the three-dimensional acquisition area to select the target resource object within the three-dimensional acquisition area includes: In response to an adjustment operation on a parameter adjustment control in the acquisition status interface; or in response to an adjustment operation on a range of the three-dimensional acquisition area in the acquisition status interface, the target resource object is selected within the three-dimensional acquisition area.

5. The interactive method for generating a three-dimensional model based on a mobile terminal resource object according to claim 4, characterized in that: The performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selection matching relationship in the selection acquisition state interface includes: According to the selected matching relationship, in response to triggering a capture operation in the selected capture state interface, outputting multi-angle capture prompt information; According to the multi-angle acquisition prompt information, multi-angle image acquisition is performed on the three-dimensional acquisition area and the target resource object having the selection matching relationship.

6. The interactive method for generating a three-dimensional model based on a mobile terminal resource object according to claim 5, characterized in that: The performing multi-angle image acquisition on the three-dimensional acquisition area and the target resource object having the selected matching relationship according to the multi-angle acquisition prompt information includes: According to the multi-angle acquisition prompt information, taking the target resource object selected in the three-dimensional acquisition area in the selection acquisition interface as a reference object, the acquisition device performs the multi-angle image acquisition in the horizontal direction around the reference object; or, According to the multi-angle acquisition prompt information, the target resource object is rotated in the horizontal direction with the acquisition device as a reference to perform multi-angle image acquisition.

7. The interactive method for generating a three-dimensional model based on a mobile terminal resource object according to claim 1, characterized in that: The step of displaying the three-dimensional model generated according to the acquisition data acquired by the multi-angle image acquisition in the three-dimensional model display interface includes: In response to a viewing angle operation of the three-dimensional model display interface, rotating the three-dimensional model to a position matching the viewing angle operation for display; or, In response to a viewing operation on the three-dimensional model display interface, the three-dimensional model is automatically rotated for display on the three-dimensional model display interface.

8. A three-dimensional model generation interactive device based on mobile terminal resource objects, characterized in that: include: A first display unit, configured to display a collection state interface with a three-dimensional collection area generated in response to a three-dimensional model generation request of a resource object; A first generating unit, configured to adjust the selection relationship between the displayed three-dimensional acquisition area and the target resource object in response to a selection adjustment state interface generated based on the acquisition state interface; A second generating unit is configured to generate a selection acquisition state interface based on the selection adjustment state interface according to the selection matching relationship determined between the three-dimensional acquisition area and the target resource object when the selection relationship in the selection adjustment state interface meets the acquisition operation requirement; A collection unit, used for performing multi-angle image collection on the three-dimensional collection area and the target resource object having the selection matching relationship in the selection collection state interface; A second display unit, used to display the three-dimensional model generated according to the acquisition data of the multi-angle image acquisition in a three-dimensional model display interface; The first generating unit is specifically configured to move the three-dimensional acquisition area to the position of the target resource object; or move the target resource object to the position of the three-dimensional acquisition area; The range of the three-dimensional acquisition area is adjusted, and the target resource object is selected within the three-dimensional acquisition area.

9. A method for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects, characterized in that: include: Acquire multi-angle image data collected based on the matching relationship between the three-dimensional acquisition area and the target resource object; Determine, according to the position data and posture data of the target resource object in the frame picture of the multi-angle image data, a collection distance between the target resource object in the frame picture and a collection device and a rotation angle of the target resource object in the frame picture; Normalizing the acquisition distance and the rotation angle onto a spatial spherical surface; A correspondence between the normalized frame image and the interactive operation is established.

10. A device for establishing a three-dimensional model interactive relationship based on mobile terminal resource objects, characterized in that: include: An acquisition unit, used to acquire multi-angle image data acquired according to a matching relationship selected between a three-dimensional acquisition area and a target resource object; a determining unit, configured to determine, according to the position data and posture data of the target resource object in the frame picture of the multi-angle image data, a collection distance between the target resource object in the frame picture and a collection device and a rotation angle of the target resource object in the frame picture; A processing unit, used for normalizing the acquisition distance and the rotation angle in the frame to a spatial sphere; An establishing unit is used to establish an interactive correspondence relationship between the normalized frame image and the interactive operation.

11. A computer storage medium for storing data generated by a network platform and a program for processing the data generated by the network platform; When the program is read and executed by the processor, it executes the three-dimensional model generation interaction method based on mobile terminal resource objects as described in any one of claims 1 to 7; or, it executes the three-dimensional model interaction relationship establishment method based on mobile terminal resource objects as described in claim 9.

12. An electronic device comprising: processor; A memory for storing a program for processing data generated by a network platform, wherein when the program is read and executed by the processor, the program executes the three-dimensional model generation interaction method based on mobile terminal resource objects as described in any one of claims 1 to 7; or, executes the three-dimensional model interaction relationship establishment method based on mobile terminal resource objects as described in claim 9.

Images