Multimedia content fusion method based on 3d model

Abstract

The invention discloses a multimedia content fusion method based on a 3d model, and solves the technical problem that a paper sculpture note manufactured by an existing method is relatively single in function. Comprising the following steps: manufacturing a paper-carved note sample; making multimedia content of the paper carving note; designing an AR program; according to the designed AR program, designing a paper-carved note 3D model, and making the paper-carved note 3D model into a real object; and in combination with a 3D paper sculpture note real object, an AR program of debugging design is optimized. According to the method, an existing method for manufacturing the paper-carved note is improved, the AR scanning function and the multimedia technology are utilized, the content of voice, videos, pictures and the like related to the paper-carved note is increased, the paper-carved note has the capability of being applied to various devices and scene environments, and the application range of the paper-carved note is widened. The method is more suitable for display, propaganda and popularization in multi-scene environments such as multimedia and intelligent equipment, the limitation of popularization and propaganda of an existing paper sculpture note product is broken through, and output of various cultural value contents of the paper sculpture note is facilitated.

Description

Technical Field

[0001] The present invention belongs to the technical field of paper carving production, and particularly relates to a multimedia content fusion method based on a 3D model. Background Art

[0002] The three-dimensional paper carving sticky note is a newly emerging paper carving stationery product in recent years. It was first launched by the Japanese company OMOSHIROIBLOCK in 2018 and became a popular cultural and creative product as soon as it came out. Subsequently, domestic companies have successively borrowed the corresponding production methods and launched various model paper carving sticky notes. At present, there are many three-dimensional paper carving sticky notes with different shapes on the market. These three-dimensional paper carving sticky notes use the method of stacking and tearing paper to gradually outline the 2D and 3D models of buildings and objects. The models are presented with contents such as buildings, landscapes, and characters. The production method of the existing paper carving sticky notes is not difficult, but the functions of the paper carving sticky notes made by the existing method are relatively single. It is impossible to display multimedia contents such as pictures, texts, videos, and programs through the paper carving model, and it is even more difficult to achieve the effect of product + content + interaction. It does not have the conditions to provide the output of multiple cultural value contents, and there are limitations in promotion and publicity. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a multimedia content fusion method based on a 3D model to solve the technical problem that the functions of the paper carving sticky notes made by the existing method are relatively single.

[0004] To achieve the above object, the technical solution adopted by the present invention is as follows:

[0005] A multimedia content fusion method based on a 3D model, characterized by comprising the following steps:

[0006] Step 1, making a paper carving sticky note sample;

[0007] Step 2, making multimedia content of the paper carving sticky note;

[0008] Step 3, designing an AR program;

[0009] Step 4, designing a 3D model of the paper carving sticky note according to the recognition accuracy of the AR program designed in Step 3, and making the designed 3D model of the paper carving sticky note into a physical object;

[0010] Step 5, optimizing and debugging the AR program on the basis of the designed AR program in combination with the physical 3D paper carving sticky note.

[0011] Further, Step 3 includes:

[0012] Step 31, using the image recognition function in OpenCV on Unity to perform feature recognition on the paper carving sticky note sample;

[0013] Step 32: Use SLAM to perform real - space positioning on the recognized paper - cut sticky note sample;

[0014] Step 33: Create a virtual model using 3DMax;

[0015] Step 34: Import the created virtual model and the multimedia content of the paper - cut sticky note into Unity and configure special effects;

[0016] Step 34: Align the real - space positioning of the paper - cut sticky note sample with the 3D coordinates of the virtual model;

[0017] Step 35: Design an interactive page using WebAR to obtain an AR program.

[0018] Furthermore, in step 5, use the physical paper - cut sticky note produced as the recognition object of the designed AR program, and optimize and debug the AR program according to the content displayed by the AR program.

[0019] Furthermore, in step 2, the multimedia content of the paper - cut sticky note produced includes text annotations and audio commentaries of the paper - cut sticky note.

[0020] Furthermore, in step 4, the steps of making the designed 3D model of the paper - cut sticky note into a physical object include:

[0021] Step 41: Create a three - dimensional digital model of the paper - cut sticky note using 3DMax;

[0022] Step 42: Perform layered cutting on the three - dimensional digital model of the paper - cut sticky note to obtain a layered file;

[0023] Step 43: Export the layered file;

[0024] Step 44: Convert the exported layered file into a file that can be recognized by a laser cutter and then import it into the laser cutter. The laser cutter cuts the paper layer by layer according to the file number;

[0025] Step 45: Stack and assemble each layer of the laser - cut paper layer by layer in the order of paper cutting;

[0026] Step 47: Install lights and an acrylic base on the installed paper to obtain a physical paper - cut sticky note.

[0027] Furthermore, in step 42, perform layered cutting on the three - dimensional digital model according to the paper thickness. Furthermore, in step 42, the obtained layered file is the cutting contour line of the paper.

[0028] Furthermore, in step 42, when performing layered cutting on the three - dimensional digital model of the paper - cut sticky note, leave connection points between the layer files.

[0029] Compared with the prior art, the present invention has the following beneficial effects:

[0030] The present invention improves the existing method for making paper carving sticky notes, and utilizes the AR scanning function and multimedia technology to add relevant voice, video, pictures, etc. to the paper carving sticky notes, so that the paper carving sticky notes are presented in the form of 2.5D / 3D, enabling the paper carving sticky notes to have the ability to be applied in various device and scenario environments, that is, it is more suitable for display, publicity and promotion in multi-scenario environments such as multimedia and intelligent devices. It not only breaks the limitations existing in the promotion and publicity of existing paper carving sticky note products, but also facilitates the output of various cultural value contents of the paper carving sticky notes. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 It is a flowchart of the steps of the method of the present invention. DETAILED IMPLEMENTATION METHOD

[0033] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0034] As Figure 1 shown, a multimedia content fusion method based on a 3D model provided by the present invention includes the following steps:

[0035] Step 1, making a paper carving sticky note sample;

[0036] Step 2, making multimedia content of the paper carving sticky note;

[0037] Step 3, designing an AR program;

[0038] Step 4, designing a 3D model of the paper carving sticky note according to the recognition accuracy of the AR program designed in Step 3, and making the designed 3D model of the paper carving sticky note into a physical object;

[0039] Step 5, optimizing and debugging the AR program on the basis of the designed AR program in combination with the physical object of the 3D paper carving sticky note.

[0040] In some embodiments, Step 3 includes:

[0041] Step 31, performing feature recognition on the paper carving sticky note sample using the image recognition function in OpenCV on Unity;

[0042] Step 32, using SLAM to perform real-space positioning on the recognized paper carving sticky note sample;

[0043] Step 33: Create a virtual model using 3DMax;

[0044] Step 34: Import the created virtual model and the multimedia content of the paper-cut sticky note into Unity and configure special effects;

[0045] Step 34: Align the real-space positioning of the paper-cut sticky note sample with the 3D coordinates of the virtual model;

[0046] Step 35: Design an interactive page using WebAR to obtain an AR program.

[0047] In some embodiments, in step 5, the physical paper-cut sticky note produced is used as the recognition object of the designed AR program, and the AR program is optimized and debugged according to the content displayed by the AR program.

[0048] In some embodiments, in step 2, the multimedia content of the paper-cut sticky note produced includes text annotations and audio commentaries of the paper-cut sticky note.

[0049] In some embodiments, in step 4, the steps of making the designed 3D model of the paper-cut sticky note into a physical object include:

[0050] Step 41: Create a three-dimensional digital model of the paper-cut sticky note using 3DMax;

[0051] Step 42: Perform layered cutting on the three-dimensional digital model of the paper-cut sticky note to obtain a layered file;

[0052] Step 43: Export the layered file;

[0053] Step 44: Convert the exported layered file into a file that can be recognized by a laser cutter and then import it into the laser cutter. The laser cutter cuts the paper layer by layer according to the file number;

[0054] Step 45: Stack and assemble each layer of the laser-cut paper layer by layer in the order of paper cutting;

[0055] Step 47: Install lights and an acrylic base on the installed paper to obtain a physical paper-cut sticky note.

[0056] In some embodiments, in step 42, the three-dimensional digital model is cut into layers according to the paper thickness. That is, according to the thickness of the paper to be selected, the three-dimensional digital model is sectioned layer by layer. For example, if the overall height of the model is 60 millimeters and the paper thickness to be selected is 0.2 millimeters, then the model is cut at equal intervals of 0 / 0.2 / 0.4 / 0.6..... to obtain the cross-sectional contour lines at different heights. This cross-sectional contour line is the cutting contour line of the paper.

[0057] In some embodiments, in step 42, the obtained layered file is the cutting contour line of the paper.

[0058] In some embodiments, in step 42, when performing layered cutting on the 3D digital model of the paper-cut sticky note, connection points are reserved between the layer files. The width of the connection points is 0.6 mm. Reserving connection points between the layer files is beneficial for separating each layer of paper after the subsequent laser cutter cuts the paper, thereby facilitating the subsequent assembly of the cut paper into a physical paper-cut sticky note.

[0059] The exported layered file is a vector file. The files recognized by the laser cutter have format requirements. From the vector file to the file recognized by the laser cutter, it only needs to be exported in the vector drawing software.

[0060] The present invention improves the existing method for making paper-cut sticky notes, and uses the AR scanning function and multimedia technology to add content such as voices, videos, and pictures related to the paper-cut sticky notes, so that the paper-cut sticky notes are presented in the form of 2.5D / 3D, enabling the paper-cut sticky notes to have the ability to be applied in a variety of device and scenario environments, that is, it is more suitable for display, promotion, and publicity in multi-scenario environments such as multimedia and intelligent devices. It not only breaks the limitations of the existing paper-cut sticky note products in promotion and publicity, but also facilitates the output of various cultural value contents of the paper-cut sticky notes.

[0061] Finally, it should be noted that: the above embodiments are only relatively preferred embodiments of the present invention to illustrate the technical solutions of the present invention, rather than limiting it, and certainly not limiting the patent scope of the present invention; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention; that is to say, any meaningless modifications or touch-ups made on the main design concept and spirit of the present invention, as long as the technical problems solved are still the same as those of the present invention, should be included within the protection scope of the present invention; in addition, directly or indirectly applying the technical solutions of the present invention to other related technical fields shall also be included within the patent protection scope of the present invention by the same token.

Claims

1. A multimedia content fusion method based on a 3D model, characterized in that, It includes the following steps: Step 1, make a paper carving sticky note sample; Step 2, make multimedia content of the paper carving sticky note; Step 3, design an AR program; Step 4, according to the recognition accuracy of the AR program designed in Step 3, design a 3D model of the paper carving sticky note, and make the designed 3D model of the paper carving sticky note into a physical object; Step 5, on the basis of the designed AR program, combine the physical 3D paper carving sticky note to optimize and debug the AR program.

2. The multimedia content fusion method based on a 3D model according to claim 1, wherein, Step 3 includes: Step 31, use the image recognition function in OpenCV on Unity to perform feature recognition on the paper carving sticky note sample; Step 32, use SLAM to perform real-space positioning on the recognized paper carving sticky note sample; Step 33, use 3DMax to create a virtual model; Step 34, import the created virtual model and the multimedia content of the paper carving sticky note into Unity and configure special effects; Step 34, align the real-space positioning of the paper carving sticky note sample with the 3D coordinates of the virtual model; Step 35, use WebAR to design an interactive page to obtain an AR program.

3. The multimedia content fusion method based on a 3D model according to claim 2, wherein In Step 5, use the made physical paper carving sticky note as the recognition object of the designed AR program, and optimize and debug the AR program according to the content displayed by the AR program.

4. A multimedia content fusion method based on a 3D model according to claim 1, characterized in that, In Step 2, the multimedia content of the paper carving sticky note made includes text annotations and audio commentaries of the paper carving sticky note.

5. A multimedia content fusion method based on a 3D model according to claim 1, characterized in that In Step 4, the steps of making the designed 3D model of the paper carving sticky note into a physical object include: Step 41, use 3DMax to create a three-dimensional digital model of the paper carving sticky note; Step 42, perform layered cutting on the three-dimensional digital model of the paper carving sticky note to obtain a layered file; Step 43, export the layered file; Step 44, convert the exported layered file into a file that can be recognized by a laser cutting machine and then import it into the laser cutting machine. The laser cutting machine cuts the paper layer by layer according to the file number; Step 45, stack and assemble each layer of the laser-cut paper layer by layer in the order of paper cutting; Step 47, install lights and an acrylic base on the installed paper to obtain a physical paper carving sticky note.

6. A multimedia content fusion method based on a 3D model according to claim 4, characterized in that, In Step 42, perform layered cutting on the three-dimensional digital model according to the paper thickness.

7. A multimedia content fusion method based on a 3D model according to claim 4, characterized in that In Step 42, the obtained layered file is the cutting contour line of the paper.

8. A multimedia content fusion method based on a 3D model according to claim 4, characterized in that, In Step 42, when performing layered cutting on the three-dimensional digital model of the paper carving sticky note, leave connection points between the layer files.

Images