Historical block-based narrative interaction method and system, and intelligent device

Abstract

The invention discloses a narrative interaction method and system based on a historical block and intelligent equipment, and belongs to the technical field of element universe. The method comprises the following steps: acquiring site scanning data of historical blocks; establishing a digital asset model according to a sparse point cloud algorithm and the site scanning data; constructing a virtual historical block scene according to the digital asset model; and interacting with a target user according to the virtual historical block scene. The technical effect of improving the education function of the historical block is achieved.

Description

Technical Field

[0001] The present invention relates to the field of metaverse, and in particular to a narrative interaction method, system, intelligent device and storage medium based on historical blocks. Background Art

[0002] With the diversification of mass consumption and the development of electronic information technology, the cultural tourism industry needs to be constantly innovated. At present, the Cultural Tourism Bureau often attracts tourists and audiences by preserving ancient original buildings in historical blocks and improving the image of ancient buildings. However, many ancient buildings and historical information are only displayed independently and cannot be fully pushed to tourists and audiences. The information density of a single ancient building and a single text information is insufficient, and the display effect is poor, which cannot adapt to the information contact method of the current young people who grew up based on the video interaction generation. This leads to a decline in the ability to spread culture and a decline in educational functions.

[0003] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of the present invention is to provide a narrative interaction method, system, intelligent device and storage medium based on historical blocks, aiming to improve the educational function of historical blocks.

[0005] To achieve the above object, the present invention provides a narrative interaction method based on a historical block, the narrative interaction method based on a historical block comprising the following steps:

[0006] Obtain site scan data for historic districts;

[0007] Establishing a digital asset model based on a sparse point cloud algorithm and the site scan data;

[0008] constructing a virtual historical block scene according to the digital asset model;

[0009] Interact with target users based on the virtual historical district scene.

[0010] Optionally, after the step of establishing the digital asset model according to the sparse point cloud algorithm and the site scanning data, the step further includes:

[0011] Obtain cultural archival data of the historic district;

[0012] Matching the cultural archive data with the site scan data to obtain matching data;

[0013] The associated position relationship between the digital asset model and the cultural archive data is determined according to the matching data.

[0014] Optionally, the step of matching the cultural archive data with the site scan data to obtain matching data comprises:

[0015] Standardizing the cultural archive data to obtain standard cultural relic data;

[0016] Matching the standard cultural relic data and the site scanning data according to a three-dimensional matching algorithm to obtain matching data;

[0017] The step of determining the positional relationship between the digital asset model and the cultural archive data according to the matching data comprises:

[0018] The standard cultural relic data is associated with the digital asset model according to the matching data and the associated position relationship is determined.

[0019] Optionally, the step of establishing a digital asset model according to a sparse point cloud algorithm and the site scanning data includes:

[0020] Simplifying the site scan data according to the sparse point cloud algorithm to obtain simplified site data;

[0021] The digital asset model is established based on the visual positioning service and simplified site data.

[0022] Optionally, there are multiple digital asset models, and the step of constructing a virtual historical block scene according to the digital asset models includes:

[0023] Importing each of the digital asset models into the Unity platform;

[0024] Each of the digital asset models is integrated and bound in the Unity platform to obtain the virtual historical block scene.

[0025] Optionally, the step of obtaining site scanning data of the historic district includes:

[0026] The drone is controlled to scan each object in the historic district.

[0027] In addition, to achieve the above-mentioned purpose, the present invention further provides a narrative interaction system based on historical blocks, the narrative interaction system based on historical blocks comprising:

[0028] A scanning module for acquiring site scan data of historic districts;

[0029] A processing module, for establishing a digital asset model based on a sparse point cloud algorithm and the site scan data;

[0030] An integration module for constructing a virtual historical block scene based on the digital asset model;

[0031] An interaction module is used to interact with target users based on the virtual historical block scene.

[0032] Optionally, the narrative interaction system based on historical blocks further includes:

[0033] A positioning module is used to obtain the cultural archive data of the historical block; match the cultural archive data with the site scanning data to obtain matching data; and determine the associated position relationship between the digital asset model and the cultural archive data based on the matching data.

[0034] In addition, to achieve the above-mentioned purpose, the present invention also provides an intelligent device, which includes: a memory, a processor, and a narrative interaction program based on a historical block stored in the memory and executable on the processor, wherein the narrative interaction program based on a historical block is configured to implement the steps of any of the above-mentioned narrative interaction methods based on a historical block.

[0035] In addition, to achieve the above-mentioned purpose, the present invention also provides a storage medium, on which a narrative interaction program based on a historical block is stored, and when the narrative interaction program based on a historical block is executed by a processor, the steps of the narrative interaction method based on a historical block described in any one of the above-mentioned items are implemented.

[0036] The present invention proposes a narrative interaction method based on historical blocks. The method obtains site scanning data of the historical blocks and constructs a virtual historical block scene according to the digital asset model. The virtual historical block scene constructed according to the digital asset model can fully display the historical contact scene, thereby increasing the amount of information interacted with the user, and further improving the educational effect of the educational function of the historical block. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a schematic diagram of the structure of an intelligent device in a hardware operating environment involved in an embodiment of the present invention;

[0038] Figure 2 It is a flowchart of a first embodiment of the narrative interaction method based on historical blocks of the present invention;

[0039] Figure 3 This is an example of a full-site scan;

[0040] Figure 4 is a feature space graph including feature points of sparse point cloud;

[0041] Figure 5 The image data of the roof and the wall in the second embodiment of the narrative interaction method based on the historical block;

[0042] Figure 6The image data of the window in the second embodiment of the narrative interaction method based on the historical district;

[0043] Figure 7 It is a flowchart of a third embodiment of the narrative interaction method based on historical blocks of the present invention;

[0044] Figure 8 This is a RAR historical scene experience map;

[0045] Fig. 9 It is a text data display diagram of cultural archive data in the virtual historical district scene;

[0046] Fig.10 Label renderings constructed for text data from cultural archive data in a virtual historical district scene;

[0047] Fig.11 This is an interactive example of a window in a virtual historic district scene;

[0048] Fig.12 This is an interactive example of a window in a virtual historic district scene;

[0049] Fig.13 An example image of a reconstruction of an ancient scene.

[0050] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0051] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0052] Reference Figure 1 , Figure 1 A schematic diagram of the structure of an intelligent device in the hardware operating environment involved in an embodiment of the present invention.

[0053] like Figure 1As shown, the smart device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, an interactive device 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The interactive device 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional interactive device 1003 may also be connected to the communication bus through a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0054] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the smart device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0055] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating system, a data storage module, a network communication module, a user interface module, and a narrative interaction program based on historical blocks.

[0056] exist Figure 1 In the smart device shown, the network interface 1004 is mainly used for data communication with other devices; the interactive device 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the smart device of the present invention can be set in the smart device, and the smart device calls the narrative interaction program based on historical blocks stored in the memory 1005 through the processor 1001, and executes the narrative interaction method based on historical blocks provided in the embodiment of the present invention.

[0057] The embodiment of the present invention provides a narrative interaction method based on a historical block, referring to Figure 2 , Figure 2 It is a flowchart of a first embodiment of a narrative interaction method based on historical blocks of the present invention.

[0058] In this embodiment, the narrative interaction method based on historical blocks includes:

[0059] Step S1, obtaining site scanning data of the historical district;

[0060] In this embodiment, the site scanning data of the historical block here may include ancient buildings, cultural relics, documents, tools, weapons, furniture, and clothing in the historical block. Ancient buildings include: ancient palaces, temples, churches, houses, bridges, towers, etc. It should be noted that the acquisition method here can adopt a method including laser scanning to obtain the site scanning data, and specifically, it can be obtained by drone or manual scanning. In addition, the site scanning data is specifically point cloud data, and the point cloud data can have different scanning accuracy according to different object types, that is, the density of the point cloud. For specific reference Figure 3 As shown, Figure 3 The site is scanned in its entirety, and a site survey map is obtained by combining airborne photogrammetry, ground-based 3D laser scanning, and drone aerial photography. In this embodiment, the Cultural Tourism Bureau and the cultural relics protection unit can upload the scanned data to the Meta-RAR platform to facilitate the management and update of the site scan data, thereby further managing and updating the digital cultural assets and digital cultural relics information of the historical block according to subsequent steps S2 and S3.

[0061] Step S2, establishing a digital asset model based on a sparse point cloud algorithm and the site scanning data;

[0062] In this embodiment, the specific steps of processing the origin scan data according to the sparse point cloud algorithm include: preprocessing of point cloud data, feature extraction, point cloud segmentation, point cloud simplification, feature point retention, etc. Specifically, the preprocessing of point cloud data includes denoising and filtering, so as to remove outliers and noise in the point cloud data. Feature extraction can effectively determine the point cloud data that need to be focused on, and simplify the non-feature point cloud data. The specific simplification method is to simplify through the octree algorithm. During the simplification process, the space will be recursively divided into multiple sub-cubes, and only one non-feature point cloud data will be retained in each divided cube. In this embodiment, the number of divided cubes can determine the degree of simplification. Refer to Figure 4 , Figure 4 is a feature space graph including feature points of sparse point cloud.

[0063] Step S3, constructing a virtual historical block scene according to the digital asset model;

[0064] In this embodiment, the digital asset model is input into the Unity platform, and a plurality of the digital asset models are used to construct a virtual historical block scene in the Unity platform.

[0065] Step S4: interacting with the target user according to the virtual historical block scene.

[0066] Specifically, the virtual historical block scene is rendered in the Unity platform, where the rendering includes rendering pipeline, rendering texture, and changing the lighting conditions of the historical block scene. Optionally, the interaction with the user is achieved through mobile devices such as AR glasses, iPad, mobile phones, etc. Furthermore, in this embodiment, a display device can also be set in the historical block to interact with the user.

[0067] In this embodiment, by acquiring site scanning data of the historical block and constructing a virtual historical block scene based on the digital asset model, the historical contact scene can be fully displayed, thereby increasing the amount of information interacted with the user, and further improving the educational effect of the educational function of the historical block.

[0068] Further, based on the first embodiment, a second embodiment of the narrative interaction method based on the historical block of the present invention is proposed. In this embodiment, after the step of establishing the digital asset model according to the sparse point cloud algorithm and the site scanning data, the method further includes:

[0069] obtaining cultural archival data of the historic district;

[0070] Matching the cultural archive data with the site scan data to obtain matching data;

[0071] The associated position relationship between the digital asset model and the cultural archive data is determined according to the matching data.

[0072] The cultural archive data here may include data such as text and images. Optionally, the image data in the historical block is obtained by combining different camera positions. Preferably, refer to Figure 5 and Figure 6 ,in, Figure 5 is the image data of the roof and wall, Figure 6 The image data of the window. Specifically, the cultural archive data is matched with the site scan data through three-dimensional matching technology, and feature matching is performed with the feature points of the site scan data, and the point cloud is projected onto the image of the cultural archive data so as to directly correspond to the pixels of the image. The matching effect is further improved through an iterative optimization algorithm, thereby obtaining an associated position relationship.

[0073] In this embodiment, by acquiring the cultural archive data of the historical block and matching the cultural archive data with the site scanning data, matching data is obtained, and the associated positional relationship between the digital asset model and the cultural archive data is determined based on the matching data, thereby obtaining a complete and accurate digital asset model.

[0074] Furthermore, the step of matching the cultural archive data with the site scan data to obtain matching data includes:

[0075] Standardizing the cultural archive data to obtain standard cultural relic data;

[0076] Matching the standard cultural relic data and the site scanning data according to a three-dimensional matching algorithm to obtain matching data;

[0077] The step of determining the positional relationship between the digital asset model and the cultural archive data according to the matching data comprises:

[0078] The standard cultural relic data is associated with the digital asset model according to the matching data and the associated position relationship is determined.

[0079] Specifically, through normalization processing, the pixel value range of the image data is limited to the pre-examination range, and through the processing of de-meaning time centering, standard cultural relic data can be obtained.

[0080] In this embodiment, the standard cultural relic data is obtained by standardizing the cultural archive data; and the standard cultural relic data and the site scanning data are matched according to a three-dimensional matching algorithm to obtain matching data, thereby improving the integrity of the subsequent construction of the virtual historical block scene.

[0081] Further, based on the first embodiment or the second embodiment, a third embodiment of the narrative interaction method based on the historical block of the present invention is proposed, referring to Figure 7 In this embodiment, the step of establishing a digital asset model based on the sparse point cloud algorithm and the site scanning data includes:

[0082] Step S21, simplifying the site scan data according to the sparse point cloud algorithm to obtain simplified site data;

[0083] Step S22: establishing the digital asset model according to the visual positioning service and simplified site data.

[0084] In this embodiment, the site scan data can be subdivided to obtain multiple sub-scan data, and further fine modeling can be performed through the sub-scan data, and the spatial accuracy of the model can be enhanced through the visual positioning system (VPS). For tourists and users, tourists can explore the historical blocks through AR devices, and each door, window and architectural element will tell the historical story behind it. At the same time, AR devices can be used on real historical blocks at the same time, and tourists can be guided to the location they want to go in the virtual historical blocks, which can increase tourists' interest and enhance the attractiveness of cultural tourism. In addition, through interaction with virtual historical scenes, tourists can have a deep understanding of historical information and increase the fun and sense of participation in the travel process. In addition, it should be noted that based on the tourist behavior data collected by electronic devices through the platform, the government and the Cultural and Tourism Bureau can perform data analysis to determine key and excellent digital asset models, so that key and excellent digital asset models can be pushed first, and management and promotion strategies can be optimized.

[0085] Further, based on any of the above embodiments, a fourth embodiment of the narrative interaction method based on historical blocks of the present invention is proposed. In this embodiment, the number of the digital asset models is multiple, and the step of constructing a virtual historical block scene according to the digital asset models includes:

[0086] Importing each of the digital asset models into the Unity platform;

[0087] Each of the digital asset models is integrated and bound in the Unity platform to obtain the virtual historical block scene.

[0088] In this embodiment, the virtual historical district scene here can refer to Figure 8 , Fig. 9 as well as Fig.10 As shown, Figure 8 This is a RAR historical scene experience map. Fig. 9 The text data display diagram of the cultural archive data in the virtual historical block scene can be displayed together with the digital asset model, and the corresponding text data can be controlled by different interactive instructions. Fig.10 The label renderings constructed for the text data of the cultural archive data in the virtual historical block scene, where the labels can be displayed in front of the digital asset model for prompts. Compared with the traditional display method of historical blocks, this expression method can increase the information density in the interactive process, allowing tourists and users to learn and experience better. Fig.11 and Fig.12 , Fig.11 This is an interactive example of a window in a virtual historic district scene. Fig.12This is an interactive example of a window in a virtual historical district scene. In addition, it should be noted that for some damaged buildings, architectural reconstruction technology can be used to restore the appearance of the real ancient scene reconstruction. Fig.13 As shown, Fig.13 An example image of a reconstruction of an ancient scene.

[0089] In addition, the embodiment of the present invention further proposes a narrative interaction system based on a historical block, and the narrative interaction system based on a historical block includes:

[0090] A scanning module for acquiring site scan data of historic districts;

[0091] A processing module, for establishing a digital asset model based on a sparse point cloud algorithm and the site scan data;

[0092] An integration module for constructing a virtual historical block scene based on the digital asset model;

[0093] An interaction module is used to interact with target users based on the virtual historical block scene.

[0094] Furthermore, the narrative interaction system based on historical blocks also includes: a positioning module, used to obtain cultural archive data of the historical blocks; match the cultural archive data with the site scanning data to obtain matching data; and determine the associated positional relationship between the digital asset model and the cultural archive data based on the matching data.

[0095] In addition, an embodiment of the present invention further proposes an intelligent device, comprising: a memory, a processor, and a narrative interaction program based on a historical block stored in the memory and executable on the processor, wherein the narrative interaction program based on a historical block is configured to implement the steps of any of the embodiments of the narrative interaction method based on a historical block described above.

[0096] In addition, an embodiment of the present invention further proposes a storage medium on which a narrative interaction program based on a historical block is stored. When the narrative interaction program based on a historical block is executed by a processor, the embodiment steps of any of the above-mentioned narrative interaction methods based on a historical block are implemented.

[0097] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0098] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0099] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0100] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A narrative interaction method based on historical blocks, characterized in that: The narrative interaction method based on historical blocks includes the following steps: Obtain site scan data for historic districts; Establishing a digital asset model based on a sparse point cloud algorithm and the site scan data; constructing a virtual historical block scene according to the digital asset model; Interact with target users based on the virtual historical district scene.

2. The narrative interaction method based on historical blocks as claimed in claim 1, characterized in that: After the step of establishing a digital asset model based on the sparse point cloud algorithm and the site scanning data, the method further includes: Obtain cultural archival data of the historic district; Matching the cultural archive data with the site scan data to obtain matching data; The associated position relationship between the digital asset model and the cultural archive data is determined according to the matching data.

3. The narrative interaction method based on historical blocks as claimed in claim 2, characterized in that: The step of matching the cultural archive data with the site scan data to obtain matching data comprises: Standardizing the cultural archive data to obtain standard cultural relic data; Matching the standard cultural relic data and the site scanning data according to a three-dimensional matching algorithm to obtain matching data; The step of determining the positional relationship between the digital asset model and the cultural archive data according to the matching data comprises: The standard cultural relic data is associated with the digital asset model according to the matching data and the associated position relationship is determined.

4. The narrative interaction method based on historical blocks as claimed in claim 1, characterized in that: The step of establishing a digital asset model based on the sparse point cloud algorithm and the site scanning data includes: Simplifying the site scan data according to the sparse point cloud algorithm to obtain simplified site data; The digital asset model is established based on the visual positioning service and simplified site data.

5. The narrative interaction method based on historical blocks as claimed in claim 1, characterized in that: The number of the digital asset models is multiple, and the step of constructing a virtual historical block scene according to the digital asset models includes: Importing each of the digital asset models into the Unity platform; Each of the digital asset models is integrated and bound in the Unity platform to obtain the virtual historical block scene.

6. The narrative interaction method based on historical blocks according to any one of claims 1 to 5, characterized in that: The step of obtaining site scanning data of the historic district comprises: The drone is controlled to scan each object in the historic district.

7. A narrative interaction system based on historical blocks, characterized in that: The narrative interaction system based on historical blocks includes: A scanning module for acquiring site scan data of historic districts; A processing module, for establishing a digital asset model based on a sparse point cloud algorithm and the site scan data; An integration module for constructing a virtual historical block scene based on the digital asset model; An interaction module is used to interact with target users based on the virtual historical block scene.

8. The narrative interaction system based on historical blocks as claimed in claim 7, characterized in that: The narrative interaction system based on historical blocks also includes: A positioning module is used to obtain the cultural archive data of the historical block; match the cultural archive data with the site scanning data to obtain matching data; and determine the associated position relationship between the digital asset model and the cultural archive data based on the matching data.

9. A smart device, characterized in that: The smart device includes: a memory, a processor, and a narrative interaction program based on a historical block stored in the memory and executable on the processor, wherein the narrative interaction program based on a historical block is configured to implement the steps of the narrative interaction method based on a historical block as described in any one of claims 1 to 6.

10. A storage medium, characterized in that: The storage medium stores a narrative interaction program based on a historical block, and when the narrative interaction program based on a historical block is executed by a processor, the steps of the narrative interaction method based on a historical block as described in any one of claims 1 to 6 are implemented.

Images