Cultural relic display method and device based on three-dimensional model and medium

Abstract

The embodiment of the invention discloses a cultural relic display method and device based on a three-dimensional model and a medium, and relates to the technical field of cultural relic display, and the method comprises the steps: collecting the cultural relic display demand information of a current user through a preset cultural relic display portable terminal in a current exhibition hall, and determining the intentional cultural relic information corresponding to the current user; according to the intentional cultural relic information, determining at least one corresponding cultural relic three-dimensional model, and constructing a cultural relic terminal display library corresponding to the cultural relic display portable terminal; based on the real-time terminal position data and the exhibition hall distribution data, performing cultural relic position matching on the current user, determining at least one real-time target cultural relic of the current user, performing model matching, and determining at least one target cultural relic three-dimensional model corresponding to the cultural relic display portable terminal; cultural relic display information of each target cultural relic three-dimensional model is determined, real-time target cultural relics are displayed in the cultural relic display portable terminal according to the cultural relic display information, and the cultural relic display information comprises cultural relic information and cultural relic interaction information.

Description

Technical Field

[0001] The present invention relates to the field of cultural relic display technology, and in particular to a cultural relic display method, device and medium based on a three-dimensional model. Background Art

[0002] In the field of cultural relics exhibition, cultural relics display mainly relies on physical display, picture display and simple multimedia presentation. Although physical display can directly present the true form of cultural relics, it is limited by space, protection conditions and display time. Visitors can often only observe cultural relics from limited angles and find it difficult to fully understand their details and characteristics. Although picture display can make up for the shortcomings of physical display to a certain extent, it is a two-dimensional flat image and cannot truly show the three-dimensional form and spatial relationship of cultural relics. With the continuous development of science and technology, some digital display methods have begun to appear, such as three-dimensional models.

[0003] At present, the three-dimensional display of cultural relics is carried out in the exhibition venue through the display equipment fixed in the exhibition hall, and the setting position of the display equipment is relatively fixed, such as being set at the entrance. In this scenario, the audience can only passively accept the preset display content and order, and cannot make independent choices and explorations according to their own interests and needs; and the distance between the equipment location and the actual exhibition location of the cultural relics is large, resulting in a relative separation between the cultural relic display process and the cultural relic itself. In addition, the current display method lacks an effective interactive mechanism, and the communication between the audience and the cultural relics is limited to one-way viewing and listening, and real interaction and participation cannot be achieved. Therefore, when the cultural relics are displayed through fixed display equipment, the display location, display content and display order are relatively fixed, and the cultural relic display process is relatively separated from the cultural relic itself and the audience's needs, which affects the audience's viewing experience. Summary of the invention

[0004] One or more embodiments of the present specification provide a method, device and medium for displaying cultural relics based on a three-dimensional model, which are used to solve the following technical problems: when displaying cultural relics through fixed display equipment, the display position, display content and display order are relatively fixed, and the cultural relic display process is relatively separated from the cultural relics themselves and the audience's needs, which affects the audience's exhibition experience.

[0005] One or more embodiments of this specification adopt the following technical solutions:

[0006] One or more embodiments of the present specification provide a cultural relic display method based on a three-dimensional model, the method comprising: collecting cultural relic display demand information of a current user through a preset cultural relic display portable terminal in a current exhibition hall, and determining intended cultural relic information corresponding to the current user according to the cultural relic display demand information of the current user and pre-acquired exhibition hall distribution data; screening in a preset three-dimensional cultural relic library according to the intended cultural relic information to determine at least one corresponding three-dimensional cultural relic model, and constructing a cultural relic terminal display library corresponding to the cultural relic display portable terminal; acquiring real-time terminal position data of the cultural relic display portable terminal, and performing cultural relic position matching on the current user based on the real-time terminal position data and the exhibition hall distribution data, and determining at least one real-time target cultural relic of the current user, so as to perform model matching in the cultural relic terminal display library, and determining at least one target cultural relic three-dimensional model corresponding to the cultural relic display portable terminal; determining cultural relic display information of each of the target cultural relic three-dimensional models, and displaying the real-time target cultural relic in the cultural relic display portable terminal according to the cultural relic display information, wherein the cultural relic display information includes cultural relic information and cultural relic interaction information.

[0007] One or more embodiments of this specification provide a cultural relic display device based on a three-dimensional model, including:

[0008] at least one processor; and,

[0009] a memory communicatively connected to the at least one processor; wherein,

[0010] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the above method.

[0011] One or more embodiments of the present specification provide a non-volatile computer storage medium storing computer executable instructions, wherein the computer executable instructions are configured to execute the above method.

[0012] At least one of the above technical solutions adopted in the embodiments of this specification can achieve the following beneficial effects: through the above technical solution, by collecting the user's cultural relics display demand information, it is possible to provide users with personalized cultural relics display services, so that users can browse and understand cultural relics according to their own interests and needs, avoiding the problem of relatively fixed display positions, display contents and display sequences when displaying cultural relics through fixed display equipment, and realizing personalized display; based on real-time terminal location data and exhibition hall distribution data, cultural relics are matched for users in real time, improving users' exhibition viewing efficiency and experience, effectively solving the problem of relative separation between the cultural relics display process and the cultural relics themselves, and enhancing users' exhibition viewing experience; by building a cultural relics terminal display library, and matching and displaying the three-dimensional model of the target cultural relics and their cultural relics display information in it, users can have a more comprehensive and in-depth Understand the historical background, cultural connotation and artistic value of cultural relics; the addition of interactive information on cultural relics allows users to learn about cultural relics in an interactive way during the exhibition process, enhancing the interest and effectiveness of learning; it can quickly match and display cultural relics that users are interested in based on the user's real-time location and intended cultural relic information, avoiding users from blindly searching and wasting time in the exhibition hall; combined with the exhibition hall distribution data, it can also provide users with the best exhibition route planning to help users visit the exhibition hall efficiently and orderly; displaying three-dimensional models of cultural relics through portable cultural relic display terminals reduces users' direct contact with cultural relics, reduces the risk of damage to cultural relics, and is beneficial to cultural relic protection; through the user behavior data collected by the portable cultural relic display terminal, the exhibition hall can analyze users' exhibition habits and preferences, and provide data support for subsequent exhibition planning and layout optimization. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the embodiments of this specification or the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art description. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. In the drawings:

[0014] Figure 1 A schematic diagram of a flow chart of a method for displaying cultural relics based on a three-dimensional model provided in an embodiment of this specification;

[0015] Figure 2 A schematic diagram of the structure of a cultural relic display device based on a three-dimensional model provided in an embodiment of this specification. DETAILED DESCRIPTION

[0016] In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this specification.

[0017] The embodiment of this specification provides a method for displaying cultural relics based on a three-dimensional model. It should be noted that the execution subject in the embodiment of this specification can be a server or any device with data processing capabilities. Figure 1 A flow chart of a method for displaying cultural relics based on a three-dimensional model provided in an embodiment of this specification is shown in FIG. Figure 1 As shown, it mainly includes the following steps:

[0018] Step S101, collecting the cultural relic display demand information of the current user through the preset cultural relic display portable terminal in the current exhibition hall, and determining the intended cultural relic information corresponding to the current user according to the cultural relic display demand information of the current user and the pre-acquired exhibition hall distribution data.

[0019] In one embodiment of this specification, a portable terminal for displaying cultural relics is used to display cultural relics in three dimensions. With the popularization of mobile devices and the continuous development of technology, today's portable terminals have high-performance processors, large-capacity storage devices, high-definition screens and rich interactive functions. These technical foundations provide strong support for the realization of portable terminals for displaying cultural relics. It should be noted that the portable terminal for displaying cultural relics in the embodiment of this specification has an intuitive and easy-to-use user interface to ensure that users can easily understand and operate the terminal, and provides a clear navigation menu to guide users to select the categories and periods of cultural relics of interest; in addition, it supports touch operations such as clicking and sliding, which is convenient for users to interact with the terminal, and can also be equipped with a voice recognition function to allow users to query needs through voice input. In addition, in addition to using portable terminals for displaying cultural relics belonging to the exhibition hall, due to the limited number of terminal devices, there may be a situation where the terminal device cannot meet the number of people when the flow of people is too large. In this case, the function of displaying cultural relics can also be realized by using the user's mobile terminal in the form of an application program or a service platform.

[0020] In one embodiment of the present specification, first, after a user enters an exhibition hall, if a three-dimensional display of cultural relics is required, the user can enter the cultural relic display requirements in the cultural relic display portable terminal, that is, the exhibition cultural relics that need to be viewed this time. There are two situations when the user inputs, one is to directly enter the name of the cultural relic and other identifiers, and the other is to enter the relevant information of the cultural relic. When the input information contains cultural relic identifiers such as the name of the cultural relic, the corresponding cultural relic is directly determined as the intended cultural relic of the current user. When the input information is the relevant information of the cultural relic, the cultural relic display requirement information needs to be analyzed to determine the intended cultural relic corresponding to the current user.

[0021] Determining the intended cultural relics information corresponding to the current user according to the cultural relics display demand information of the current user and the pre-acquired exhibition hall distribution data, specifically comprising: acquiring the cultural relics display demand information, wherein the cultural relics display demand information includes any one or more of cultural relics age information, cultural relics type information, cultural relics material information and cultural relics label; acquiring cultural relics location data and exhibition cultural relics list information corresponding to the exhibition cultural relics through the pre-acquired exhibition hall distribution data; performing cultural relics matching according to the cultural relics display demand information and the exhibition cultural relics list information, and determining a plurality of target intended cultural relics corresponding to the current user; generating an exhibition path of the current user based on the cultural relics location data of each of the target intended cultural relics, and displaying the path in the cultural relics display portable terminal, so as to receive a trigger operation of the current user on the exhibition path, wherein the trigger operation includes any one of a confirmation operation and a deletion operation; determining a target exhibition path according to the trigger operation of the current user, so as to determine the intended cultural relics information corresponding to the current user based on a plurality of cultural relics in the target exhibition path.

[0022] In one embodiment of the present specification, according to a user-friendly interface designed on a portable terminal for displaying cultural relics, the user's cultural relic display demand information is collected. The interface includes multiple input fields or options, which correspond to the age of cultural relics, cultural relic types, cultural relic materials, and cultural relic labels, etc. After the user fills in or selects the demand information, he clicks the search button to trigger data submission and background processing. After the user submits the demand information, the back-end server receives and parses the information and prepares for subsequent cultural relic matching.

[0023] It should be noted that the exhibition hall should maintain a detailed database of exhibition relics, including the ID, name, age, type, material, label and location data (such as exhibition hall number, booth number or GPS coordinates) of the relics. At the same time, there should be an exhibition hall distribution data table to describe the spatial layout and path information in the exhibition hall. Use SQL query or other database retrieval technology to extract relevant information of all exhibition relics based on the current exhibition relics list and exhibition hall distribution data. Take the cultural relic display demand information and exhibition cultural relic list information as input, and filter the exhibition cultural relic list according to one or more conditions in the demand information (such as age, type, material, label) to find the cultural relics that meet the conditions as the target intended cultural relics. Return the matching results (i.e. the target intended cultural relic list) to the front end to generate the exhibition path.

[0024] Using the path finding algorithm in graph theory (such as Dijkstra algorithm, A* algorithm, etc.), according to the location data of each target intended cultural relic, an optimal exhibition path is planned. Here, the algorithm needs to be appropriately adjusted for the layout and path restrictions of the actual exhibition hall (such as one-way channels, prohibited areas, etc.). The generated exhibition path is displayed on the portable terminal for displaying cultural relics. Here, it can be a list of cultural relics arranged in order, or a map of the exhibition hall with the location and walking path of the cultural relics marked. The user can view the detailed information of each target intended cultural relic and confirm or modify the exhibition path. The user's trigger operation on the exhibition path is received, which can be a confirmation operation or a deletion operation. The deletion operation here corresponds to the deletion of cultural relics. If the user performs a confirmation operation, the exhibition path is saved as the target exhibition path; if the user performs a cultural relic deletion operation, the corresponding cultural relic is deleted from the target intended cultural relic, and the path is replanned. According to the finalized target exhibition path, the information of each cultural relic in the path is extracted as the intended cultural relic information corresponding to the current user, and is displayed to the user in a list, report or other form for their subsequent visit.

[0025] By collecting users' information on cultural relics display needs, it can provide users with a personalized cultural relics display experience and ensure that users can quickly find the cultural relics they are interested in; the user-friendly interface design allows users to easily fill in or select demand information, and view exhibition paths and cultural relics details in an intuitive way (such as lists or maps); cultural relics are matched based on users' specific needs, avoiding users from blindly searching among a large number of cultural relics, thus saving time and energy; using an efficient path finding algorithm, combined with the actual layout and path restrictions of the exhibition hall, the optimal exhibition path is planned, improving the user's visit efficiency; real-time reception and processing of user trigger operations, such as confirming the exhibition path or deleting cultural relics, allows users to make flexible adjustments according to their needs; by collecting and analyzing user behavior data, the exhibition hall can understand user preferences and demand changes, and provide data support for exhibition planning and cultural relics display; automated processing of tasks such as cultural relics matching and path planning reduces the burden on staff and improves management efficiency.

[0026] Step S102, screening is performed in a preset three-dimensional cultural relic library according to the intended cultural relic information to determine at least one corresponding three-dimensional cultural relic model, and constructing a cultural relic terminal display library corresponding to the cultural relic display portable terminal.

[0027] According to the intended cultural relic information, screening is performed in a preset three-dimensional cultural relic library to determine at least one corresponding three-dimensional cultural relic model, and before the cultural relic terminal display library corresponding to the cultural relic display portable terminal is constructed, the method also includes: collecting data on each exhibition cultural relic to determine the cultural relic scanning information of each exhibition cultural relic, wherein the cultural relic scanning information includes cultural relic three-dimensional point cloud data, cultural relic texture information and cultural relic color information; obtaining cultural relic metadata of each exhibition cultural relic, wherein the cultural relic metadata includes cultural relic basic information and cultural relic derived description information; using three-dimensional modeling technology, three-dimensional modeling is performed according to the three-dimensional point cloud data of the cultural relic, and optimization is performed based on the cultural relic texture information and the cultural relic color information to determine the cultural relic three-dimensional model corresponding to each exhibition cultural relic; according to the cultural relic metadata of each exhibition cultural relic, the cultural relic description information corresponding to each exhibition cultural relic is generated; a cultural relic identification is set for each exhibition cultural relic, and a mapping relationship between the cultural relic identification, the cultural relic three-dimensional model and the cultural relic description information is established to construct the three-dimensional cultural relic library.

[0028] In one embodiment of the present specification, a high-precision three-dimensional scanner (such as a laser scanner or a structured light scanner) is used to capture the three-dimensional point cloud data of the cultural relics, and a high-resolution camera is used to capture the texture and color information of the cultural relics. The three-dimensional scanner is placed in a suitable position to ensure that all surfaces of the cultural relics can be fully covered. Perform a scanning operation to obtain the three-dimensional point cloud data of the cultural relics. Depending on the size and complexity of the cultural relics, data stitching from multiple scanning positions or angles may be required. Use a high-resolution camera to take photos of the cultural relics from different angles to obtain rich texture and color information. The basic information of cultural relics usually comes from the museum's cultural relics archives, including the name, age, type, material, etc. of the cultural relics. The derived descriptive information of the cultural relics includes the historical background, cultural significance, production process, etc. of the cultural relics. This information can be obtained through literature, expert interviews, etc. The basic information and derived descriptive information of the cultural relics are organized into a unified format and stored in a database.

[0029] Use 3D modeling software (such as Blender, 3ds Max, Maya, etc.) to import the 3D point cloud data of the cultural relics. Generate a preliminary 3D model of the cultural relics using the point cloud data, including steps such as point cloud denoising and point cloud reconstruction. Apply the high-resolution photos taken as texture maps to the 3D model to enhance the realism of the model. Adjust the material properties of the model according to the color information of the cultural relics so that the color of the model is consistent with the real object. Optimize the model in detail, such as adjusting the edge smoothness and repairing the holes in the model. Extract key information from the cultural relics metadata, such as the name, age, and introduction of the cultural relics. Write a detailed description text of the cultural relics, including information on the historical background, cultural value, and production process of the cultural relics. Organize the description information of the cultural relics into a unified format (such as Markdown, HTML, etc.) for subsequent display and retrieval. Assign a unique identifier (such as UUID, barcode, etc.) to each exhibition cultural relic. Create a table or data structure in the database to store the mapping relationship between the cultural relic identification, the cultural relic 3D model file path (or URL), and the cultural relic description information to ensure that each cultural relic identification can accurately correspond to its 3D model and description information. Integrate 3D models, artifact description information and mapping relationships into a unified 3D artifact library. Regularly maintain and update the 3D artifact library, including adding new artifacts, fixing model errors, updating artifact description information, etc.

[0030] In one embodiment of the present specification, due to the difference in the groups served by the portable terminal for displaying cultural relics each time, the exhibition needs of different users are different, and the three-dimensional cultural relics library contains all the cultural relics in the exhibition hall. If the three-dimensional cultural relics library is stored in the portable terminal for displaying cultural relics, a large storage burden will be generated on the portable terminal for displaying cultural relics, affecting the user experience of the terminal device. Therefore, the three-dimensional cultural relics library can be stored in the server, and after receiving the intended cultural relics information corresponding to the portable terminal for displaying cultural relics, according to the intended cultural relics information in the request, the three-dimensional cultural relics library is screened to find all qualified three-dimensional models of cultural relics. The three-dimensional cultural relics model and its related information (such as name, description, metadata, etc.) screened out are packaged or organized into a temporary cultural relics terminal display library, and the cultural relics terminal display library here can be dynamic, that is, only exists in the memory of the server side, and is dynamically generated according to the request, and does not need persistent storage. The constructed cultural relics terminal display library is transmitted to the portable terminal for displaying cultural relics through the network. If the amount of data is large, it can be considered to use streaming or batch transmission. After the portable terminal for displaying cultural relics receives the data, it parses and displays the three-dimensional model of cultural relics and its related information, and the user can view the detailed information of the cultural relics, rotate and scale the model, browse the exhibition path, etc. on the terminal.

[0031] The above technical solution avoids directly storing a huge three-dimensional cultural relic library on a portable terminal for displaying cultural relics, thereby significantly reducing the storage burden of the terminal device, allowing the portable terminal to focus more on providing a smooth interaction and display experience instead of being dragged down by a large amount of data; since the storage space of the terminal device is freed up, users can enjoy a smoother and faster application experience, and the dynamically constructed cultural relic terminal display library can ensure that users only see the cultural relic information they are interested in or need, thereby improving the pertinence and effectiveness of the information;

[0032] By dynamically screening the three-dimensional models of cultural relics according to the user's exhibition needs, personalized cultural relics display can be achieved. Different user groups can obtain customized exhibition experiences according to their interests and needs, thereby enhancing the user's sense of participation and satisfaction; the three-dimensional cultural relics library is centrally stored on the server, which can better control the security and integrity of the data, and a higher level of security measures can be adopted to protect the data from unauthorized access and tampering, and it is also convenient for data backup and recovery operations; placing the three-dimensional cultural relics library on the server can more conveniently manage and update the data. Administrators can add new cultural relics information, fix model errors, or update cultural relics descriptions at any time without having to operate each portable terminal separately, which improves the efficiency and accuracy of data management; the server-side architecture can support multiple cultural relics display portable terminals to access the three-dimensional cultural relics library at the same time, and build corresponding cultural relics terminal display libraries according to their respective intended cultural relics information, meeting the needs of multiple users at the same time in large exhibitions or public places, and improving concurrent processing capabilities.

[0033] Step S103, obtaining the real-time terminal location data of the portable terminal for displaying cultural relics, performing cultural relic location matching on the current user based on the real-time terminal location data and the exhibition hall distribution data, determining at least one real-time target cultural relic of the current user, performing model matching in the display library of the cultural relic terminal, and determining at least one target cultural relic three-dimensional model corresponding to the portable terminal for displaying cultural relics;

[0034] In one embodiment of the present specification, the real-time terminal location data of the portable terminal for displaying cultural relics is obtained through the positioning module of the portable terminal for displaying cultural relics. The real-time terminal location data here is the real-time location of the current user in the exhibition hall, and in order to protect the privacy of the user, the real-time terminal location data here is the positioning data authorized by the user and limited to the exhibition hall. Since the viewing conditions of different users are different, after the exhibition path is provided, the actual viewing path of the user may be different from the exhibition path. Therefore, the actual viewing path of the user needs to be confirmed in the process.

[0035] Based on the real-time terminal location data and the exhibition hall distribution data, the cultural relic location of the current user is matched to determine at least one real-time target cultural relic of the current user, specifically including: determining the cultural relic location data corresponding to multiple exhibition cultural relics in the exhibition hall and the travel path information between any two exhibition cultural relics according to the exhibition hall distribution data; determining multiple target cultural relics of the next tour node corresponding to the current user through multiple real-time terminal location data, the cultural relic location data and multiple travel path information; and screening among the multiple target cultural relics based on at least one intended cultural relic information corresponding to the current user to determine at least one real-time target cultural relic corresponding to the next tour node.

[0036] In one embodiment of the present specification, based on the exhibition hall distribution data, the cultural relic location data corresponding to multiple exhibition cultural relics in the exhibition hall and the passage path information between any two exhibition cultural relics are determined. The passage path information here refers to the existing passable path between two exhibition cultural relics, which can be obtained through the venue planning information.

[0037] Determine multiple target cultural relics of the next tour node corresponding to the current user through multiple real-time terminal location data, cultural relic location data and multiple travel path information, specifically including: generate the historical operation trajectory of the current user through multiple real-time terminal location data, and determine the passage cultural relics corresponding to the historical operation trajectory according to the cultural relic location data corresponding to each exhibition cultural relic; determine at least one target travel path information corresponding to the passage cultural relics based on the passage cultural relic location data and multiple travel path information of the passage cultural relics; determine multiple target cultural relics of the next tour node corresponding to the current user according to each target travel path information.

[0038] In one embodiment of the present specification, a plurality of real-time terminal location data are used to generate the historical running track of the current user in the exhibition. Here, the historical running track is the position of the user in the museum. The cultural relic location data corresponding to each exhibition cultural relic is matched with the historical running track to determine the cultural relic corresponding to the historical running track. Here, the corresponding scenario is the situation where there is a path. The cultural relic may be one or more, which is used to represent the cultural relic that the user has passed through in the museum. Based on the cultural relic location data of the cultural relic and the information of the multiple passing paths, at least one target passing path information with the latest cultural relic as the starting point is determined, that is, the cultural relic is one of the two path endpoints in the target passing path, and another cultural relic corresponding to the other path endpoint in each of the target passing path information is used as a plurality of target cultural relics of the next tour node. When there is no cultural relic, it means that the user has not passed through the cultural relic in the path currently traversed. In this case, the cultural relic closest to the real-time position is determined according to the real-time terminal location data of the user as the real-time target cultural relic of the next tour node.

[0039] According to at least one intended cultural relic information corresponding to the current user, a target cultural relic belonging to the intended cultural relic is screened out from multiple target cultural relics, and at least one real-time target cultural relic corresponding to the next tour node is determined. If multiple target cultural relics do not belong to the intended cultural relic corresponding to the current user, each target cultural relic is used as a future passage cultural relic, and cultural relic matching is performed in accordance with the above method to determine the real-time target cultural relic of the next tour node corresponding to the current user.

[0040] Step S104, determining the cultural relic display information of each target cultural relic three-dimensional model, and displaying the real-time target cultural relic in the cultural relic display portable terminal according to the cultural relic display information.

[0041] Among them, the cultural relics display information includes cultural relics information and cultural relics interaction information.

[0042] In one embodiment of the present specification, the cultural relic display information of each target cultural relic three-dimensional model is determined, and the cultural relic display information here includes cultural relic information and cultural relic interaction information. According to the cultural relic display information, the real-time target cultural relic is displayed in the cultural relic display portable terminal. It should be noted that in order to ensure the adaptive display and interaction of the three-dimensional model in the mobile terminal, the WebGL graphics rendering library (such as three.js) is introduced into the uniapp project, and the code of the model loading module, the rendering engine module, the interactive control module and the interface display module is written.

[0043] The model loading module is used to load 3D model files (such as glb, fbx and other formats) from the server or local resources and parse them into a format that can be used in the rendering engine. The corresponding code logic is described as follows: First, define the loading function, create a function (such as loadModel), receive the URL or path of the model file as a parameter, and use uniapp's uni.downloadFile to download the model file from the network or use uni.readFile to read the file from the local according to the location of the model file. Use a third-party library (such as three.js with GLTFLoader) to parse the downloaded or read model data and convert it into a format that the rendering engine can recognize (such as three.js's Mesh object). After loading is complete, pass the model data to the rendering engine module for rendering through the callback function, or give an error prompt when loading fails.

[0044] The rendering engine module is used to render the 3D model on the screen of the mobile terminal and process visual effects such as lighting, shadows, and materials. The corresponding code logic is described as follows: create a renderer (such as WebGLRenderer of three.js) and set its size to fit the mobile device screen; create a scene (Scene) and a camera (such as PerspectiveCamera) to place and observe the model; receive the parsed model data from the model loading module and add it to the scene, use

[0045] requestAnimationFrame or uniapp's uni.onAnimationFrame function creates a rendering loop, continuously calls the render method of the renderer, renders the scene content from the camera's perspective to the screen; adds light sources (such as AmbientLight, DirectionalLight) to the scene, and sets the model's material to show different visual effects.

[0046] The interaction control module is responsible for handling the interaction between the user and the 3D model, such as rotating, scaling, and translating the model. The code logic of the interaction control module is described as follows: Listen to the touch events of the mobile device (such as touchstart, touchmove, touchend), or use the uniapp API such as uni.onTouchStart. According to the data of the touch event (such as position, moving distance), calculate the user's interaction intention (such as rotation angle, scaling ratio, translation distance). According to the interaction data obtained by parsing, update the transformation of the model in the scene (such as rotation matrix, scaling factor, position), trigger the rendering cycle of the rendering engine, and display the updated model to the user.

[0047] The interface display module is responsible for displaying the user interface, including the model display area, control buttons, information prompts, etc. The page layout uses the page layout syntax of uniapp (such as <view> 、 、 <button>In the interface layout, specify an area for displaying 3D models. If WebGL rendering is used, it is usually a full-screen area. <canvas>Elements. Add control buttons, sliders, text prompts and other controls to the interface according to actual needs to control the display mode of the model or provide information display. Add event listeners to the control elements to respond to user clicks, slides and other operations, and call the functions of the interactive control module to update the model display.

[0048] Determining the cultural relic display information of each three-dimensional model of the target cultural relic specifically includes: determining the target cultural relic position data of the real-time target cultural relic; matching the current user with the real-time target cultural relic according to the real-time terminal position data and the target cultural relic position data of the real-time target cultural relic, and determining the relative position state between the current user and the real-time target cultural relic, wherein the relative position state includes a position overlap state within the area and a proximity state outside the area; determining the cultural relic display information of each three-dimensional model of the target cultural relic according to the relative position state between the current user and the real-time target cultural relic.

[0049] In actual application scenarios, fixed display equipment has the problem that the cultural relics display process is relatively separated from the cultural relics themselves, resulting in the audience obtaining cultural relics display information at the display equipment and then going to the cultural relics exhibition area, making it difficult for the audience to closely connect the two visually and psychologically, thereby weakening the overall effect of the cultural relics display.

[0050] In one embodiment of the present specification, when determining the cultural relic display information of the target cultural relic three-dimensional model, the type of information to be displayed is determined according to the real-time position of the user. First, the target cultural relic position data of the real-time target cultural relic is determined, and an RFID tag or other wireless positioning technology device is pre-set on the target cultural relic. The position data of the target cultural relic is collected by a corresponding reading device (such as an RFID reader), and the collected position data is converted into a unified coordinate system (such as indoor map coordinates, etc.), and stored in a database for subsequent query. The real-time terminal position data is transmitted to a server or a processing center in real time to match the cultural relic position data. If the position coordinates of the current user are very close to the position coordinates of the target cultural relic, it can be judged here according to a preset distance threshold, then it is considered that the user and the cultural relic are in a "regional position overlap state". If the current user is not in the region where the cultural relic is located, but is moving to the location of the cultural relic and the distance is gradually reduced, then it is considered that the user and the cultural relic are in a "regional close state".

[0051] According to the relative position state between the current user and the real-time target cultural relic, the cultural relic display information of each three-dimensional model of the target cultural relic is determined, specifically including: when the relative position state is a close state outside the area, the cultural relic display information is determined to be cultural relic information, and the real-time target cultural relic three-dimensional model corresponding to the real-time target cultural relic and the target cultural relic brief information corresponding to the real-time target cultural relic are obtained; through the real-time terminal position data, the current environment data corresponding to the current user is obtained, wherein the current environment data includes lighting data and sound data; according to the lighting data in the current environment data, the visual display elements of the real-time target cultural relic three-dimensional model are adjusted to determine the display target cultural relic three-dimensional model, wherein the visual display elements include any one or more of display brightness and display contrast; based on the sound data in the current environment data, the broadcast parameters of the target cultural relic brief information are adjusted to broadcast the target cultural relic brief information.

[0052] In one embodiment of the present specification, when the relative position state is a near state outside the area, it means that the user is on the way to the cultural relic exhibition area corresponding to the real-time target cultural relic. At this time, the cultural relic display information is determined to be cultural relic information, that is, the cultural relic introduction of the corresponding real-time target cultural relic and other target cultural relic brief information. On the basis of displaying the real-time target cultural relic three-dimensional model, the target cultural relic brief information is visually displayed and auditorily broadcast. Due to the differences in the indoor environment at different exhibition hall locations, the influence of the surrounding environment should be considered when displaying to enhance the audience experience. Through the preset sensor equipment in the exhibition hall, the illumination data and sound data of the current environment are collected in real time, and the collected environmental data are uploaded so that the display effect can be adjusted according to the environmental data later. The illumination data of the current environment is analyzed, including the illumination intensity and the direction of the light source. The display brightness of the three-dimensional model is automatically adjusted according to the ambient illumination intensity to ensure that the model can be clearly displayed under different lighting conditions. In a dark light environment, the contrast is appropriately increased to make the model details more prominent. Here, the model display angle can also be dynamically adjusted according to the user's walking direction and the location of the cultural relic so that the user can better preview the cultural relic. Analyze the sound data of the current environment, including the background noise level, frequency distribution, etc., and automatically increase the broadcast volume in a noisy environment to ensure that users can clearly hear the briefing information. According to the user's possible mobile state (such as walking), the speech speed can be appropriately adjusted to make it neither too fast nor too slow, so that the user can understand and receive information. In some cases, the timbre can be adjusted according to the environmental atmosphere, such as using a more solemn or warm timbre to match different cultural relics. While displaying the real-time 3D model of the target cultural relic, the briefing information of the target cultural relic is broadcast through the adjusted broadcast parameters to ensure the synchronization and coordination of visual and auditory information.

[0053] Dynamically adjust display parameters according to the user's current environment (such as lighting and sound conditions) to make the cultural relics display more in line with the user's actual experience, thereby improving user satisfaction and immersion; provide relevant cultural relics introduction information on the way to the cultural relics exhibition area, which increases the user's sense of expectation and participation, making the entire exhibition process smoother and more interesting; through the dual methods of visual display and auditory broadcast, users can have a more comprehensive and in-depth understanding of the historical background, cultural significance and other information of the cultural relics, thereby enhancing the educational effect.

[0054] According to the relative position state between the current user and the real-time target cultural relic, the cultural relic display information of each three-dimensional model of the target cultural relic is determined, specifically including: when the relative position state is a position overlap state within the area, judging whether there is an interactive triggering action of the current user, wherein the interactive triggering action includes any one of click, touch and voice wake-up; if the interactive triggering action exists, then according to the interactive triggering action, interactive display is performed in the three-dimensional model of the target cultural relic to determine the interactive display information, and according to the interactive display information and the cultural relic information, the cultural relic interactive information is determined according to the interactive display information and the cultural relic information corresponding to the real-time target cultural relic.

[0055] In one embodiment of the present specification, when the relative position state is a position overlap state in the region, it indicates that the current user has reached the position of the real-time target cultural relic. In this case, in addition to displaying the real-time target cultural relic three-dimensional model and the target cultural relic brief information and other cultural relic information, the interactive information between the user and the cultural relic can also be displayed. When the user position coincides with the position of the real-time target cultural relic or enters the preset interactive area, the detection of the position overlap state is triggered. Through the preset interactive control module (such as a touch screen, a microphone, an accelerometer, etc.), the user's click, touch screen, specific gestures, voice commands and other interactive triggering actions are monitored. According to the monitored user interaction behavior, the specific interactive triggering action (such as clicking a button on the screen, saying a specific voice command, etc.) is identified. According to the identified interactive triggering action, the corresponding interactive display information is selected from the preset interactive display content library, which can be more details of the cultural relic, animation of the production process, video clips of related historical events, etc. Operations. The interactive display information is integrated with the original cultural relic information (such as a three-dimensional model, brief information, etc.) through the interface display module to form a complete cultural relic interactive information display.

[0056] On the basis of displaying the real-time three-dimensional model of the target cultural relic, an interactive interface is designed to seamlessly integrate the interactive display information with the three-dimensional model. Users can interact with the three-dimensional model through operations on the interface (such as sliding, zooming, rotating, etc.) and view the interactive display information, that is, the three-dimensional model after the corresponding interactive operation. According to the user's interactive behavior, the interactive information is updated and displayed in real time. For example, when the user clicks on an interactive point, the relevant part can be highlighted on the three-dimensional model, and the corresponding video or animation can be played. If the user chooses to use voice interaction, the system should be able to recognize the user's voice commands and give corresponding voice feedback or broadcast the interactive display information. Through multiple sensory channels such as vision (such as images, videos, animations), hearing (such as voice broadcasts) and touch (such as vibration feedback), users are provided with an immersive interactive experience. Users can choose interactive content according to their interests and needs, such as clicking to view detailed information of cultural relics, watching animations of the production process, etc., meeting the personalized needs of users; the interactive display not only provides basic information about cultural relics, but also displays relevant knowledge such as the production process and historical background of cultural relics through animations, videos, etc., which helps users to have a more comprehensive understanding of cultural relics. The interactive display process is carried out at the location of the cultural relics, which not only ensures the relevance of the interactive process to the actual cultural relics, but also reduces the direct contact of users with cultural relics, reduces the risk of damage to cultural relics, and is beneficial to the protection of cultural relics.

[0057] Through the above technical solution, by collecting the user's cultural relics display demand information, it is possible to provide users with personalized cultural relics display services, so that users can browse and understand cultural relics according to their own interests and needs, avoiding the problem of relatively fixed display positions, display contents and display sequences when displaying cultural relics through fixed display equipment, and realizing personalized display; based on real-time terminal location data and exhibition hall distribution data, cultural relics are matched for users in real time, improving users' exhibition efficiency and experience, effectively solving the problem of relative separation between the cultural relics display process and the cultural relics themselves, and enhancing users' exhibition experience; by building a cultural relics terminal display library, and matching and displaying the three-dimensional model of the target cultural relics and its cultural relics display information in it, users can have a more comprehensive and in-depth understanding of the historical background, cultural connotation and Artistic value; the addition of interactive information on cultural relics enables users to learn about cultural relics in an interactive way during the exhibition, enhancing the interest and effectiveness of learning; it can quickly match and display cultural relics that users are interested in based on the user's real-time location and intended cultural relic information, avoiding users from blindly searching and wasting time in the exhibition hall; combined with the exhibition hall distribution data, it can also provide users with the best exhibition route planning to help users visit the exhibition hall efficiently and orderly; displaying three-dimensional models of cultural relics through portable cultural relic display terminals reduces users' direct contact with cultural relics, reduces the risk of damage to cultural relics, and is beneficial to cultural relic protection; through the user behavior data collected by the portable cultural relic display terminal, the exhibition hall can analyze users' exhibition habits and preferences, and provide data support for subsequent exhibition planning and layout optimization.

[0058] The embodiment of this specification also provides a cultural relic display device based on a three-dimensional model, such as Figure 2 As shown, the device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the above method.

[0059] The embodiments of the present specification also provide a non-volatile computer storage medium storing computer executable instructions, wherein the computer executable instructions are configured to execute the above method.

[0060] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device, equipment, and non-volatile computer storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0061] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0062] The devices and media provided in the embodiments of this specification correspond one-to-one to the methods. Therefore, the devices and media also have similar beneficial technical effects as the corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the devices and media will not be repeated here.

[0063] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0064] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0065] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0066] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0067] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0068] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0069] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0070] It should also be noted that the term "includes", "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the existence of other identical elements in the process, method, commodity or device including the element.

[0071] The above description is only one or more embodiments of this specification and is not intended to limit this specification. For those skilled in the art, one or more embodiments of this specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of one or more embodiments of this specification shall be included in the scope of the claims of this specification.< / canvas> < / button> < / view>

Claims

1. A method for displaying cultural relics based on a three-dimensional model, characterized in that: The method comprises: The cultural relic display demand information of the current user is collected through the preset cultural relic display portable terminal in the current exhibition hall, and the intended cultural relic information corresponding to the current user is determined according to the cultural relic display demand information of the current user and the pre-acquired exhibition hall distribution data; According to the intended cultural relic information, screening is performed in a preset three-dimensional cultural relic library to determine at least one corresponding three-dimensional cultural relic model, and a cultural relic terminal display library corresponding to the cultural relic display portable terminal is constructed; Acquire the real-time terminal location data of the portable terminal for displaying cultural relics, perform cultural relic location matching on the current user based on the real-time terminal location data and the exhibition hall distribution data, determine at least one real-time target cultural relic of the current user, perform model matching in the display library of the cultural relic terminal, and determine at least one target cultural relic three-dimensional model corresponding to the portable terminal for displaying cultural relics; Determine the cultural relic display information of each of the target cultural relic three-dimensional models, and display the real-time target cultural relic in the cultural relic display portable terminal according to the cultural relic display information, wherein the cultural relic display information includes cultural relic information and cultural relic interaction information.

2. A method for displaying cultural relics based on a three-dimensional model according to claim 1, characterized in that: Based on the real-time terminal location data and the exhibition hall distribution data, performing cultural relic location matching on the current user to determine at least one real-time target cultural relic of the current user specifically includes: Determine, according to the exhibition hall distribution data, the cultural relic location data corresponding to the plurality of exhibition cultural relics in the exhibition hall and the passage path information between any two exhibition cultural relics; Determine multiple target cultural relics of the next tour node corresponding to the current user through the multiple real-time terminal location data, the cultural relic location data and the multiple travel path information; Based on the at least one intended cultural relic information corresponding to the current user, the plurality of target cultural relics are screened to determine at least one real-time target cultural relic corresponding to the next tour node.

3. A method for displaying cultural relics based on a three-dimensional model according to claim 2, characterized in that: Determining multiple target cultural relics of the next tour node corresponding to the current user through the multiple real-time terminal location data, the cultural relic location data and the multiple travel path information specifically includes: Generate the historical running track of the current user through the plurality of real-time terminal location data, and determine the cultural relics on the way corresponding to the historical running track according to the cultural relic location data corresponding to each exhibition cultural relic; Determine at least one target passage path information corresponding to the passage cultural relic based on the passage cultural relic position data and the plurality of passage path information; According to each target travel path information, a plurality of target cultural relics of the next tour node corresponding to the current user are determined.

4. The method for displaying cultural relics based on a three-dimensional model according to claim 1, characterized in that: Determining the cultural relic display information of each of the three-dimensional models of the target cultural relics, specifically including: Determine the target cultural relic position data of the real-time target cultural relic; According to the real-time terminal position data and the target cultural relic position data of the real-time target cultural relic, the current user is matched with the real-time target cultural relic to determine the relative position state between the current user and the real-time target cultural relic, wherein the relative position state includes a position overlap state within the area and a proximity state outside the area; According to the relative position state between the current user and the real-time target cultural relic, the cultural relic display information of each of the three-dimensional models of the target cultural relic is determined.

5. The method for displaying cultural relics based on a three-dimensional model according to claim 4, characterized in that: Determining the cultural relic display information of each of the three-dimensional models of the target cultural relic according to the relative position state between the current user and the real-time target cultural relic, specifically includes: When the relative position state is a close state outside the area, determining that the cultural relic display information is cultural relic information, obtaining a real-time target cultural relic three-dimensional model corresponding to the real-time target cultural relic and target cultural relic brief information corresponding to the real-time target cultural relic; Acquire current environment data corresponding to the current user through the real-time terminal location data, wherein the current environment data includes lighting data and sound data; According to the illumination data in the current environment data, the visual display elements of the real-time target cultural relic three-dimensional model are adjusted to determine the display target cultural relic three-dimensional model, wherein the visual display elements include any one or more of display brightness and display contrast; Based on the sound data in the current environment data, the broadcasting parameters of the target cultural relic brief introduction information are adjusted to broadcast the target cultural relic brief introduction information.

6. The method for displaying cultural relics based on a three-dimensional model according to claim 4, characterized in that: Determining the cultural relic display information of each of the three-dimensional models of the target cultural relic according to the relative position state between the current user and the real-time target cultural relic, specifically includes: When the relative position state is a position overlap state within the area, determining whether there is an interaction triggering action of the current user, wherein the interaction triggering action includes any one of click, touch and voice wake-up; If the interaction triggering action exists, an interactive display is performed in the three-dimensional model of the target cultural relic according to the interaction triggering action, and the interactive display information is determined, so as to determine the cultural relic interactive information according to the interactive display information and the cultural relic information corresponding to the real-time target cultural relic.

7. The method for displaying cultural relics based on a three-dimensional model according to claim 1, characterized in that: According to the intended cultural relic information, screening is performed in a preset three-dimensional cultural relic library to determine at least one corresponding three-dimensional cultural relic model, and before constructing a cultural relic terminal display library corresponding to the cultural relic display portable terminal, the method further includes: Collect data for each exhibited cultural relic to determine the cultural relic scanning information of each exhibited cultural relic, wherein the cultural relic scanning information includes cultural relic three-dimensional point cloud data, cultural relic texture information and cultural relic color information; Acquire the cultural relic metadata of each of the exhibited cultural relics, wherein the cultural relic metadata includes cultural relic basic information and cultural relic derived description information; Using 3D modeling technology, perform 3D modeling based on the 3D point cloud data of the cultural relics, and optimize based on the texture information and color information of the cultural relics to determine the 3D model of the cultural relics corresponding to each of the exhibited cultural relics; Generating cultural relic description information corresponding to each of the exhibited cultural relics according to the cultural relic metadata of each of the exhibited cultural relics; A cultural relic identification is set for each of the exhibited cultural relics, and a mapping relationship is established between the cultural relic identification, the three-dimensional model of the cultural relic and the cultural relic description information to construct the three-dimensional cultural relic library.

8. The method for displaying cultural relics based on a three-dimensional model according to claim 1, characterized in that: Determining the intended cultural relic information corresponding to the current user according to the cultural relic display demand information of the current user and the pre-acquired exhibition hall distribution data, specifically includes: Acquiring the cultural relic display demand information, wherein the cultural relic display demand information includes any one or more of cultural relic age information, cultural relic type information, cultural relic material information, and cultural relic label; Obtain cultural relic location data and exhibition cultural relic list information corresponding to the exhibition cultural relics through the pre-acquired exhibition hall distribution data; According to the cultural relic display demand information and the exhibition cultural relic list information, cultural relic matching is performed to determine a plurality of target intended cultural relics corresponding to the current user; Based on the cultural relic location data of each of the target intended cultural relics, an exhibition path of the current user is generated, and the exhibition path is displayed in the cultural relic display portable terminal, so as to receive a trigger operation of the current user on the exhibition path, wherein the trigger operation includes any one of a confirmation operation and a deletion operation; According to the triggering operation of the current user, a target exhibition path is determined, so as to determine the intended cultural relic information corresponding to the current user based on a plurality of cultural relics in the target exhibition path.

9. A cultural relic display device based on a three-dimensional model, characterized in that: The device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can perform the method according to any one of claims 1 to 8.

10. A non-volatile computer storage medium storing computer executable instructions, characterized in that: The computer executable instructions are configured to execute the method according to any one of claims 1 to 8.

Images