Road and bridge explanation holographic projection immersion interaction system based on multi-dimensional data

Abstract

The invention discloses a road and bridge explanation holographic projection immersion interaction system based on multi-dimensional data, and the system comprises a multi-dimensional data obtaining module which is used for obtaining interaction data when a user group in a target venue experiences a plurality of interaction items; the holographic display module is used for generating a corresponding road and bridge holographic projection for display according to the interaction data; the GPT interaction module is used for generating corresponding road and bridge explanation content for explanation according to the road and bridge holographic projection, determining an interaction problem according to the road and bridge explanation content and interaction data and selecting a corresponding target user for interaction; the multi-dimensional data is adopted to generate the holographic projection highly associated with the user, and the GPT technology and the multi-dimensional data are utilized to improve the interaction efficiency with the tourist, so that the promotion of the bridge culture is promoted.

Description

Technical Field

[0001] The present invention belongs to the technical field of holographic projection, and in particular relates to a road and bridge explanation holographic projection immersive interactive system based on multi-dimensional data. Background Art

[0002] Holographic projection refers to the use of interference and diffraction principles to record and reproduce the real three-dimensional image of an object. The virtual reality immersive experience produced by holographic projection technology can project scenes that cannot be seen in the real scene in the form of holograms. It has the characteristics of combining reality and illusion, being immersive, rich in information, and strong interactivity. This display technology has a high degree of simulation and can make the audience feel like they are really at the scene.

[0003] Based on the high simulation of holographic projection technology, holographic projection technology has been widely used in the field of bridges. Visitors can choose different holographic interactive projects to experience according to their preferences in relevant bridge libraries.

[0004] However, since tourists have little knowledge of bridges, it is difficult for them to gain an immersive understanding of bridge knowledge through simple observation. The existing bridge holographic interaction technology still interacts with tourists through pre-set programs. This interaction method has the problems of low interaction efficiency and poor tourist sensory perception. Therefore, there is an urgent need for a road and bridge explanation holographic projection immersive interaction system based on multi-dimensional data to solve the problems of low interaction efficiency and poor tourist sensory perception in the existing bridge holographic interaction. Summary of the invention

[0005] In view of this, the purpose of the present invention is to provide a road and bridge explanation holographic projection immersive interactive system based on multi-dimensional data to solve the above problems.

[0006] In order to achieve the above object, the present invention provides the following technical solutions:

[0007] A road and bridge explanation holographic projection immersive interactive system based on multi-dimensional data, comprising:

[0008] A multi-dimensional data acquisition module is used to acquire the interaction data of the user groups in the target venue when they experience multiple interactive projects;

[0009] Holographic display module, used to generate corresponding road and bridge holographic projections for display based on interactive data;

[0010] The GPT interaction module is used to generate corresponding road and bridge explanation content according to the road and bridge holographic projection, and to determine interaction questions and select corresponding target users for interaction according to the road and bridge explanation content and interaction data.

[0011] Furthermore, the multidimensional data acquisition module includes:

[0012] The AR bridge construction simulation interaction data acquisition unit is used to acquire the interaction data of users in the venue on the AR bridge construction simulation teaching module during a preset time period;

[0013] A VR bridge culture teaching interaction data acquisition unit, used to acquire the interaction data of users in the venue on the VR bridge culture teaching dissemination module during a preset time period;

[0014] The GPT bridge culture guidance interaction data acquisition unit is used to obtain the interaction data of users in the venue on the GPT bridge culture guidance dialogue module during a preset time period.

[0015] Furthermore, the holographic display module performs the following operations:

[0016] Receiving interactive data transmitted by the multi-dimensional data acquisition module;

[0017] According to the preset parsing method, the interaction data is parsed to obtain the interaction bridge type and specific interaction bridge information; wherein the interaction bridge type and specific interaction bridge information obtained by parsing both carry the interaction personnel's wristband information mark;

[0018] According to the built-in information receiving unit, obtain the user's bracelet information within the preset range of the current interactive project;

[0019] According to the user's wristband information, based on the preset filtering conditions, the interactive bridge type and specific interactive bridge information corresponding to the user's wristband information are filtered to obtain the target bridge display information;

[0020] According to the target bridge display information and based on the holographic projection generation method, the corresponding road and bridge holographic projection is generated for display.

[0021] Furthermore, the GPT interaction module performs the following operations:

[0022] Based on the chatGPT method, the corresponding road and bridge explanation content is generated according to the road and bridge holographic projection;

[0023] Extract the user bracelet information within the preset range of the current interactive project obtained by the information receiving unit, and send a pairing request to all user Bluetooth headsets within the preset range of the current interactive project according to the Bluetooth pairing information corresponding to the user bracelet information;

[0024] After the user accepts the pairing operation through the user's wristband, the road and bridge content is explained to the user through the user's Bluetooth headset according to the explanation sound type and road and bridge explanation content pre-selected by the user.

[0025] Furthermore, the GPT interaction module is also used to perform the following operations:

[0026] Based on the preset segmentation rules, the road and bridge explanation contents are classified to obtain multiple road and bridge explanation sections;

[0027] Obtain user expression information within the preset range of the interactive items during the explanation of each road and bridge section, and analyze the user expression information to obtain the user's first intention to participate in the interaction;

[0028] Obtain the heart rate change information from the user's wristband information within the preset range of the interactive project during the explanation of each road and bridge section, and analyze the heart rate change information to obtain the user's second intention to participate in the interaction;

[0029] Determine the target user according to the first intention level and the second intention level;

[0030] Determine the interaction problem according to the first intention level, the second intention level, and the interaction data of the target user;

[0031] Interact with target users based on interaction questions.

[0032] Furthermore, the user's facial expression information within the preset range of the interactive items during the explanation of each road and bridge section is obtained, and the user's facial expression information is analyzed to obtain the user's first intention to participate in the interaction, including:

[0033] Collecting user facial information within a preset range of the interactive project using a camera device pre-installed at a preset position in the target venue;

[0034] According to the wristband positioning information corresponding to the user wristband carried by the user, combined with the visual positioning information when the camera device collects the user's facial information, the collected user facial information is marked with the user wristband information to construct a large set of facial information for each user;

[0035] According to the time information of each road and bridge section explanation, the large set of facial information is divided, and based on the expression analysis method, the user expression information in the large set of facial information is identified to obtain a small set of expression information of each user at each road and bridge section explanation stage;

[0036] Obtain the preset intention weight corresponding to each expression information;

[0037] According to the corresponding scores of all the expression information in the small set of expression information and the corresponding preset intention weights, the first intention degree of each user to participate in the corresponding road and bridge explanation interaction is calculated by weighted summation.

[0038] Furthermore, the heart rate change information in the user's wristband information within the preset range of the interactive items during the explanation of each road and bridge section is obtained, and the heart rate change information is analyzed to obtain the second intention degree of the user to participate in the interaction, including:

[0039] According to the signal sending unit built into the GPT interaction module, the heart rate activation information is sent to the user's wristband within the preset range of the interaction project to activate the heart rate monitoring device built into the user's wristband;

[0040] Collecting user heart rate information through the heart rate monitoring device, extracting user heart rate information within a preset range of the current interactive item acquired by the information receiving unit, and constructing a large set of heart rate change information for each user;

[0041] According to the time information of each road and bridge section explanation, the large set of heart rate change information is divided, and based on HRV and emotion analysis methods, the user emotion information in the large set of heart rate change information is identified to obtain a small set of emotion information of each user at each road and bridge section explanation stage;

[0042] Obtaining a preset second intention weight corresponding to each emotional information;

[0043] According to the corresponding scores of all the emotion information in the emotion information small set and the corresponding preset second intention weights, the second intention degree of each user participating in the corresponding road and bridge explanation interaction is calculated by weighted summation.

[0044] Further, determining the target user according to the first intention level and the second intention level includes:

[0045] Obtaining the first intention levels of all users corresponding to each road and bridge explanation section, and determining the number of users whose first intention levels are greater than a preset qualified value as the first number;

[0046] Obtain the second intention degree of all users corresponding to each road and bridge explanation section, and determine the number of users whose second intention degree is greater than a preset second qualified value as the second number;

[0047] Obtain the first quantity, the second quantity and the corresponding weight corresponding to each road and bridge explanation section, and calculate the total intention degree of each road and bridge explanation section by weighted sum;

[0048] Obtain the road and bridge explanation section with the highest total intention degree as the target explanation section;

[0049] Obtaining the first intention level and the second intention level of each user corresponding to the target explanation paragraph, and summing and calculating to obtain the second total intention level of each user for the target explanation paragraph;

[0050] The user with the second highest total intention is obtained as the target user.

[0051] Further, determining the interaction problem according to the first intention degree, the second intention degree, and the interaction data of the target user includes:

[0052] Determine the target explanation paragraph according to the first intention level and the second intention level;

[0053] Determine the screening conditions according to the category of the explanation content of the target explanation paragraph;

[0054] Determine the range of optional questions based on target users’ interaction data;

[0055] The optional question range is matched according to the screening conditions to obtain interactive questions.

[0056] The beneficial effects of the present invention are:

[0057] The present invention proposes a road and bridge explanation holographic projection immersive interaction system based on multi-dimensional data. The multi-dimensional data acquisition module is used to fully understand the tourists' interaction data, and then the tourists' mastery of bridge knowledge and their interests are understood. The holographic display module is used to generate corresponding holographic projections to enhance the tourists' senses and make them interested in bridges. Finally, a unique interaction method is formulated through the GPT interaction module to improve the interaction efficiency.

[0058] Other advantages, objectives and features of the present invention will be described in the following description and will be apparent to those skilled in the art to some extent, or they may be taught from the practice of the present invention. The purposes and other advantages of the present invention may be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0059] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0061] Figure 1 A schematic diagram of a module of a road and bridge explanation holographic projection immersive interactive system based on multi-dimensional data in an embodiment of the present invention;

[0062] Figure 2 It is a unit schematic diagram of a multi-dimensional data acquisition module in a road and bridge explanation holographic projection immersive interactive system based on multi-dimensional data in an embodiment of the present invention;

[0063] Figure 3 This is a flow chart of the execution process of the GPT interaction module in a road and bridge explanation holographic projection immersive interaction system based on multi-dimensional data in an embodiment of the present invention. DETAILED DESCRIPTION

[0064] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0065] See also Figure 1 The present invention proposes a road and bridge explanation holographic projection immersive interactive system based on multi-dimensional data, comprising:

[0066] A multi-dimensional data acquisition module is used to acquire the interaction data of the user groups in the target venue when they experience multiple interactive projects;

[0067] Holographic display module, used to generate corresponding road and bridge holographic projections for display based on interactive data;

[0068] The GPT interaction module is used to generate corresponding road and bridge explanation content according to the road and bridge holographic projection, and to determine the interaction questions and select the corresponding target users for interaction according to the road and bridge explanation content and interaction data;

[0069] The working principle of the above technical solution is as follows: the present invention provides a road and bridge explanation holographic projection immersive interaction system based on multi-dimensional data, which is preferably applied to a bridge culture library to improve the user group's interest in learning bridge culture, adopt the immersive interaction mode of holographic projection, improve the interaction efficiency, and further promote bridge culture; the system mainly includes a multi-dimensional data acquisition module, a holographic display module and a GPT interaction module. In specific application, the holographic projection is screened in advance and generated for backup by obtaining the interactive content of the user group in the current venue and other interactive systems in the venue. The purpose of generating the backup in advance is to improve the projection efficiency. At the same time, the bridge is explained from the aspects of interest to the user group, which can attract more users to stay in front of the current interactive system, thereby completing the promotion of bridge culture. At the same time, through the built-in chat GPT of the system, when the audience who stays reaches the threshold or the explanation process reaches the trigger question link, the interactive content in other interactive systems is screened and extracted, and the on-site audience is located according to the interactive content and the audience's intention to select the target audience, to ensure that the extracted content corresponds to the audience who specifies the answer, so that it can answer normally, to prevent the audience from being cold and reducing the learning enthusiasm of the audience, and to improve the interaction efficiency;

[0070] The beneficial effects of the above technical solution are: through the multi-dimensional data acquisition module, the tourists' interaction data can be fully understood, and then the tourists' mastery of bridge knowledge and interests can be understood, thereby generating corresponding holographic projections through the holographic display module to enhance tourists' senses and make tourists interested in bridges. Finally, a unique interaction method is formulated through the GPT interaction module to improve interaction efficiency.

[0071] See also Figure 2 In one embodiment, the multidimensional data acquisition module includes:

[0072] The AR bridge construction simulation interaction data acquisition unit is used to acquire the interaction data of users in the venue on the AR bridge construction simulation teaching module during a preset time period;

[0073] A VR bridge culture teaching interaction data acquisition unit, used to acquire the interaction data of users in the venue on the VR bridge culture teaching dissemination module during a preset time period;

[0074] The GPT bridge culture guidance interaction data acquisition unit is used to obtain the interaction data of users in the venue on the GPT bridge culture guidance dialogue module during a preset time period;

[0075] The working principle and beneficial effects of the above technical solution are as follows: the system includes a multi-dimensional data acquisition module, wherein the multi-dimensional data acquisition module includes but is not limited to an AR bridge construction simulation interaction data acquisition unit, a VR bridge culture teaching interaction data acquisition unit and a GPT bridge culture guidance interaction data acquisition unit, wherein the AR bridge construction simulation interaction data acquisition unit is used to obtain the interaction data of users in the venue on the AR bridge construction simulation teaching module during a preset time period, and the AR bridge construction simulation teaching module is suitable for users with a certain foundation in bridge construction. The specific design includes combining a special bridge building entity model, a parameter input device, actual bridge parameters collected by big data and other data, so that users can simulate and complete the bridge design. At the same time, based on the parameter design of the model, the bridge model is separated from the full virtual environment to provide users with a more reliable and realistic construction simulation, and at the same time, real-time error correction is performed according to AR to improve the learning experience of users, accumulate learning interest, and further promote bridge culture; the VR bridge culture teaching interaction data acquisition unit is used to The interactive data of users in the venue on the VR bridge culture teaching and communication module in a preset time period is obtained. Compared with the previous module, the VR bridge culture teaching and communication module is less professional and is used to provide teaching simulations for users who are not majoring in bridge majors. The specific design is mainly to popularize bridge culture for non-bridge majors based on VR technology, and to provide interest-based teaching for them, so as to increase users' love for bridge culture and further improve users' basic bridge knowledge. At the same time, the rich teaching modules in it can make users have more enthusiasm for learning and contribute to the promotion of bridge culture. The GPT bridge culture guided interactive data acquisition unit is used to obtain the interactive data of users in the venue on the GPT bridge culture guided dialogue module in a preset time period. Its design concept is derived from the navigation smart screen in the shopping mall. The main functions include enabling users to choose chat topics and scenes according to their needs and interests. The system screens suitable bridge culture according to the content, topic and scene of the chat and conducts guided dialogue with users, thereby popularizing bridge culture to users in the chat without their knowledge.

[0076] In one embodiment, the holographic display module performs the following operations:

[0077] Receiving interactive data transmitted by the multi-dimensional data acquisition module;

[0078] According to the preset parsing method, the interaction data is parsed to obtain the interaction bridge type and specific interaction bridge information; wherein the interaction bridge type and specific interaction bridge information obtained by parsing both carry the interaction personnel's wristband information mark;

[0079] According to the built-in information receiving unit, obtain the user's bracelet information within the preset range of the current interactive project;

[0080] According to the user's wristband information, based on the preset filtering conditions, the interactive bridge type and specific interactive bridge information corresponding to the user's wristband information are filtered to obtain the target bridge display information;

[0081] According to the target bridge display information, based on the holographic projection generation method, the corresponding road and bridge holographic projection is generated for display;

[0082] The working principle of the above technical solution is as follows: the system includes a holographic display module, which is used to generate a holographic projection according to the interactive data and display it to the user. Specifically, after the holographic display module receives the interactive data sent by the multi-dimensional data acquisition module, it parses the interactive data according to a preset parsing method to obtain the interactive bridge type and specific interactive bridge information. The interactive bridge type is preferably divided into beam bridges, arch bridges, suspension bridges, cable-stayed bridges, steel structure bridges and combined system bridges. The specific interactive bridge information refers to existing bridges or incomplete bridges recorded in the book, such as Wuhan Yangtze River Bridge, Nanjing Yangtze River Bridge and Zhaojia Bridge. It is worth noting that the interactive bridge type and specific interactive bridge information obtained by the analysis are both marked with the interactive personnel wristband information. The interactive personnel wristband information refers to the recycled smart wristband information bound to personal information collected by the user at the entrance management; the main purpose of the above steps is to obtain the bridge preference information of the user group in the venue. After determination, the user wristband information within the preset range of the current interactive project is obtained according to the information receiving unit built into the holographic display module. The operating principle of the information receiving unit is preferably to capture the user's smart wristband. The specific signal is used to determine the user's wristband information; finally, according to the user's wristband information, based on the preset screening conditions, the interactive bridge type and specific interactive bridge information corresponding to the user's wristband information are screened, and the target bridge display information is screened. The formulation standard of the preset screening conditions is preferably that the screened target bridge display information conforms to most of the interactive bridge types and the types of specific interactive bridge information. The specific screening method is preferably to obtain all interactive types, mark the times of all different interactive types according to the different interactive types, and at the same time obtain different specific interactive bridge information corresponding to each interactive type, and mark all different specific interactive bridge information for the second time according to the different specific interactive bridge information, thereby determining two times marks of each specific interactive bridge information, determining the interactive type according to the first times mark, and determining the specific interactive bridge information according to the second times mark. It is worth noting that if there is an interactive type with the same first times mark, the second times mark shall prevail, or a combined system bridge shall be selected to complete the selection of the specific bridge information; finally, according to the target bridge display information, based on the holographic projection generation method, generate the corresponding road and bridge holographic projection for display;

[0083] The beneficial effect of the above technical solution is: through the above technical solution, the design of the holographic projection is completed, and the method of obtaining the user's interactive data to generate the holographic projection is adopted, which is beneficial to improve the attractiveness of the holographic projection to the user group and achieve the effect of user aggregation.

[0084] In one embodiment, the GPT interaction module performs the following operations:

[0085] Based on the chatGPT method, the corresponding road and bridge explanation content is generated according to the road and bridge holographic projection;

[0086] Extract the user bracelet information within the preset range of the current interactive project obtained by the information receiving unit, and send a pairing request to all user Bluetooth headsets within the preset range of the current interactive project according to the Bluetooth pairing information corresponding to the user bracelet information;

[0087] After the user accepts the pairing operation through the user's wristband, the road and bridge content is explained to the user through the user's Bluetooth headset according to the explanation sound type and road and bridge explanation content pre-selected by the user;

[0088] The working principle and beneficial effects of the above technical solution are as follows: the system includes a GPT interaction module, which is used to explain roads and bridges based on holographic projections and interact with on-site users at the same time, so that users can immerse themselves in the explanation project, which is beneficial to increase users' interest in road and bridge knowledge and improve the efficiency of popularizing bridge culture; specifically, the GPT interaction module is based on the chatGPT method, and uses the bridge information corresponding to the road and bridge holographic projection as input, and generates corresponding road and bridge explanation content text according to the trained chatGPT output. At the same time, the GPT interaction module extracts the user bracelet information within the preset range of the current interactive project obtained by the information receiving unit built into the holographic display module. The selection of the preset range of the current interactive project is related to other interactive systems in the venue and the overall layout of the venue, and then generates a corresponding road and bridge explanation content text according to the user's bracelet information. Corresponding Bluetooth pairing information sends a pairing request to all user Bluetooth headsets within the preset range of the current interactive project. It is worth noting that the user Bluetooth headset is preferably distributed together with the user bracelet, and the user's Bluetooth headset can also be used without the user's Bluetooth headset to choose to control the sound source of the speaker unit of the GPT interactive module to ensure that it will not interfere with other interactive system projects. The advantage of equipping the user with a Bluetooth headset is that it will not interfere with other users who do not want to participate in the current interactive project, and at the same time enable users participating in the current interactive project to adjust the explanation sound according to their own situation. Of course, the user Bluetooth headset involved in this solution does not belong to a forced connection, but after the user accepts the pairing operation through the user bracelet, the road and bridge content explanation is given to the user through the user's Bluetooth headset according to the user's pre-selected explanation sound type and road and bridge explanation content.

[0089] See also Figure 3 In one embodiment, the GPT interaction module is further configured to perform the following operations:

[0090] S101, classifying the road and bridge explanation content based on a preset segmentation rule to obtain a plurality of road and bridge explanation sections;

[0091] S102, obtaining user expression information within a preset range of the interactive items during the explanation of each road and bridge section, and analyzing the user expression information to obtain the first intention degree of the user to participate in the interaction;

[0092] S103, obtaining the heart rate change information of the user's wristband information within the preset range of the interactive items during the explanation of each road and bridge section, and analyzing the heart rate change information to obtain the second intention degree of the user to participate in the interaction;

[0093] S104, determining a target user according to the first intention degree and the second intention degree;

[0094] S105, determining an interaction problem according to the first intention degree, the second intention degree, and the interaction data of the target user;

[0095] S106, interacting with the target user according to the interaction question;

[0096] The working principle and beneficial effects of the above technical solution are as follows: the system includes a GPT interaction module, which, in addition to explaining the roads and bridges based on holographic projection, can also interact with on-site users, so that users can immerse themselves in this explanation project; specifically, the GPT interaction module performs the following operations: first, based on the preset segmentation rules, the road and bridge explanation content is categorized to obtain multiple road and bridge explanation sections, and the preset segmentation rules are preferably used to divide the content according to the history, celebrities, and bridge structures of the roads and bridges. The specific segmentation rules can be specifically designed according to the actual application scenarios; then, the user expression information within the preset range of the interactive project during the explanation of each road and bridge section is obtained, and the user expression information is analyzed to obtain the first intention degree of the user to participate in the interaction, such as happiness, intention, Expressions such as indifference can, to a certain extent, determine the degree to which the user is attracted by the content of this explanation. At the same time, the heart rate change information in the user's bracelet information within the preset range of the interactive project during the explanation of each road and bridge section is obtained, and the heart rate change information is analyzed to obtain the second intention degree of the user to participate in the interaction. The verification of HRV is added to improve the accuracy of judging the user's emotions, thereby improving the efficiency of subsequent interactions. Then, the target user is determined according to the first intention degree and the second intention degree, and the interaction problem is determined according to the first intention degree, the second intention degree, and the interaction data of the target user. Finally, the target user is interacted with according to the interaction problem to complete the interaction of this road and bridge explanation. The above technical solution is beneficial to improving the interaction efficiency, preventing the scene from being cold, and preventing the occurrence of problems that dampen the user's enthusiasm for learning.

[0097] In one embodiment, the user expression information within the preset range of the interactive item during the explanation of each road and bridge section is obtained, and the user expression information is analyzed to obtain the first intention degree of the user to participate in the interaction, including:

[0098] Collecting user facial information within a preset range of the interactive project using a camera device pre-installed at a preset position in the target venue;

[0099] According to the wristband positioning information corresponding to the user wristband carried by the user, combined with the visual positioning information when the camera device collects the user's facial information, the collected user facial information is marked with the user's wristband information to construct a large set of facial information for each user;

[0100] According to the time information of each road and bridge section explanation, the large set of facial information is divided, and based on the expression analysis method, the user expression information in the large set of facial information is identified to obtain a small set of expression information of each user at each road and bridge section explanation stage;

[0101] Obtain the preset intention weight corresponding to each expression information;

[0102] According to the corresponding scores of all the expression information in the expression information small set and the corresponding preset intention weights, the first intention degree of each user to participate in the corresponding road and bridge explanation interaction is calculated by weighted summation;

[0103] The working principle of the above technical solution is as follows: according to the camera device pre-deployed at the preset position in the target venue, the camera device can be a monitoring device in the venue, or a separate camera device can be set up to collect user facial information within the preset range of the interactive project; in order to further determine the matching of user facial information and user identity information, according to the wristband positioning information corresponding to the user wristband carried by the user, combined with the visual positioning information when the camera device collects the user facial information, the collected user facial information is marked with the user wristband information. Of course, it can also be implemented by using technologies such as face recognition, but this method requires the user to enter the face in advance, the operation is cumbersome, and it is not suitable for entering the library. Therefore, the positioning information is used to reduce the operation steps of the user end and improve the user experience. Then, a large set of facial information of each user is constructed according to the marking information; and according to the time information of the explanation of each road and bridge section, the large set of facial information is divided to obtain a small set of facial information for each road and bridge section, and then according to the expression analysis method, the user expression information in the small set of facial information is identified to obtain the expression of each user at the explanation stage of each road and bridge section. A small set of information; obtaining a preset intention weight corresponding to each expression information, the preset intention weight is preferably determined in advance according to the content emotion of the current road and bridge explanation paragraph, and the specific determination method can be manually determined in advance or intelligently determined. For example, the current road and bridge explanation paragraph tells the story of Qu Yuan's drowning in the river, which is convenient for the subsequent better explanation of Zhuoying Bridge. In the current explanation paragraph, the preset intention weight of pessimistic expression is higher, greater than calm expression and optimistic expression, or, if the current road and bridge explanation paragraph explains the relevant knowledge of Lian Gong Bridge and involves the history of Lugou Bridge, then in the current explanation paragraph, the preset intention weights of expressions such as grief and pride are higher; finally, according to the corresponding scores of all expression information in the small set of expression information and the corresponding preset intention weights, the weighted sum is calculated to obtain the first intention degree of each user to participate in the corresponding road and bridge explanation interaction, and the corresponding scores of all expression information are pre-set basic scores. The setting of the score is preferably set according to the range of emotional fluctuations, that is, if the current expression information is more excited, the corresponding basic score is higher, and the excitement level includes positive emotional excitement and negative emotional excitement, wherein the calculation formula is preferably:

[0104]

[0105] Among them, P 1，n is the first intention degree of the nth road and bridge explanation paragraph, j is the number of expression information in the small set of expression information corresponding to the nth road and bridge explanation paragraph, x i is the corresponding score of the ith facial expression information in the small set of facial expression information corresponding to the nth road and bridge explanation paragraph, y i，n The preset intention weight corresponding to the i-th expression information in the n-th road and bridge explanation paragraph;

[0106] The beneficial effect of the above technical solution is: through the above technical solution, the user's first intention level is determined, providing reliable data support for the subsequent determination of target users and target problems.

[0107] In one embodiment, the heart rate change information in the user's wristband information within the preset range of the interactive item during each road and bridge section explanation is obtained, and the heart rate change information is analyzed to obtain the second intention degree of the user to participate in the interaction, including:

[0108] According to the signal sending unit built into the GPT interaction module, the heart rate activation information is sent to the user's wristband within the preset range of the interaction project to activate the heart rate monitoring device built into the user's wristband;

[0109] By building a heart rate monitoring device into the user's wristband, the user's heart rate information in each explanation section can be monitored to further determine the user's emotional information based on relevant heart rate analysis methods;

[0110] At the same time, it can also monitor the user's physical health and issue an alarm in time according to the monitoring results to prevent the user from triggering other diseases due to excessive heart rate fluctuations caused by excessive mood swings;

[0111] Collecting user heart rate information through the heart rate monitoring device, extracting user heart rate information within a preset range of the current interactive item acquired by the information receiving unit, and constructing a large set of heart rate change information for each user;

[0112] According to the time information of each road and bridge section explanation, the large set of heart rate change information is divided, and based on HRV and emotion analysis methods, the user emotion information in the large set of heart rate change information is identified to obtain a small set of emotion information of each user at each road and bridge section explanation stage;

[0113] The technology of this HRV and emotion analysis method is relatively mature, so I will not go into details here;

[0114] Obtaining a preset second intention weight corresponding to each emotional information;

[0115] The method for determining the preset second intention weight is similar to the method for determining the preset intention weight. The specific determination method may refer to the setting method of the preset intention weight.

[0116] According to the corresponding scores of all the emotional information in the emotional information small set and the corresponding preset second intention weights, the second intention degree of each user to participate in the corresponding road and bridge explanation interaction is calculated by weighted summation;

[0117] The corresponding score of the emotion information is preferably the same as the corresponding score of the expression information;

[0118] The calculation method of the second intention level is preferably:

[0119]

[0120] Among them, P 2n is the second intention degree of the nth road bridge explanation paragraph, k is the number of emotional information in the small set of emotional information corresponding to the nth road bridge explanation paragraph, x m is the corresponding score of the mth expression information in the small set of emotional information corresponding to the nth road and bridge explanation paragraph, y m，n The preset second intention weight corresponding to the mth emotional information in the nth road and bridge explanation paragraph;

[0121] The beneficial effect of the above technical solution is: through the above technical solution, the user's second intention level is determined, providing reliable data support for the subsequent determination of target users and target problems.

[0122] In one embodiment, determining the target user according to the first intention level and the second intention level includes:

[0123] Obtaining the first intention levels of all users corresponding to each road and bridge explanation section, and determining the number of users whose first intention levels are greater than a preset qualified value as the first number;

[0124] Obtain the second intention degree of all users corresponding to each road and bridge explanation section, and determine the number of users whose second intention degree is greater than a preset second qualified value as the second number;

[0125] Generally, most users maintain an uncertain state of mind, whether to participate or not. The preset qualified value and the preset second qualified value are set to exclude these users, and the number of users whose mentality is maintained in a certain state of mind is used for the subsequent selection of target users.

[0126] The first quantity, the second quantity and the corresponding weight corresponding to each road and bridge explanation section are obtained, and the total intention degree of each road and bridge explanation section is calculated by weighted summation; the calculation formula is preferably:

[0127] K n =S 1，，n *α1+S 2，，n *#2

[0128] Among them, K n is the total intention degree of the nth road and bridge explanation paragraph, S 1，，n is the first quantity corresponding to the nth section of the road and bridge explanation, α1 is the weight corresponding to the predetermined first quantity, S 2，，n is the second quantity corresponding to the nth section of the road and bridge explanation, α2 is the weight corresponding to the predetermined second quantity, the settings of α1 and α2 are determined by the administrator, and the sum of α1 and α2 is 1, and in the initial state, α1 and α2 are both 0.5;

[0129] Obtain the road and bridge explanation section with the highest total intention degree as the target explanation section;

[0130] The first intention level and the second intention level of each user corresponding to the target explanation paragraph are obtained, and the sum is calculated to obtain the second total intention level of each user for the target explanation paragraph; the calculation formula is preferably:

[0131] P n =P 1，n +P 2，n

[0132] Among them, P n The second overall intention level when explaining the target paragraph for the nth explanation paragraph;

[0133] Get the user with the second highest total intention as the target user;

[0134] The beneficial effect of the above technical solution is: through the above technical solution, the intention level of all user groups is analyzed to complete the determination of target users, which is beneficial to screen out the users with the highest intention level in the explanation paragraphs with the highest relevant intention level in the user group, further improve the interaction success rate, and increase the probability that the user group is interested in the interactive content during the interaction.

[0135] In one embodiment, determining the interaction problem according to the first intention level, the second intention level, and the interaction data of the target user includes:

[0136] Determine the target explanation paragraph according to the first intention level and the second intention level;

[0137] Please refer to the above technical solution for specific determination steps;

[0138] Determine the screening conditions according to the category of the explanation content of the target explanation paragraph;

[0139] For example, if the category of the explanation content of the current target explanation paragraph is celebrities, such as the story of Qu Yuan drowning in the river, the filtering condition is to filter celebrity stories;

[0140] Determine the range of optional questions based on target users’ interaction data;

[0141] That is, the target user's interaction data in this venue is selected, and the interaction content with the target user's interaction degree reaching a certain threshold is selected as the optional questions. The threshold is set to prevent the user from forgetting the relevant data, and all optional questions are obtained to determine the scope of the questions;

[0142] Match the optional question range according to the screening conditions to obtain interactive questions;

[0143] For example, if the screening condition is a celebrity story, a knowledge point in any celebrity story is selected from the range of optional questions for target user interaction to ask the user a question to determine the interaction question;

[0144] It is worth noting that if there is no relevant celebrity story in the range of optional questions, since the selection step occurs before the formal interaction, the target user is changed and the interaction question is re-determined until the selection is completed, triggering the interaction;

[0145] The beneficial effect of the above technical solution is: through the above technical solution, the selection of interaction questions is completed, which is beneficial to improving the interaction success rate and increasing the probability that the user group is interested in the interaction content during the interaction.

[0146] Finally, it should be noted that the above preferred embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail through the above preferred embodiments, those skilled in the art should understand that various changes can be made in form and details without departing from the scope defined by the claims of the present invention.

Claims

1. A road and bridge explanation holographic projection immersive interactive system based on multi-dimensional data, characterized in that: include: A multi-dimensional data acquisition module is used to acquire the interaction data of the user groups in the target venue when they experience multiple interactive projects; Holographic display module, used to generate corresponding road and bridge holographic projections for display based on interactive data; The GPT interaction module is used to generate corresponding road and bridge explanation content according to the road and bridge holographic projection, and to determine interaction questions and select corresponding target users for interaction according to the road and bridge explanation content and interaction data.

2. According to the multi-dimensional data-based holographic projection immersive interactive system for road and bridge explanations, the system is characterized by: The multidimensional data acquisition module includes: The AR bridge construction simulation interaction data acquisition unit is used to acquire the interaction data of users in the venue on the AR bridge construction simulation teaching module during a preset time period; A VR bridge culture teaching interaction data acquisition unit, used to acquire the interaction data of users in the venue on the VR bridge culture teaching dissemination module during a preset time period; The GPT bridge culture guidance interaction data acquisition unit is used to obtain the interaction data of users in the venue on the GPT bridge culture guidance dialogue module during a preset time period.

3. The immersive interactive system for road and bridge explanation based on multi-dimensional data according to claim 1 is characterized in that: The holographic display module performs the following operations: Receiving interactive data transmitted by the multi-dimensional data acquisition module; According to the preset parsing method, the interaction data is parsed to obtain the interaction bridge type and specific interaction bridge information; wherein the interaction bridge type and specific interaction bridge information obtained by parsing both carry the interaction personnel's wristband information mark; According to the built-in information receiving unit, obtain the user's bracelet information within the preset range of the current interactive project; According to the user's wristband information, based on the preset filtering conditions, the interactive bridge type and specific interactive bridge information corresponding to the user's wristband information are filtered to obtain the target bridge display information; According to the target bridge display information and based on the holographic projection generation method, the corresponding road and bridge holographic projection is generated for display.

4. The immersive interactive system for road and bridge explanation based on multi-dimensional data according to claim 1 is characterized in that: The GPT interaction module performs the following operations: Based on the chatGPT method, the corresponding road and bridge explanation content is generated according to the road and bridge holographic projection; Extract the user bracelet information within the preset range of the current interactive project obtained by the information receiving unit, and send a pairing request to all user Bluetooth headsets within the preset range of the current interactive project according to the Bluetooth pairing information corresponding to the user bracelet information; After the user accepts the pairing operation through the user's wristband, the road and bridge content is explained to the user through the user's Bluetooth headset according to the explanation sound type and road and bridge explanation content pre-selected by the user.

5. The immersive interactive system for road and bridge explanation based on multi-dimensional data according to claim 1 is characterized in that: The GPT interaction module is also used to perform the following operations: Based on the preset segmentation rules, the road and bridge explanation contents are classified to obtain multiple road and bridge explanation sections; Obtain user expression information within the preset range of the interactive items during the explanation of each road and bridge section, and analyze the user expression information to obtain the user's first intention to participate in the interaction; Obtain the heart rate change information from the user's wristband information within the preset range of the interactive project during the explanation of each road and bridge section, and analyze the heart rate change information to obtain the user's second intention to participate in the interaction; Determine the target user according to the first intention level and the second intention level; Determine the interaction problem according to the first intention level, the second intention level, and the interaction data of the target user; Interact with target users based on interaction questions.

6. The immersive interactive system for road and bridge explanation based on multi-dimensional data holographic projection according to claim 5 is characterized in that: Obtain the user's facial expression information within the preset range of the interactive items during the explanation of each road and bridge section, and analyze the user's facial expression information to obtain the user's first intention to participate in the interaction, including: Collecting user facial information within a preset range of the interactive project using a camera device pre-installed at a preset position in the target venue; According to the wristband positioning information corresponding to the user wristband carried by the user, combined with the visual positioning information when the camera device collects the user's facial information, the collected user facial information is marked with the user's wristband information to construct a large set of facial information for each user; According to the time information of each road and bridge section explanation, the large set of facial information is divided, and based on the expression analysis method, the user expression information in the large set of facial information is identified to obtain a small set of expression information of each user at each road and bridge section explanation stage; Obtain the preset intention weight corresponding to each expression information; According to the corresponding scores of all the expression information in the small set of expression information and the corresponding preset intention weights, the first intention degree of each user to participate in the corresponding road and bridge explanation interaction is calculated by weighted summation.

7. The immersive interactive system for road and bridge explanation based on multi-dimensional data holographic projection according to claim 5 is characterized in that: Obtain the heart rate change information from the user's wristband information within the preset range of the interactive project during the explanation of each road and bridge section, and analyze the heart rate change information to obtain the user's second intention to participate in the interaction, including: According to the signal sending unit built into the GPT interaction module, the heart rate activation information is sent to the user's wristband within the preset range of the interaction project to activate the heart rate monitoring device built into the user's wristband; Collecting user heart rate information through the heart rate monitoring device, extracting user heart rate information within a preset range of the current interactive item acquired by the information receiving unit, and constructing a large set of heart rate change information for each user; According to the time information of each road and bridge section explanation, the large set of heart rate change information is divided, and based on HRV and emotion analysis methods, the user emotion information in the large set of heart rate change information is identified to obtain a small set of emotion information of each user at each road and bridge section explanation stage; Obtaining a preset second intention weight corresponding to each emotional information; According to the corresponding scores of all the emotion information in the emotion information small set and the corresponding preset second intention weights, the second intention degree of each user participating in the corresponding road and bridge explanation interaction is calculated by weighted summation.

8. The immersive interactive system for road and bridge explanation based on multi-dimensional data holographic projection according to claim 5 is characterized in that: Determine the target users based on the first intention level and the second intention level, including: Obtaining the first intention levels of all users corresponding to each road and bridge explanation section, and determining the number of users whose first intention levels are greater than a preset qualified value as the first number; Obtain the second intention degree of all users corresponding to each road and bridge explanation section, and determine the number of users whose second intention degree is greater than a preset second qualified value as the second number; Obtain the first quantity, the second quantity and the corresponding weight corresponding to each road and bridge explanation section, and calculate the total intention degree of each road and bridge explanation section by weighted sum; Obtain the road and bridge explanation section with the highest total intention degree as the target explanation section; Obtaining the first intention level and the second intention level of each user corresponding to the target explanation paragraph, and summing and calculating to obtain the second total intention level of each user for the target explanation paragraph; The user with the second highest total intention is obtained as the target user.

9. The immersive interactive system for road and bridge explanation based on multi-dimensional data according to claim 5, characterized in that: Determine the interaction problem based on the first intention level, the second intention level, and the interaction data of the target user, including: Determine the target explanation paragraph according to the first intention level and the second intention level; Determine the screening conditions according to the category of the explanation content of the target explanation paragraph; Determine the range of optional questions based on target users’ interaction data; The optional question range is matched according to the screening conditions to obtain interactive questions.

Images