Guide method and system based on virtual reality and multi-dimensional scene, medium and product

Abstract

The invention discloses a guide method and system based on virtual reality and a multi-dimensional scene, a medium and a product, and relates to the technical field of virtual reality. By adopting the technical scheme, the control system monitors the exhibition hall static characteristic data and the exhibition hall dynamic characteristic data of the exhibition site in real time, and when the visit comfort is not high due to dense people flow, the virtual exhibition hall visit mode is automatically switched to for the user, so that the problem of poor visit experience of an entity exhibition hall at the peak of people flow is effectively solved. The control system can generate the virtual visiting behavior portrait of the user according to the virtual visiting behavior data of the user in the virtual exhibition hall and determine the recommended exhibit matched with the interest of the user according to the virtual visiting behavior portrait, so that more intelligent and personalized visiting experience is provided. Compared with an appointment time-sharing visiting mode, the exhibition hall display method combining virtuality and reality has the advantages that the visiting order of an exhibition place is guaranteed, and the user can still obtain good visiting experience in the peak period of people flow.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a navigation method, system, medium and product based on virtual reality and multi-dimensional scenes. Background Art

[0002] With the rapid development of digital technology, museums, art galleries and other exhibition venues are constantly innovating in their display methods, providing visitors with a richer cultural enjoyment. Especially during major exhibitions and holidays, exhibition halls often have large traffic and limited visiting experience. How to ensure that visitors have a good visiting experience has become an important issue that the exhibition industry needs to solve urgently.

[0003] At present, exhibition venues usually adopt a management method of appointment and time-slot visits, and control the density of people in the exhibition hall by limiting the number of visitors in each time slot. In specific implementation, staff will count the flow of people at the entrance of the exhibition hall. When the upper limit of the number of people is reached, subsequent visitors are required to wait outside the exhibition hall. At the same time, fixed visiting routes and signboards will be set up inside the exhibition hall to guide visitors to visit in an orderly manner according to the established routes.

[0004] This management method has some limitations in actual operation. For example, although appointment-based visits in different time periods can control the flow of people to a certain extent, it is difficult to effectively deal with sudden peaks in the flow of people, resulting in crowded viewing and reduced comfort for visitors. Summary of the invention

[0005] The present application provides a tour guide method, system, medium and product based on virtual reality and multi-dimensional scenes, which are used to improve the user's visiting comfort when the exhibition hall is crowded with people.

[0006] In a first aspect, the present application provides a navigation method based on virtual reality and multi-dimensional scenes, which is applied to a control system, and the method includes: obtaining static feature data and dynamic feature data of an exhibition hall, the static feature data of the exhibition hall including the layout of the exhibition hall, the location of exhibits and the type of exhibits, and the dynamic feature data of the exhibition hall including the real-time density of people flow and the movement trajectory of people flow; based on the static feature data of the exhibition hall, constructing a virtual exhibition hall, the virtual exhibition hall including a three-dimensional model of the physical exhibition hall; according to the dynamic feature data of the exhibition hall, evaluating the visiting comfort of the physical exhibition hall; when the visiting comfort is lower than a preset comfort threshold, presenting the virtual exhibition hall to the user through a virtual reality device, so that the user can visit the virtual exhibition hall; during the virtual exhibition hall visit, collecting the user's virtual visiting behavior data to generate a user's virtual visiting behavior portrait, the virtual visiting behavior data including head movement data, gesture interaction data and line of sight focus data; according to the user's virtual visiting behavior portrait, screening recommended exhibits that match the user's virtual interests, and displaying them through a multimodal interactive interface.

[0007] By adopting the above technical solution, the control system monitors the static feature data and dynamic feature data of the exhibition hall in the exhibition venue in real time. When the high density of visitors leads to low visiting comfort, it automatically switches the user to the virtual exhibition hall visiting mode, effectively solving the problem of poor visiting experience in the physical exhibition hall during peak visitor hours. The control system can generate a portrait of the user's virtual visiting behavior based on the virtual visiting behavior data of the user in the virtual exhibition hall, and determine recommended exhibits that match the user's interests accordingly, providing a more intelligent and personalized visiting experience. This method of combining virtual and real exhibition hall displays, compared with the reservation time-sharing visiting mode, not only ensures the visiting order of the exhibition venue but also enables users to still obtain a good visiting experience during peak visitor hours.

[0008] In combination with some embodiments of the first aspect, in some embodiments, based on the static feature data of the exhibition hall, a virtual exhibition hall is constructed. The virtual exhibition hall includes a three-dimensional model of the physical exhibition hall, specifically including: obtaining the three-dimensional data of the exhibition hall and the exhibit position data. The three-dimensional data of the exhibition hall includes the spatial structure and wall information, and the exhibit position data includes the spatial coordinates of the exhibits; processing the three-dimensional data of the exhibition hall to obtain the basic framework data; integrating the exhibit position data into the basic framework data to generate the exhibition hall layout data, which is used to represent the overall structure of the exhibition hall and the distribution positions of the exhibits; constructing a virtual exhibition hall model based on the exhibition hall layout data; collecting the lighting data of the physical exhibition hall and applying the lighting data to the virtual exhibition hall model to generate the virtual exhibition hall.

[0009] By adopting the above technical solution, the control system obtains the three-dimensional data of the exhibition hall and the exhibit position data, determines the basic framework data in combination with elements such as the spatial structure and wall information, then integrates the spatial coordinates of the exhibits to generate the complete exhibition hall layout data. Finally, the control system collects and applies the lighting data of the physical exhibition hall to obtain a virtual exhibition hall that highly restores the physical exhibition hall. This systematic method of constructing a virtual exhibition hall ensures that the virtual exhibition hall is highly consistent with the physical exhibition hall in terms of visual effects and spatial layout, enabling users to obtain an immersive experience close to on-site visits during virtual visits and enhancing the realism and sense of immersion of virtual exhibition hall visits.

[0010] In combination with some embodiments of the first aspect, in some embodiments, according to the dynamic feature data of the exhibition hall, the visiting comfort of the physical exhibition hall is evaluated, specifically including: calculating the crowding degree of each exhibit area in the physical exhibition hall according to the real-time crowd density, and the crowding degree is determined according to the total number of people and the maximum capacity in the exhibit area; calculating the moving state of the crowd based on the crowd movement trajectory, and the moving state is obtained by dividing the average moving speed of the crowd by the preset moving speed; determining the visiting comfort of the physical exhibition hall according to the crowding degree and moving state of each exhibit area.

[0011] By adopting the above technical solution, the control system calculates the crowding degree and the moving state of the people flow in each exhibition area of the physical exhibition area, and can scientifically evaluate the visiting comfort of the current user in the physical exhibition hall. This dynamic evaluation mechanism based on multi-dimensional indicators enables the control system to accurately grasp the crowding degree and the visiting experience level of the physical exhibition hall, provides an objective basis for whether to start the virtual exhibition hall visiting mode, and effectively avoids the subjectivity and lag of the traditional manual statistics and empirical judgment methods.

[0012] In combination with some embodiments of the first aspect, in some embodiments, after the step of screening recommended exhibits matching the user's virtual interests according to the user's virtual visit behavior portrait and displaying them through the multi-modal interaction interface, the method further includes: when the user clicks on a preset interaction trigger point, activating the detailed display and interaction information of the corresponding virtual exhibit; recording the virtual exhibits to generate a user interest-associated visiting route of the physical exhibition hall, and the user interest-associated visiting route is used to connect the physical exhibits corresponding to the virtual exhibits.

[0013] By adopting the above technical solution, the control system sets a preset interaction trigger point and records the user's interaction behavior in the virtual exhibition hall to generate a user interest-associated visiting route of the physical exhibition hall, realizing the intelligent connection between the virtual and physical exhibition halls. This route planning mechanism based on user interests enables the user to view the physical exhibits of their interest in a targeted manner during subsequent visits to the physical exhibition hall, greatly improving the visiting efficiency. At the same time, this virtual-reality combined visiting mode also provides a more complete exhibition experience for the user, making the virtual visit no longer a simple alternative, but a beneficial supplement to the physical visit.

[0014] In combination with some embodiments of the first aspect, in some embodiments, after the step of evaluating the visiting comfort of the physical exhibition hall according to the dynamic characteristic data of the exhibition hall, the method further includes: when the visiting comfort is higher than or equal to the preset comfort threshold, superimposing and displaying guiding information on the physical exhibition hall through the augmented reality device, enabling the user to visit the physical exhibition hall; during the visit to the physical exhibition hall, collecting the user's physical visit behavior data to generate a user physical visit behavior portrait, and the physical visit behavior data includes the user's walking trajectory, the user's staying position, and the user's interaction data; generating a personalized physical guiding path based on the user physical visit behavior portrait and the exhibition hall crowding heat map, and the exhibition hall crowding heat map is determined according to the real-time people flow density and the people flow movement trajectory, and the personalized physical guiding path is used to represent the optimal visiting route of the user in the physical exhibition hall; superimposing and displaying the personalized physical guiding path in the user's field of view through the augmented reality device to guide the user to walk.

[0015] By adopting the above technical solution, when the comfort level of visiting the physical exhibition hall is relatively high, the control system uses augmented reality technology to provide real-time guided tour services. The control system will generate a portrait of the user's physical visit behavior based on the user's physical visit behavior data, and combine it with the real-time heat map of the exhibition hall crowd density to plan the optimal visit route for the user. This intelligent guided tour system not only takes into account the user's personal interests, but also incorporates the factor of the flow of people distribution into the route planning, which can effectively avoid crowded areas and provide a smoother visit experience for the user.

[0016] Combined with some embodiments of the first aspect, in some embodiments, after the step of superimposing and displaying a personalized physical guided tour path in the user's field of view through an augmented reality device to guide the user to walk, the method further includes: when the distance between the user and the target exhibit is lower than a preset distance threshold, superimposing and displaying the target explanation content of the target exhibit through the augmented reality device, where the target exhibit is any physical exhibit in the physical exhibition hall, and the target explanation content includes the text description, video material or interactive information of the target exhibit; receiving an interactive instruction issued by the user, and adjusting the display mode of the target explanation content according to the interactive instruction.

[0017] By adopting the above technical solution, the control system realizes the intelligent triggering and interactive display of the exhibit explanation content based on the distance between the user and the physical exhibit, enabling the user to obtain exhibit information without manual search. At the same time, the control system supports the user to adjust the display mode of the exhibit explanation content through interactive instructions, providing a more flexible information acquisition experience. This automatic explanation mechanism based on distance triggering not only avoids the problem of inconvenient information acquisition in the traditional explanation method, but also ensures the personalization of information display through interactive adjustment, greatly enhancing the educational value and user experience of the exhibition.

[0018] Combined with some embodiments of the first aspect, in some embodiments, the method further includes: determining the popularity of each physical exhibit in the physical exhibition hall according to the virtual visit behavior data and the physical visit behavior data; determining the physical exhibits with a popularity exceeding a preset popularity threshold as popular exhibits; and adjusting the exhibition layout of the physical exhibition hall based on the popular exhibits.

[0019] By adopting the above technical solution, the control system analyzes the user's visit behavior data in the virtual exhibition hall and the physical exhibition hall to establish an evaluation mechanism for the popularity of exhibits, and optimizes the exhibition layout accordingly. This data-driven exhibition layout optimization solution breaks through the limitation of the traditional exhibition layout mainly relying on empirical judgment, and can respond to the audience's interests more scientifically, enhancing the overall viewing effect of the exhibition.

[0020] In a second aspect, an embodiment of the present application provides a control system, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to cause the control system to execute the method described in the first aspect and any possible implementation manner in the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer program product containing instructions. When the computer program product runs on a control system, it causes the control system to execute the method described in the first aspect and any possible implementation manner in the first aspect.

[0022] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium including instructions. When the instructions run on a control system, they cause the control system to execute the method described in the first aspect and any possible implementation manner in the first aspect.

[0023] It can be understood that the control system provided in the second aspect above, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiments of the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, and will not be elaborated here.

[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. By adopting the above technical solution, the control system can monitor the static feature data and dynamic feature data of the exhibition halls in the exhibition venue in real time. When the crowd density leads to low visiting comfort, it automatically switches the user to the virtual exhibition hall visiting mode, effectively solving the problem of poor visiting experience in the physical exhibition hall during peak hours. The control system can generate a portrait of the user's virtual visiting behavior based on the virtual visiting behavior data of the user in the virtual exhibition hall, and accordingly determine recommended exhibits that match the user's interests, providing a more intelligent and personalized visiting experience. This method of combining virtual and real exhibition hall displays, compared with the reservation time-sharing visiting mode, not only ensures the visiting order of the exhibition venue but also allows users to still obtain a good visiting experience during peak hours.

[0025] 2. By adopting the above technical solution, the control system calculates the crowding degree and the moving state of the crowd in each exhibition area of the physical exhibition area, and can scientifically evaluate the current user's visiting comfort in the physical exhibition hall. This dynamic evaluation mechanism based on multi-dimensional indicators enables the control system to accurately grasp the crowding degree and visiting experience level of the physical exhibition hall, providing an objective basis for whether to start the virtual exhibition hall visiting mode, and effectively avoiding the subjectivity and lag of the traditional manual statistics and experience judgment methods.

[0026] 3. By adopting the above technical solution, the control system sets preset interaction trigger points and records the user's interaction behaviors in the virtual exhibition hall to generate a user interest-related visit route for the physical exhibition hall, realizing the intelligent connection between the virtual and physical exhibition halls. This route planning mechanism based on user interests enables users to view the physical exhibits they are interested in in a targeted manner when visiting the physical exhibition hall subsequently, greatly improving the visit efficiency. At the same time, this virtual-reality combined visit mode also provides users with a more complete exhibition experience, making the virtual visit no longer a simple alternative but a beneficial supplement to the physical visit. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a flowchart of a navigation method based on virtual reality and multi-dimensional scenarios in an embodiment of the present application; Figure 2 is another flowchart of a navigation method based on virtual reality and multi-dimensional scenarios in an embodiment of the present application; Figure 3 is a schematic structural diagram of a physical device of the control system in an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0028] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of the present application, the singular forms "a", "an", "the above", "the", and "this" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations including one or more of the listed items.

[0029] Hereinafter, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as implying or suggesting relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality" is two or more.

[0030] The following describes the process of the method provided in this embodiment in combination with the above scenarios. Please refer to Figure 1 , which is a flowchart of a navigation method based on virtual reality and multi-dimensional scenarios in an embodiment of the present application.

[0031] S101. Obtain the static feature data and dynamic feature data of the exhibition hall. The static feature data of the exhibition hall includes the exhibition hall layout, the positions of the exhibits, and the types of the exhibits. The dynamic feature data of the exhibition hall includes the real-time crowd density and the crowd movement trajectories; Among them, the static feature data of the exhibition hall refers to the fixed attribute information in the exhibition hall that does not change with time, including the exhibition hall layout, the location of exhibits, and the types of exhibits; the exhibition hall layout refers to the overall spatial structure of the exhibition hall, including wall arrangements, passage designs, functional partitions, etc.; the location of exhibits refers to the specific spatial coordinates and placement directions of each exhibit in the exhibition hall; the types of exhibits refer to the classification attributes of exhibits, such as cultural relics, artworks, scientific and technological exhibits, etc. The dynamic feature data of the exhibition hall refers to the data that changes in real time in the exhibition hall, including the real-time crowd density and the crowd movement trajectory; the real-time crowd density refers to the number of visitors per unit area; the crowd movement trajectory refers to the movement path and direction of visitors in the exhibition hall.

[0032] Specifically, the control system obtains the three-dimensional structure data of the exhibition hall through spatial scanning devices, and reads the detailed information of the exhibits from the exhibition hall management database, including the specific location coordinates, type labels, and placement angles of each exhibit. At the same time, the control system collects crowd flow data in real time through a sensor network distributed throughout the exhibition hall, including the crowd density data obtained by infrared sensors and the visitor movement trajectory information tracked by the video analysis system. After these data are preprocessed and integrated, complete static feature data and dynamic feature data of the exhibition hall are formed.

[0033] S102. Based on the static feature data of the exhibition hall, construct a virtual exhibition hall, and the virtual exhibition hall includes a three-dimensional model of the physical exhibition hall; Among them, the virtual exhibition hall refers to a digital exhibition space constructed through computer technology for simulating the visiting experience of the physical exhibition hall; the three-dimensional model refers to a three-dimensional digital representation of the exhibition hall space created using computer graphics technology; the physical exhibition hall refers to an actual exhibition venue in reality.

[0034] Specifically, first, the control system imports the obtained three-dimensional data of the exhibition hall into a three-dimensional modeling engine, and reconstructs the basic framework data of the exhibition hall through computer graphics algorithms, including accurately restoring building structures such as walls, floors, and ceilings. Then, the control system places the corresponding three-dimensional models of the exhibits in the virtual space according to the exhibit location data, ensuring that their positions and directions are consistent with those of the physical exhibition hall. At the same time, the control system also processes the materials and lighting in the virtual space, and simulates the real visual effects through rendering technology, and finally generates a virtual exhibition hall that highly restores the physical exhibition hall.

[0035] Optionally, generally, based on the static feature data of the exhibition hall, a virtual exhibition hall is constructed. The virtual exhibition hall includes a three-dimensional model of the physical exhibition hall, which can be realized in the following ways (not limited here): Obtain the three-dimensional data of the exhibition hall and the exhibit position data. The three-dimensional data of the exhibition hall includes the spatial structure and wall information, and the exhibit position data includes the spatial coordinates of the exhibits; Process the three-dimensional data of the exhibition hall to obtain the basic framework data; Integrate the exhibit position data into the basic framework data to generate the exhibition hall layout data, which is used to represent the overall structure of the exhibition hall and the distribution positions of the exhibits; Based on the exhibition hall layout data, construct a virtual exhibition hall model; Collect the lighting data of the physical exhibition hall and apply the lighting data to the virtual exhibition hall model to generate a virtual exhibition hall.

[0036] Taking the "Space Technology Exhibition Hall" of a certain science and technology museum as an example: The first step is data collection: The control system uses a 3D laser scanner to measure the spatial dimensions of the physical exhibition hall as 30 meters in length, 20 meters in width, and 8 meters in height. Through surveying and mapping, record the layout structure of 6 exhibition areas in the physical exhibition hall, including the specific positions and area data of exhibition areas such as the "Rocket Propulsion Technology Area", the "Spacecraft Structure Area", and the "Space Station Living Area". The control system stores these data in the exhibition hall feature dataset.

[0037] The second step is modeling and construction: The control system generates a 600-square-meter ground grid and a 416-square-meter wall grid through modeling software according to the exhibition hall feature dataset. The control system divides 6 virtual exhibition areas on the ground grid according to the physical exhibition hall layout data. For example, set the "Rocket Propulsion Technology Area" in the center of the virtual exhibition hall, covering an area of 100 square meters; Mark the lighting parameter positions of 40 LED spotlights on the wall grid.

[0038] The third step is rendering and processing: The control system applies a dark gray anti-slip material texture map to the ground grid and a matte white material texture map to the wall grid. The control system places a three-dimensional virtual exhibit of the Long March 5 carrier rocket model in the "Rocket Propulsion Technology Area" and sets the lighting parameters of 40 LED spotlights to form a lighting effect with moderate brightness and prominent focus.

[0039] The fourth step is interaction design: Set an observation area with a radius of 2 meters around the three-dimensional virtual exhibit. When the viewer's perspective enters this range, an exhibit information panel will automatically pop up, displaying detailed information such as the technical parameters and launch history of the rocket. At the same time, allow the viewer to freely move within the exhibition hall through virtual roaming, and the viewing angle can be rotated 360 degrees horizontally and adjusted 45 degrees up and down vertically.

[0040] S103. Evaluate the visiting comfort of the physical exhibition hall according to the dynamic feature data of the exhibition hall; Among them, the visit comfort level refers to the level of the user's visit experience in the current state of the physical exhibition hall; the evaluation refers to the quantitative calculation of the visit comfort level through a specific algorithm; the visit comfort level of the physical exhibition hall is used to represent the visit experience indicators in the physical exhibition hall, including elements such as the degree of crowding and the freedom of movement.

[0041] Specifically, first, the control system calculates the crowding degree of each exhibit area in the physical exhibition hall. This crowding degree is obtained by dividing the total number of people detected in real time in the exhibit area by the maximum capacity of this exhibit area. At the same time, the control system analyzes the flow movement trajectory, calculates the average movement speed of the audience, and compares it with the preset movement speed to obtain the movement state of the crowd. The control system performs a weighted calculation on the crowding degree and the movement state according to the preset weights, and finally obtains a comprehensive visit comfort level. This visit comfort level will be used to determine whether to activate the virtual exhibition hall visit mode.

[0042] Optionally, generally, according to the dynamic characteristic data of the exhibition hall, the evaluation of the visit comfort level of the physical exhibition hall can be achieved in the following ways, which are not limited here: Calculate the crowding degree of each exhibit area in the physical exhibition hall according to the real-time crowd density, and the crowding degree is determined according to the total number of people and the maximum capacity of the exhibit area; Based on the flow movement trajectory, calculate the movement state of the crowd, and the movement state is obtained by dividing the average movement speed of the crowd by the preset movement speed; Determine the visit comfort level of the physical exhibition hall according to the crowding degree and the movement state of each exhibit area.

[0043] Taking the "Impressionist Art Exhibition Hall" of a certain art museum as an example: The total area of this exhibition hall is 400 square meters, and it has 4 main exhibition areas: the "Monet Zone", the "Van Gogh Zone", the "Renoir Zone" and the "Cézanne Zone". The control system evaluates the visit comfort level through the following methods: (1) Example of crowding degree calculation: The "Monet Zone" has an area of 100 square meters, a maximum capacity of 50 people, and currently there are 35 people in the area, with a crowding degree of 70% (35 / 50); The "Van Gogh Zone" has an area of 80 square meters, a maximum capacity of 40 people, and currently there are 38 people in the area, with a crowding degree of 95% (38 / 40); The "Renoir Zone" has an area of 120 square meters, a maximum capacity of 60 people, and currently there are 30 people in the area, with a crowding degree of 50% (30 / 60); The "Cézanne Zone" has an area of 100 square meters, a maximum capacity of 50 people, and currently there are 20 people in the area, with a crowding degree of 40% (20 / 50); (2) Example of movement state calculation (the preset movement speed is 1 m / s): The average moving speed of the crowd in the "Monet Zone" is 0.6 m / s, and the moving state is 0.6 (0.6 / 1); The average moving speed of the crowd in the "Van Gogh Zone" is 0.3 m / s, and the moving state is 0.3 (0.3 / 1); The average moving speed of the crowd in the "Renoir Zone" is 0.8 m / s, and the moving state is 0.8 (0.8 / 1); The average moving speed of the crowd in the "Cézanne Zone" is 0.9 m / s, and the moving state is 0.9 (0.9 / 1); (3)Evaluation of visit comfort: "Monet Zone": Medium comfort level (moderate crowding, slightly slow moving speed); "Van Gogh Zone": Low comfort level (high crowding, slow moving speed); "Renoir Zone": High comfort level (low crowding, fast moving speed); "Cézanne Zone": Optimal comfort level (low crowding, moving speed close to normal).

[0044] S104. When the visit comfort level is lower than the preset comfort threshold, present a virtual exhibition hall to the user through virtual reality equipment, enabling the user to visit the virtual exhibition hall; Among them, the preset comfort threshold refers to the pre-set judgment standard for visit comfort level, which is used to trigger the virtual exhibition hall visit mode; the virtual reality equipment refers to the hardware equipment that can provide an immersive virtual experience for the user, such as a head-mounted display (HMD), a handle controller, etc.; presenting means transmitting the visual content of the virtual exhibition hall to the user through the virtual reality equipment; the virtual exhibition hall visit refers to the exhibition viewing activity carried out by the user in the virtual exhibition hall, which can realize the interaction and observation with the virtual exhibits.

[0045] Specifically, the control system loads the constructed virtual exhibition hall and performs real-time rendering through the graphics rendering engine. The control system transmits the rendered virtual exhibition hall to the virtual reality equipment worn by the user, and at the same time activates the tracking function of the handle controller, enabling the user to move and interact freely in the virtual exhibition hall. The control system will also adjust the viewing angle and scene display in real time according to the user's position and orientation to ensure that the user obtains a smooth virtual visit experience. During this process, the control system will continuously monitor the operating state of the virtual reality equipment to ensure the stability of the display effect and interaction response.

[0046] S105. During the virtual exhibition hall visit, collect the user's virtual visit behavior data to generate a user virtual visit behavior portrait. The virtual visit behavior data includes head movement data, gesture interaction data, and line-of-sight focus data; Among them, virtual visit behavior data refers to various activity data of users in the virtual exhibition hall; head movement data refers to information on attitude changes such as the turning and tilting of the user's head; gesture interaction data refers to operations such as pointing, selecting, and grasping performed by the user through the handle controller; line-of-sight focus data refers to the fixation point position and dwell time of the user in the virtual exhibition hall; the user's virtual visit behavior portrait refers to the user's interests summarized based on these virtual visit behavior data.

[0047] Specifically, the control system collects the user's virtual visit behavior data in real time through various sensors of the virtual reality device: records the rotation angle and speed of the user's head through the gyroscope sensor in the head-mounted display; tracks the user's hand movements and interaction operations through the handle controller; obtains the user's line-of-sight direction and fixation duration through the eye-tracking module. The control system processes and analyzes this raw data, extracts the user's behavior characteristics, such as the attention level to specific types of exhibits, typical viewing angles, and common interaction methods. Finally, the control system constructs a user's virtual visit behavior portrait that reflects the user's visit preferences.

[0048] S106. According to the user's virtual visit behavior portrait, screen out recommended exhibits that match the user's virtual interests and display them through a multi-modal interaction interface.

[0049] Among them, the user's virtual interest refers to the user's interest preference characteristics extracted from the user's virtual visit behavior portrait; the recommended exhibits refer to the set of exhibits that the control system filters out as potentially interesting based on the user's virtual interests; the multi-modal interaction interface refers to a user interface that integrates various interaction methods such as vision, audition, and touch.

[0050] Specifically, first, the control system conducts feature analysis on the user's virtual visit behavior portrait to extract the user's virtual interests, such as the preferred exhibit types, concerned theme directions, and habitual viewing methods. Then, the control system calculates the similarity between these user's virtual interests and the characteristics of each exhibit in the exhibit library, and selects several exhibits with the highest similarity as the recommended exhibits. The control system displays these recommended exhibits to the user through the multi-modal interaction interface in the virtual reality environment, including displaying guiding instructions in the user's field of vision, playing exhibit introductions through stereo sound, and providing interactive options with tactile feedback.

[0051] By adopting the above technical solution, the control system monitors the static feature data and dynamic feature data of the exhibition hall in the exhibition venue in real time. When the high density of people leads to low visiting comfort, it automatically switches the user to the virtual exhibition hall visiting mode, effectively solving the problem of poor visiting experience in the physical exhibition hall during the peak flow of people. The control system can generate a user virtual visiting behavior portrait based on the virtual visiting behavior data of the user in the virtual exhibition hall, and determine recommended exhibits that match the user's interests accordingly, providing a more intelligent and personalized visiting experience. This method of combining virtual reality and reality for exhibition hall display, compared with the reservation time-sharing visiting mode, not only ensures the visiting order of the exhibition venue, but also enables users to still obtain a good visiting experience during the peak flow of people.

[0052] The following provides a further and more specific process description of the method of this embodiment. Please refer to Figure 2 , which is another process schematic diagram of the navigation method based on virtual reality and multi-dimensional scenarios in the embodiments of the present application.

[0053] After step S103, the following steps may also be executed, or may not be executed, and this is not limited herein: S201. When the visiting comfort is lower than the preset comfort threshold, present the virtual exhibition hall to the user through the virtual reality device so that the user can visit the virtual exhibition hall; Specifically, refer to step S104, which will not be elaborated here.

[0054] S202. During the process of visiting the virtual exhibition hall, collect the virtual visiting behavior data of the user to generate a user virtual visiting behavior portrait. The virtual visiting behavior data includes head movement data, gesture interaction data, and line-of-sight focus data; Specifically, refer to step S105, which will not be elaborated here.

[0055] S203. According to the user virtual visiting behavior portrait, screen recommended exhibits that match the user's virtual interests and display them through the multi-modal interaction interface; Specifically, refer to step S106, which will not be elaborated here.

[0056] S204. When the user clicks on the preset interaction trigger point, activate the detailed display and interaction information of the corresponding virtual exhibit; Among them, the preset interaction trigger point refers to the interactable points set in advance in the virtual exhibition hall, including information markers around the virtual exhibit, virtual buttons, etc.; clicking refers to the selection or trigger operation performed by the user through the handle controller; the detailed display refers to the presentation of the in-depth information of the virtual exhibit, including text descriptions, multimedia materials, etc.; the interaction information refers to the function options that the user can operate and interact with, such as 3D model operations of the virtual exhibit, querying relevant materials, etc.; the virtual exhibit refers to the digital exhibit model in the virtual exhibition hall.

[0057] Specifically, the control system arranges visible preset interaction trigger points around the virtual exhibits, and these preset interaction trigger points maintain appropriate visibility as the user's perspective changes. When the user selects a certain preset interaction trigger point through the ray of the handle controller or direct touch, the control system will immediately display the detail panel related to the virtual exhibit. This detail panel adopts a spatial layout method and may include multiple information levels: the first level shows the basic introduction of the virtual exhibit, the second level provides historical background and creation stories, and the third level may include professional analysis and relevant research materials. At the same time, the control system activates specific interaction functions according to the type of virtual exhibit. For example, cultural relic exhibits can be rotated 360 degrees for observation, painting exhibits can be magnified for local details, and installation art can be demonstrated with virtual operations, etc.

[0058] S205. Record the virtual exhibits to generate a user interest-related visit route for the physical exhibition hall, and the user interest-related visit route is used to connect the physical exhibits corresponding to the virtual exhibits; Among them, recording the virtual exhibits means tracking and saving the virtual exhibits that the user has viewed or interacted with in the virtual exhibition hall; the user interest-related visit route refers to the recommended path for visiting the physical exhibition hall generated based on the user's interests shown in the virtual exhibition hall; the physical exhibit refers to the real exhibit corresponding to the virtual exhibit.

[0059] Specifically, the control system stores the virtual exhibits that the user has interacted with in the virtual exhibition hall in a temporary database. For these virtual exhibits, the control system locates the positions of their corresponding physical exhibits on the floor plan of the physical exhibition hall and uses a path planning algorithm to calculate an optimal visit route as the user interest-related visit route. This user interest-related visit route takes into account factors such as the physical distance between physical exhibits, the layout structure of the exhibition hall, and the rationality of the visit flow, ensuring that the route can cover the physical exhibits that the user is interested in and guarantee the smoothness of the visit experience. In this way, the user can not only screen out the virtual exhibits they are interested in through the virtual exhibition hall when there are many people, but also go to the physical exhibition hall to appreciate the physical exhibits corresponding to the virtual exhibits they are interested in when there are fewer people.

[0060] S206. When the visit comfort level is higher than or equal to the preset comfort threshold, superimpose and display the navigation information in the physical exhibition hall through the augmented reality device, so that the user can visit the physical exhibition hall; Among them, the preset comfort threshold refers to the pre-set judgment standard for the comfort of the visit; the augmented reality device refers to the hardware device that can superimpose virtual information on the real scene, such as AR glasses, smartphones, etc.; the tour guide information refers to various virtual prompt contents to assist the visit, including exhibit descriptions, direction guides, interactive prompts, etc.; the superimposed display refers to the spatial alignment and fusion display of virtual information and the physical scene; the physical exhibition hall visit refers to the exhibition viewing activity carried out by the user in the real physical space.

[0061] Specifically, first, the control system activates the augmented reality device worn by the user and starts its spatial positioning and scene recognition functions. The control system loads the pre-prepared tour guide information into the augmented reality device and precisely aligns this virtual information to the corresponding positions in the physical exhibition hall according to the user's position and orientation. The tour guide information includes: exhibit introduction labels, optimal tour route indication arrows, crowd density prompts for the current area, interactive hot spot marks, etc. The control system will adjust the display mode of this virtual information in real time to ensure its clarity and readability in the user's field of vision, while avoiding interference with the viewing of physical exhibits. In addition, the control system will automatically adjust the brightness and contrast of the virtual content according to the light conditions in the physical exhibition hall to provide the best mixed reality experience.

[0062] S207. During the physical exhibition hall visit, collect the user's physical visit behavior data to generate a user physical visit behavior portrait. The physical visit behavior data includes the user's walking trajectory, the user's staying position, and the user's interaction data. Among them, the physical visit behavior data refers to the set of activity data of the user in the physical exhibition hall, including the user's walking trajectory, the user's staying position, and the user's interaction data; the user's walking trajectory refers to the movement path and speed information of the user in the physical exhibition hall; the user's staying position refers to the spatial coordinates where the user stops to watch in front of a specific exhibit or area; the user's interaction data refers to the interaction behavior records between the user and the physical exhibit or the tour guide system; the physical visit behavior portrait refers to the user's interest constructed based on these physical visit behavior data.

[0063] Specifically, the control system collects the user's physical visit behavior data through a variety of sensing devices: continuously tracks the user's spatial position changes through the positioning system of the augmented reality device, and records their complete walking path; detects the user's standing behavior through the attitude sensor of the augmented reality device, including the location, duration, and frequency of stays; collects the interaction data between the user and physical exhibits or interactive facilities through cameras and touch sensors, such as viewing angles, gesture operations, information queries, etc. The control system performs spatio-temporal correlation analysis on these raw data to extract the user's behavior patterns, such as common visit routes, types of exhibits of key concern, preferred interaction methods, etc. Based on these analysis results, the control system constructs a user physical visit behavior portrait including dimensions such as user visit preferences, user interest tendencies, and user behavior habits for subsequent personalized service optimization.

[0064] S208. Generate a personalized physical tour path based on the user physical visit behavior portrait and the heat map of the exhibition hall crowding degree. The heat map of the exhibition hall crowding degree is determined according to the real-time crowd density and crowd movement trajectory. The personalized physical tour path is used to represent the optimal visit route of the user in the physical exhibition hall; Among them, the heat map of the exhibition hall crowding degree refers to a visual map that uses different shades of color to represent the crowd density of each area in the physical exhibition hall; the real-time crowd density refers to the instant number statistics per unit area of each area; the crowd movement trajectory refers to the distribution of the movement paths of the audience group in the physical exhibition hall; the personalized physical tour path refers to the optimal visit route customized according to the user's personal characteristics, which is an ideal path planned after comprehensively considering the visit experience and efficiency.

[0065] Specifically, the control system collects the crowd flow data in real time through the sensor network distributed throughout the physical exhibition hall, and converts these crowd flow data into an intuitive heat map of the exhibition hall crowding degree for display, where the red area indicates dense crowd and the green area indicates sparse crowd. At the same time, the control system analyzes the user physical visit behavior portrait and extracts characteristic parameters such as the user's walking speed preference, typical standing duration, fatigue degree, etc. The control system combines these user characteristics with the heat map of the exhibition hall crowding degree and uses an intelligent path planning algorithm to generate a personalized physical tour path. This personalized physical tour path will automatically avoid crowded areas and adjust the visit rhythm according to the user's characteristics, such as reserving more standing time for users who like to observe carefully and arranging more rest points for users with insufficient physical strength, ultimately ensuring that the personalized physical tour path can not only meet the user's visit preferences but also avoid the discomfort caused by crowding.

[0066] S209. Overlay and display the personalized physical tour path in the user's field of vision through the augmented reality device to guide the user to walk; Among them, the user's field of view refers to the actual scene range that can be seen through the augmented reality device; the personalized physical guided tour path refers to the virtual guiding lines and markers used to guide the user's walking direction.

[0067] Specifically, the control system transmits the generated personalized physical guided tour path to the augmented reality device worn by the user. The control system will superimpose and display clear navigation elements in the user's field of view, including arrow indications on the ground, path hint lines in the air, prominent markers at key turning points, etc. These virtual guided tour elements will update their positions and directions in real time as the user moves to ensure the accuracy of the guidance. In addition, the control system will also mark the estimated walking time and the position of the next recommended stop point on the personalized physical guided tour path to help the user better plan the visit rhythm.

[0068] S210. When the distance between the user and the target exhibit is lower than the preset distance threshold, superimpose and display the target explanation content of the target exhibit through the augmented reality device. The target exhibit is any physical exhibit in the physical exhibition hall, and the target explanation content includes the text description, video materials or interactive information of the target exhibit; Among them, the preset distance threshold refers to the distance judgment standard for triggering the display of the explanation content; the target exhibit refers to the physical exhibit that the user is currently approaching; the target explanation content refers to the collection of detailed information related to the target exhibit; the text description refers to the text content such as the basic information and historical background of the target exhibit; the video materials refer to the video materials related to the target exhibit; the interactive information refers to the function options that the user can operate and understand in depth.

[0069] Specifically, the control system accurately calculates the relative distance between the user and the surrounding exhibits through the spatial positioning system of the augmented reality device. When the user approaches a certain exhibit to the triggering distance (usually within 1 - 2 meters), the control system will automatically identify this exhibit as the target exhibit and retrieve the corresponding target explanation content from the database. The control system will display the target explanation content hierarchically according to the exhibit type and importance: first, display a brief text introduction, including basic information such as the exhibit name, era, author, etc.; then provide expandable detailed explanations, including historical background, artistic value, relevant allusions, etc.; at the same time, superimpose a video playback window at an appropriate position to display relevant historical images, creation processes or expert interpretation videos. In addition, the control system will also mark the interactive hot spots, and the user can obtain more in-depth information or conduct virtual operation experiences through these hot spots.

[0070] S211. Receive the interaction instruction issued by the user and adjust the display mode of the target explanation content according to the interaction instruction; Among them, the interaction instruction refers to the operation command issued by the user through the augmented reality device; the display mode refers to the presentation form and layout mode of the target commentary content; the adjustment refers to changing the display parameters of the target commentary content according to the user's needs.

[0071] Specifically, the control system supports multiple forms of interaction instruction input: the user can adjust the display position and size of the commentary content through gesture operations (such as swiping, clicking, zooming, etc.); the user can also switch different types of commentary content through voice commands; the user can also select the information module of interest through eye gaze to expand or collapse. The control system will respond to these interaction instructions in real time and accordingly adjust the display mode of the target commentary content. For example: adjusting the text size and transparency to improve readability; changing the playback position and size of the video window; switching between 2D and 3D display modes; adjusting the expansion state of the information hierarchy, etc.

[0072] S212. Determine the popularity of each physical exhibit in the physical exhibition hall according to the virtual visit behavior data and the physical visit behavior data; Among them, the popularity refers to the comprehensive evaluation index of the physical exhibit attracting the attention and interaction of the audience.

[0073] Specifically, the control system processes the virtual visit behavior data, including statistics of indicators such as the number of times each virtual exhibit is viewed, the access depth of the details page, the interaction duration, and the collection mark. At the same time, the control system analyzes the physical visit behavior data and calculates indicators such as the standing time of the audience in front of the physical exhibit, the number of repeated visits, the frequency of photo-taking records, and the information query volume. The control system performs weighted calculations on these two types of data according to the preset weights to generate the popularity degree of each physical exhibit. During the calculation process, the control system will consider the time factor and assign higher weights to the recent visit data to reflect the dynamic change trend of the popularity of the physical exhibit.

[0074] S213. Determine the physical exhibits with a popularity exceeding the preset popularity threshold as popular exhibits; Among them, the preset popularity threshold refers to the standard value for determining whether a physical exhibit is a popular exhibit; a popular exhibit refers to a physical exhibit that receives relatively high attention from the audience.

[0075] Specifically, the control system sets a reasonable preset popularity threshold according to historical data and exhibition goals. The preset popularity threshold may be dynamically adjusted according to factors such as the exhibition type, the number of visitors, and the duration of the exhibition period. The control system compares the popularity degree of each physical exhibit with the preset popularity threshold. When the popularity exceeds the preset popularity threshold, the physical exhibit will be marked as a popular exhibit.

[0076] S214. Adjust the exhibition layout of the physical exhibition hall based on popular exhibits.

[0077] Among them, the exhibition layout refers to the arrangement and display method of physical exhibits in the physical exhibition hall.

[0078] Specifically, first, the control system analyzes the spatial distribution characteristics of popular exhibits and evaluates potential problems existing in the current layout, such as the congestion risk in crowded areas and the uneven distribution of popular exhibits. Then, according to the characteristics of the exhibition hall space and the logic of the exhibition theme, the control system plans new display positions for popular exhibits, which may include: moving some popular exhibits to more open areas to relieve congestion; adjusting the distance between exhibits to provide a better viewing field of view; optimizing the layout of auxiliary facilities around the exhibits to enhance the visiting experience; adding temporary visiting channels or rest areas when necessary.

[0079] The control system in the embodiment of the present invention application will be described from the perspective of hardware processing. Please refer to Figure 3 , which is a schematic structural diagram of a physical device of the control system in the embodiment of the present application.

[0080] It should be noted that Figure 3 The structure of the control system shown is only an example and should not bring any limitations to the functions and usage scope of the embodiments of the present invention.

[0081] As Figure 3 shown, the control system includes a CPU 301, which can perform various appropriate actions and processes according to the program stored in the read-only memory ROM 302 or the program loaded from the storage part 308 into the random access memory RAM 303, such as executing the method described in the above embodiments. In the RAM 303, various programs and data required for system operation are also stored. The CPU 301, ROM 302, and RAM 303 are connected to each other through a bus 304. The I / O interface 305 is also connected to the bus 304.

[0082] The following components are connected to the I / O interface 305: an input section 306 including an audio input device, a button switch, etc.; an output section 307 including a liquid crystal display (LCD), an audio output device, an indicator light, etc.; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 310 as needed so that a computer program read from it can be installed into the storage section 308 as needed.

[0083] Specifically, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product that includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 309, and / or installed from the removable medium 311. When the computer program is executed by the CPU 301, various functions defined in the present invention are executed.

[0084] It should be noted that specific examples of computer-readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0085] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present invention. Among them, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the above-mentioned module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order from that marked in the accompanying drawings.

[0086] Specifically, the control system of this embodiment includes a processor and a memory. A computer program is stored on the memory. When the computer program is executed by the processor, the navigation method based on virtual reality and multi-dimensional scenes provided in the above-mentioned embodiment is implemented.

[0087] On the other hand, the present invention also provides a computer-readable storage medium, which may be included in the control system described in the above-mentioned embodiment; or it may exist alone without being assembled into the control system. The above storage medium carries one or more computer programs. When the above one or more computer programs are executed by a processor of the control system, the control system implements the navigation method based on virtual reality and multi-dimensional scenes provided in the above-mentioned embodiment.

[0088] As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the various embodiments of the present application.

[0089] As used in the above embodiments, depending on the context, the term "when..." may be interpreted to mean "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if detecting (the stated condition or event)" may be interpreted to mean "if determining...", "in response to determining...", "when detecting (the stated condition or event)", or "in response to detecting (the stated condition or event)".

[0090] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by relevant hardware instructed by a computer program. This program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The aforementioned storage medium includes various media that can store program codes, such as ROM or random access memory RAM, magnetic disks, or optical discs.

Claims

1. A navigation method based on virtual reality and multi-dimensional scenarios, characterized in that, Applied to a control system, the method includes: Obtain static feature data and dynamic feature data of the exhibition hall. The static feature data of the exhibition hall includes the layout of the exhibition hall, the positions of exhibits, and the types of exhibits. The dynamic feature data of the exhibition hall includes the real-time crowd density and the crowd movement trajectory; Based on the static feature data of the exhibition hall, construct a virtual exhibition hall, which includes a three-dimensional model of the physical exhibition hall; Evaluate the visiting comfort of the physical exhibition hall according to the dynamic feature data of the exhibition hall; When the visiting comfort is lower than a preset comfort threshold, present the virtual exhibition hall to the user through virtual reality equipment so that the user can visit the virtual exhibition hall; During the virtual exhibition hall visit, collect the user's virtual visit behavior data to generate a user virtual visit behavior portrait. The virtual visit behavior data includes head movement data, gesture interaction data, and line-of-sight focus data; According to the user virtual visit behavior portrait, screen recommended exhibits that match the user's virtual interests and display them through a multimodal interaction interface.

2. The method according to claim 1, wherein The constructing a virtual exhibition hall based on the static feature data of the exhibition hall, which includes a three-dimensional model of the physical exhibition hall, specifically includes: Obtain the three-dimensional data of the exhibition hall and the exhibit position data. The three-dimensional data of the exhibition hall includes the spatial structure and wall information, and the exhibit position data includes the spatial coordinates of the exhibits; Process the three-dimensional data of the exhibition hall to obtain basic framework data; Integrate the exhibit position data into the basic framework data to generate exhibition hall layout data, which is used to represent the overall structure of the exhibition hall and the distribution positions of the exhibits; Based on the exhibition hall layout data, construct a virtual exhibition hall model; Collect the lighting data of the physical exhibition hall and apply the lighting data to the virtual exhibition hall model to generate the virtual exhibition hall.

3. The method according to claim 1, wherein The evaluating the visiting comfort of the physical exhibition hall according to the dynamic feature data of the exhibition hall specifically includes: According to the real-time crowd density, calculate the crowding degree of each exhibit area in the physical exhibition hall. The crowding degree is determined according to the total number of people and the maximum capacity in the exhibit area; Based on the crowd movement trajectory, calculate the movement state of the crowd. The movement state is obtained by dividing the average movement speed of the crowd by a preset movement speed; Determine the visiting comfort of the physical exhibition hall according to the crowding degree of each exhibit area and the movement state.

4. The method according to claim 1, characterized in that, After the step of screening recommended exhibits that match the user's virtual interests according to the user virtual visit behavior portrait and displaying them through a multimodal interaction interface, the method further includes: When the user clicks a preset interaction trigger point, activate the detailed display and interaction information of the corresponding virtual exhibit; Record the virtual exhibit to generate a user interest-associated visiting route of the physical exhibition hall, which is used to connect the physical exhibits corresponding to the virtual exhibits.

5. The method according to claim 1, wherein After the step of evaluating the visiting comfort of the physical exhibition hall according to the dynamic feature data of the exhibition hall, the method further includes: When the visiting comfort level is higher than or equal to the preset comfort level threshold, display the guided tour information in the physical exhibition hall by superimposing it through the augmented reality device, so that the user can visit the physical exhibition hall; During the visit to the physical exhibition hall, collect the physical visit behavior data of the user to generate a user physical visit behavior portrait. The physical visit behavior data includes the user's walking trajectory, the user's staying position, and the user's interaction data; Generate a personalized physical guided tour path based on the user physical visit behavior portrait and the exhibition hall crowding heat map. The exhibition hall crowding heat map is determined according to the real-time crowd density and the crowd movement trajectory. The personalized physical guided tour path is used to represent the optimal visiting route of the user in the physical exhibition hall; Superimpose and display the personalized physical guided tour path in the user's field of vision through the augmented reality device to guide the user to walk.

6. The method according to claim 5, wherein After the step of superimposing and displaying the personalized physical guided tour path in the user's field of vision through the augmented reality device to guide the user to walk, the method further includes: When the distance between the user and the target exhibit is lower than the preset distance threshold, superimpose and display the target explanation content of the target exhibit through the augmented reality device. The target exhibit is any physical exhibit in the physical exhibition hall, and the target explanation content includes the text description, video material or interaction information of the target exhibit; Receive the interaction instruction issued by the user and adjust the display mode of the target explanation content according to the interaction instruction.

7. The method according to claim 1, wherein The method further includes: Determine the popularity of each physical exhibit in the physical exhibition hall according to the virtual visit behavior data and the physical visit behavior data; Determine the physical exhibits with the popularity exceeding the preset popularity threshold as popular exhibits; Adjust the exhibition layout of the physical exhibition hall based on the popular exhibits.

8. A control system, characterized in that, The control system includes: one or more processors and a memory; the memory is coupled to the one or more processors. The memory is used to store computer program code, and the computer program code includes computer instructions. The one or more processors call the computer instructions to enable the control system to execute the method according to any one of claims 1-7.

9. A computer-readable storage medium, comprising instructions, characterized in that, When the instruction runs on the control system, enable the control system to execute the method according to any one of claims 1-7.

10. A computer program product, characterized in that, When the computer program product runs on the control system, enable the control system to execute the method according to any one of claims 1-7.

Images