Virtual reality and multi-dimensional scene-based tour guide method, system, medium and product

By constructing virtual exhibition halls and assessing visitor comfort in real time, and combining virtual reality and augmented reality technologies, the problem of poor visitor experience during peak hours has been solved, providing personalized intelligent tour guide services and improving the visitor experience at exhibition venues.

CN120353337BActive Publication Date: 2025-11-25JIN CHENYU (TIANJIN) TECHNOLOGY CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510432787.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-04-08
Publication Date
2025-11-25
Estimated Expiration
2045-04-08

AI Technical Summary

Technical Problem

Existing exhibition venues offer a poor visitor experience during peak hours. The traditional reservation and time-slot-based visit model is ineffective in dealing with sudden surges in visitors, resulting in overcrowding and reduced comfort for visitors when viewing exhibits.

Method used

By acquiring static and dynamic feature data of the exhibition hall, a virtual exhibition hall is constructed, the comfort of visitors is assessed in real time, and visitors can switch to the virtual exhibition hall when there are many people. Based on user behavior data, personalized exhibits are recommended, and intelligent tour guide services are provided by combining virtual reality and augmented reality technologies.

Benefits of technology

Providing a good visiting experience during peak hours, enabling personalized visits that match user interests, improving visit comfort and efficiency, and avoiding the subjectivity and lag of traditional methods.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120353337B_ABST
    Figure CN120353337B_ABST
Patent Text Reader

Abstract

The method, system, medium and product for guiding tour based on virtual reality and multi-dimensional scene relate to the technical field of virtual reality. By adopting the technical scheme, the control system monitors the static characteristic data and dynamic characteristic data of the exhibition hall of the exhibition place in real time. When the crowd density leads to low comfort level of visiting, the control system automatically switches the user to the virtual exhibition hall visiting mode, effectively solving the problem of poor visiting experience of the entity exhibition hall during the peak of people flow. The control system can generate a virtual visiting behavior portrait of the user according to the virtual visiting behavior data of the user in the virtual exhibition hall, and determine the recommended exhibits matching the interest of the user according to the virtual visiting behavior portrait, thereby providing a more intelligent and personalized visiting experience. The exhibition hall display method combining virtual and reality can not only ensure the visiting order of the exhibition place, but also enable the user to still obtain a good visiting experience during the peak of people flow compared with the reservation time-sharing visiting mode.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of virtual reality, and in particular to a virtual reality and multi-dimensional scene-based tour guide method and system, medium and product. BACKGROUND

[0002] With the rapid development of digital technology, exhibition places such as museums and art galleries are constantly innovating in their display methods, providing visitors with a richer cultural experience. In particular, during major exhibitions and holidays, exhibition halls often have large crowds and limited viewing experiences. How to ensure that visitors have a good viewing experience has become an important issue that needs to be addressed in the exhibition industry.

[0003] Currently, exhibition places usually adopt a pre-arranged time period viewing management method, which controls the flow density in the exhibition hall by limiting the number of visitors in each time period. In specific implementation, staff will count the number of people at the entrance of the exhibition hall, and when the number reaches the upper limit, subsequent visitors will be required to wait outside the exhibition hall. At the same time, fixed viewing routes and signs will be set up inside the exhibition hall to guide visitors to view in an orderly manner.

[0004] This management method has some limitations in actual operation. For example, while pre-arranged time period viewing can control the flow to some extent, it is difficult to effectively respond to sudden flow peaks, resulting in crowded conditions and reduced comfort for visitors when viewing exhibits. SUMMARY

[0005] The present application provides a virtual reality and multi-dimensional scene-based tour guide method, system, medium and product for improving the viewing comfort of users when the flow in the exhibition hall is dense.

[0006] In a first aspect, the present application provides a virtual reality and multi-dimensional scene-based tour guide method applied to a control system, the method comprising: obtaining exhibition hall static feature data and exhibition hall dynamic feature data, the exhibition hall static feature data including exhibition hall layout, exhibit location and exhibit type, and the exhibition hall dynamic feature data including real-time flow density and flow movement trajectory; based on the exhibition hall static feature data, constructing a virtual exhibition hall, the virtual exhibition hall including a three-dimensional model of the physical exhibition hall; according to the exhibition hall dynamic feature data, evaluating the viewing comfort of the physical exhibition hall; when the viewing comfort is lower than a preset comfort threshold, presenting the virtual exhibition hall to the user through a virtual reality device, so that the user views the virtual exhibition hall; during the virtual exhibition hall viewing process, collecting virtual viewing behavior data of the user to generate a user virtual viewing behavior portrait, the virtual viewing behavior data including head movement data, gesture interaction data and visual focus data; according to the user virtual viewing behavior portrait, filtering recommended exhibits that match the user's virtual interests, and displaying them through a multi-modal interaction interface.

[0007] By adopting the technical scheme, the control system monitors the static feature data and the dynamic feature data of the exhibition hall in real time, and automatically switches the user to the virtual exhibition hall visiting mode when the crowd density leads to low visiting comfort, effectively solving the problem of poor visiting experience of the entity exhibition hall during the peak of people flow. The control system can generate a user virtual visiting behavior portrait according to the virtual visiting behavior data of the user in the virtual exhibition hall, and determine recommended exhibits matching the user's interest accordingly, providing a more intelligent and personalized visiting experience. This virtual and real combination exhibition hall display method not only ensures the visiting order of the exhibition place, but also enables users to still obtain a good visiting experience during the peak of people flow.

[0008] In some embodiments in combination with some embodiments of the first aspect, based on the static feature data of the exhibition hall, a virtual exhibition hall is constructed, and the virtual exhibition hall includes a three-dimensional model of the entity exhibition hall, specifically including: obtaining exhibition hall three-dimensional data and exhibit position data, the exhibition hall three-dimensional data including spatial structure and wall information, and the exhibit position data including spatial coordinates of the exhibits; processing the exhibition hall three-dimensional data to obtain basic framework data; integrating the exhibit position data into the basic framework data to generate exhibition hall layout data, the exhibition hall layout data being used to represent the overall structure of the exhibition hall and the distribution position of the exhibits; constructing a virtual exhibition hall model based on the exhibition hall layout data; collecting lighting data of the entity exhibition hall, and applying the lighting data to the virtual exhibition hall model to generate the virtual exhibition hall.

[0009] By adopting the technical scheme, the control system obtains the exhibition hall three-dimensional data and the exhibit position data, determines the basic framework data in combination with elements such as spatial structure and wall information, integrates the spatial coordinates of the exhibits to generate complete exhibition hall layout data, and finally collects and applies the lighting data of the entity exhibition hall to obtain a virtual exhibition hall highly restored from the entity exhibition hall. This systematic virtual exhibition hall construction method ensures that the virtual exhibition hall is highly consistent with the entity exhibition hall in terms of visual effect and spatial layout, enabling users to obtain an immersive experience close to on-site visiting when virtually visiting, and improving the sense of reality and the sense of immersion of virtual exhibition hall visiting.

[0010] In some embodiments in combination with some embodiments of the first aspect, the visiting comfort of the entity exhibition hall is evaluated according to the dynamic feature data of the exhibition hall, specifically including: calculating the crowding degree of each exhibit area in the entity exhibition hall according to the real-time people flow density, the crowding degree being determined according to the total number of people and the maximum number of people that can be accommodated in the exhibit area; calculating the moving state of the people flow based on the people flow moving trajectory, the moving state being obtained by dividing the average moving speed of the people flow by the preset moving speed; determining the visiting comfort of the entity exhibition hall according to the crowding degree and the moving state of each exhibit area.

[0011] By adopting the technical scheme, the control system calculates the crowdedness of each exhibition area in the entity exhibition area and the moving state of the people flow, so that the visiting comfort of the current user in the entity exhibition hall can be scientifically evaluated. The dynamic evaluation mechanism based on the multi-dimensional indexes enables the control system to accurately grasp the crowdedness and visiting experience level of the entity exhibition hall, provides an objective basis for whether to start the virtual exhibition hall visiting mode, and effectively avoids the subjectivity and hysteresis of the traditional manual statistics and experience judgment mode.

[0012] In combination with some embodiments of the first aspect, in some embodiments, after the step of filtering the recommended exhibits matched with the virtual interest of the user according to the user virtual visiting behavior portrait and displaying the recommended exhibits through the multi-modal interactive interface, the method further comprises: activating the detail display and interactive information of the corresponding virtual exhibit when the user clicks the preset interactive trigger point; and recording the virtual exhibit to generate a user interest associated visiting route of the entity exhibition hall, the user interest associated visiting route being used to connect the entity exhibits corresponding to the virtual exhibits.

[0013] By adopting the technical scheme, the control system sets the preset interactive trigger point and records the interactive behavior of the user in the virtual exhibition hall to generate a user interest associated visiting route of the entity exhibition hall, thereby realizing the intelligent connection between the virtual and entity exhibition halls. The route planning mechanism based on the user interest enables the user to view the entity exhibits of interest in subsequent entity exhibition hall visiting, thereby greatly improving the visiting efficiency. Meanwhile, the virtual-real combined visiting mode provides a more complete exhibition experience for the user, so that the virtual visiting is no longer a simple alternative solution, but a beneficial supplement to the entity visiting.

[0014] In combination with some embodiments of the first aspect, in some embodiments, after the step of evaluating the visiting comfort of the entity exhibition hall according to the exhibition hall dynamic characteristic data, the method further comprises: when the visiting comfort is higher than or equal to a preset comfort threshold, superimposing and displaying guide information in the entity exhibition hall through an augmented reality device to enable the user to visit the entity exhibition hall; collecting entity visiting behavior data of the user in the entity exhibition hall visiting process to generate a user entity visiting behavior portrait, the entity visiting behavior data including a user walking track, a user staying position and user interactive data; generating a personalized entity guide path based on the user entity visiting behavior portrait and an exhibition hall crowdedness heat map, the exhibition hall crowdedness heat map being determined according to real-time people flow density and people flow moving track, and the personalized entity guide path being used to represent an optimal visiting route of the user in the entity exhibition hall; and superimposing and displaying the personalized entity guide path in the field of view of the user through the augmented reality device to guide the user to walk.

[0015] By adopting the technical scheme, when the entity exhibition hall visiting comfort degree is high, the control system provides real-time guide service by using augmented reality technology, the control system generates a user entity visiting behavior portrait according to user entity visiting behavior data, and combines a real-time exhibition hall congestion degree heat map to plan an optimal visiting route for the user. The intelligent guide system not only considers the personal interests of the user, but also takes the people flow distribution factor into account in the route planning, can effectively avoid crowded areas, and provides a smoother visiting experience for the user.

[0016] In combination with some embodiments of the first aspect, in some embodiments, after the step of superimposedly displaying the personalized entity guide path in the user's field of view by the augmented reality device to guide the user to walk, the method further comprises: when the distance between the user and the target exhibit is lower than a preset distance threshold, superimposedly displaying, by the augmented reality device, target interpretation content of the target exhibit, the target exhibit being any one of the entity exhibits in the entity exhibition hall, and the target interpretation content including a text description, video material or interactive information of the target exhibit; receiving an interactive instruction issued by the user, and adjusting a display mode of the target interpretation content according to the interactive instruction.

[0017] By adopting the technical scheme, the control system realizes intelligent triggering and interactive display of the exhibit interpretation content based on the distance between the user and the entity exhibit, so that the user can obtain the exhibit information without manually searching. Meanwhile, the control system supports the user to adjust the display mode of the exhibit interpretation content through the interactive instruction, and provides a more flexible information obtaining experience. The automatic interpretation mechanism based on distance triggering not only avoids the inconvenience of information obtaining in the traditional interpretation mode, but also ensures the personalization of information display through interactive adjustment, greatly improving the educational value of the exhibition and the user experience.

[0018] In combination with some embodiments of the first aspect, in some embodiments, the method further comprises: determining the popularity of each entity exhibit in the entity exhibition hall according to the virtual visiting behavior data and the entity visiting behavior data; determining an entity exhibit with a popularity exceeding a preset popularity threshold as a popular exhibit; and adjusting the exhibition layout of the entity exhibition hall based on the popular exhibit.

[0019] By adopting the technical scheme, the control system analyzes the visiting behavior data of the user in the virtual exhibition hall and the entity exhibition hall to establish an evaluation mechanism of the popularity of the exhibits, and optimizes the exhibition layout accordingly. The data-driven exhibition layout optimization scheme breaks through the limitation that the traditional exhibition layout mainly relies on experience, and can more scientifically respond to the interests of the audience and improve the overall viewing effect of the exhibition.

[0020] In a second aspect, the embodiments of the present application provide a control system, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is configured to store computer program codes, the computer program codes comprising computer instructions, and the one or more processors are configured to invoke the computer instructions to cause the control system to perform the method described in the first aspect and any possible implementation manner of the first aspect.

[0021] In a third aspect, the embodiments of the present application provide a computer program product comprising instructions which, when executed on a control system, cause the control system to perform the method described in the first aspect and any possible implementation manner of the first aspect.

[0022] In a fourth aspect, the embodiments of the present application provide a computer-readable storage medium comprising instructions which, when executed on a control system, cause the control system to perform the method described in the first aspect and any possible implementation manner of the first aspect.

[0023] It can be understood that the control system provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the method provided in the embodiments of the present application. Therefore, the beneficial effects that can be achieved are referred to the beneficial effects in the corresponding method, which will not be described here.

[0024] The one or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0025] 1. By adopting the above technical solution, the control system monitors the static feature data and the dynamic feature data of the exhibition hall of the exhibition place in real time, and automatically switches the user to the virtual exhibition hall visiting mode when the crowd density leads to low visiting comfort, effectively solving the problem of poor visiting experience of the physical exhibition hall during the peak period. The control system can generate a user virtual visiting behavior portrait according to the virtual visiting behavior data of the user in the virtual exhibition hall, and determine the recommended exhibits that match the user's interest according to the virtual visiting behavior portrait, thereby providing a more intelligent and personalized visiting experience. This virtual and real exhibition hall display method not only ensures the visiting order of the exhibition place, but also enables users to still obtain a good visiting experience during the peak period.

[0026] 2. By adopting the above technical solution, the control system calculates the crowdedness of each exhibition area in the entity exhibition area and the moving state of the crowd, so as to scientifically evaluate the visiting comfort of the current user in the entity exhibition hall. The dynamic evaluation mechanism based on multiple dimensions enables the control system to accurately grasp the crowdedness and visiting experience level of the entity exhibition hall, provides an objective basis for whether to start the virtual exhibition hall visiting mode, and effectively avoids the subjectivity and hysteresis of the traditional manual statistics and experience judgment mode.

[0027] 3. By adopting the above technical solution, the control system sets a preset interaction trigger point and records the interaction behavior of the user in the virtual exhibition hall, so as to generate a user interest related visiting route of the entity exhibition hall, and realizes the intelligent connection between the virtual and entity exhibition halls. The route planning mechanism based on user interest enables the user to view the entity exhibits of interest in subsequent entity exhibition hall visiting, greatly improving the visiting efficiency. At the same time, the virtual-real combined visiting mode also provides a more complete exhibition experience for the user, so that the virtual visiting is no longer a simple alternative scheme, but a beneficial supplement to the entity visiting. BRIEF DESCRIPTION OF DRAWINGS

[0028] Figure 1 is a flowchart of a guide method based on virtual reality and multi-dimensional scenes in an embodiment of the present application;

[0029] Figure 2 is another flowchart of a guide method based on virtual reality and multi-dimensional scenes in an embodiment of the present application;

[0030] Figure 3 is a schematic diagram of an entity device structure of a control system in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be limiting on the present application. As used in the specification of the present application, the singular expression "one", "a", "the", "said" and "this" are intended to include the plural expression, unless there is clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application means any or all possible combinations of one or more listed items.

[0032] Hereinafter, the terms "first", "second" are only for the purpose of description, and cannot be understood as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise specified.

[0033] The method provided by the embodiment is described in the following flowchart in combination with the above scenario. Please refer to Figure 1 FIG. 1 is a flowchart of a method for guided tour based on virtual reality and multi-dimensional scene according to an embodiment of the present application.

[0034] S101, obtain static feature data of the exhibition hall and dynamic feature data of the exhibition hall, the static feature data of the exhibition hall including layout of the exhibition hall, positions of exhibits and types of the exhibits, the dynamic feature data of the exhibition hall including real-time crowd density and crowd moving track;

[0035] The static feature data of the exhibition hall refers to fixed attribute information that does not change with time, including layout of the exhibition hall, positions of exhibits and types of the exhibits. The layout of the exhibition hall refers to the overall spatial structure of the exhibition hall, including wall arrangement, passage design, functional partition and the like. The position of an exhibit refers to the specific spatial coordinates and the placing direction of each exhibit in the exhibition hall. The type of an exhibit refers to the classification attribute of the exhibit, such as cultural relics, artwork, scientific and technological exhibits and the like. The dynamic feature data of the exhibition hall refers to data that changes with time in real time, including real-time crowd density and crowd moving track. The real-time crowd density refers to the number of visitors in a unit area. The crowd moving track refers to the movement path and direction of visitors in the exhibition hall.

[0036] Specifically, the control system obtains the three-dimensional structure data of the exhibition hall through a space scanning device, and reads detailed information of the exhibits from an exhibition hall management database, including specific position coordinates, type labels and placing angles of each exhibit and the like. At the same time, the control system collects crowd data in real time through a sensor network distributed at various places in the exhibition hall, including crowd density data obtained by an infrared sensor, and moving track information of visitors obtained by a video analysis system. After preprocessing and integration, these data form complete static feature data of the exhibition hall and dynamic feature data of the exhibition hall.

[0037] S102, construct a virtual exhibition hall based on the static feature data of the exhibition hall, the virtual exhibition hall including a three-dimensional model of the entity exhibition hall;

[0038] The virtual exhibition hall refers to a digital exhibition space constructed by computer technology, used for simulating the visiting experience of the entity exhibition hall. The three-dimensional model refers to a three-dimensional digital representation of the exhibition hall space created by computer graphics technology. The entity exhibition hall refers to an exhibition place actually existing in reality.

[0039] Specifically, first, the control system imports the obtained exhibition hall three-dimensional data into a three-dimensional modeling engine, reconstructs the basic framework data of the exhibition hall through computer graphics algorithms, including accurately restoring the architectural structures such as walls, floors, and ceilings. Then, the control system places corresponding three-dimensional models of exhibits in the virtual space according to the exhibit position data, ensuring that their positions and directions are consistent with the physical exhibition hall. At the same time, the control system also processes the materials and lighting of the virtual space, simulates the real visual effect through rendering technology, and finally generates a virtual exhibition hall that highly restores the physical exhibition hall.

[0040] Optionally, generally, based on the static feature data of the exhibition hall, the virtual exhibition hall including the three-dimensional model of the physical exhibition hall can be realized in the following way, which is not limited herein: obtaining exhibition hall three-dimensional data and exhibit position data, the exhibition hall three-dimensional data including space structure and wall information, and the exhibit position data including the spatial coordinates of the exhibits; processing the exhibition hall three-dimensional data to obtain basic framework data; integrating the exhibit position data into the basic framework data to generate exhibition hall layout data, which is used to represent the overall structure of the exhibition hall and the distribution position of the exhibits; based on the exhibition hall layout data, constructing a virtual exhibition hall model; collecting lighting data of the physical exhibition hall and applying the lighting data to the virtual exhibition hall model to generate a virtual exhibition hall.

[0041] Taking the "Space Science and Technology Exhibition Hall" of a certain science and technology museum as an example:

[0042] First step of data collection: the control system uses a 3D laser scanner to measure the spatial dimensions of the physical exhibition hall as 30 meters long, 20 meters wide, and 8 meters high. The layout structure of the 6 exhibition areas in the physical exhibition hall is recorded through surveying and mapping, including the specific position and area data of exhibition areas such as "Rocket Propulsion Technology Area", "Spacecraft Structure Area", "Space Station Life Area", etc. The control system stores these data into the exhibition hall feature data set.

[0043] Second step of modeling and construction: the control system generates a 600 square meter ground grid and a 416 square meter wall grid based on the exhibition hall feature data set through modeling software. The control system divides the 6 virtual exhibition areas on the ground grid according to the layout data of the physical exhibition hall, such as setting the "Rocket Propulsion Technology Area" in the center of the virtual exhibition hall with an area of 100 square meters; and marking the lighting parameter positions of 40 LED spotlights on the wall grid.

[0044] Third step of rendering processing: the control system applies a dark gray non-slip material map to the ground grid and a matte white material map to the wall grid. The control system places a three-dimensional virtual exhibit of the Long March 5 carrier rocket model in the "Rocket Propulsion Technology Area" and sets the lighting parameters of the 40 LED spotlights to form a lighting effect with moderate brightness and prominent highlights.

[0045] The fourth step is interactive design: A 2-meter radius observation area is set around the 3D virtual exhibit. When a visitor's view enters this area, an exhibit information panel automatically pops up, displaying detailed information such as the rocket's technical parameters and launch history. Visitors are also allowed to move freely within the exhibition hall via virtual roaming, with the observation angle adjustable 360 ​​degrees horizontally and 45 degrees vertically.

[0046] S103. Evaluate the visitor comfort of the physical exhibition hall based on the dynamic characteristic data of the exhibition hall;

[0047] Among them, visitor comfort refers to the level of visitor experience in the current state of the physical exhibition hall; evaluation refers to the quantitative calculation of visitor comfort through a specific algorithm; visitor comfort in the physical exhibition hall is used to represent visitor experience indicators in the physical exhibition hall, including elements such as crowding level and freedom of movement.

[0048] Specifically, first, the control system calculates the crowding level of each exhibit area in the physical exhibition hall. This crowding level is obtained by dividing the total number of people in each exhibit area by its maximum capacity. Simultaneously, the control system analyzes the movement trajectories of the crowds, calculates their average movement speed, and compares it to a preset speed to determine the movement status of the crowds. The control system then weights the crowding level and movement status according to preset weights to arrive at a comprehensive visitor comfort score. This visitor comfort score is used to determine whether to activate the virtual exhibition hall visit mode.

[0049] Optionally, under normal circumstances, the visitor comfort of a physical exhibition hall can be assessed based on the dynamic characteristics data of the exhibition hall in the following ways, without limitation: Calculate the crowding level of each exhibit area in the physical exhibition hall based on the real-time crowd density. The crowding level is determined based on the total number of people in the exhibit area and the maximum capacity. Calculate the movement state of the crowd based on the movement trajectory of the crowd. The movement state is obtained by dividing the average movement speed of the crowd by the preset movement speed. Determine the visitor comfort of the physical exhibition hall based on the crowding level and movement state of each exhibit area.

[0050] Take, for example, the "Impressionist Art Gallery" of a certain art museum:

[0051] The exhibition hall covers a total area of ​​400 square meters and has four main exhibition areas: "Monet Zone," "Van Gogh Zone," "Renoir Zone," and "Cézanne Zone." The control system assesses visitor comfort through the following methods:

[0052] (1) Example of congestion calculation:

[0053] The "Monet Zone" covers an area of ​​100 square meters and has a maximum capacity of 50 people. Currently, there are 35 people in the zone, which is 70% crowded (35 / 50).

[0054] The "Van Gogh Zone" has an area of 80 square meters and can accommodate a maximum of 40 people. Currently, there are 38 people in the zone, resulting in a crowd density of 95% (38 / 40);

[0055] The "Renoir Zone" has an area of 120 square meters and can accommodate a maximum of 60 people. Currently, there are 30 people in the zone, resulting in a crowd density of 50% (30 / 60);

[0056] The "Cézanne Zone" has an area of 100 square meters and can accommodate a maximum of 50 people. Currently, there are 20 people in the zone, resulting in a crowd density of 40% (20 / 50);

[0057] (2) Mobile state calculation example (preset moving speed is 1 meter / second):

[0058] The average moving speed of the crowd in the "Monet Zone" is 0.6 meters / second, and the mobile state is 0.6 (0.6 / 1);

[0059] The average moving speed of the crowd in the "Van Gogh Zone" is 0.3 meters / second, and the mobile state is 0.3 (0.3 / 1);

[0060] The average moving speed of the crowd in the "Renoir Zone" is 0.8 meters / second, and the mobile state is 0.8 (0.8 / 1);

[0061] The average moving speed of the crowd in the "Cézanne Zone" is 0.9 meters / second, and the mobile state is 0.9 (0.9 / 1);

[0062] (3) Visit comfort assessment:

[0063] "Monet Zone": Moderate comfort (moderate crowd density, slightly slow moving speed);

[0064] "Van Gogh Zone": Low comfort (high crowd density, slow moving speed);

[0065] "Renoir Zone": High comfort (low crowd density, fast moving speed);

[0066] "Cézanne Zone": Best comfort (low crowd density, moving speed close to normal).

[0067] S104, when the visit comfort is lower than the preset comfort threshold, the virtual exhibition hall is presented to the user through the virtual reality device, so that the user visits the virtual exhibition hall;

[0068] The preset comfort threshold refers to a pre-set visit comfort judgment standard for triggering the virtual exhibition hall visit mode; the virtual reality device refers to a hardware device capable of providing immersive virtual experience for users, such as a head-mounted display (HMD), a handle controller, etc.; the presentation refers to the transmission of visual content of the virtual exhibition hall to the user through the virtual reality device; the virtual exhibition hall visit refers to the exhibition viewing activities of the user in the virtual exhibition hall, which can realize interaction and observation of virtual exhibits.

[0069] Specifically, the control system loads the constructed virtual exhibition hall and performs real-time rendering through a graphics rendering engine. The control system transmits the rendered virtual exhibition hall to the virtual reality device worn by the user, and simultaneously starts the tracking function of the handle controller, so that the user can freely move and interact in the virtual exhibition hall. The control system also adjusts the view angle and scene display in real time according to the position and orientation of the user, to ensure a smooth virtual visit experience for the user. In this process, the control system continuously monitors the running state of the virtual reality device to ensure the stability of the display effect and interactive response.

[0070] S105, in the virtual exhibition hall visit process, collecting virtual visit behavior data of the user to generate a user virtual visit behavior portrait, the virtual visit behavior data including head movement data, gesture interaction data and visual focus data;

[0071] The virtual visit behavior data refers to various activity data of the user in the virtual exhibition hall; the head movement data refers to the attitude change information of the user's head, such as turning and tilting; the gesture interaction data refers to the pointing, selecting, grabbing and other operations of the user through the handle controller; the visual focus data refers to the gaze point position and dwell time of the user in the virtual exhibition hall; the user virtual visit behavior portrait refers to the user interest summarized according to these virtual visit behavior data.

[0072] Specifically, the control system collects the virtual visit behavior data of the user in real time through various sensors of the virtual reality device: the rotation angle and speed of the user's head are recorded through the gyroscope sensor in the head-mounted display; the hand movements and interactive operations of the user are tracked through the handle controller; the visual direction and gaze duration of the user are obtained through the eye tracking module. The control system processes and analyzes these raw data to extract the behavior characteristics of the user, such as the attention degree to specific types of exhibits, typical observation angles, commonly used interaction methods, etc. Finally, the control system constructs a user virtual visit behavior portrait reflecting the visit preferences of the user.

[0073] S106, according to the user virtual visit behavior portrait, filtering the recommended exhibits matched with the user virtual interest, and displaying through a multi-modal interactive interface.

[0074] The user virtual interest refers to a user interest preference feature extracted from a user virtual visiting behavior portrait; the recommended exhibits refer to a set of exhibits that the control system screens out according to the user virtual interest and that the user is likely to be interested in; and the multi-modal interactive interface refers to a user interface integrating multiple interactive modes such as vision, hearing and touch.

[0075] Specifically, first, the control system performs feature analysis on the user virtual visiting behavior portrait and extracts the user virtual interest, such as preferred exhibit types, focused theme directions and habitual observation modes. Then, the control system performs similarity calculation on the user virtual interest and the features of each exhibit in the exhibit library and selects a number of exhibits with the highest similarity as the recommended exhibits. The control system displays these recommended exhibits to the user through the multi-modal interactive interface in the virtual reality environment, including displaying a guide indication in the user's field of view, playing an exhibit introduction through stereo sound and providing an interactive option with tactile feedback.

[0076] By adopting the above technical solution, the control system monitors the static feature data and dynamic feature data of the exhibition hall in real time, automatically switches the user to the virtual exhibition hall visiting mode when the crowd density leads to low visiting comfort, and effectively solves the problem of poor visiting experience in the entity exhibition hall during the peak period. The control system can generate a user virtual visiting behavior portrait according to the virtual visiting behavior data of the user in the virtual exhibition hall and determine the recommended exhibits matching the user interest accordingly, thereby providing a more intelligent and personalized visiting experience. This virtual and real combination of the exhibition hall display method not only ensures the visiting order of the exhibition place, but also enables the user to still obtain a good visiting experience during the peak period.

[0077] The method provided by the embodiment will be described further in a more specific flow. Figure 2 Another flowchart of the method for guiding and visiting based on virtual reality and multi-dimensional scenes in the embodiment of the present application is shown in FIG. 2.

[0078] The following steps can also be performed after step S103, or can not be performed, which is not limited here:

[0079] S201, when the visiting comfort is lower than the preset comfort threshold, presenting a virtual exhibition hall to the user through a virtual reality device, so that the user visits the virtual exhibition hall;

[0080] Specifically, refer to step S104, which is not described here again.

[0081] S202, in the virtual exhibition hall visiting process, collecting virtual visiting behavior data of the user to generate a user virtual visiting behavior portrait, the virtual visiting behavior data including head movement data, gesture interaction data and visual focus data;

[0082] Specifically, please refer to step S105, which will not be repeated here.

[0083] S203, according to the user virtual visit behavior portrait, filtering and displaying the recommended exhibits matched with the user virtual interest through the multi-modal interactive interface;

[0084] Specifically, please refer to step S106, which will not be repeated here.

[0085] S204, when the user clicks on the preset interactive trigger point, activating the detail display and interactive information of the corresponding virtual exhibit;

[0086] Among them, the preset interactive trigger point refers to the interactive point set in advance in the virtual exhibition hall, including information markers around the virtual exhibit, virtual buttons, etc.; click refers to the selection or triggering operation of the user through the handle controller; detail display refers to the presentation of the depth information of the virtual exhibit, including text description, multimedia materials, etc.; interactive information refers to the function options that the user can operate and interact, such as 3D model operation of the virtual exhibit, related data query, etc.; virtual exhibit refers to the digital exhibit model in the virtual exhibition hall.

[0087] Specifically, the control system arranges visible preset interactive trigger points around the virtual exhibit, which will maintain appropriate visibility with the change of the user's perspective. When the user selects a preset interactive trigger point through the handle controller ray or direct touch, the control system will immediately expand the detail panel related to the virtual exhibit. This detail panel adopts a spatialized layout, which may contain multiple levels of information: the first layer displays the basic introduction of the virtual exhibit, the second layer provides historical background and creation story, and the third layer may contain professional analysis and related research materials. At the same time, the control system will activate specific interactive functions according to the type of the virtual exhibit, such as 360-degree rotation observation for cultural relics, local detail magnification for paintings, virtual operation demonstration for installation art, etc.

[0088] S205, recording the virtual exhibit to generate a user interest associated visit route of the entity exhibition hall, the user interest associated visit route being used to connect the virtual exhibit corresponding entity exhibit;

[0089] Among them, recording the virtual exhibit refers to tracking and saving the virtual exhibits viewed or interacted by the user in the virtual exhibition hall; the user interest associated visit route refers to the entity exhibition hall visit suggestion path generated based on the interest shown by the user in the virtual exhibition hall; the entity exhibit refers to the real exhibit corresponding to the virtual exhibit.

[0090] Specifically, the control system stores the virtual exhibits that the user has interacted with in the virtual exhibition hall into a temporary database. For these virtual exhibits, the control system locates the positions of their corresponding physical exhibits on the floor plan of the physical exhibition hall and calculates an optimal visiting route using a path planning algorithm as the user interest-related visiting route. This user interest-related visiting route takes into account the physical distance between physical exhibits, the layout of the exhibition hall, the rationality of the visiting flow, and other factors to ensure that the route not only covers the physical exhibits of interest to the user but also ensures the smoothness of the visiting experience. In this way, the user can not only filter out the virtual exhibits of interest through the virtual exhibition hall when there are many people, but also can appreciate the physical exhibits corresponding to the virtual exhibits of interest in the physical exhibition hall when there are few people.

[0091] S206, when the visiting comfort level is higher than or equal to the preset comfort threshold, superimposing and displaying the guide information in the physical exhibition hall through the augmented reality device, so that the user visits the physical exhibition hall;

[0092] Wherein, the preset comfort threshold refers to the pre-set visiting comfort level judgment standard; the augmented reality device refers to a hardware device capable of superimposing virtual information in a real scene, such as AR glasses, smart phones, etc.; the guide information refers to various virtual prompt contents for assisting visiting, including exhibit description, direction indication, interactive prompt, etc.; superimposed display refers to spatial alignment and fusion display of virtual information and physical scene; physical exhibition hall visiting refers to the exhibition viewing activities carried out by the user in the real physical space.

[0093] Specifically, first, the control system activates the augmented reality device worn by the user and starts its spatial positioning and scene recognition functions. The control system loads the pre-prepared guide information into the augmented reality device, and according to the user's position and orientation, accurately aligns these virtual information to the corresponding position of the physical exhibition hall. The guide information includes: exhibit introduction label, optimal visiting route indication arrow, current area people flow density prompt, interactive hot spot mark, etc. The control system will adjust the display mode of these virtual information in real time to ensure its clarity and readability in the user's field of view, while avoiding interference with the appreciation of physical exhibits. In addition, the control system will also automatically adjust the brightness and contrast of virtual content according to the light conditions of the physical exhibition hall to provide the best mixed reality experience.

[0094] S207, in the process of visiting the physical exhibition hall, collecting the user's physical visiting behavior data to generate a user physical visiting behavior portrait, the physical visiting behavior data including the user's walking trajectory, the user's stopping position and the user's interaction data;

[0095] The entity visit behavior data refers to a set of activity data of a user in an entity exhibition hall, including user walking trajectory, user stay position, and user interaction data; the user walking trajectory refers to movement path and speed information of the user in the entity exhibition hall; the user stay position refers to spatial coordinates at which the user stops and watches in front of a specific exhibit or area; the user interaction data refers to interaction behavior records between the user and the entity exhibit or a guide system; and the entity visit behavior portrait refers to user interest constructed based on the entity visit behavior data.

[0096] Specifically, the control system collects entity visit behavior data of the user through various sensing devices: the spatial position change of the user is continuously tracked through a positioning system of an augmented reality device to record a complete walking path; a posture sensor of the augmented reality device detects the stop behavior of the user, including a stay position, a time length, and a frequency; and a camera and a touch sensor collect interaction data of the user with the entity exhibit or interactive facilities, such as a viewing angle, a gesture operation, and information query. The control system performs spatio-temporal correlation analysis on the raw data to extract behavior patterns of the user, such as commonly used visit routes, types of exhibits focused on, and preferred interaction modes. Based on the analysis results, the control system constructs a user entity visit behavior portrait including dimensions of visit preferences of the user, interest tendencies of the user, and behavior habits of the user, for subsequent optimization of personalized services.

[0097] S208, generating a personalized entity guide path based on the user entity visit behavior portrait and an exhibition hall congestion heat map, the exhibition hall congestion heat map being determined according to real-time crowd density and crowd movement trajectory, and the personalized entity guide path being used to represent an optimal visit route of the user in the entity exhibition hall;

[0098] The exhibition hall congestion heat map refers to a visual map representing the crowd density of each area of the entity exhibition hall with different color depths; the real-time crowd density refers to an instantaneous number of people in a unit area of each area; the crowd movement trajectory refers to a motion path distribution of an audience group in the entity exhibition hall; and the personalized entity guide path refers to an optimal visit route customized according to personal characteristics of the user, which is an ideal path planned after comprehensively considering visit experience and efficiency.

[0099] Specifically, the control system collects real-time pedestrian flow data through a sensor network distributed throughout the physical exhibition hall. This data is then converted into an intuitive heat map displaying the hall's congestion level, where red areas represent dense crowds and green areas represent sparse crowds. Simultaneously, the control system analyzes user behavior profiles, extracting features such as walking speed preferences, typical dwell time, and fatigue levels. Combining these user characteristics with the heat map, the system uses intelligent path planning algorithms to generate a personalized physical tour route. This personalized route automatically avoids congested areas and adjusts the pace of the visit based on user characteristics, such as allocating more time for users who prefer detailed observation and arranging more rest stops for those with less stamina. Ultimately, this ensures that the personalized physical tour route satisfies user preferences while avoiding the discomfort caused by overcrowding.

[0100] S209. Personalized physical navigation paths are overlaid and displayed in the user's field of vision using augmented reality devices to guide the user's movement;

[0101] Among them, the user's field of view refers to the actual scene range that can be seen through augmented reality devices; the personalized physical navigation path refers to the virtual indicator lines and markers used to guide the user's direction of travel.

[0102] Specifically, the control system transmits the generated personalized physical navigation path to the augmented reality device worn by the user. The control system overlays clear navigation elements into the user's field of vision, including arrows on the ground, path lines in the air, and prominent markers for key turning points. These virtual navigation elements update their position and direction in real time as the user moves, ensuring accurate guidance. Furthermore, the control system also marks the estimated walking time and the location of the next recommended stop on the personalized physical navigation path, helping users better plan their visit.

[0103] S210. When the distance between the user and the target exhibit is lower than a preset distance threshold, the target explanatory content of the target exhibit is superimposed on the target exhibit through an augmented reality device. The target exhibit is any physical exhibit in the physical exhibition hall, and the target explanatory content includes text descriptions, video materials or interactive information of the target exhibit.

[0104] Among them, the preset distance threshold refers to the distance judgment standard for triggering the display of explanatory content; the target exhibit refers to the physical exhibit that the user is currently approaching; the target explanatory content refers to the collection of detailed information related to the target exhibit; the text description refers to the text content such as the basic information and historical background of the target exhibit; the video material refers to the video material related to the target exhibit; and the interactive information refers to the functional options that the user can operate and learn more about.

[0105] Specifically, the control system accurately calculates the relative distance between the user and the surrounding exhibits through the spatial positioning system of the augmented reality device. When the user approaches an exhibit to a trigger distance (usually within 1-2 meters), the control system automatically identifies the exhibit as the target exhibit and retrieves the corresponding target interpretation content from the database. The control system displays the target interpretation content in layers according to the type and importance of the exhibit: first, it displays a brief text introduction, including the basic information of the exhibit name, age, author, etc.; then it provides expandable detailed explanations, including historical background, artistic value, related anecdotes, etc.; at the same time, it superimposes video playback windows at appropriate positions to display related historical images, creation process or expert interpretation videos. In addition, the control system also marks the interactive hotspots, and users can obtain more in-depth information or experience virtual operation through these hotspots.

[0106] S211、Receiving the user's interactive instruction, adjusting the display mode of the target interpretation content according to the interactive instruction;

[0107] Among them, the interactive instruction refers to the operation command issued by the user through the augmented reality device; the display mode refers to the presentation form and layout of the target interpretation content; the adjustment refers to changing the display parameters of the target interpretation content according to user needs.

[0108] Specifically, the control system supports multiple forms of interactive instruction input: users can adjust the display position and size of the interpretation content through gesture operations (such as sliding, clicking, zooming, etc.); users can also switch different types of interpretation content through voice commands; users can also select the information module of interest through eye gaze to expand or fold. The control system will respond to these interactive instructions in real time and adjust the display mode of the target interpretation content accordingly, such as adjusting the text size and transparency to improve readability; changing the playback position and size of the video window; converting 2D and 3D display modes; adjusting the expansion state of information levels, etc.

[0109] S212, According to the virtual visit behavior data and the entity visit behavior data, determine the popularity of each entity exhibit in the entity exhibition hall;

[0110] Among them, the popularity refers to the comprehensive evaluation index of the entity exhibit attracting the attention and interaction of the audience.

[0111] Specifically, the control system processes the virtual visiting behavior data, including the number of times each virtual exhibit is viewed, the access depth of the detail page, the interaction duration, the collection mark, and other indicators. At the same time, the control system analyzes the entity visiting behavior data, calculates the time the audience stays in front of the entity exhibit, the number of repeated visits, the frequency of photographing records, the amount of information inquiries, and other indicators. The control system calculates the popularity degree of each entity exhibit by weighting the two types of data according to the preset weight. In the calculation process, the control system will consider the time factor and give higher weight to the recent visiting data to reflect the dynamic change trend of the popularity degree of the entity exhibit.

[0112] S213, determining the entity exhibit with a popularity degree exceeding a preset popularity degree threshold as a popular exhibit;

[0113] The preset popularity degree threshold is a standard value for determining whether an entity exhibit is a popular exhibit. The popular exhibit refers to an entity exhibit that receives a high degree of attention from the audience.

[0114] Specifically, the control system sets a reasonable preset popularity degree threshold according to historical data and exhibition goals, which may be dynamically adjusted according to factors such as exhibition type, number of visitors, and exhibition period. The control system compares the popularity degree of each entity exhibit with the preset popularity degree threshold, and when the popularity degree exceeds the preset popularity degree threshold, the entity exhibit will be marked as a popular exhibit.

[0115] S214, adjusting the exhibition layout of the entity exhibition hall based on the popular exhibit.

[0116] The exhibition layout refers to the arrangement and display method of the entity exhibits in the entity exhibition hall.

[0117] Specifically, first, the control system analyzes the spatial distribution characteristics of the popular exhibits and evaluates potential problems in the current layout, such as congestion risks in areas with high human flow density, uneven distribution of popular exhibits, etc. Then, the control system plans new display positions for the popular exhibits according to the space characteristics of the exhibition hall and the exhibition theme logic, which may include: moving some popular exhibits to more open areas to alleviate congestion; adjusting the distance between exhibits to provide a better view of the exhibition; optimizing the arrangement of auxiliary facilities around the exhibits to improve the visiting experience; and adding temporary visiting channels or rest areas if necessary.

[0118] The control system in the embodiments of the present application will be described from the perspective of hardware processing. Please refer to Figure 3 , which is a schematic diagram of a physical device structure of the control system in the embodiments of the present application.

[0119] It should be noted that, Figure 3The structure of the control system shown is only one example and should not impose any limitations on the functions and the range of use of the embodiments of the present application.

[0120] As shown in Figure 3 the control system includes a CPU 301 which can perform various appropriate actions and processes in accordance with a program stored in a read only memory ROM 302 or a program loaded from a storage section 308 into a random access memory RAM 303, such as performing the methods described in the above embodiments. In the RAM 303, various programs and data required for the operation of the system are also stored. The CPU 301, the ROM 302, and the RAM 303 are connected to each other through a bus 304. An I / O interface 305 is also connected to the bus 304.

[0121] The following components are connected to the I / O interface 305: an input section 306 including an audio input device, a push button switch, and the like; an output section 307 including a Liquid Crystal Display (LCD), an audio output device, an indicator, and the like; the storage section 308 including a hard disk, and the like; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card, a modem, and the like. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as necessary. A removable media 311 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like is attached to the drive 310 as necessary so that a computer program read therefrom is installed into the storage section 308 as necessary.

[0122] In particular, in accordance with embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present application include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing a computer program for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network by the communication section 309 and / or installed from the removable media 311. When the computer program is executed by the CPU 301, various functions defined in the present application are performed.

[0123] Note that specific examples of computer-readable storage media can include but are not limited to an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, computer-readable storage media can be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

[0124] The flow diagrams and the block diagrams in the drawings are illustrations of possible architectures, functions, and operations for systems, methods, and computer program products according to various embodiments of the present disclosure. It will be understood that each block of the flow diagrams and the block diagrams, and combinations of blocks in the flow diagrams and the block diagrams, can be implemented by a computer program instruction or code. Such instructions can be generated by a computer program product that causes a processor to perform functions described in the flow diagrams and the block diagrams. Also, each block can represent a module, a segment, or a portion of a computer program, and the computer program can include one or more of the blocks.

[0125] Specifically, the control system of the embodiment includes a processor and a memory, and the memory stores a computer program. When the computer program is executed by the processor, the method for guiding based on virtual reality and multi-dimensional scene provided by the above embodiment is implemented.

[0126] As another aspect, the present disclosure also provides a computer-readable storage medium. The storage medium can be included in the control system described in the above embodiments, or can exist separately and not be assembled into the control system. The storage medium carries one or more computer programs. When the one or more computer programs are executed by a processor of the control system, the control system implements the method for guiding based on virtual reality and multi-dimensional scene provided by the above embodiments.

[0127] The above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than limit the same. Although the present disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still make modifications to the technical solutions recorded in the foregoing embodiments, or make equivalent replacements to some of the technical features. The modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present disclosure.

[0128] In the above embodiments, the term "when" can be interpreted to mean "if" or "after" or "in response to determining" or "in response to detecting" depending on the context. Similarly, the phrase "on determining" or "if detecting (a stated condition or event)" can be interpreted to mean "if determining" or "in response to determining" or "on detecting (a stated condition or event)" or "in response to detecting (a stated condition or event)" depending on the context.

[0129] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by a computer program instructing the relevant hardware to complete, and the program can be stored in a computer readable storage medium. When the program is executed, it can include the processes of the above-mentioned embodiments. The aforementioned storage medium includes ROM or random storage memory RAM, magnetic disk or optical disk and various storage program codes.

Claims

1. A guided tour method based on virtual reality and multi-dimensional scenes, characterized in that, The method, applied to a control system, includes: acquiring static and dynamic characteristic data of an exhibition hall, wherein the static characteristic data includes the exhibition hall layout, exhibit locations, and exhibit types, and the dynamic characteristic data includes real-time pedestrian density and pedestrian movement trajectories; constructing a virtual exhibition hall based on the static characteristic data, wherein the virtual exhibition hall includes a 3D model of the physical exhibition hall; evaluating the visitor comfort of the physical exhibition hall based on the dynamic characteristic data; when the visitor comfort is lower than a preset comfort threshold, presenting the virtual exhibition hall to the user through a virtual reality device, allowing the user to visit the virtual exhibition hall; during the virtual exhibition hall visit, collecting the user's virtual visitor behavior data to generate a user virtual visitor behavior profile, wherein the virtual visitor behavior data includes head movement data, gesture interaction data, and gaze focus data; and filtering recommended exhibits that match the user's virtual interests based on the user's virtual visitor behavior profile and displaying them through a multimodal interactive interface.

2. The method according to claim 1, characterized in that, The process of constructing a virtual exhibition hall based on the static feature data of the physical exhibition hall includes: acquiring 3D data of the exhibition hall and exhibit location data; processing the 3D data of the exhibition hall to obtain basic framework data; integrating the exhibit location data into the basic framework data to generate exhibition hall layout data, which represents the overall structure of the exhibition hall and the distribution of exhibits; constructing a virtual exhibition hall model based on the exhibition hall layout data; and collecting lighting data from the physical exhibition hall and applying the lighting data to the virtual exhibition hall model to generate the virtual exhibition hall.

3. The method according to claim 1, characterized in that, The step of evaluating the visitor comfort of the physical exhibition hall based on the dynamic characteristic data of the exhibition hall specifically includes: calculating the crowding level of each exhibit area in the physical exhibition hall based on the real-time crowd density, wherein the crowding level is determined based on the total number of people and the maximum capacity of the exhibit area; calculating the movement state of the crowd based on the movement trajectory of the crowd, wherein the movement state is obtained by dividing the average movement speed of the crowd by a preset movement speed; and determining the visitor comfort of the physical exhibition hall based on the crowding level of each exhibit area and the movement state.

4. The method according to claim 1, characterized in that, After the step of filtering recommended exhibits that match the user's virtual interests based on the user's virtual visit behavior profile and displaying them through a multimodal interactive interface, the method further includes: activating the detailed display and interactive information of the corresponding virtual exhibit when the user clicks a preset interactive trigger point; recording the virtual exhibit to generate a user interest-related visit route for the physical exhibition hall, wherein the user interest-related visit route is used to connect the physical exhibits corresponding to the virtual exhibits.

5. The method according to claim 1, characterized in that, After the step of evaluating the visitor comfort of the physical exhibition hall based on the dynamic feature data of the exhibition hall, the method further includes: when the visitor comfort is higher than or equal to the preset comfort threshold, displaying guided information overlaid in the physical exhibition hall using an augmented reality device, enabling the user to visit the physical exhibition hall; during the visit to the physical exhibition hall, collecting the user's physical visitor behavior data to generate a user physical visitor behavior profile, the physical visitor behavior data including the user's walking trajectory, the user's stopping position, and the user's interaction data; generating a personalized physical guided path based on the user's physical visitor behavior profile and the exhibition hall congestion heat map, the exhibition hall congestion heat map being determined according to the real-time crowd density and the crowd movement trajectory, the personalized physical guided path being used to represent the user's optimal visit route in the physical exhibition hall; and displaying the personalized physical guided path overlaid in the user's field of vision using the augmented reality device to guide the user's movement.

6. The method according to claim 5, characterized in that, After the step of displaying the personalized physical guide path overlaid in the user's field of vision through the augmented reality device to guide the user's movement, the method further includes: when the distance between the user and the target exhibit is lower than a preset distance threshold, displaying target explanatory content overlaid with the target exhibit through the augmented reality device, wherein the target exhibit is any physical exhibit in the physical exhibition hall, and the target explanatory content includes text descriptions, video materials, or interactive information of the target exhibit; receiving interactive instructions issued by the user, and adjusting the display mode of the target explanatory content according to the interactive instructions.

7. The method according to claim 5, characterized in that, The method further includes: determining the popularity of each physical exhibit in the physical exhibition hall based on the virtual visitor behavior data and the physical visitor behavior data; identifying physical exhibits whose popularity exceeds a preset popularity threshold as popular exhibits; and adjusting the exhibition layout of the physical exhibition hall based on the popular exhibits.

8. A control system, characterized in that, The control system includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the control system to perform the method as described in any one of claims 1-7.

9. A computer-readable storage medium comprising instructions, characterized in that, When the instruction is executed on the control system, it causes the control system to perform the method as described in any one of claims 1-7.

10. A computer program product, characterized in that, When the computer program product is run on the control system, the control system performs the method as described in any one of claims 1-7.

Citation Information

Patent Citations

  • AR technology-based intelligent exhibition hall guide information method and system

    CN111897419A

  • Central control system of digital multimedia exhibition hall

    CN117970823A