An exhibition appreciation guiding method and system integrated with AR technology

Abstract

The application discloses an exhibition appreciation guiding method integrated with AR technology, and comprises the following steps: obtaining exhibition information; marking coordinate points of key contents in exhibits, connecting coordinate points of all key contents in the same exhibit to build corresponding virtual guiding paths; judging the exhibits in the current line of sight of a user through an eye tracking function of an AR device, and obtaining corresponding virtual guiding paths and all key contents from a cloud database to perform visual output; collecting the moving track of the user in an exhibition site plan after wearing the AR device, and generating a popular exhibit queue; and screening the first N exhibits in the popular exhibit queue to perform virtual guiding path and key content, and uploading the virtual guiding path and the key content to the cloud database of the AR device to replace the virtual guiding path and the key content in the cloud database of the AR device. The application further provides an exhibit appreciation guiding system. The method provided by the application can make full use of the AR device to realize hierarchical display and dynamic visual guiding, thereby improving the immersion experience of exhibition visitors.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of AR assistance, and particularly relates to an exhibition appreciation guiding method and system integrated with AR technology. BACKGROUND

[0002] In traditional museums and exhibitions, visitors usually rely on text labels, audio guides and manual explanations to obtain exhibition information. However, these methods have obvious limitations and cannot meet the needs of visitors for deeper understanding and interaction of the exhibits. Especially for some complex and rich artistic works (such as traditional Chinese paintings), traditional exhibition methods cannot effectively guide visitors to appreciate the hierarchical relationship and cultural background of the works in the best path and order.

[0003] With the development of AR technology, AR-based display methods have been gradually applied in museums, but current AR applications mainly focus on simple information superimposition, lacking systematic path guidance and multi-level information display support. Therefore, there is an urgent need for a comprehensive system that generates multi-level exhibition information through expert annotation and realizes hierarchical display and dynamic visual guidance using AR devices to improve the immersion experience of visitors.

[0004] Patent document CN116909408A discloses a content interaction method based on MR smart glasses, which includes judging the state of the user and the demand of the user, and obtaining the local image of the visual fixation point area; performing artificial intelligence processing on the obtained image content, and according to the processing result, performing priority sorting on the notification icons of related applications, services and information; according to the demand of the user and the priority sorting, retrieving the database to obtain answers or open related applications, and presenting on the optical display. It provides more accurate content interaction experience and realizes functions such as target detection and semantic segmentation.

[0005] Patent document CN116090879A discloses a flight training quality evaluation method based on eye movement data. First, eye movement data of different pilots completing the same flight task under the same environmental conditions is collected, and the existing pilot flight operation quality automatic evaluation system is used to evaluate the completion of the task and record the score. Then, the data is processed to construct a pilot flight training quality evaluation model based on principal component analysis-back propagation neural network evaluation model, and the flight training quality of the flight student to be evaluated is evaluated to obtain the evaluation result. SUMMARY

[0006] The purpose of the present application is to provide an exhibition appreciation guiding method and system integrated with AR technology, which can make full use of AR devices to realize hierarchical display and dynamic visual guidance, thereby improving the immersion experience of exhibition visitors.

[0007] In order to achieve the first object of the present application, the following technical solution is provided: an exhibition appreciation guiding method integrated with AR technology, comprising the following steps:

[0008] exhibition information is acquired, including an exhibition site plan and planar position coordinates of all exhibits in the exhibition site;

[0009] coordinates of key contents in the exhibits are marked manually, coordinate points of all key contents in the same exhibit are connected in series to construct a corresponding virtual guiding path, and the virtual guiding path and all key contents are uploaded to a cloud database of an AR device;

[0010] exhibits in the current line of sight of a user are determined through an eye tracking function in the AR, and corresponding virtual guiding paths and all key contents are acquired from the cloud database to be visually outputted;

[0011] moving tracks of the user in the exhibition site plan after wearing the AR device are collected, moving tracks of all users are counted, and the moving tracks are compared with planar position coordinates of all exhibits to generate a popular exhibit queue;

[0012] the first N exhibits in the popular exhibit queue are screened to update the virtual guiding path and the key contents, and the virtual guiding path and the key contents are uploaded to the cloud database of the AR device to be replaced.

[0013] The present application helps the audience to understand the content and details of the exhibits step by step in an immersive manner by generating path marking and key point indication, increases the level of appreciation and interest, and improves the deficiencies of the traditional museum exhibit display method.

[0014] Specifically, the virtual guiding path is generated by fitting a plurality of coordinate points through a Catmull-Rom curve to generate a corresponding path curve, and the path curve is optimized by using a Hermite interpolation algorithm.

[0015] Specifically, the Catmull-Rom curve is generated by selecting four connected coordinate points to generate a corresponding curve segment, and all curve segments are connected end to end to construct a path curve, and the expression is as follows: ; wherein, represents a current coordinate point, represents adjacent coordinate points before and after the current path point, represents an interpolation ratio between path points, wherein The expression of is .

[0016] Specifically, the Hermite interpolation algorithm is used to optimize the smooth transition of the path curve through the coordinate points at both ends of the path curve, and the expression is as follows: ; wherein, a coordinate point representing an end of the path curve, a velocity direction vector representing the corresponding coordinate point, an interpolation ratio representing between path points.

[0017] Specifically, the key content is composed of multi-level information of the exhibition, and the multi-level information includes:

[0018] L1 basic information layer, including basic background information;

[0019] L2 key appreciation object layer, including composition elements and corresponding explanation content;

[0020] L3 secondary object information layer, including secondary composition elements and corresponding explanation content;

[0021] L4 in-depth analysis layer, including cultural background and artistic criticism.

[0022] Specifically, the updating process is as follows:

[0023] Through the eye tracking function in the AR device, the region where the user's line of sight stays the longest in the exhibition except the original coordinate point of the key content is taken as the newly added key content;

[0024] The newly added key content is marked by a coordinate point in an artificial manner, and the current virtual guide path of the exhibition is reconstructed based on the newly added coordinate point to output a new virtual guide path.

[0025] In order to realize the second object of the application, the following technical scheme is provided: an exhibition appreciation guide system, which is realized by the above-mentioned exhibition appreciation guide method integrated with AR technology, and includes:

[0026] A multi-level information marking module for marking coordinate points of key content in the exhibition and inputting key content;

[0027] A guide path generation module for generating a virtual guide path of the corresponding exhibition according to the coordinate points of the key content;

[0028] A visual guide and path display module for visualizing the virtual guide path of the exhibition in the user's line of sight;

[0029] A multi-level information display module for visualizing the key content of each coordinate point in the virtual guide path;

[0030] A path updating module for updating the virtual guide path of the exhibition according to the movement trajectories of multiple users, the plane position coordinates of the exhibition, and the region where the user's line of sight stays the longest in the exhibition.

[0031] Specifically, it further comprises a real-time interaction and feedback module, which is used for identifying the gesture action of the user to generate corresponding control instructions to switch and display zoom operation of the hierarchical information in the key content of each coordinate point.

[0032] Compared with the prior art, the present application has the following beneficial effects:

[0033] The smooth dynamic path is generated by the Catmull-Rom curve generation and Hermite interpolation subdivision algorithm, so that the path is more natural and smooth when guiding the user, and the problem of jumping of the viewing line in the traditional path marking mode is avoided, thereby providing a seamless visual guiding experience for the user.

[0034] Through the hierarchical information display, the user can select different viewing depths according to interests, gradually understand the connotation of the exhibits, and realize from the basic background to in-depth academic analysis, and the audience can experience systematic knowledge transmission. BRIEF DESCRIPTION OF DRAWINGS

[0035] Figure 1 A flowchart of the exhibition appreciation guiding method integrated with AR technology provided by the embodiment;

[0036] Figure 2 A schematic diagram of the exhibition appreciation guiding system provided by the embodiment. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme of the embodiments of the present application will be described clearly and completely in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all the embodiments. The components of the embodiments of the present application described and shown in the drawings can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the claimed present application, but only represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0038] As shown in the flowchart of the exhibition appreciation guiding method integrated with AR technology provided by the embodiment, Figure 1

[0039] acquiring exhibition information, which includes an exhibition site plan and a plan position coordinate of all exhibits in the exhibition site;

[0040] ​The key content in the exhibits is marked by artificial coordinate points, and the coordinate points of all key contents in the same exhibit are connected to construct a corresponding virtual guide path, and the virtual guide path and all key contents are uploaded to the cloud database of the AR device.

[0041] The current exhibit in the user's line of sight is determined by the eye tracking function in the AR device, and the corresponding virtual guide path and all key contents are obtained from the cloud database and visually output.

[0042] By collecting the movement trajectory of the user in the exhibition site plan after wearing the AR device, the movement trajectories of all users are counted and combined with the plane position coordinates of all exhibits to generate a popular exhibit queue.

[0043] The first N exhibits in the popular exhibit queue are screened to update the virtual guide path and key content, and are uploaded to the cloud database of the AR device for replacement.

[0044] More specifically, for the process of marking the key content in each exhibit by artificial coordinate points, connecting the coordinate points of all key contents in the same exhibit to construct a corresponding virtual guide path, the basis of the AR exhibition system is completed, and multi-level information structure and key content marking are connected to support subsequent virtual guide path generation and hierarchical display. The artificial method refers to the hierarchical marking of exhibit information according to the characteristics and viewing needs of the exhibits, and the information levels include:

[0045] L1 basic information layer, including basic background information, in this embodiment, referring to the name of the exhibit, the author, the creation time, etc.

[0046] L2 key appreciation object layer, including composition elements, which are used as key nodes of the viewing path in this embodiment.

[0047] L3 secondary object information layer, including composition secondary elements and corresponding explanation contents, referring to seals and inscriptions in this embodiment, to provide auxiliary understanding.

[0048] L4 in-depth analysis layer, including cultural background and artistic criticism, to meet the more in-depth needs of the audience.

[0049] By marking the nodes of the best viewing path on the exhibit, the order and importance of appreciation are defined, providing input for subsequent dynamic path generation. Path nodes are stored through coordinates and annotation data, laying the foundation for smooth path generation.

[0050] In addition, the key positions of the exhibit (such as key compositions or details) are annotated through visual markers and description information to ensure that the audience can accurately capture the core elements during viewing.

[0051] The construction of the virtual guide path is to generate a corresponding path curve by fitting multiple coordinate points through the Catmull-Rom curve, and to optimize the path curve through the Hermite interpolation algorithm. In this way, a smooth and natural guide path can be generated, and the specific process is as follows:

[0052] The Catmull-Rom curve is generated by selecting four connected coordinate points to generate a corresponding curve segment, and connecting all the curve segments end to end to construct a path curve, and its expression is as follows: ; wherein, represents the current coordinate point, represents the coordinate points adjacent to the current path point, represents the interpolation ratio between path points, wherein The expression of .

[0053] In order to make the turning point of the path more smooth and coherent, the Hermite interpolation algorithm is combined to further refine each path segment. Hermite interpolation can ensure smooth transition of the path through tangent control points.

[0054] The Hermite interpolation algorithm is to optimize the smooth transition of the path curve through the coordinate points at both ends of the path curve, and its expression is as follows: ; wherein, represents the coordinate points at both ends of the path curve, represents the velocity direction vector of the corresponding coordinate point, represents the interpolation ratio between path points.

[0055] Through Hermite interpolation, the curvature and transition of the path can be accurately controlled, thereby eliminating unnatural jumps in the path.

[0056] The embodiment also provides an exhibition appreciation guide system, which is realized through the exhibition appreciation guide method provided by the above-mentioned embodiment, as shown in Figure 2 , which comprises:

[0057] A multi-level information labeling module is used for coordinate point labeling of key content in the exhibition and input of the key content. That is, the system presents the generated path in the audience's field of view through virtual guide lines and dynamic visual markers in the AR device. The dynamic generation and update of the path depend on the node positions labeled by experts and the real-time feedback of the audience, ensuring a smooth and focused appreciation process and improving the sense of immersion.

[0058] A guide path generation module generates a virtual guide path for the corresponding exhibition according to the coordinate points of the key content.

[0059] The visual guidance and path display module is used to visualize the virtual guidance path of the exhibits in the user's line of sight, that is, the system presents the generated path in the viewer's field of view through virtual guide lines and dynamic visual markers in the AR device. The dynamic generation and update of the path rely on the node positions annotated by experts and the real-time feedback of the audience, ensuring a smooth and focused viewing process and improving the sense of immersion.

[0060] The multi-level information display module is used to visualize the key content of each coordinate point in the virtual guidance path.

[0061] The path update module updates the virtual guidance path of the exhibits according to the movement trajectories of multiple users, the plane position coordinates of the exhibits, and the area where the user's line of sight stays the longest, so that the virtual guidance path is more in line with the user's interests.

[0062] The real-time interaction and feedback module is used to recognize the user's gesture actions to generate corresponding control instructions for switching and displaying the operation of the key content of each coordinate point. That is, based on the eye tracking and gesture recognition functions of the AR device (Vision Pro), the system monitors the viewer's gaze position and gesture operation in real time. For example, when the viewer's line of sight stays on a certain appreciation point, the system automatically triggers the display of detailed information in that area. The viewer can select different information levels through gestures or line of sight without additional equipment, and the interactive experience is natural and smooth. The innovation lies in using the eye tracking of the AR device to realize automatic pop-up and personalized recommendation of information, making the viewing process more in line with the audience's needs.

[0063] In summary, the method provided by the embodiment has the following advantages over the prior art:

[0064] (1) Smooth dynamic path generation, improving the naturalness of visual guidance: The smooth dynamic path is generated through the Catmull-Rom curve generation and Hermite interpolation subdivision algorithm, making the presentation of the viewing path natural and smooth, avoiding the problem of viewing line jumping in traditional path marking methods, and providing a seamless visual guidance experience for the audience.

[0065] (2) Multi-level information display, enhancing the hierarchy of knowledge transmission: Hierarchical information display allows the audience to choose different viewing depths according to their interests and gradually understand the content of the exhibits, from basic background to in-depth academic analysis, and the audience experiences systematic knowledge transmission.

[0066] (3) Based on the natural interaction of AR equipment, improve the immersive experience: using the eye tracking and spatial computing functions of Vision Pro, the system automatically pops up detailed information in the area where the audience's gaze stays, and selects different information levels through gesture operation, so that the interactive experience conforms to natural habits. In this way, the audience can customize the viewing path and content according to their own needs, and realize personalized immersive experience.

[0067] (4) Suitable for Vision Pro equipment, fully exert the hardware advantages: the system uses the "infinite space" function of Vision Pro, so that the audience can flexibly adjust the display position, size and angle of virtual exhibits, increasing the sense of space and immersion of the display content, especially suitable for displaying multi-level content and complex structure of art works.

[0068] In addition, the terms "upper", "lower", "inner", "outer", "front", "back" are only for description purposes, and cannot be understood as indicating or implying relative importance. Unless otherwise specified, the relative steps, numerical expressions and numerical values of the components and steps set forth in these embodiments do not limit the scope of the present application.

[0069] Of course, the above only describes specific embodiments of the present application, and does not limit the scope of the present application. Any equivalent changes or modifications made in accordance with the principles and features described in the patent application of the present application shall be included in the patent application of the present application.

[0070] Finally, it should be noted that the above-described embodiments are only specific embodiments of the present application, and are used to illustrate the technical solutions of the present application, but not to limit it. The protection scope of the present application is not limited to this. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can make modifications or easily think of changes to the technical solutions described in the foregoing embodiments within the technical scope disclosed by the present application, or make equivalent replacements to some technical features; and these modifications, changes or replacements do not make the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. An exhibit appreciation guide method integrated with AR technology, characterized by, It comprises the following steps: Obtaining exhibition information, including exhibition site plan and the plan position coordinates of all exhibits in the exhibition site; Artificially marking coordinate points of key contents in each exhibit, concatenating coordinate points of all key contents in the same exhibit to construct a corresponding virtual guide path, and uploading the virtual guide path and all key contents to the cloud database of the AR device; The key contents are composed of multi-level information of the exhibits, including: L1 basic information layer, including basic background information; L2 key appreciation object layer, including composition elements and corresponding explanation contents, the composition elements being key nodes for appreciation; L3 secondary object information layer, including composition secondary elements and corresponding explanation contents, the composition secondary elements including seals and inscriptions; L4 in-depth analysis layer, including cultural background and artistic criticism; Judging the exhibit in the user's current line of sight through the eye tracking function of the AR device, and visually outputting the corresponding virtual guide path and all key contents obtained from the cloud database; Collecting the movement trajectory of the user in the exhibition site plan after wearing the AR device, statistically analyzing the movement trajectories of all users, and combining the plan position coordinates of all exhibits to generate a popular exhibit queue; Selecting the top N exhibits in the popular exhibit queue to update the virtual guide path and key contents, and uploading them to the cloud database of the AR device for replacement; The specific process of updating is as follows: obtaining the area where the user's line of sight stays the longest in the exhibit through the eye tracking function of the AR device, except for the original key contents, as new key contents; Artificially marking coordinate points of the new key contents, and reconstructing the current virtual guide path of the exhibit based on the new coordinate points to output a new virtual guide path.

2. The integrated AR technology exhibit appreciation guide method according to claim 1, characterized by, The virtual guide path is fitted with multiple coordinate points to generate a corresponding path curve through the Catmull-Rom curve, and is optimized using the Hermite interpolation algorithm.

3. The integrated AR technology exhibit appreciation guide method according to claim 2, characterized by, The Catmull-Rom curve is generated by selecting four connected coordinate points to generate a corresponding curve segment, and connecting the start and end of all curve segments to construct a path curve, and the expression is as follows: ; wherein, represents the current coordinate point, represents the coordinate point adjacent to the front and rear of the current path point, represents the interpolation ratio between path points, wherein The expression of is .

4. The integrated AR technology exhibit appreciation guide method according to claim 2, characterized by, The Hermite interpolation algorithm is to optimize the smooth transition of the path curve by the coordinate points at both ends of the path curve, and the expression is as follows: ; wherein, denotes the coordinate points at both ends of the path curve, denotes the velocity direction vector of the corresponding coordinate point, denotes the interpolation ratio between the path points.

5. An exhibit appreciation guidance system characterized by comprising: The exhibition appreciation guide method integrated with AR technology is realized by the method of any one of claims 1-4, which comprises: A multi-level information marking module for marking coordinate points of key contents in the exhibit and inputting key contents; A guide path generation module for generating a virtual guide path of the corresponding exhibit according to the coordinate points of the key contents; A visual guide and path display module for visually displaying the virtual guide path of the exhibit in the user's line of sight; A multi-level information display module for visually displaying the key contents of each coordinate point in the virtual guide path; A path update module for updating the virtual guide path of the exhibit according to the movement trajectories of multiple users, the plan position coordinates of the exhibits, and the area where the user's line of sight stays the longest in the exhibit.

6. The exhibit appreciation guidance system of claim 5, wherein, It also includes a real-time interaction and feedback module for recognizing the user's gesture actions to generate corresponding control instructions to switch and display and zoom the hierarchical information in the key contents of each coordinate point.

Images