Exhibition appreciation guiding method and system integrated with AR (Augmented Reality) technology

Abstract

The invention discloses an AR technology-integrated exhibit appreciation guiding method. The method comprises the steps of obtaining exhibition information; carrying out coordinate point labeling on key contents in the exhibit, and connecting coordinate points of all key contents in the same exhibit in series so as to construct a corresponding virtual guide path; an exhibit in the current sight line of the user is judged through an eye movement tracking function in AR equipment, and a corresponding virtual guide path and all key contents are obtained from a cloud database for visual output; the method comprises the steps of collecting a moving track of a user in an exhibition site planar graph after the user wears AR equipment, and generating a hot exhibition item queue; and screening the first N exhibitions in the hot exhibit queue to virtually guide paths and key contents, and uploading the paths and the key contents to a cloud database of AR equipment for replacement. The invention further provides an exhibition appreciation guiding system. According to the method provided by the invention, the AR equipment can be fully utilized to realize hierarchical display and dynamic visual guidance, so that the immersion experience of exhibition audiences is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of AR assistance, and particularly relates to an exhibition item appreciation guiding method and system integrating AR technology. Background Art

[0002] In traditional museums and exhibition displays, visitors usually rely on text labels, audio guides, and manual explanations to obtain information about exhibits. However, these methods have obvious limitations and are difficult to meet visitors' deeper understanding and interaction needs of exhibits. Especially for some artworks with complex structures and rich connotations (such as traditional Chinese paintings), the traditional exhibition methods cannot effectively guide visitors to appreciate the hierarchical relationships and cultural backgrounds of the works in the best path and order.

[0003] With the development of AR technology, AR-based display methods have gradually been applied to museums. However, current AR applications mainly focus on simple information overlay and lack the support of systematic path guidance and multi-level information display. Therefore, there is an urgent need for a comprehensive system that generates multi-level exhibit information through expert annotation and uses AR devices to achieve hierarchical display and dynamic visual guidance, thereby enhancing the immersive experience of exhibition visitors.

[0004] Patent document CN116909408A discloses a content interaction method based on an MR smart glasses, including judging the state and needs of a user, and acquiring a local image of a visually fixated area; performing artificial intelligence processing on the acquired image content, and sorting the notification icons of relevant applications, services, and information according to the processing results; retrieving a database to obtain an answer or open a relevant application according to the needs of the user and the sorting of priorities, and presenting the answer or application on an optical display. It provides a more accurate content interaction experience and realizes functions such as object detection and semantic segmentation.

[0005] Patent document CN116090879A discloses a flight training quality evaluation method based on eye movement data. First, collect the eye movement data of different pilots completing the same flight task under the same environmental conditions, and use the existing automatic evaluation system for pilots' flight operation quality to evaluate their task completion situation and record their scores. Then, process the data and construct a flight training quality evaluation model for flight trainees to be evaluated using a principal component analysis-backpropagation neural network evaluation model to obtain an evaluation result. Summary of the Invention

[0006] The purpose of the present invention is to provide an exhibition item appreciation guiding method and system integrating AR technology. This method can make full use of AR devices to achieve hierarchical display and dynamic visual guidance, thereby enhancing the immersive experience of exhibition visitors.

[0007] To achieve the first objective of the present invention, the following technical solution is provided: A method for guiding the appreciation of exhibition items integrating AR technology, comprising the following steps: Obtain exhibition information, which includes a floor plan of the exhibition venue and the planar position coordinates of all exhibition items in the exhibition venue; Manually mark the coordinates of key contents in the exhibition items, connect the coordinate points of all key contents in the same exhibition item in series to construct a corresponding virtual guiding path, and upload the virtual guiding path and all key contents to the cloud database of the AR device; Judge the exhibition item in the current line of sight of the user through the eye movement tracking function in AR, and obtain the corresponding virtual guiding path and all key contents from the cloud database for visual output; Collect the movement trajectories of users in the floor plan of the exhibition venue after wearing the AR device, count all the movement trajectories of users and compare them with the planar position coordinates of all exhibition items to generate a queue of popular exhibition items; Screen the top N exhibition items in the queue of popular exhibition items to update the virtual guiding path and key contents, and upload them to the cloud database of the AR device for replacement.

[0008] The present invention helps the audience to gradually understand the content and details of the exhibits immersively by generating path markings and key point guidance, increases the layering and interest of viewing, and improves the deficiencies of the traditional museum exhibit display method.

[0009] Specifically, the virtual guiding path is generated by fitting multiple coordinate points through a Catmull-Rom curve to generate a corresponding path curve, and the Hermite interpolation algorithm is used to optimize the path curve.

[0010] Specifically, the Catmull-Rom curve generates a corresponding curve segment by selecting four adjacent coordinate points, and connects all the curve segments end to end to construct a path curve, and its expression is as follows: ; where represents the current coordinate point, , , represent the coordinate points adjacent to the current path point before and after, represents the interpolation ratio between path points, where the expression of .

[0011] Specifically, the Hermite interpolation algorithm optimizes the path curve through the coordinate points at both ends of the path curve, and its expression is as follows: ; where , represent the coordinate points at both ends of the path curve, , represents the velocity direction vector of the corresponding coordinate point, represents the interpolation ratio between path points.

[0012] Specifically, the key content consists of multi-level information of the exhibit, and the multi-level information includes: L1 basic information layer, including basic background information; L2 key appreciation object layer, including composition elements and corresponding explanatory content; L3 secondary object information layer, including secondary composition elements and corresponding explanatory content; L4 in-depth analysis layer, including cultural background and art reviews.

[0013] Specifically, the update process is as follows: Through the eye movement tracking function in the AR device, the area where the user's line of sight stays the longest in the exhibit except for the coordinate points of the original key content is used as the newly added key content; Manually mark the coordinate points of the newly added key content, and reconstruct the current virtual guiding path of the exhibit based on the newly added coordinate points to output a new virtual guiding path.

[0014] To achieve the second object of the present invention, the following technical solution is provided: An exhibit appreciation guiding system is realized by the above-mentioned exhibit appreciation guiding method integrating AR technology, and it includes: A multi-level information annotation module for performing coordinate point annotation and input of key content in the exhibit; A guiding path generation module for generating a virtual guiding path of the corresponding exhibit according to the coordinate points of the key content; A visual guiding and path display module for visualizing the virtual guiding path of the exhibit in the user's line of sight; A multi-level information display module for visualizing the key content of each coordinate point in the virtual guiding path; A path update module for updating the virtual guiding path of the exhibit according to the movement trajectories of multiple users, the plane position coordinates of the exhibit, and the area where the user's line of sight stays the longest in the exhibit.

[0015] Specifically, it further includes a real-time interaction and feedback module for identifying the user's gesture actions to generate corresponding control instructions for switching the hierarchical information and performing display zoom operations on the key content of each coordinate point.

[0016] Compared with the prior art, the beneficial effects of the present invention: Generate a smooth dynamic path through Catmull-Rom curve generation and Hermite interpolation subdivision algorithm, making the path more natural and smooth when guiding users, avoiding the problem of jumping viewing lines in traditional path marking methods, and providing users with a seamless visual guidance experience; Through the display of hierarchical information, users can select different viewing depths according to their interests, gradually understand the connotations of the exhibits, and achieve everything from basic background to in-depth academic analysis, enabling the audience to experience systematic knowledge transfer. Brief Description of the Drawings

[0017] Figure 1 It is a flowchart of the exhibit appreciation guidance method integrating AR technology provided by this embodiment; Figure 2 It is a schematic diagram of the exhibit appreciation guidance system provided by this embodiment. Detailed Embodiment

[0018] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. Usually, the components of the embodiments of the present invention described and illustrated herein can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0019] As Figure 1 shown, it is the exhibit appreciation guidance method integrating AR technology provided by this embodiment, Obtain exhibition information, which includes the floor plan of the exhibition venue and the planar position coordinates of all exhibits in the exhibition venue; Manually mark the coordinate points of the key content in the exhibits, connect the coordinate points of all the key content in the same exhibit in series to construct a corresponding virtual guidance path, and upload the virtual guidance path and all the key content to the cloud database of the AR device; Judge the exhibit in the current line of sight of the user through the eye movement tracking function in the AR device, and obtain the corresponding virtual guidance path and all the key content from the cloud database for visual output.

[0020] Collect the movement trajectories of users in the floor plan of the exhibition venue after wearing the AR device, count all the movement trajectories of users and combine them with the planar position coordinates of all the exhibits to generate a queue of popular exhibits; Screen the top N exhibits in the popular exhibit queue to update the virtual guiding path and key content, and upload them to the cloud database of the AR device for replacement.

[0021] More specifically, for the process of manually marking the coordinate points of the key content in each exhibit and concatenating the coordinate points of all the key content in the same exhibit to construct the corresponding virtual guiding path, it is completed based on the foundation of the AR expansion system. Through the multi-level information structure and the concatenation of key content annotations, it supports the subsequent generation of virtual guiding paths and hierarchical display. Among them, the manual method refers to the hierarchical annotation of the exhibit information according to the characteristics of the exhibit and the viewing needs, and its information levels include: L1 basic information layer, including basic background information, which in this embodiment refers to the exhibit name, author, creation time, etc.

[0022] L2 key appreciation object layer, including composition elements, which are used as the key nodes of the viewing path in this embodiment.

[0023] L3 secondary object information layer, including secondary composition elements and corresponding explanatory content, which in this embodiment refers to seals and inscriptions to provide auxiliary understanding.

[0024] L4 in-depth analysis layer, including cultural background and art reviews to meet the deeper needs of the audience.

[0025] By marking the nodes of the best viewing path on the exhibit, defining the appreciation order and importance, it provides input for the subsequent generation of dynamic paths. The path nodes are stored through coordinates and annotation data, laying a foundation for the generation of smooth paths.

[0026] In addition, the key positions of the exhibit (such as key compositions or details) are annotated through visual markers and descriptive information to ensure that the audience can accurately capture the core elements during the viewing process.

[0027] The construction of the virtual guiding path is to fit multiple coordinate points through the Catmull-Rom curve to generate the corresponding path curve, and use the Hermite interpolation algorithm to optimize the path curve. Through this method, a smooth and natural guiding path can be generated, and its specific process is as follows: The Catmull-Rom curve generates the corresponding curve segment by selecting four adjacent coordinate points and connects all the curve segments end to end to construct the path curve. Its expression is as follows: ; where represents the current coordinate point, , , represent the coordinate points adjacent to the current path point before and after, represents the interpolation ratio between path points, where The expression is .

[0028] In order to make the turning points of the path smoother and more coherent, the Hermite interpolation algorithm is combined to further refine each path segment. Hermite interpolation can ensure the smooth transition of the path through tangent control points.

[0029] The Hermite interpolation algorithm optimizes the smooth transition of the path curve through the coordinate points at both ends of the path curve, and its expression is as follows: ; where , represents the coordinate points at both ends of the path curve, , represents the velocity direction vector of the corresponding coordinate point, represents the interpolation ratio between path points.

[0030] Through Hermite interpolation, the bending and transition of the path can be precisely controlled, thus eliminating unnatural jumps in the path.

[0031] This embodiment also provides an exhibition item appreciation guidance system, which is implemented by the exhibition item appreciation guidance method integrating AR technology provided in the above embodiment, as Figure 2 shown, and it includes: A multi-level information annotation module for annotating the coordinate points of key contents in the exhibition item and inputting the key contents, that is, the system presents the generated path in the viewer's field of view through virtual guiding lines and dynamic visual markers in the AR device. The dynamic generation and update of the path depend on the node positions marked by experts and the real-time feedback of the viewer, ensuring a smooth and focused viewing process and enhancing the immersion.

[0032] A guiding path generation module that generates a virtual guiding path for the corresponding exhibition item according to the coordinate points of the key contents; A visual guidance and path display module for visualizing the virtual guiding path of the exhibition item in the user's line of sight, that is, the system presents the generated path in the viewer's field of view through virtual guiding lines and dynamic visual markers in the AR device. The dynamic generation and update of the path depend on the node positions marked by experts and the real-time feedback of the viewer, ensuring a smooth and focused viewing process and enhancing the immersion.

[0033] A multi-level information display module for visualizing the key contents of each coordinate point in the virtual guiding path; A path update module that updates the virtual guiding path of the exhibition item according to the movement trajectories of multiple users, the planar position coordinates of the exhibition item, and the area where the user's line of sight stays on the exhibition item for the longest time, so as to make the virtual guiding path more in line with the user's interests.

[0034] The real-time interaction and feedback module is used to recognize the user's gesture actions to generate corresponding control instructions for switching the hierarchical information of the key content at each coordinate point and for operations such as display zoom. That is, based on the eye-tracking and gesture recognition functions of the AR device (Vision Pro), the system monitors the viewer's gaze position and gesture operations in real time. For example, when the viewer's line of sight stays on a certain appreciation point, the system automatically triggers the display of detailed information in that area. The viewer can select different information levels through gestures or line of sight without additional devices, and the interaction experience is natural and smooth. The innovation lies in using the eye-tracking of the AR device to achieve automatic pop-up of information and personalized recommendations, making the viewing process more in line with the viewer's needs.

[0035] In summary, the method provided in this embodiment compared with the prior art: (1) Smooth dynamic path generation, enhancing the naturalness of visual guidance: By generating a Catmull-Rom curve and using the Hermite interpolation subdivision algorithm to generate a smooth dynamic path, the presentation of the viewing path is natural and smooth, avoiding the problem of jumping viewing lines in traditional path marking methods, and providing the viewer with a seamless visual guidance experience.

[0036] (2) Multi-level information display, enhancing the hierarchy of knowledge transfer: The hierarchical information display enables the viewer to select different viewing depths according to their interests, gradually understand the connotation of the exhibits, and can achieve from basic background to in-depth academic analysis. The viewer experiences a systematic knowledge transfer.

[0037] (3) Natural interaction based on AR devices, enhancing the immersive experience: Utilizing the eye-tracking and spatial computing functions of Vision Pro, the system automatically pops up detailed information in the area where the viewer's line of sight stays, and gesture operations are used to select different information levels, making the interaction experience conform to natural habits. In this way, the viewer can customize the viewing path and content according to their own needs to achieve a personalized immersive experience.

[0038] (4) Adapt to the Vision Pro device and give full play to the hardware advantages: The system utilizes the "infinite space" function of Vision Pro, enabling the viewer to flexibly adjust the display position, size, and angle of virtual exhibits, increasing the sense of space and immersion of the display content, and is particularly suitable for displaying artworks with multi-level content and complex structures.

[0039] In addition, the terms "upper", "lower", "inner", "outer", "front", and "rear" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. Unless otherwise specifically stated, the relative steps, numerical expressions, and values of the components and steps set forth in these embodiments do not limit the scope of the present invention.

[0040] Certainly, the above are only specific embodiments of the present invention and are not intended to limit the scope of the present invention. Any equivalent changes or modifications made according to the structure, features, and principles described in the scope of the patent application of the present invention shall be included in the scope of the patent application of the present invention.

[0041] Finally, it should be noted that the above embodiments are only specific implementation manners of the present invention, used to illustrate the technical solutions of the present invention, rather than limiting it. The protection scope of the present invention is not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that any person skilled in the art within the technical scope disclosed by the present invention can still modify the technical solutions recorded in the foregoing embodiments or can easily think of changes, or perform equivalent replacements on some of the technical features; and these modifications, changes, or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention and should all be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. An exhibition item appreciation guidance method integrating AR technology, characterized in that, It includes the following steps: Obtain exhibition information, which includes a floor plan of the exhibition venue and the planar position coordinates of all exhibits in the exhibition venue; Manually mark the coordinate points of the key content in each exhibit, connect the coordinate points of all the key content in the same exhibit in series to construct a corresponding virtual guiding path, and upload the virtual guiding path and all the key content to the cloud database of the AR device; Use the eye-tracking function in the AR device to judge the exhibit in the user's current line of sight, and obtain the corresponding virtual guiding path and all the key content from the cloud database for visual output; Collect the movement trajectories of users in the floor plan of the exhibition venue after wearing the AR device, count all the movement trajectories of users and combine them with the planar position coordinates of all exhibits to generate a queue of popular exhibits; Screen the top N exhibits in the queue of popular exhibits to update the virtual guiding path and key content, and upload them to the cloud database of the AR device for replacement.

2. The method for guiding the appreciation of exhibits integrating AR technology according to claim 1, wherein The virtual guiding path is generated by fitting multiple coordinate points through a Catmull-Rom curve to generate a corresponding path curve, and the path curve is optimized using the Hermite interpolation algorithm.

3. The method for guiding the appreciation of exhibits integrating AR technology according to claim 2, characterized in that, The Catmull-Rom curve generates corresponding curve segments by selecting four consecutive coordinate points and constructs a path curve by connecting all the curve segments end to end. Its expression is as follows: ; where represents the current coordinate point, , , represent the coordinate points adjacent to the current path point before and after, represents the interpolation ratio between path points, where the expression of is .

4. The method for guiding the appreciation of exhibits integrating AR technology according to claim 2, characterized in that, The Hermite interpolation algorithm optimizes the smooth transition of the path curve through the coordinate points at both ends of the path curve, and its expression is as follows: ; where , represents the coordinate points at both ends of the path curve, , represents the velocity direction vector of the corresponding coordinate point, represents the interpolation ratio between path points.

5. The method for guiding the appreciation of exhibits integrating AR technology according to claim 1, characterized in that, The key content consists of multi-level information of the exhibit, and the multi-level information includes: L1 basic information layer, including basic background information; L2 key appreciation object layer, including composition elements and corresponding explanatory content; L3 secondary object information layer, including secondary composition elements and corresponding explanatory content; L4 in-depth analysis layer, including cultural background and art reviews.

6. The method for guiding the appreciation of exhibits integrating AR technology according to claim 1, characterized in that The specific process of the update is as follows: Use the eye-tracking function in the AR device to obtain the area where the user's line of sight stays in the exhibit for the longest time except for the coordinate points of the original key content as the newly added key content; Manually mark the coordinate points of the newly added key content, and reconstruct the current virtual guiding path of the exhibit based on the newly added coordinate points to output a new virtual guiding path.

7. An exhibition item appreciation guidance system, characterized in that, It is realized by the exhibit appreciation guiding method integrating AR technology as described in any one of claims 1 to 6, and it includes: A multi-level information marking module for marking the coordinate points of the key content in the exhibit and inputting the key content; A guiding path generation module for generating a virtual guiding path of the corresponding exhibit according to the coordinate points of the key content; A visual guiding and path display module for visualizing the virtual guiding path of the exhibit in the user's line of sight; A multi-level information display module for visualizing the key content of each coordinate point in the virtual guiding path; A path update module for updating the virtual guiding path of the exhibit according to the movement trajectories of multiple users, the planar position coordinates of the exhibit, and the area where the user's line of sight stays in the exhibit for the longest time.

8. The exhibit appreciation guidance system according to claim 7, characterized in that, It also includes a real-time interaction and feedback module for identifying the user's gesture actions to generate corresponding control instructions for switching the hierarchical information and displaying zoom operations of the key content at each coordinate point.

Images