A method and system for interactive AR experience of museum exhibits

By collecting and analyzing the cultural background information of museum exhibits and the visual data of visitors, and adjusting the display screen and voice parameters of AR devices, the problem of poor user experience in the existing technology is solved, and personalized and adaptive user experience is achieved .

CN119027623BActive Publication Date: 2025-02-07JIANGSU SUYUAN GUANGYI SCI-TECH CO LTD

Patent Information

Application Number
CN202411476690.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-10-22
Publication Date
2025-02-07
Estimated Expiration
2044-10-22

AI Technical Summary

Technical Problem

The prior art has failed to customize according to the user's visual preferences, comfort or interest in cultural relics information, and has failed to dynamically adjust the display screen information and voice parameters to adapt to different environmental conditions, resulting in poor user experience.

Method used

By collecting cultural background information of the exhibits and visual data of visitors, analyzing and adjusting the display screen and voice parameters of the AR device, ensuring the personalization and adaptability of display effects and voice broadcasts.

Benefits of technology

Improve user experience satisfaction and immersion, ensuring the best visual experience and clear information communication in different environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119027623B_ABST
    Figure CN119027623B_ABST
Patent Text Reader

Abstract

The present invention discloses a method and system for interactive AR experience of museum exhibits, and relates to the field of interactive AR experience technology. In the process of exhibit display adjustment, by incorporating the cultural background information of the exhibits into the design of the AR display screen, users can better understand the historical background and cultural value of each exhibit. In the process of display screen analysis, by adjusting the display screen information of the AR device in real time, it can be optimized according to the visual comfort and preference of each visitor, which is conducive to each visitor to obtain the best visual experience in different environments and avoid visual fatigue or discomfort caused by display discomfort. In the process of voice broadcast analysis, by analyzing the environmental noise and the voice input of the visitor, the system can dynamically adjust the speech speed and volume of the voice broadcast, so that the voice information can remain clear and audible under various environmental noise conditions, thereby improving the effectiveness of interaction and the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of interactive AR experience, and in particular to a method and system for interactive AR experience of museum exhibits. Background Art

[0002] Traditional museum exhibitions often have problems such as insufficient information on exhibits and poor interactivity. Audiences are increasingly demanding a sense of participation and experience in exhibition content. AR technology can enhance audience participation and learning interest by providing dynamic information display and virtual interaction.

[0003] Prior art, such as the invention patent application with announcement number CN106886285A, discloses a cultural relic interaction system and operation method based on virtual reality, which includes a camera and a human-computer interaction module. The camera transmits the collected video information to the human-computer interaction module, which processes the obtained video information, identifies the user's gesture type, generates the effect of controlling the cultural relic and displays the result through the VR display unit. The system abandons the existing museum interaction system's strong rendering of the situation, applies human-computer interaction technology to museum cultural relics, and realizes the interaction between people and cultural relics, including people controlling cultural relics to zoom in, zoom out and other operations, and people actively learning about the relevant historical knowledge of cultural relics; at the same time, the system combines gesture recognition technology with virtual reality technology, and integrates them into a portable all-in-one machine.

[0004] With respect to the above scheme, the applicant of the present invention has found that the above technology has at least the following technical problems: 1. The above scheme does not involve how to customize according to the visual preferences, comfort or interest in cultural relics information of different users, which may result in that the interactive effect of the system may not meet the personalized needs of each user, reduce the user experience satisfaction and interactive effect, and does not mention the dynamic adjustment of parameters such as brightness, contrast and color temperature of the display screen information, resulting in the system being unable to automatically optimize the display effect under different environmental conditions, such as light changes or display device differences, thereby affecting the visual experience and the clarity of information communication.

[0005] 2. The above solution does not mention how to adjust the background and content of the AR display screen according to the cultural background of the exhibits and the user's interaction history, which may result in the background of the AR display not being consistent with the actual cultural background of the exhibits, affecting the user's understanding and interest in the exhibits. Summary of the invention

[0006] The purpose of the present invention is to provide a method and system for interactive AR experience of museum exhibits, which solves the problems existing in the background technology.

[0007] To solve the above technical problems, the present invention adopts the following technical solution: The present invention provides an interactive AR experience method for museum exhibits, including: Step 1, exhibit display adjustment: According to the cultural background information corresponding to each exhibit in the designated museum, the AR display screen background corresponding to each exhibit is analyzed.

[0008] Step 2: Display image analysis: Collect the influencing parameters of the exhibit display adjustment through the AR device, and then analyze the corresponding comprehensive display evaluation index of each visitor when wearing the AR device, so as to adjust the display image information corresponding to the AR device worn by each visitor.

[0009] Step 3: Voice broadcast analysis: Collect the voice input information corresponding to each visitor, and collect the decibels of ambient noise according to the set collection time points, and then analyze and obtain the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point, so as to adjust the voice parameters corresponding to the AR device worn by each visitor in real time.

[0010] Step 4: Text display analysis: Based on the AR images of each exhibit preset in the database, text display instructions are provided for each visitor during the interactive AR experience.

[0011] Step 5: Display prompts: When the display screen information and voice broadcast information corresponding to the AR device worn by the visitor are adjusted, a prompt is displayed.

[0012] Preferably, the AR display screen background corresponding to each exhibit is analyzed, and the specific analysis process is as follows:

[0013] The cultural background information includes the origin period and historical events of each exhibit. The AR display screen background is divided into large screen backgrounds, medium screen backgrounds and small screen backgrounds. The exhibits are divided according to the cultural background information into exhibits with the same cultural background information, exhibits with only one cultural background information in common and exhibits with no cultural background information in common, which are recorded as exhibits of the same type, exhibits with any one cultural background information in common and exhibits with no cultural background information in common, respectively.

[0014] Place various types of identical exhibits in front of the major screen backgrounds, and add the corresponding cultural background information of various types of identical exhibits in the AR display background designs of the major screen backgrounds; place any of the same exhibits in front of the medium screen backgrounds, and add the corresponding cultural background information of each of the same exhibits in the AR display background designs of the medium screen backgrounds; place different exhibits in front of the small screen backgrounds, and add the corresponding cultural background information of each different exhibit in the AR display background designs of the small screen backgrounds.

[0015] In a second aspect, the present invention provides a museum exhibit interactive AR experience system, including: an exhibit display adjustment module, which is used to analyze the AR display screen background corresponding to each exhibit according to the cultural background information corresponding to each exhibit in the designated museum.

[0016] The display screen analysis module is used to collect the influencing parameters of the exhibit display adjustment through the AR device, and then analyze the corresponding comprehensive display evaluation index of each visitor when wearing the AR device, thereby adjusting the display screen information corresponding to the AR device worn by each visitor.

[0017] The voice broadcast analysis module is used to collect the voice input information corresponding to each visitor, and collect the decibels of environmental noise according to the set collection time points, and then analyze and obtain the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point, so as to adjust the voice parameters corresponding to the AR device worn by each visitor in real time.

[0018] The text display analysis module is used to display the screen according to the preset text, so as to realize the text display for each visitor during the interactive AR experience.

[0019] The display terminal is used to display prompts when the display screen information and voice broadcast information corresponding to the AR device worn by the visitor are adjusted.

[0020] The beneficial effects of the present invention are as follows: 1. The present invention provides an interactive AR experience method and system for museum exhibits. During the exhibit display adjustment process, by incorporating the cultural background information of the exhibits into the design of the AR display screen, it can ensure that the presentation of each exhibit in virtual reality can accurately reflect its historical and cultural background, avoiding generalized display, so that users can better understand the historical background and cultural value of each exhibit, thereby enhancing the educational effect and user immersion. During the display screen analysis process, by adjusting the display screen information of the AR device in real time, it can be optimized according to the visual comfort and preferences of each visitor, which is conducive to each visitor to obtain the best visual experience in different environments, avoiding visual fatigue or discomfort caused by display discomfort, thereby improving overall user satisfaction.

[0021] 2. In the process of voice broadcast analysis, the embodiment of the present invention analyzes the environmental noise and the voice input of the visitor, and the system can dynamically adjust the speech speed and volume of the voice broadcast, so that the voice information can remain clear and audible under various environmental noise conditions, ensuring that each visitor can accurately hear and understand the voice explanation, thereby improving the effectiveness of interaction and the user experience.

[0022] 3. In the text display analysis process, the embodiment of the present invention ensures that each visitor obtains relevant detailed instructions when interacting with the exhibits by presetting the AR image of the exhibit and the corresponding text description, thereby reducing the trouble of users needing to conduct additional searches or inquiries and improving the efficiency of information acquisition. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0024] Figure 1 It is a schematic flow chart of the implementation steps of the present invention.

[0025] Figure 2 It is a schematic diagram of the system structure connection of the present invention. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] See also Figure 1 As shown, the present invention provides a method for interactive AR experience of museum exhibits, the method comprising: step 1, exhibit display adjustment: according to the cultural background information corresponding to each exhibit in the designated museum, the AR display screen background corresponding to each exhibit is analyzed.

[0028] In a specific embodiment, the analysis of the AR display screen background corresponding to each exhibit is specifically performed as follows: the cultural background information includes the origin period and historical events of each exhibit, the AR display screen background is divided into large screen backgrounds, medium screen backgrounds and small screen backgrounds, and each exhibit is divided according to the cultural background information, and is divided into exhibits with the same cultural background information, exhibits with only one item of the same cultural background information and exhibits with no identical cultural background information, which are respectively recorded as exhibits of the same type, exhibits with any one item of the same cultural background information and exhibits that are not the same in cultural background information.

[0029] Place various types of identical exhibits in front of the major screen backgrounds, and add the corresponding cultural background information of various types of identical exhibits in the AR display background designs of the major screen backgrounds; place any of the same exhibits in front of the medium screen backgrounds, and add the corresponding cultural background information of each of the same exhibits in the AR display background designs of the medium screen backgrounds; place different exhibits in front of the small screen backgrounds, and add the corresponding cultural background information of each different exhibit in the AR display background designs of the small screen backgrounds.

[0030] It should be noted that various types of identical exhibits refer to exhibits of a certain type that include the same cultural background information. Since there are multiple origin periods and historical events, the exhibits with the same origin period but different historical events are counted to obtain Class A origin period exhibits, and the exhibits with different origin periods but the same historical events are counted to obtain Class B historical event exhibits. Then, the Class A origin period exhibits and the Class B historical event exhibits are combined to obtain any identical exhibits. Different exhibits refer to exhibits that do not have the same origin period and historical event.

[0031] Step 2: Display image analysis: Collect the influencing parameters of the exhibit display adjustment through the AR device, and then analyze the corresponding comprehensive display evaluation index of each visitor when wearing the AR device, so as to adjust the display image information corresponding to the AR device worn by each visitor.

[0032] In a specific embodiment, the influencing parameters of the exhibit display adjustment are collected, and the specific collection process is as follows: the influencing parameters include the pupil diameter of each visitor, the ambient light intensity of each visitor's current location, and the color temperature of the light source.

[0033] Each AR device is equipped with a micro camera, a light intensity sensor, a color temperature meter and a positioning function. The pupils of each visitor are scanned by the micro camera to obtain the corresponding pupil diameter of each visitor. The position of each visitor is monitored in real time by the positioning function of the AR device worn by each visitor. When a change in the position corresponding to a visitor is detected, the ambient light intensity and color temperature of the light source at the visitor's current position are collected by the light intensity sensor and the color temperature meter to obtain the ambient light intensity and color temperature of the light source at the visitor's current position, and then the ambient light intensity and color temperature of the light source at the current position of each visitor are collected.

[0034] In a specific embodiment, the comprehensive display evaluation index corresponding to each visitor wearing an AR device is analyzed, and the specific analysis process is as follows: standard influence parameters corresponding to the AR device are obtained from a database, and the standard influence parameters include standard pupil diameter, standard ambient light intensity, and standard light source color temperature.

[0035] By calculating the formula , and obtain the corresponding comprehensive display evaluation index of each visitor when wearing AR equipment , Indicates the number corresponding to each visitor, , is any integer greater than 2, It is expressed as the total number of visitors, where , , Respectively expressed as The pupil diameter corresponding to each visitor, the ambient light intensity at the current location, and the color temperature of the light source corresponding to the current location. , , They are represented by standard pupil diameter, standard ambient light intensity, and standard light source color temperature. , , They are respectively the weight factor corresponding to the set pupil diameter, the weight factor corresponding to the ambient light intensity at the current location, and the weight factor corresponding to the color temperature of the light source at the current location.

[0036] It should be noted that , , The values ​​of are all greater than and less than .

[0037] It should also be noted that when setting the weight factors of pupil diameter, ambient light intensity and light source color temperature, the influence of pupil diameter, ambient light intensity and light source color temperature is first determined. The weight factor of pupil diameter is based on its direct impact on visual comfort. Large pupils usually allow more light to enter, affecting brightness perception. The weight factor of ambient light intensity takes into account the impact of light intensity on visual clarity and contrast. Strong light will lead to overexposure, and weak light will affect detail display. The weight factor of light source color temperature is based on the impact of color temperature on color performance. Cold light sources and warm light sources will affect color accuracy and visual effects. In summary, and through experimental data and expert opinions, the weight factor corresponding to pupil diameter, the weight factor corresponding to the ambient light intensity at the current location, and the weight factor corresponding to the light source color temperature at the current location are determined.

[0038] In a specific embodiment, the adjustment of the display screen information corresponding to the AR device worn by each visitor is carried out as follows: the display screen information includes brightness, contrast and color temperature, and the comprehensive display evaluation index corresponding to each visitor when wearing the AR device is compared with the set comprehensive display evaluation index intervals, and the set comprehensive display evaluation index intervals correspond to each display screen information. If the comprehensive display evaluation index corresponding to a visitor when wearing the AR device belongs to a set comprehensive display evaluation index interval, the display screen information corresponding to the AR device worn by the visitor is adjusted to the display screen information corresponding to the comprehensive display evaluation index interval, thereby adjusting the display screen information corresponding to the AR device worn by each visitor.

[0039] Step 3: Voice broadcast analysis: Collect the voice input information corresponding to each visitor, and collect the decibels of ambient noise according to the set collection time points, and then analyze and obtain the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point, so as to adjust the voice parameters corresponding to the AR device worn by each visitor in real time.

[0040] In a specific embodiment, the voice input information and ambient noise decibels corresponding to each visitor are collected. The specific collection process is as follows: the voice input information includes speech speed and sound decibels. A voice collection sensor is provided inside the AR device. When each visitor wears the AR device, the AR device broadcasts the specific sentences and the number of times that each visitor needs voice input through headphones. The number of times that voice input is needed is recorded as , when each visitor inputs voice through the microphone After hearing a specific sentence, the voice input information corresponding to each visitor is collected, and the average of the voice input information corresponding to each visitor is calculated. The result is the voice input information corresponding to each visitor. The decibel of ambient noise is collected at each collection time point by the voice collection sensor.

[0041] In a specific embodiment, the analysis obtains the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point. The specific analysis process is as follows: standard voice input information and standard environmental noise decibels corresponding to the AR device are obtained from a database, and the standard voice input information includes a standard speaking speed and a standard sound decibel.

[0042] By calculating the formula , get the voice adjustment evaluation coefficient corresponding to each visitor's AR device at each collection time point , Indicates the number corresponding to each collection time point, , is any integer greater than 2, It is expressed as the total number of acquisition time points, where , Respectively expressed as The speaking speed and decibel level of each visitor, Expressed as Visitors in The ambient noise decibel corresponding to each collection time point, , , They are respectively expressed as standard speaking speed, standard sound decibel, and standard environmental noise decibel. , , They are respectively the weight factor corresponding to the set speaking speed, the weight factor corresponding to the sound decibel, and the weight factor corresponding to the ambient noise decibel.

[0043] It should be noted that , , The values ​​of are all greater than and less than .

[0044] It should also be noted that, first of all, it is necessary to clarify the impact and importance of speech speed, sound decibels and ambient noise decibels on the visitor experience. Speech speed affects the clarity of information transmission and the visitor's understanding ability. The speech speed is usually set to a medium value so that visitors can easily understand. Therefore, the weight factor may be between 0.4 and 0.5. Sound decibels directly affect the auditory comfort of the audio. The ideal volume is between 65 and 75 decibels. The weight factor can be set to 0.3 to ensure that the volume can attract attention without causing auditory fatigue. The weight factor of ambient noise reflects the degree of interference with visitors' reception of information. To ensure effective auditory communication, ambient noise should be kept below 50 decibels. The set weight factor can be 0.2, thereby completing the setting of the weight factor corresponding to speech speed, the weight factor corresponding to sound decibels, and the weight factor corresponding to ambient noise decibels.

[0045] In a specific embodiment, the real-time adjustment of the voice parameters corresponding to the AR device worn by each visitor is carried out as follows: the voice parameters include the speaking speed and volume of the voice broadcast, and the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point is compared with the set voice adjustment evaluation coefficient intervals, and the set voice adjustment evaluation coefficient intervals correspond to the voice parameter setting values. If the voice adjustment evaluation coefficient corresponding to the AR device worn by a visitor at a certain collection time point belongs to a set voice adjustment evaluation coefficient interval, then the voice parameter corresponding to the AR device worn by the visitor at the collection time point is adjusted to the voice parameter setting value corresponding to the voice adjustment evaluation coefficient interval, so as to adjust the voice parameters corresponding to the AR devices worn by each visitor in real time.

[0046] During the voice broadcast analysis process of the embodiment of the present invention, by analyzing the environmental noise and the visitor's voice input, the system can dynamically adjust the speech speed and volume of the voice broadcast, so that the voice information can remain clear and audible under various environmental noise conditions, ensuring that each visitor can accurately hear and understand the voice explanation, thereby improving the effectiveness of interaction and the user experience.

[0047] Step 4: Text display analysis: Based on the AR images of each exhibit preset in the database, text display instructions are provided for each visitor during the interactive AR experience.

[0048] In a specific embodiment, the text display instructions for each visitor during the interactive AR experience are implemented as follows: when a visitor browses an exhibit AR image through an AR device he / she is wearing, when the visitor stays on the exhibit AR image for more than a preset browsing time, the AR device collects the currently displayed exhibit AR image, compares the currently displayed exhibit AR image with preset exhibit AR images, and the preset exhibit AR images correspond to each text display instruction; if the currently displayed exhibit AR image is the same as a preset exhibit AR image, the text display instruction corresponding to the preset exhibit AR image is displayed in the blank space of the exhibit AR image where the visitor stays, thereby implementing the text display instructions for each visitor during the interactive AR experience.

[0049] It should be noted that "comparing the currently displayed AR image of the exhibit with the preset AR images of each exhibit" involves image processing, computer vision, pattern recognition and other technologies, and the "text display description" includes the name, age, historical background, and cultural significance of each exhibit, and the text display description is in the format of a floating label. A click button is set on the floating label, which supports clicking to jump to display more text.

[0050] In the text display analysis process, the embodiment of the present invention ensures that each visitor obtains relevant detailed instructions when interacting with the exhibits by presetting the exhibit AR image and the corresponding text description, thereby reducing the trouble of users needing to conduct additional searches or inquiries and improving the efficiency of information acquisition.

[0051] Step 5: Display prompts: When the display screen information and voice parameter adjustments corresponding to the AR device worn by the visitor are completed, a prompt is displayed.

[0052] See also Figure 2 As shown, a museum exhibit interactive AR experience system includes the following modules: an exhibit display adjustment module, a display screen analysis module, a voice broadcast analysis module, a text display analysis module, a display terminal and a database.

[0053] The exhibit display adjustment module is connected to the display picture analysis module, the display picture analysis module is respectively connected to the voice broadcast analysis module, the display terminal and the database, the voice broadcast analysis module is respectively connected to the text display analysis module, the display terminal and the database, and the text display analysis module is respectively connected to the display terminal and the database.

[0054] The exhibit display adjustment module is used to analyze the AR display screen background corresponding to each exhibit according to the cultural background information corresponding to each exhibit in the designated museum.

[0055] The display screen analysis module is used to collect the influencing parameters of the exhibit display adjustment through the AR device, and then analyze the corresponding comprehensive display evaluation index of each visitor when wearing the AR device, thereby adjusting the display screen information corresponding to the AR device worn by each visitor.

[0056] The voice broadcast analysis module is used to collect the voice input information corresponding to each visitor, and collect the decibels of environmental noise according to the set collection time points, and then analyze and obtain the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point, so as to adjust the voice parameters corresponding to the AR device worn by each visitor in real time.

[0057] The text display analysis module is used to display the screen according to the preset text, so as to realize the text display for each visitor during the interactive AR experience.

[0058] The display terminal is used to display prompts when the display screen information and voice broadcast information corresponding to the AR device worn by the visitor are adjusted.

[0059] Database, users store preset AR images of exhibits, standard pupil diameter, standard ambient light intensity and standard light source color temperature corresponding to AR devices, obtain standard voice input information and standard ambient noise decibels corresponding to AR devices, and standard voice input information includes standard speaking speed and standard sound decibels.

[0060] It should be noted that the above-mentioned data is stored in a database and indexed for storage, and the stored parameters can be directly obtained by querying the index.

[0061] The present invention provides an interactive AR experience method and system for museum exhibits. During the exhibit display adjustment process, by incorporating the cultural background information of the exhibits into the design of the AR display screen, it can ensure that the presentation of each exhibit in virtual reality can accurately reflect its historical and cultural background, avoid generalized display, and enable users to better understand the historical background and cultural value of each exhibit, thereby enhancing the educational effect and user immersion. During the display screen analysis process, by adjusting the display screen information of the AR device in real time, it can be optimized according to the visual comfort and preferences of each visitor, which is conducive to each visitor to obtain the best visual experience in different environments, avoiding visual fatigue or discomfort caused by display discomfort, thereby improving overall user satisfaction.

[0062] The above contents are merely examples and explanations of the concept of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the concept of the invention or exceed the scope defined in this specification, they shall all fall within the protection scope of the present invention.

Claims

1. A method for interactive AR experience of museum exhibits, characterized in that: include: Step 1: Exhibit display adjustment: According to the cultural background information corresponding to each exhibit in the designated museum, the AR display screen background corresponding to each exhibit is analyzed; The specific analysis process of analyzing the AR display screen background corresponding to each exhibit is as follows: The cultural background information includes the origin period and historical events of each exhibit. The AR display screen background is divided into large screen backgrounds, medium screen backgrounds and small screen backgrounds. The exhibits are divided according to the cultural background information into exhibits with the same cultural background information, exhibits with only one cultural background information in common and exhibits with no cultural background information in common, which are recorded as exhibits of the same type, exhibits with any one cultural background information in common and exhibits with no cultural background information in common, respectively. Place various types of identical exhibits in front of the major screen backgrounds, and add the corresponding cultural background information of various types of identical exhibits in the AR display screen background design of the major screen backgrounds; place any of the same exhibits in front of the medium screen backgrounds, and add the corresponding cultural background information of any of the same exhibits in the AR display screen background design of the medium screen backgrounds; place different exhibits in front of the small screen backgrounds, and add the corresponding cultural background information of each different exhibit in the AR display screen background design of the small screen backgrounds; Step 2: Display screen analysis: Collect the influencing parameters of the exhibit display adjustment through the AR device, and then analyze the comprehensive display evaluation index corresponding to each visitor when wearing the AR device, so as to adjust the display screen information corresponding to the AR device worn by each visitor; The specific collection process of the parameters influencing the adjustment of the exhibit display is as follows: The influencing parameters include the pupil diameter of each visitor, the ambient light intensity at each visitor’s current location, and the color temperature of the light source; Each AR device is equipped with a micro camera, a light intensity sensor, a color temperature meter and a positioning function. The pupils of each visitor are scanned by the micro camera to obtain the pupil diameter of each visitor. The position of each visitor is monitored in real time by the positioning function of the AR device worn by each visitor. When a change in the position corresponding to a visitor is detected, the ambient light intensity and the color temperature of the light source at the current position of the visitor are collected by the light intensity sensor and the color temperature meter to obtain the ambient light intensity and the color temperature of the light source at the current position of the visitor, and then the ambient light intensity and the color temperature of the light source at the current position of each visitor are collected; The analysis of the comprehensive display evaluation index corresponding to each visitor wearing the AR device is as follows: Obtain standard impact parameters corresponding to the AR device from the database, where the standard impact parameters include standard pupil diameter, standard ambient light intensity, and standard light source color temperature; By calculating the formula , and obtain the corresponding comprehensive display evaluation index of each visitor when wearing AR equipment , Indicates the number corresponding to each visitor, , is any integer greater than 2, It is expressed as the total number of visitors, where , , Respectively expressed as The pupil diameter corresponding to each visitor, the ambient light intensity at the current location, and the color temperature of the light source corresponding to the current location. , , They are represented by standard pupil diameter, standard ambient light intensity, and standard light source color temperature. , , They are respectively the weight factor corresponding to the set pupil diameter, the weight factor corresponding to the ambient light intensity at the current location, and the weight factor corresponding to the color temperature of the light source at the current location; The specific adjustment process of adjusting the display screen information corresponding to the AR device worn by each visitor is as follows: The display screen information includes brightness, contrast and color temperature. The comprehensive display evaluation index corresponding to each visitor when wearing the AR device is compared with each set comprehensive display evaluation index interval. Each set comprehensive display evaluation index interval corresponds to each display screen information. If the comprehensive display evaluation index corresponding to a visitor when wearing the AR device belongs to a set comprehensive display evaluation index interval, the display screen information corresponding to the AR device worn by the visitor is adjusted to the display screen information corresponding to the comprehensive display evaluation index interval, thereby adjusting the display screen information corresponding to the AR device worn by each visitor; Step 3: Voice broadcast analysis: collect the voice input information corresponding to each visitor, and collect the decibel of environmental noise according to the set collection time points, and then analyze and obtain the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point, so as to adjust the voice parameters corresponding to the AR device worn by each visitor in real time; Step 4: Text display analysis: Based on the AR images of each exhibit preset in the database, the text display instructions for each visitor during the interactive AR experience are realized; Step 5: Display prompts: When the display screen information and voice parameter adjustments corresponding to the AR device worn by the visitor are completed, a prompt is displayed.

2. The method for interactive AR experience of museum exhibits according to claim 1, characterized in that: The specific collection process of collecting the voice input information and ambient noise decibels corresponding to each visitor is as follows: Voice input information includes speech speed and sound decibels. A voice collection sensor is set inside the AR device. When each visitor wears the AR device, the AR device broadcasts the specific sentences and the number of times that each visitor needs voice input through the earphone. The number of times that voice input is needed is recorded as , when each visitor inputs voice through the microphone After hearing a specific sentence, the voice input information corresponding to each visitor is collected, and the average of the voice input information corresponding to each visitor is calculated. The result is the voice input information corresponding to each visitor. The decibel of ambient noise is collected at each collection time point by the voice collection sensor.

3. The method for interactive AR experience of museum exhibits according to claim 2, characterized in that: The analysis obtains the voice adjustment evaluation coefficient corresponding to each visitor's AR device at each acquisition time point. The specific analysis process is as follows: Obtain standard voice input information and standard ambient noise decibels corresponding to the AR device from the database, where the standard voice input information includes a standard speaking speed and a standard sound decibel; By calculating the formula , get the voice adjustment evaluation coefficient corresponding to each visitor's AR device at each collection time point , Indicates the number corresponding to each collection time point, , is any integer greater than 2, It is expressed as the total number of acquisition time points, where , Respectively expressed as The speaking speed and decibel level of each visitor, Expressed as Visitors in The ambient noise decibel corresponding to each collection time point, , , They are respectively expressed as standard speaking speed, standard sound decibel, and standard environmental noise decibel. , , They are respectively the weight factor corresponding to the set speaking speed, the weight factor corresponding to the sound decibel, and the weight factor corresponding to the ambient noise decibel.

4. The method for interactive AR experience of museum exhibits according to claim 3, characterized in that: The real-time adjustment of the voice parameters corresponding to the AR devices worn by each visitor is as follows: The voice parameters include the speed and volume of the voice broadcast. The voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point is compared with the set voice adjustment evaluation coefficient intervals. The set voice adjustment evaluation coefficient intervals correspond to the voice parameter setting values. If the voice adjustment evaluation coefficient corresponding to the AR device worn by a visitor at a certain collection time point belongs to a set voice adjustment evaluation coefficient interval, the voice parameter corresponding to the AR device worn by the visitor at the collection time point is adjusted to the voice parameter setting value corresponding to the voice adjustment evaluation coefficient interval, so as to adjust the voice parameters corresponding to the AR devices worn by each visitor in real time.

5. The method for interactive AR experience of museum exhibits according to claim 4, characterized in that: The specific implementation process of realizing the text display instructions for each visitor during the interactive AR experience is as follows: When a visitor browses an AR image of an exhibit through an AR device he is wearing, when the time the visitor stays on the AR image of the exhibit exceeds the preset browsing time, the AR device collects the currently displayed AR image of the exhibit, and compares the currently displayed AR image of the exhibit with the preset AR images of each exhibit. The preset AR images of each exhibit correspond to each text display description. If the currently displayed AR image of the exhibit is the same as a preset AR image of an exhibit, the text display description corresponding to the preset AR image of the exhibit is displayed in the blank space of the AR image of the exhibit where the visitor stays, thereby realizing the text display description of each visitor during the interactive AR experience process.

6. A museum exhibit interactive AR experience system for executing the museum exhibit interactive AR experience method according to any one of claims 1 to 5, characterized in that: Includes the following modules: The exhibit display adjustment module is used to analyze the AR display screen background corresponding to each exhibit in the designated museum according to the cultural background information corresponding to each exhibit; The display screen analysis module is used to collect the influencing parameters of the exhibit display adjustment through the AR device, and then analyze the comprehensive display evaluation index corresponding to each visitor when wearing the AR device, thereby adjusting the display screen information corresponding to the AR device worn by each visitor; The voice broadcast analysis module is used to collect the voice input information corresponding to each visitor, and collect the decibel of environmental noise according to the set collection time points, and then analyze and obtain the voice adjustment evaluation coefficient corresponding to the AR device worn by each visitor at each collection time point, so as to adjust the voice parameters corresponding to the AR device worn by each visitor in real time; The text display analysis module is used to display the screen according to the preset text, so as to realize the text display of each visitor during the interactive AR experience; The display terminal is used to display prompts when the display screen information and voice broadcast information corresponding to the AR device worn by the visitor are adjusted.

Citation Information

Patent Citations

  • Virtual reality-based cultural relic interaction system and operation method

    CN106886285A

  • Systems and methods for predictively downloading volumetric data

    US11659043B1

  • KR20190045012A

Cited By

  • Virtual-real combined interactive touring method and system for digital museum

    CN121786283A