Display interaction method and system for intelligent AI interactive exhibition hall

Abstract

The invention belongs to the technical field of exhibition hall display and intelligent interaction, and discloses a display interaction method and system for an intelligent AI interactive exhibition hall, and the method comprises the steps: obtaining the identity information of an entrance visitor, completing the lightweight authentication, and adapting to an interaction device corresponding to the visitor. According to the method, the visitor experience accurately meets the requirements of different crowds, and the situation that professional audiences feel too shallow content and ordinary tourists feel too complex cannot occur, for example, when spaceflight enthusiasts carry out exhibition, a screen can automatically push expansion experiment videos of spacecrafts of the same series; parents with dolls do not need to manually switch modes, and the interaction device can directly start'parent-child cooperation breakthrough '; the visitors of the elderly visitors can automatically enlarge the fonts and slow down the speech without additionally asking for help of workers; the system can capture audience preferences in real time without depending on manual questionnaire statistics, for example, if the retention rate of a certain exhibit is insufficient for continuous three days, the system can automatically adjust the exhibit document firstly, and if the exhibit document is still not improved, an operator can receive a prompt and adjust the exhibit to a more conspicuous position in time; meanwhile, the stadium does not need to frequently update the content on a large scale, the content can change along with the preferences of audiences through dynamic adjustment of the system, the operation cost can be greatly reduced, and actual application and operation are facilitated.

Description

Technical Field

[0001] This invention relates to the field of exhibition hall display and intelligent interactive technology, and in particular to a display and interaction method and system for an intelligent AI interactive exhibition hall. Background Technology

[0002] The current traditional exhibition halls' exhibit explanations and display formats (such as fixed text and uniform videos) are "one-size-fits-all"—families with children need engaging and story-based content, but can only receive explanations dense with technical jargon; architecture professionals need the structural parameters of the exhibits, but can only see basic introductions, resulting in a low match between the experiences of visitors with different needs; the interactive devices in existing exhibition halls are mostly fixed in mode (such as uniform touch screen operation and fixed-speed guided tours), which elderly visitors often cannot use due to small fonts and complicated operation, while young visitors are unwilling to participate due to monotonous content, and the equipment is not well adapted to the usage habits of different groups of people. Summary of the Invention

[0003] One of the objectives of this invention is to provide a display and interaction method and system for an intelligent AI interactive exhibition hall.

[0004] To achieve the above objectives, the technical solution adopted by this invention is: a display and interaction method and system for an intelligent AI interactive exhibition hall, comprising the following steps:

[0005] S1: Obtain the identity information of the visitors and complete lightweight authentication, while adapting the interactive device corresponding to the visitors;

[0006] S2: Collect multimodal perception information on the visitor's status within the exhibition hall;

[0007] S3: Real-time data fusion processing of the collected multimodal sensing information is performed through the edge computing unit;

[0008] S4: Perform context analysis based on the fused information and construct a feature model of the visitor;

[0009] S5: Based on the context analysis results and visitor characteristic model, the content generation unit generates personalized display content in real time;

[0010] S6: The interactive execution unit performs adaptive interactive operations based on the personalized display content;

[0011] S7: The visitor completes an immersive interactive experience based on the adaptive interactive operation;

[0012] S8: Collect feedback data from visitors during the interactive experience;

[0013] S9: Anonymize the feedback data;

[0014] S10: Iteratively optimize the content generation unit and feature model based on the feedback data after anonymization;

[0015] S11: After the visitor leaves, generate an experience report based on the interactive experience data, and optimize the exhibition hall operation parameters based on the report.

[0016] Preferably, the global multimodal perception information in S2 includes at least one of visual perception information, auditory perception information, and behavioral operation information.

[0017] Preferably, the processing of the edge computing unit in S3 includes data denoising, data association matching, and multi-source information integration.

[0018] Preferably, the dimensions of the personalized display content in S5 include at least one of the following: the depth of the displayed information, the type of display format, and the interaction rhythm.

[0019] Preferably, it includes an identity authentication and device adaptation module, a global perception and acquisition module, an edge computing fusion module, an environment analysis and feature modeling module, a content generation module, an adaptive interaction execution module, a feedback data acquisition module, a data anonymization processing module, an iterative optimization module, and a reporting and operation optimization module;

[0020] The identity authentication and device adaptation module is used to obtain the identity information of the visitors and complete lightweight authentication, while adapting to the interactive device corresponding to the visitors.

[0021] The full-domain perception and acquisition module is used to collect full-domain multimodal perception information on the visitor's status within the exhibition hall;

[0022] The edge computing fusion module is used to perform real-time data fusion processing on the collected multimodal sensing information through the edge computing unit;

[0023] The context analysis and feature modeling module is used to perform context analysis based on the fused information and to construct the feature model of the visitor.

[0024] The content generation module is used to generate personalized display content in real time based on the context analysis results and visitor characteristic model.

[0025] The adaptive interaction execution module is used to perform adaptive interaction operations based on the personalized display content;

[0026] The feedback data collection module is used to collect feedback data from visitors during the interactive experience.

[0027] The data anonymization processing module is used to anonymize the feedback data;

[0028] The iterative optimization module is used to iteratively optimize the content generation module and the feature model based on the feedback data after anonymization.

[0029] The reporting and operation optimization module is used to generate an experience report based on the interactive experience data after the visitor leaves, and to optimize the exhibition hall operation parameters based on the report.

[0030] Preferably, the global perception acquisition module includes at least one of a visual acquisition unit, an auditory acquisition unit, and a behavior acquisition unit.

[0031] Preferably, the data anonymization processing module processes data by removing identity information and blurring feature data.

[0032] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0033] (1) With this invention, the visitor experience is precisely tailored to the needs of different groups of people, and there will be no situation where "professional visitors find the content too shallow and ordinary visitors find it too complicated". For example, when aerospace enthusiasts visit the exhibition, the screen will automatically push extended experimental videos of the same series of spacecraft; parents with children do not need to manually switch modes, and the interactive device will directly start "parent-child collaborative challenge"; the guide for elderly visitors will automatically increase the font size and slow down the speech speed, without the need for additional assistance from staff; cost reduction and efficiency improvement, the content "becomes more and more palatable" without relying on manual surveys, the system can capture audience preferences in real time: for example, if it is found that the dwell rate of a certain exhibit is insufficient for three consecutive days, the system will first automatically adjust its display text. If there is still no improvement, the operators will be reminded and the exhibit will be moved to a more prominent position in time; at the same time, the venue does not need to frequently update the content on a large scale, the content can be "changed with audience preferences" by dynamically adjusting the system, and the operating cost can be reduced significantly.

[0034] (2) In this invention, all collected information will be "stripped of personal identification". For example, the system only knows that "a visitor likes ceramic exhibits", but will not know the visitor's name or where he lives. This not only protects the privacy and security of visitors, but also allows the system to continuously optimize the experience based on this anonymous data. There is no delay or lag, and the pace is "keeping up" because the data is processed locally in the exhibition hall. There is no need to wait for the remote server to respond. For example, if a visitor stays in front of a painting for more than ten seconds, the interactive screen next to it will immediately pop up a small animation of the painting's creation process. As soon as a mechanical exhibit's control lever is touched, the device will start to simulate operation simultaneously, and there will be no situation where "the button is pressed and there is no response for a long time". It covers more exhibition scenarios. Whether it is a professional visiting the exhibition alone, a family with children, a group of students, or an elderly visitor who moves a little slower, the system can automatically match the corresponding display method without manually distinguishing the groups. Attached Figure Description

[0035] Figure 1 This is a schematic diagram of the overall process of the present invention. Detailed Implementation

[0036] The present invention will now be further described in conjunction with specific embodiments. It should be noted that, without conflict, the various embodiments or technical features described below can be arbitrarily combined to form new embodiments.

[0037] In the description of this invention, it should be noted that directional terms such as "center," "lateral," "longitudinal," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," and "counterclockwise" indicate the orientation and positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. They should not be construed as limiting the specific protection scope of this invention.

[0038] It should be noted that the terms "first" and "second" in the specification and claims of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0039] One preferred embodiment of the present invention, such as Figure 1 As shown, a display and interaction method and system for an intelligent AI interactive exhibition hall includes the following steps:

[0040] S1: Obtain the identity information of the visitors and complete lightweight authentication, while adapting the interactive device corresponding to the visitors;

[0041] S2: Collect multimodal perception information on the visitor's status within the exhibition hall;

[0042] S3: Real-time data fusion processing of the collected multimodal sensing information is performed through the edge computing unit;

[0043] S4: Perform context analysis based on the fused information and construct a feature model of the visitor;

[0044] S5: Based on the context analysis results and visitor characteristic model, the content generation unit generates personalized display content in real time;

[0045] S6: The interactive execution unit performs adaptive interactive operations based on the personalized display content;

[0046] S7: The visitor completes an immersive interactive experience based on the adaptive interactive operation;

[0047] S8: Collect feedback data from visitors during the interactive experience;

[0048] S9: Anonymize the feedback data;

[0049] S10: Iteratively optimize the content generation unit and feature model based on the feedback data after anonymization;

[0050] S11: After the visitor leaves, generate an experience report based on the interactive experience data, and optimize the exhibition hall operation parameters based on the report.

[0051] The global multimodal perception information in S2 includes at least one of visual perception information, auditory perception information, and behavioral operation information.

[0052] The processing of the edge computing unit in S3 includes data denoising, data association matching, and multi-source information integration.

[0053] The dimensions of personalized content display in S5 include at least one of the following: the depth of displayed information, the type of display format, and the interaction rhythm.

[0054] It includes modules for identity authentication and device adaptation, global perception and data acquisition, edge computing fusion, environmental analysis and feature modeling, content generation, adaptive interaction execution, feedback data acquisition, data anonymization, iterative optimization, and reporting and operational optimization.

[0055] The identity authentication and device adaptation module is used to obtain the identity information of the visitors and complete lightweight authentication, while adapting to the interactive device corresponding to the visitors.

[0056] The full-domain perception and acquisition module is used to collect full-domain multimodal perception information on the visitor's status within the exhibition hall;

[0057] The edge computing fusion module is used to perform real-time data fusion processing on the collected multimodal sensing information through the edge computing unit;

[0058] The context analysis and feature modeling module is used to perform context analysis based on the fused information and to construct the feature model of the visitor.

[0059] The content generation module is used to generate personalized display content in real time based on the context analysis results and visitor characteristic model.

[0060] The adaptive interaction execution module is used to perform adaptive interaction operations based on the personalized display content;

[0061] The feedback data collection module is used to collect feedback data from visitors during the interactive experience.

[0062] The data anonymization processing module is used to anonymize the feedback data;

[0063] The iterative optimization module is used to iteratively optimize the content generation module and the feature model based on the feedback data after anonymization.

[0064] The reporting and operation optimization module is used to generate an experience report based on the interactive experience data after the visitor leaves, and to optimize the exhibition hall operation parameters based on the report.

[0065] The global perception acquisition module includes at least one of a visual acquisition unit, an auditory acquisition unit, and a behavior acquisition unit.

[0066] The data anonymization processing module processes data by removing identity information and blurring feature data.

[0067] Working principle:

[0068] When in use, visitors scan a reservation code upon arrival to complete quick identity verification. The system automatically matches the corresponding interactive devices, such as portable tablets with animated explanations for families with children, touchscreens for architecture professionals to view structural parameters of exhibits, and audio guides with enlarged fonts for elderly visitors. While visitors are browsing the exhibition, smart cameras in the venue capture the duration of their stay in front of exhibits and their movements of approaching or moving away. Touch sensors next to exhibits record the number of times visitors click interactive buttons. The sonic device can also pick up keywords from visitors' discussions of exhibits with their companions, and this information is simultaneously transmitted to the venue's local computing devices. This scattered information does not need to be transmitted to a remote server; the computing unit in the venue integrates it on the spot, for example, combining "staying for five minutes + clicking the interactive button three times". The system combines the information "materials" and other relevant data to instantly remove noise and perform correlation matching. Based on the integrated information, the system determines the visitor's current state: if the visitor frowns and approaches the exhibit, it determines that "a more accessible explanation is needed"; if the visitor quickly scrolls past a section without touching the interactive button, it determines that "they have low interest in this type of content"; it also records the visitor's preferences, such as "focusing on material details" and "liking interactive operations"; based on these judgments, the system generates appropriate content on the spot. For example, for visitors who are interested in "materials," the screen automatically displays an analysis of the exhibit's material and craftsmanship; for students who like interaction, an interactive mini-game of "simulating the assembly of the exhibit" is immediately launched; for elderly visitors with a slower pace, the system automatically slows down the explanation speed and adds historical stories about the exhibit.

[0069] Interactive devices will respond synchronously to the following: the guide screen automatically switches to the corresponding analysis page, the interactive station pops up an operation button for the "assembly game", and the audio guide starts playing a slow-paced story version explanation, allowing visitors to immerse themselves in the exhibition by following the adapted content without manual adjustment; during the interaction, the system will record visitor feedback, such as "played the assembly game twice", "skipped a certain technical explanation", "lingered to take photos in front of a certain exhibit", and this data will immediately remove personal identifiers such as name and reservation phone number, retaining only anonymous information such as "visitor + preferred interactive games + skipped technical content"; this anonymous data will be used to update the system's content logic, for example, if ten visitors skip a certain explanation, the system will automatically shorten the duration of that content; after the visitors leave, the system will generate an experience report, and the operators can directly see "the percentage of parent-child visitors on weekends" and "the low interaction rate of a certain exhibit", and then adjust the number of parent-child installations in the exhibition area and optimize the display copy of the exhibit.

[0070] The basic principles, main features, and advantages of this invention have been described above. Those skilled in the art should understand that this invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely principles of the invention. Various changes and modifications can be made without departing from the spirit and scope of the invention, and all such changes and modifications fall within the scope of the invention as claimed. The scope of protection claimed by this invention is defined by the appended claims and their equivalents.

Claims

1. A display interaction method of an intelligent AI interactive exhibition hall, characterized in that, Includes the following steps: S1: Obtain the identity information of the visitors and complete lightweight authentication, while adapting the interactive device corresponding to the visitors; S2: Collect multimodal perception information on the visitor's status within the exhibition hall; S3: Real-time data fusion processing of the collected multimodal sensing information is performed through the edge computing unit; S4: Perform context analysis based on the fused information and construct a feature model of the visitor; S5: Based on the context analysis results and visitor characteristic model, the content generation unit generates personalized display content in real time; S6: The interactive execution unit performs adaptive interactive operations based on the personalized display content; S7: The visitor completes an immersive interactive experience based on the adaptive interactive operation; S8: Collect feedback data from visitors during the interactive experience; S9: Anonymize the feedback data; S10: Iteratively optimize the content generation unit and feature model based on the feedback data after anonymization; S11: After the visitor leaves, generate an experience report based on the interactive experience data, and optimize the exhibition hall operation parameters based on the report.

2. The display and interaction method of an intelligent AI interactive exhibition hall as described in claim 1, characterized in that: The global multimodal perception information in S2 includes at least one of visual perception information, auditory perception information, and behavioral operation information.

3. The display and interaction method of an intelligent AI interactive exhibition hall as described in claim 1, characterized in that: The processing of the edge computing unit in S3 includes data denoising, data association matching, and multi-source information integration.

4. The display and interaction method of an intelligent AI interactive exhibition hall as described in claim 1, characterized in that: The dimensions of personalized content display in S5 include at least one of the following: the depth of displayed information, the type of display format, and the interaction rhythm.

5. A display and interactive system for an intelligent interactive exhibition hall that implements the method of any one of claims 1-4, characterized in that: It includes modules for identity authentication and device adaptation, global perception and data acquisition, edge computing fusion, environmental analysis and feature modeling, content generation, adaptive interaction execution, feedback data acquisition, data anonymization, iterative optimization, and reporting and operational optimization. The identity authentication and device adaptation module is used to obtain the identity information of the visitors and complete lightweight authentication, while adapting to the interactive device corresponding to the visitors. The full-domain perception and acquisition module is used to collect full-domain multimodal perception information on the visitor's status within the exhibition hall; The edge computing fusion module is used to perform real-time data fusion processing on the collected multimodal sensing information through the edge computing unit; The context analysis and feature modeling module is used to perform context analysis based on the fused information and to construct the feature model of the visitor. The content generation module is used to generate personalized display content in real time based on the context analysis results and visitor characteristic model. The adaptive interaction execution module is used to perform adaptive interaction operations based on the personalized display content; The feedback data collection module is used to collect feedback data from visitors during the interactive experience. The data anonymization processing module is used to anonymize the feedback data; The iterative optimization module is used to iteratively optimize the content generation module and the feature model based on the feedback data after anonymization. The reporting and operation optimization module is used to generate an experience report based on the interactive experience data after the visitor leaves, and to optimize the exhibition hall operation parameters based on the report.

6. The system according to claim 5, characterized in that: The global perception acquisition module includes at least one of a visual acquisition unit, an auditory acquisition unit, and a behavior acquisition unit.

7. The system according to claim 5, characterized in that: The data anonymization processing module processes data by removing identity information and blurring feature data.

Images