Art exhibition intelligent interaction management method combined with virtual reality

Abstract

The invention provides an art exhibition intelligent interaction management method combined with virtual reality, and relates to the technical field of exhibition management, and the method comprises the steps: obtaining global scanning information of a target exhibition hall, carrying out the global division based on interaction characteristics, determining exhibition hall partitions, constructing a logic array for an interaction mode, and supervising a training scene interaction module. A scene interaction unit in the scene interaction module is configured in an exhibition hall partition, and user interaction information capture and exhibition response based on the scene interaction unit are carried out by sensing the exhibition viewing position of a user according to a partition interaction mode; the method and device are used for solving the technical problems that in the prior art, due to the lack of accurate user behavior data analysis and multi-scene and multi-mode adaptive capacity, the response of exhibition interaction is not accurate enough, different exhibition requirements cannot be flexibly met, and the individuation degree is insufficient. And a plurality of interaction modes and response modes are combined, so that richer and immersive interaction experience is provided for audiences.

Description

Technical Field

[0001] The present invention relates to the technical field of exhibition management, and in particular to an intelligent interactive management method for art exhibitions combined with virtual reality. Background Art

[0002] In traditional art exhibitions, the audience's interactive methods are relatively simple, usually presented in a static display form, and the interaction between the audience and the exhibits is limited, making it difficult to provide a personalized immersive experience. With the development of virtual reality (VR), augmented reality (AR) and mixed reality (MR) technologies, more and more art exhibitions are beginning to try to incorporate these advanced technologies to achieve a more vivid and interactive exhibition effect. However, the existing virtual reality art exhibition system still faces many technical problems.

[0003] At present, most of the existing interactive management methods rely on simple touch or single motion recognition, and have poor adaptive dynamic adjustment capabilities for exhibition content. In addition, the behavioral response to user interaction is relatively simple, and it is impossible to provide a diversified interactive experience based on the different characteristics of the exhibits. In particular, cultural exhibition halls such as Peking Opera are not only exhibitions of exhibits, but also the perception of cultural connotations, which puts higher requirements on interaction.

[0004] Therefore, existing technologies have certain limitations in the interactive management of exhibition halls. They mostly rely on a single sensor device for interaction, lack accurate user behavior data analysis and multi-scenario and multi-mode adaptability, resulting in inaccurate responses to exhibition interactions, and inability to flexibly respond to different exhibition needs. The lack of personalization affects the user's sense of immersion and the interactive effect of the exhibition. Summary of the invention

[0005] The present application provides an intelligent interactive management method for art exhibitions combined with virtual reality, which is used to solve the technical problems existing in the prior art, such as the lack of accurate user behavior data analysis and multi-scenario and multi-mode adaptability, resulting in inaccurate responses to exhibition interactions, inability to flexibly respond to different exhibition needs, and insufficient personalization.

[0006] In view of the above problems, the present application provides an intelligent interactive management method for art exhibitions combined with virtual reality.

[0007] The present application provides an intelligent interactive management method for art exhibitions combined with virtual reality, the method comprising: obtaining global scanning information of a target exhibition hall, performing global division based on interactive characteristics, and determining exhibition hall partitions, wherein each exhibition hall partition corresponds to an interactive mode; constructing a logical array for the interactive mode, wherein the logical array has interactive trigger elements as array rows and interactive response modes as array arrays, and the interactive trigger types of the interactive mode include physical trigger types and perception trigger types; based on the logical array, supervising the training of a scene interaction module, wherein the scene interaction module includes N scene interaction units corresponding to the exhibition hall partitions; configuring the scene interaction units in the scene interaction module in the exhibition hall partitions, and capturing user interaction information and performing exhibition responses based on the scene interaction units according to the partition interaction mode by sensing the user's exhibition viewing position, wherein each scene interaction unit independently performs exhibition hall partition management.

[0008] One or more technical solutions provided in this application have at least the following technical effects or advantages:

[0009] The embodiment of the present application provides an intelligent interactive management method for art exhibitions combined with virtual reality, which obtains global scanning information of a target exhibition hall, divides the global area based on interactive characteristics, determines exhibition hall partitions, and each exhibition hall partition corresponds to an interactive mode; for the interactive mode, a logical array is constructed, with interactive trigger elements as array rows and interactive response modes as array arrays, and the interactive trigger types of the interactive mode include physical trigger types and perception trigger types; based on the logical array, a scene interaction module is supervised and trained, wherein the scene interaction module includes N scene interaction units corresponding to the exhibition hall partitions; the scene interaction units in the scene interaction module are configured in the exhibition hall partitions, and user interaction information is captured and exhibition responses are based on the scene interaction units by sensing the user's exhibition viewing position according to the partition interaction mode, so as to solve the technical problems existing in the prior art of lacking accurate user behavior data analysis and multi-scenario and multi-mode adaptability, resulting in insufficiently accurate exhibition interaction responses, inability to flexibly respond to different exhibition needs, and insufficient personalization, and providing audiences with a richer and more immersive interactive experience through accurate user behavior capture and partition management, combined with a variety of interaction modes and response methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A flow chart of an intelligent interactive management method for art exhibitions combined with virtual reality is provided for this application;

[0011] Figure 2 The present application provides a schematic diagram of the exhibition management process of the first interactive mode in the intelligent interactive management method for art exhibitions combined with virtual reality. DETAILED DESCRIPTION

[0012] The present application provides an intelligent interactive management method for art exhibitions combined with virtual reality, obtains global scanning information of a target exhibition hall, divides the entire area based on interactive characteristics, determines exhibition hall partitions, constructs a logical array for interactive modes, and supervises the training of scene interaction modules. Scene interaction units in the scene interaction modules are configured in exhibition hall partitions, and user interaction information is captured and exhibition responses are based on the scene interaction units by sensing the user's exhibition viewing position and according to the partition interaction mode. The application is used to solve the technical problems existing in the prior art of lack of accurate user behavior data analysis and multi-scenario and multi-mode adaptability, resulting in insufficiently accurate exhibition interaction responses, inability to flexibly respond to different exhibition needs, and insufficient personalization.

[0013] Example: Figure 1 As shown, the present application provides an intelligent interactive management method for art exhibitions combined with virtual reality, the method comprising:

[0014] S1: Obtain the full-area scanning information of the target exhibition hall, divide the entire area based on the interactive characteristics, and determine the exhibition hall partitions, where each exhibition hall partition corresponds to an interactive mode.

[0015] In the embodiment of the present application, the global scanning information of the target exhibition hall is first obtained. Specifically, by using advanced scanning technology, such as computer vision and other methods, the entire exhibition hall space is scanned in the entire space to obtain information such as its spatial structure, exhibit layout, and display method. The global scanning information provides comprehensive environmental data support for the intelligent management of the exhibition hall.

[0016] Further based on the global scanning information obtained, the exhibition hall is divided into multiple exhibition hall partitions according to different interactive characteristics. The process of global division involves dividing the space of the exhibition hall into several areas, each with different functions or display themes. Each exhibition hall partition will be designed according to its specific interactive needs, so as to achieve more refined exhibition management. For example, the interaction method-interaction response effect is different. For example, some areas may be suitable for using touch screens or gesture recognition technology to interact with exhibits, while other areas can provide detailed information of exhibits through somatosensory interaction. Such as the interactive experience of Peking Opera costumes, the immersive interactive experience of makeup, and the singing, acting and fighting experience of Peking Opera characters in the display method. It is divided specifically according to the spatial structure of the exhibition hall and the characteristics of the exhibits to ensure that the exhibition content and interaction methods of each area can achieve the best effect.

[0017] After the exhibition hall is divided into zones, the specific interaction mode of each zone is determined. The interaction mode refers to the interaction mode and interaction response effect between users and exhibits. For example, the interaction mode is to touch the real object, and the touch interaction is performed on the dressing table, and the corresponding makeup effect is the interaction response effect. The interaction mode of each zone is different, such as visual interaction, which triggers the display content of the exhibits through the user's visual focus; the action interaction mode, the user interacts with the exhibits through body movements or gestures. For example, in the display area of ​​a Peking Opera exhibit, the user triggers the dynamic demonstration of the artwork through changes in facial expressions or postures to achieve an immersive display effect. The design of each interaction mode is based on the nature of the target exhibits and the theme requirements of the exhibition to ensure the interactivity and attractiveness of the exhibition.

[0018] By scientifically dividing the exhibition hall into zones based on the full-area scanning information and interactive characteristics of the target exhibition hall, and determining the corresponding interaction mode for each zone, it provides strong technical support for subsequent intelligent exhibition management.

[0019] S2: Construct a logic matrix for the interaction mode, wherein the logic matrix has interaction trigger elements as matrix rows and interaction response methods as matrix arrays, and the interaction trigger types of the interaction mode include physical trigger type and perception trigger type.

[0020] Specifically, for each interaction mode, a logical matrix is ​​constructed. The logical matrix is ​​a multidimensional data structure used to effectively manage and process the interactive information between users and exhibits. Specifically, the logical matrix is ​​a data set in the form of a matrix, where the rows of the matrix represent the interaction trigger elements and the columns of the matrix represent the interaction response methods. The purpose of this matrix is ​​to provide a controllable and flexible response mechanism for each interaction mode so that the system can accurately respond to the display content according to the user's behavior or input.

[0021] Among them, the interactive triggering elements refer to signals or events caused by changes in user behavior, which can trigger interactive reactions of exhibits. Interactive triggering elements usually include two types: physical triggering and perceptual triggering. Physical triggering refers to signals generated by users' direct contact or operation with physical objects in exhibits or venues, such as touch operations on touch screens. In more scene-based ways, by touching objects on the dressing table, corresponding makeup experiences can be performed. Perceptual triggering refers to user behavior signals captured by environmental perception technology (such as cameras, sensors, etc.), including user posture, facial expressions, position changes, etc. These triggering elements will change according to the user's actual behavior or status, and serve as the starting point for interaction.

[0022] For example, the interaction is triggered by body movements, and different body postures are the interaction triggering elements.

[0023] The interactive response method refers to how to respond and adjust the display content of the exhibits when the interactive triggering elements change. The design of the interactive response method is formulated according to the different types of user behaviors and the display requirements of the exhibits. For example, if a user touches an exhibit (physical trigger), the response method may be to display detailed information of the exhibit, switch the perspective of the exhibit, or play related audio commentary; and if the user's facial expression changes (perceptual trigger), the response method may be to activate a dynamic effect in virtual reality, or to display the content of the artwork that matches the user's emotions. These response methods can not only respond to user behavior in real time, but also provide personalized and immersive exhibition experience according to different interaction modes.

[0024] Then, the interaction trigger elements and the interaction response methods are matched one by one. This enables accurate identification and reasonable responses when faced with complex user behaviors. For example, facial expressions show curiosity or surprise, and this change is captured through perception technology, and the relevant art work display effect is activated based on the interaction response method.

[0025] By constructing the logic array, the response mechanism required by various interaction modes can be efficiently processed, so that each interaction mode can be accurately matched with the user's behavior, thereby improving the intelligence level of the exhibition and the exhibition experience.

[0026] Furthermore, for the interaction mode, a logical array is constructed, and step S2 of the present application includes:

[0027] Determine the interaction triggering elements of the first interaction mode based on the mutual sensing target, wherein the interaction triggering elements include the full range of interaction; for the interaction triggering elements, traverse the mutual sensing database to determine the interaction response mode, wherein there is a one-to-one correspondence between the interaction triggering elements and the interaction response mode, and the mutual sensing database is a built-in interaction information library of the target exhibition hall; based on the interaction triggering elements and the interaction response mode, construct a first logic array of the first interaction mode.

[0028] The mutual sensing target refers to user behaviors, physical conditions, etc. that can directly or indirectly trigger interactive reactions through sensing technology during the interaction process. In the first interactive mode, the interactive triggering elements include the full range of interactions, that is, all interactive characteristics of the first interactive mode, such as all possible user behaviors or changes in the state of exhibits, such as various user gestures, facial expression changes, etc. Therefore, the full range of interactions ensures that the system can respond to various types of user inputs and perform flexible interactive responses based on these inputs.

[0029] In an embodiment of the present application, the mutual induction database is an information library built into the target exhibition hall, which contains various trigger elements and response methods in the exhibition hall. The database stores detailed information about various trigger elements, including perception data of various interactive elements (such as motion recognition, position change, sound input, etc.) and the exhibition response method corresponding to each trigger element (such as displaying specific images, playing explanations, switching exhibits, etc.). Traverse the mutual induction database to find the interactive response method associated with each interactive trigger element. In this way, the system can ensure that the content of the exhibits matches the user's behavior or interaction mode, thereby providing a personalized and accurate interactive experience.

[0030] Then, based on the determined interaction triggering elements and interaction response methods, a first logic array of the first interaction mode is constructed. Each item in the first logic array represents the relationship between a specific triggering element and a response method. For example, assuming that a certain interaction triggering element is a user raising his hand, the corresponding interaction response method may be to display detailed information of the exhibit. By constructing a logic array, the system can achieve automatic matching between the triggering elements and the response methods, ensuring that when the user triggers a specific behavior, the exhibit can respond in a predetermined response method.

[0031] Similarly, for each interaction mode, the corresponding logic construction method is consistent, but the specific construction content is different.

[0032] The construction of the logical matrix enables the system to flexibly and efficiently manage all possible interaction triggering elements and their responses, ensuring that each interactive link in the exhibition can respond to user behavior accurately and promptly.

[0033] Further, after constructing the first logic matrix of the first interaction mode, step S2 of the present application includes:

[0034] Determine mutual inductance fault tolerance, wherein the mutual inductance fault tolerance is an allowable deviation of each trigger element captured; and compensate the first logic array based on the mutual inductance fault tolerance.

[0035] In the embodiment of the present application, the mutual inductance fault tolerance refers to the deviation range allowed for the signal captured by each triggering element during the interaction process. Specifically, since the user's behavior or environmental conditions may have certain fluctuations, for example, the user's actions may not completely conform to the expected trajectory, or the sensor's response to environmental changes may have certain errors, the setting of the mutual inductance fault tolerance ensures that the system can still correctly identify and respond to the user's behavior within these fluctuations. The setting of the mutual inductance fault tolerance is adjusted according to the accuracy requirements of the system and the actual application scenarios, and is usually reasonably tolerated within a predetermined error range to ensure the smoothness and accuracy of the interaction.

[0036] Next, based on the determined mutual inductance fault tolerance, the first logic array is compensated. The purpose of the compensation process is to provide a certain fault tolerance range. Specifically, each interactive trigger element of the logic array can be fine-tuned according to the mutual inductance fault tolerance, so that even if there are some inaccurate trigger signals, the system can still recognize and respond appropriately. For example, if the user's gesture slightly deviates from the preset trajectory, the system can adjust the response through the compensation algorithm to ensure that the corresponding exhibit display is triggered, and the interaction will not fail due to slight errors.

[0037] For example, in an interactive element triggered by waving, a user triggers the display of details of an exhibit in a certain exhibition area by waving. However, the user's waving action does not completely follow the preset trajectory, or the accuracy limitation of the sensor causes some deviations in motion capture. In this case, by setting the mutual inductance tolerance, the deviation is allowed to not affect the interactive response within a reasonable range, and the system adjusts or compensates according to the deviation to ensure that the effect of the exhibit display is not affected.

[0038] Through the compensation mechanism, it can adapt to different user behaviors and environmental conditions and improve the accuracy and stability of interaction.

[0039] S3: Based on the logic array, supervise the training of a scene interaction module, wherein the scene interaction module includes N scene interaction units corresponding to the exhibition hall partitions.

[0040] Specifically, the scene interaction module is the interaction management core of the entire virtual reality art exhibition system, which controls the display content and interaction mode of the exhibits according to the interaction mode between users and exhibits. By accurately managing the interaction needs of different exhibition hall partitions, an immersive and personalized experience is provided to the audience.

[0041] Based on the interactive characteristics, the exhibition hall is divided into multiple areas, such as the Peking Opera Costumes Exhibition Area, Makeup Exhibition Area, Role Demonstration Exhibition Area, etc. Each area has different interactive characteristics and exhibit display methods. Each scene interaction unit is responsible for managing the interactive behavior within its partition and executing the predetermined response according to the interactive mode of the area.

[0042] Next, each scene interaction unit is trained through the interactive trigger elements and interactive response methods provided by the logic array. Specifically, through pre-defined data sets and interaction modes, the system continuously optimizes the response capabilities of each scene interaction unit. During the supervised training process, according to the user's actual interactive behavior in the exhibition hall (such as touching exhibits, waving, position changes, etc.), combined with the preset trigger elements and response methods in the logic array, the behavior of each scene interaction unit is adjusted and optimized. For example, when a user touches an exhibit in a specific exhibition area, the scene interaction unit will display detailed information related to the exhibit or start a dynamic demonstration function according to the response rules set in the logic array.

[0043] Through sample supervised training, with preset response accuracy as the training convergence condition, it can ensure that each scene interaction unit can make accurate responses when facing different user interactions. Ultimately, the scene interaction units in each interaction mode can achieve intelligent personalized responses through training, so that the entire virtual reality art exhibition system not only has efficient interaction capabilities, but also can provide diversified exhibition management according to the different exhibition hall divisions and user behaviors.

[0044] S4: The scene interaction units in the scene interaction module are configured in the exhibition hall partitions, and user interaction information is captured and exhibition responses are made based on the scene interaction units according to the partition interaction mode by sensing the user's exhibition viewing position, wherein each scene interaction unit independently manages the exhibition hall partitions.

[0045] Specifically, the N scene interaction units in the scene interaction module, where N is the number of interaction modes, are embedded in each partition of the exhibition hall to ensure that each partition can independently manage and respond to user interaction behaviors in the area. Each exhibition hall partition can be regarded as an independent interaction area with a specific display theme and interaction mode. Through this configuration, the system can perform personalized management according to the characteristics of each partition, ensuring that every link in the exhibition process can accurately respond to user needs.

[0046] Next, the system implements interaction by sensing the user's location at the exhibition. For example, through sensor networks, camera monitoring and other equipment. These technologies can monitor the user's specific location in the exhibition hall in real time, and use positioning data to determine the exhibition area where the user is located and the distance between the user and the exhibits.

[0047] Based on the user's viewing position, user interaction information is captured according to the interaction mode of the exhibition hall partition. That is, when the user enters a specific exhibition hall partition, the scene interaction unit will capture the user's interactive behavior (such as position change, gesture, eye focus, etc.) and convert this information into interactive data that the system can process. For example, if the user stops in front of an exhibit and looks at the exhibit, the system may capture this behavior through visual tracking technology, and then trigger the dynamic display of the exhibit or play related commentary audio.

[0048] In summary, efficient interactive management can be achieved, and accurate and personalized display responses can be provided according to the characteristics of each exhibition hall partition and user behavior. This not only enhances the immersion and interactivity of the exhibition, but also greatly improves the audience's exhibition experience, making the entire exhibition hall an intelligent and responsive interactive space.

[0049] Furthermore, the scene interaction unit in the scene interaction module is configured in the exhibition hall partition. Step S4 of the present application includes:

[0050] Determine the first control center of the first exhibition hall partition, and delegate the first scene interaction unit to the first control center; obtain the front-end device of the first exhibition hall partition, and establish a communication connection between the front-end device and the first scene interaction unit.

[0051] In the embodiment of the present application, the first exhibition hall partition is any exhibition hall partition in the target exhibition hall, and the first control center is the core node in the exhibition hall partition management, responsible for coordinating and managing all interactive operations and devices in the partition. It usually includes computing resources, communication interfaces, sensor access points, etc., and can process the interactive data from each scene interaction unit in real time, and integrate these data with information such as exhibit display and user behavior feedback.

[0052] Next, the first scene interaction unit is decentralized to the first control center. The scene interaction unit is a specific execution unit within the exhibition hall partition, responsible for triggering the corresponding display response according to the interaction mode and user behavior within the partition. The process of decentralization to the control center means that the management authority and execution operations of all interaction units within the partition are centralized to the corresponding control center, thereby improving management efficiency and response speed.

[0053] Furthermore, the front-end device refers to the hardware equipment used to display exhibits or perceive user behavior in the exhibition hall partition, including but not limited to displays, touch screens, sensors, cameras, audio equipment, etc. These devices are responsible for the display of exhibits and the perception of user behavior, and are the physical infrastructure of the interactive management system. A communication connection is established between the front-end device and the first scene interaction unit for real-time transmission of interactive signals and user behavior information. Exemplarily, a standard communication protocol is used to ensure the stability and low latency of data transmission.

[0054] The front-end device of the exhibition hall partition can transmit the user's interactive behavior (such as touching, waving, standing, etc.) to the scene interaction unit. The scene interaction unit performs further response operations based on the received information, such as switching exhibit content, triggering animation effects, or playing audio explanations.

[0055] Similarly, each scene interaction unit is decentralized and configured in the control center of the corresponding exhibition hall partition to carry out targeted interaction management.

[0056] Further, such as Figure 2 As shown, according to the partition interaction mode, user interaction information is captured and the exhibition response is based on the scene interaction unit. Step S4 of the present application includes:

[0057] A first interaction mode is determined, wherein the first interaction mode takes the user's facial and body gestures as the interaction target and takes the deconstruction demonstration of the exhibit as the response; by sensing the user's exhibition viewing position, the target exhibit is deconstructed and displayed in all artistic dimensions to determine the exhibit deconstruction sequence; the first user interaction information is captured, and combined with the first scene interaction unit, the first interaction response information is determined based on the built-in first logic array; based on the exhibit deconstruction sequence, the first interaction response information is matched to perform exhibition management of the target exhibit.

[0058] Among them, the first interaction mode refers to the interaction target based on the user's facial and body posture in the exhibition environment, which triggers the deconstruction demonstration of the exhibit as a response. Specifically, the user's facial expressions and body movements are used as triggering elements for interaction. Through facial recognition technology and motion capture technology, the user's emotional changes, body posture and movement direction can be accurately identified. For example, when a user approaches an exhibit, the system can detect changes in his facial expressions (such as smiling, frowning) or body movements (such as pointing at exhibits, reaching out to touch, etc.), and then trigger the corresponding exhibit display content. This interaction mode combines the perception of facial and body postures, allowing users to interact with exhibits through natural movements.

[0059] By sensing the user's viewing position, the target exhibits that the user is viewing are determined, and further based on interactive recognition, the full artistic dimension of the target exhibits is deconstructed and displayed. That is, it is recognized whether the user is standing in front of a certain exhibit, and the full artistic dimension of the exhibit is deconstructed and displayed according to the user's position and interaction mode. The so-called full artistic dimension deconstruction display means that the system not only displays the appearance of the exhibits, but also displays multi-dimensional information such as the historical background, production process, and artistic style of the exhibits.

[0060] Among them, the exhibit deconstruction sequence refers to the display of various deconstruction dimensions and related information of the exhibit in a certain order. For example, the first step may show the appearance of the exhibit, the second step shows the creation background of the exhibit, and the third step shows the artistic techniques of the exhibit. The user's interactive information (such as touch, gaze, gesture, etc.) is captured and converted into data through sensors, cameras or motion capture devices. These interactive information can reflect the user's interest in the exhibits, focus points or interactive intentions. For example, if the user shows special attention to the details of a certain exhibit (such as staring at a certain detail for a long time), the system will adjust the display content of the exhibit according to this information, such as enlarging the display of that part or playing the commentary content related to that part.

[0061] The user interaction information is transmitted back to the first scene interaction unit, and the first interaction response information is determined based on the built-in first logic array. The logic array is a mathematical model established based on the relationship between interaction triggering elements (such as different facial expressions, body movements, and eye focus of users) and interaction response methods (such as displaying a specific artistic dimension, playing audio explanations, etc.). Through the logic array, the captured user interaction information is converted into response instructions that can be executed by the system. For example, when a user looks at an exhibit, the system can trigger a detailed introduction to the exhibit or play a related video explanation.

[0062] Finally, based on the exhibit deconstruction sequence, the system matches the first interactive response information and performs exhibition management on the target exhibit, that is, automatically selects the most appropriate display content. For example, if the user shows a strong interest in the creation background of the exhibit, the relevant historical background or production process is automatically displayed according to the corresponding part in the deconstruction sequence. This exhibition management method makes the exhibit display content more personalized and can automatically adjust the display content according to the interests and behaviors of each audience, thereby enhancing the user's immersion and experience.

[0063] For example, for the costume change exhibition of Peking Opera, the connotation of Peking Opera art is deconstructed and reconstructed, so that the experiencer can have a deeper understanding of the costumes of the characters. In the physical space, the experiencer can have a virtual fitting experience and become a Peking Opera actor to have a deeper understanding of the artistic charm of Peking Opera. Specifically, the experiencer's face and movements are recognized and real-time feedback is given on the screen to complete the facial and overall dressing process of the character. It can effectively break through the agility of small parts such as tassels and beads of Peking Opera costumes, achieve the soft effect of water sleeves, and complete real-time interaction without high equipment requirements.

[0064] In summary, through the above process, the display content of the exhibits can be managed intelligently based on the relationship between the user's interactive behavior and the exhibit deconstruction sequence, thereby providing the audience with a more personalized and interactive art exhibition experience.

[0065] Further, according to the partition interaction mode, user interaction information is captured and an exhibition response is made based on the scene interaction unit. Step S4 of the present application includes:

[0066] Determine a second interaction mode, wherein the second interaction mode takes the user's facial and body postures as the interaction target and takes the synchronous restoration of the exhibits as the response; by sensing the user's exhibition viewing position, capture the second user interaction information and track it, and in combination with the second scene interaction unit, determine the second interaction response information based on the built-in second logic array; based on the second interaction response information, perform exhibition management on the target exhibits.

[0067] Specifically, the second interaction mode uses the user's facial and body gestures as the mutual sensing target, and responds with the synchronous restoration of the exhibits. Specifically, the implementation of the second interaction mode depends on the user's facial expressions and body movements, which are used as signals to trigger the synchronous restoration of the exhibits. Through facial recognition technology and motion capture technology, the system can accurately perceive the user's emotional changes, movement posture or body position. For example, if the user makes an expression of surprise or curiosity when facing a work of art, or makes a pointing action with a gesture, the system will recognize this interactive signal and trigger the synchronous restoration response of the exhibits.

[0068] Similarly, by sensing the user's exhibition location, the exhibits are determined, and the second user interaction information is captured and tracked. The second user interaction information is the body movements and facial expressions made by the user.

[0069] In combination with the second scene interaction unit, based on the built-in second logic array, the second user interaction information is matched by an array, and the second interaction response information is further determined, that is, the interactive response made to the second user interaction information. The second scene interaction unit is applicable to the second interaction mode and is the unit responsible for executing the exhibit display management in this interaction mode. It generates a specific exhibit response according to the user's interactive behavior and position feedback.

[0070] After the second interactive response information is determined, the state or content of the exhibit display is adjusted according to the user's interactive information (such as facial expressions, body movements, position, etc.) and the synchronous restoration content of the exhibit.

[0071] For example, taking the Peking Opera "Four Skills and Five Methods" as an experience, the experiencer can interact with the interactive screen in real time. In the process of personal experience, by imitating the singing movements of Peking Opera characters, the experiencer can feel the personality of the Peking Opera characters and deepen their understanding of the character image. The experiencer's movements are recorded through motion capture, and the obtained movement data is restored and rendered on the corresponding virtual Peking Opera character, synchronizing the movements made by the real experiencer, capturing the experiencer's movements in real time, identifying and scoring them, and enhancing the interactive experience.

[0072] To sum up, through the second interactive mode, combined with the user's facial expressions, body movements and position perception, it is possible to accurately identify the user's interactive needs, and trigger the synchronous restoration display of the exhibits based on these needs, thereby realizing personalized exhibition management, which not only enhances the interactivity and immersion of the exhibition, but also provides a richer artistic experience.

[0073] Further, according to the partition interaction mode, user interaction information is captured and an exhibition response is made based on the scene interaction unit. Step S4 of the present application includes:

[0074] Determine a third interaction mode, wherein the third interaction mode takes the user's field of view characteristics as the mutual sensing target and takes the fusion of virtual and real scenes as the response; determine the physical exhibits by sensing the user's viewing position, wherein the physical exhibits are the target exhibits; capture the third field of view interaction information of the target user through the MR wearable device; combine the third field of view interaction information with the physical exhibits, determine the third interaction response information based on the third scene interaction unit and the built-in third logic array; based on the third interaction response information, construct a virtual and real combination scene to perform exhibition management of the target exhibits.

[0075] Specifically, the third interaction mode uses the user's field of view characteristics as the mutual sensing target and responds to the fusion of virtual and real scenes. The user's field of view characteristics refer to the scene content or the range of spatial perception that the user can see during the exhibition, which is mainly expressed through elements such as vision, line of sight direction and focus. The fusion of virtual and real scenes refers to the combination of virtual information with the actual exhibit content through technical means to enhance the immersion and interactivity of the exhibition. For example, the system integrates virtual information, such as historical background, into real exhibits, such as Peking Opera characters, by sensing the user's line of sight direction and focus, thereby creating an exhibition effect that is both realistic and creative. Users can trigger virtual information by moving their line of sight or adjusting their viewing angle to achieve a display effect that combines the real and the virtual.

[0076] The physical exhibits, i.e., the target exhibits, are determined by sensing the user's viewing position. Then, the third-field interaction information of the target user is captured through MR (mixed reality) wearable devices, such as head-mounted displays (HMDs) and augmented reality glasses. The third-field interaction information refers to the interaction data generated by the user's head movement, line of sight shift, line of sight focus, and perspective change when wearing the MR device. These data reflect the user's focus and interaction intention on the exhibits or exhibition space, and the system judges the user's interests and needs based on this information.

[0077] In combination with the third field of view interaction information and the physical exhibits, based on the third scene interaction unit, the third scene interaction unit refers to a specific unit responsible for executing the exhibition display and response under the third interaction mode. The logical array refers to the mapping relationship between the user's field of view characteristics and the exhibit response method through a mathematical model or a rule table. Through the built-in third logical array, the corresponding exhibition response information is determined according to the third field of view interaction information captured from the MR device. For example, when the user directs his sight at an exhibit, the virtual display content of the exhibit, such as dynamic effects, historical reproduction, etc., is automatically triggered according to the setting of the logical array.

[0078] Finally, based on the third interactive response information, the system constructs a virtual-real scene and performs exhibition management of the target exhibits. The construction of a virtual-real scene refers to the fusion of virtual display content with physical exhibits in the real world through virtual reality or augmented reality. It can enhance the multidimensionality and interactivity of the exhibit display, making the exhibition not only the viewing of static exhibits, but also a dynamic and operable art experience.

[0079] For example, MR glasses are used to bring Peking Opera helmets, costumes, and props into the virtual world based on mixed reality and augmented reality, providing a new, real, and interactive visual experience. The audience can stare at the labels or physical exhibits in the glasses by turning their eyes, and the corresponding explanations will be played. The use of augmented reality and mixed reality technologies can achieve the mobile, dynamic, and visual presentation of traditional Peking Opera content without being affected by venues and light, breaking the constraints of time and space.

[0080] In summary, through the third interactive mode, combined with the user's visual characteristics and the visual interaction information of the MR device, it is possible to achieve the integration of virtual and real scenes and provide a richer and more interactive exhibition experience. Through real-time perception of the user's line of sight, the display content of virtual information and physical exhibits is adjusted, and ultimately the refined management of the exhibition is achieved, which enhances the interactivity, immersion and personalization of the exhibition.

[0081] Further, according to the partition interaction mode, user interaction information is captured and an exhibition response is made based on the scene interaction unit. Step S4 of the present application includes:

[0082] Determine a fourth interaction mode, wherein the fourth interaction mode uses physical touch as the mutual sensing target and imaging display as the response; performs mirror imaging of the target user as the initial interaction interface; displays an interaction step video to guide the user to perform physical touch to determine fourth user interaction information; in combination with the fourth user interaction information, based on a fourth scene interaction unit and according to a built-in fourth logic array, determine fourth interaction response information; based on the fourth interaction response information, respond and display the initial interaction interface.

[0083] In an embodiment of the present application, the fourth interaction mode is characterized by using physical touch as the mutual sensing target and imaging display as the response. Physical touch is used as an interaction method to trigger changes in the exhibit display content through physical contact between the user and the exhibit. This touch can be direct physical contact, such as touching the surface of the exhibit with a finger, or simulated touch through a touch device (such as a touch screen, touch sensor, etc.). The response method associated with physical touch is imaging display, that is, the touch behavior is converted into visual feedback through a display device.

[0084] Next, the system performs mirror imaging of the target user and displays the image in real time. The purpose of mirror imaging is to allow users to see their interaction with the exhibits, thereby forming a kind of visual self-feedback. Then, the system displays an interaction step video to guide users to touch the physical objects. The interaction step video is a short video or animation that shows the steps of how to effectively interact with the exhibits, guiding users to complete the interaction process with the exhibits. For example, a demonstration video is given that shows how to trigger related display effects by touching an object or a specific part of an exhibit. Through this guide video, users can more intuitively understand how to interact with the exhibits, thereby reducing the difficulty of user operation and improving the smoothness of the interactive experience.

[0085] Next, the fourth user interaction information is captured by physical touch. The fourth user interaction information refers to the specific interaction data captured by the system when the user touches the exhibit. This information may include parameters such as the specific location of the user's touch, the strength of the touch, and the duration of the touch. The system uses devices such as touch sensors or pressure sensors to obtain the user's touch data in real time and judge the user's interaction intention based on this data.

[0086] The fourth scene interaction unit is a unit responsible for executing the response operation in the fourth interaction mode, and its function is to generate a corresponding exhibit response based on the user's interaction information. In combination with the fourth user interaction information, the system determines the fourth interaction response information based on the fourth logic array built into the fourth scene interaction unit. The fourth logic array is the array mapping relationship between the interaction triggering elements and the interaction response methods in the fourth interaction mode. Specifically, the system associates the user touch information with the display content of the exhibits through the fourth logic array to determine the corresponding exhibition response.

[0087] Finally, based on the fourth interactive response information, the system responds to and displays the initial interactive interface. The initial interactive interface refers to the interface displayed to the user through mirror imaging and guided video, while the response display refers to updating the display content of the interface in real time according to the user's touch behavior or interactive information. When the user touches the exhibit, the system updates the display content according to the fourth interactive response information, which can provide the user with a more vivid and dynamic display effect, and increase the fun and educational nature of the interaction.

[0088] For example, the exhibition area uses the somatosensory interaction achieved by pulling out drawers to show the audience the steps of Peking Opera actors putting on makeup, and the setting of the makeup table and the real objects in the drawers enhances the fun and interactivity of the experience. Using somatosensory interaction technology, when the audience pulls out different drawers, it will trigger the switch of each part of the video. The drawers are reserved for the real objects used in the makeup steps, and the audience can choose according to their interests.

[0089] In summary, through the fourth interactive mode, the system uses physical touch as the main means of interaction, and guides users to interact effectively through mirror imaging and interactive step videos. By capturing the user's touch behavior in real time and combining it with a logical array for responsive display, the system can provide users with a personalized and immersive exhibition experience.

[0090] The intelligent interactive management method for art exhibitions combined with virtual reality provided by this application has the following technical effects:

[0091] 1. Through the intelligent zoning management of the exhibition hall, targeted interactive experience can be provided for each area, so that users can obtain personalized and immersive exhibition effects in different areas, and improve the interactivity and operability of the exhibition. By establishing a logical array, the system can accurately capture the user's interactive intentions and provide appropriate responses based on different trigger behaviors to ensure the interactivity and timeliness of the exhibition. The precise trigger and response mechanism enables the exhibition system to provide intelligent feedback based on user behavior, improving the interactivity and personalization of the user experience.

[0092] 2. Independent management of user interactions within each exhibition hall partition effectively reduces system interference and improves the accuracy of user interactions in each area, achieving efficient exhibition management and effective management under multiple interactive modes. Including the seamless combination of virtual information and physical exhibits, which enhances the user's sense of immersion and participation, and enhances the expressiveness and interactivity of the exhibition. The combination of physical touch and imaging display enhances the physical connection between users and exhibits, improves the operability and interactivity of the exhibition, and enhances the user's sense of participation and interactive experience. The control center of each exhibition hall partition can independently manage and respond to exhibition needs, optimizing the overall operating efficiency of the system.

[0093] In summary, intelligent management and interactive control of art exhibitions have been achieved, and personalized, immersive exhibition displays can be provided in real time according to user behavior, effectively improving the interactivity, sense of participation and viewing experience of the exhibition. It can also be dynamically adjusted according to different exhibits and user needs, thereby enhancing the attractiveness of the exhibition and user satisfaction.

[0094] Through the above detailed description of the intelligent interactive management method for art exhibitions combined with virtual reality in this specification, those skilled in the art can clearly understand the intelligent interactive management method for art exhibitions combined with virtual reality in this embodiment. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method part.

[0095] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An intelligent interactive management method for art exhibitions combined with virtual reality, characterized in that: The method comprises: Obtain the full-area scanning information of the target exhibition hall, divide the entire area based on the interactive characteristics, and determine the exhibition hall partitions, where each exhibition hall partition corresponds to an interactive mode; For the interaction mode, a logical number matrix is ​​constructed, wherein the logical number matrix has interaction trigger elements as number matrix rows and interaction response modes as number matrix arrays, and the interaction trigger types of the interaction mode include physical trigger type and perception trigger type; Based on the logic array, supervise the training of a scene interaction module, wherein the scene interaction module includes N scene interaction units corresponding to the exhibition hall partitions; The scene interaction units in the scene interaction module are configured in the exhibition hall partitions, and the user's exhibition viewing position is sensed and the user interaction information is captured and the exhibition response is based on the scene interaction units according to the partition interaction mode, wherein each scene interaction unit independently manages the exhibition hall partitions.

2. The method for intelligent interactive management of art exhibitions combined with virtual reality according to claim 1, characterized in that: According to the partition interaction mode, user interaction information is captured and an exhibition response based on the scene interaction unit is performed, including: Determining a first interaction mode, wherein the first interaction mode takes the gesture of the user's face and body as the interaction target and takes the deconstruction demonstration of the exhibit as the response; By sensing the user's viewing position, the target exhibits are deconstructed and displayed in all artistic dimensions, and the sequence of exhibit deconstruction is determined; Capturing first user interaction information, combining with the first scene interaction unit, and determining first interaction response information based on a built-in first logic array; Based on the exhibit deconstruction sequence, the first interactive response information is matched to perform exhibition management of the target exhibit.

3. The method for intelligent interactive management of art exhibitions combined with virtual reality according to claim 1, characterized in that: According to the partition interaction mode, user interaction information is captured and an exhibition response based on the scene interaction unit is performed, including: Determining a second interaction mode, wherein the second interaction mode uses the gestures of the user's face and body as the interaction target and uses the synchronous restoration of the exhibit as the response; By sensing the user's exhibition location, capturing and tracking the second user interaction information, combining with the second scene interaction unit, and based on the built-in second logic array, determining the second interaction response information; Based on the second interactive response information, exhibition management is performed on the target exhibit.

4. The method for intelligent interactive management of art exhibitions combined with virtual reality according to claim 1, characterized in that: According to the partition interaction mode, user interaction information is captured and an exhibition response based on the scene interaction unit is performed, including: Determine a third interaction mode, wherein the third interaction mode takes the user's visual field characteristics as the mutual sensing target and takes the virtual and real scene fusion as the response; By sensing the user's viewing position, determining the physical exhibits, wherein the physical exhibits are target exhibits; Capture the target user's third-field interactive information through MR wearable devices; Combining the third visual interaction information with the physical exhibit, based on the third scene interaction unit and according to the built-in third logic array, determining third interaction response information; Based on the third interactive response information, a virtual-real scene is constructed to perform exhibition management of the target exhibit.

5. The method for intelligent interactive management of art exhibitions combined with virtual reality according to claim 1, characterized in that: According to the partition interaction mode, user interaction information is captured and an exhibition response based on the scene interaction unit is performed, including: Determining a fourth interaction mode, wherein the fourth interaction mode uses physical object touch as a mutual sensing target and imaging display as a response; Mirror the target user as the initial interaction interface; Display the interactive step video to guide the user to physically touch the object and determine the fourth user interaction information; In combination with the fourth user interaction information, based on the fourth scene interaction unit, and according to the built-in fourth logic array, fourth interaction response information is determined; Based on the fourth interaction response information, the initial interaction interface is displayed in response.

6. The method for intelligent interactive management of art exhibitions combined with virtual reality according to claim 1, characterized in that: According to the interaction mode, a logical array is constructed, including: Determining an interaction triggering element of a first interaction mode based on an interaction target, wherein the interaction triggering element includes a full range of interaction; For the interaction triggering element, traverse the mutual induction database to determine the interaction response mode, wherein there is a one-to-one correspondence between the interaction triggering element and the interaction response mode, and the mutual induction database is a built-in interaction information library of the target exhibition hall; Based on the interaction triggering elements and the interaction response mode, a first logic array of a first interaction mode is constructed.

7. The method for intelligent interactive management of art exhibitions combined with virtual reality according to claim 6, characterized in that: After constructing the first logical matrix of the first interaction mode, it includes: Determining mutual inductance fault tolerance, wherein the mutual inductance fault tolerance is an allowable deviation degree captured by each triggering element; Based on the mutual inductance fault tolerance, the first logic array is compensated.

8. The method for intelligent interactive management of art exhibitions combined with virtual reality according to claim 1, characterized in that: The scene interaction unit in the scene interaction module is configured in the exhibition hall partition, including: Determine a first control center of a first exhibition hall partition, and delegate the first scene interaction unit to the first control center; Acquire the front-end device of the first exhibition hall partition, and establish a communication connection between the front-end device and the first scene interaction unit.

Images